Jul 31 12:08:15 devstack cinder-volume[77912]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 31 12:08:15 devstack cinder-volume[77912]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 31 12:08:15 devstack cinder-volume[77912]: we strongly recommend against using it for new projects. Jul 31 12:08:15 devstack cinder-volume[77912]: If you are already using Eventlet, we recommend migrating to a different Jul 31 12:08:15 devstack cinder-volume[77912]: framework. For more detail see Jul 31 12:08:15 devstack cinder-volume[77912]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 31 12:08:15 devstack cinder-volume[77912]: import eventlet # noqa Jul 31 12:08:18 devstack cinder-volume[77912]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=77912) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 31 12:08:18 devstack cinder-volume[77912]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=77912) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 31 12:08:18 devstack cinder-volume[77912]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=77912) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 31 12:08:19 devstack cinder-volume[77912]: INFO dbcounter [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] Registered counter for database cinder Jul 31 12:08:19 devstack cinder-volume[77912]: DEBUG oslo_db.sqlalchemy.engines [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=77912) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 31 12:08:19 devstack cinder-volume[77912]: DEBUG dbcounter [-] [77912] Writer thread running {{(pid=77912) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 31 12:08:19 devstack cinder-volume[77912]: INFO cinder.rpc [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 31 12:08:19 devstack cinder-volume[77912]: INFO cinder.rpc [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 31 12:08:19 devstack cinder-volume[77912]: DEBUG oslo_db.sqlalchemy.engines [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=77912) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 31 12:08:19 devstack cinder-volume[77912]: INFO cinder.volume.manager [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] Determined volume DB was empty at startup. Jul 31 12:08:19 devstack cinder-volume[77912]: DEBUG cinder.volume.manager [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=77912) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 31 12:08:19 devstack cinder-volume[77912]: INFO cinder.volume.manager [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] Service not found for updating active_backend_id, assuming default for driver init. Jul 31 12:08:19 devstack cinder-volume[77912]: WARNING stevedore.named [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 31 12:08:19 devstack cinder-volume[77912]: WARNING castellan.key_manager [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 31 12:08:19 devstack cinder-volume[77912]: WARNING cinder.keymgr.conf_key_mgr [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 31 12:08:19 devstack cinder-volume[77912]: DEBUG cinder.volume.drivers.lvm [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=77912) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}} Jul 31 12:08:19 devstack cinder-volume[77912]: DEBUG oslo_concurrency.processutils [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=77912) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_concurrency.processutils [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] CMD "cinder-rtstool verify" returned: 0 in 0.434s {{(pid=77912) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_db.sqlalchemy.engines [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=77912) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 31 12:08:20 devstack cinder-volume[77912]: INFO cinder.rpc [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Jul 31 12:08:20 devstack cinder-volume[77912]: INFO cinder.rpc [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Jul 31 12:08:20 devstack cinder-volume[77912]: WARNING stevedore.named [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 31 12:08:20 devstack cinder-volume[77912]: WARNING castellan.key_manager [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 31 12:08:20 devstack cinder-volume[77912]: INFO cinder.volume.manager [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_db.sqlalchemy.engines [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=77912) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 31 12:08:20 devstack cinder-volume[77912]: INFO oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] Starting 1 workers Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] Started child 78067 {{(pid=77912) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] Full set of CONF: {{(pid=77912) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] ******************************************************************************** {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] Configuration options gathered from: {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] ================================================================================ {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] allow_availability_zone_fallback = False {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] allow_compression_on_image_upload = False {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] allowed_direct_url_schemes = [] {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] api_rate_limit = True {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] auth_strategy = keystone {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] az_cache_duration = 3600 {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] backend_availability_zone = None {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] backend_host = None {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] backend_name = None {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] backend_stats_polling_interval = 60 {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] backup_api_class = cinder.backup.api.API {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] backup_name_template = backup-%s {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:08:20 devstack cinder-volume[78067]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] backup_use_same_host = False {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] backup_use_temp_snapshot = False {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] chap_password = **** {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] chap_username = {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] cinder_internal_tenant_project_id = b7fc95d8943f43808027333fd407c6ae {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] cinder_internal_tenant_user_id = 8dcfb6efe704434190b65e548d703884 {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] cloned_volume_same_az = True {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] cluster = None {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] compression_format = gzip {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] compute_api_class = cinder.compute.nova.API {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] config_dir = [] {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] config_source = [] {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] control_exchange = openstack {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] debug = True {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] default_availability_zone = None {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] default_group_type = None {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] default_volume_type = lvmdriver-1 {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] disk_geometry = None {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] driver_client_cert = None {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] driver_client_cert_key = None {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] driver_data_namespace = None {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] driver_ssl_cert_path = None {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] driver_ssl_cert_verify = False {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] driver_use_ssl = False {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] enable_force_upload = False {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] enable_new_services = True {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] enable_unsupported_driver = False {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] enabled_backends = ['lvmdriver-1'] {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] enforce_multipath_for_image_xfer = False {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] filter_function = None {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] glance_api_insecure = False {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] glance_api_servers = ['http://192.168.122.21/image'] {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] glance_api_ssl_compression = False {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] glance_ca_certificates_file = None {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] glance_catalog_info = image:glance:publicURL {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] glance_certfile = None {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] glance_keyfile = None {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] glance_num_retries = 3 {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] glance_request_timeout = None {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] goodness_function = None {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] graceful_shutdown_timeout = 5 {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] group_api_class = cinder.group.api.API {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] host = devstack {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] image_compress_on_upload = True {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] image_conversion_address_space_limit = 1 {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] image_conversion_cpu_limit = 60 {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] image_conversion_disable = False {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] image_upload_use_cinder_backend = False {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] image_upload_use_internal_tenant = False {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] image_volume_cache_enabled = False {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] image_volume_cache_max_count = 0 {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] image_volume_cache_max_size_gb = 0 {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] init_host_max_objects_retrieval = 0 {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] instance_format = [instance: %(uuid)s] {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] iscsi_target_flags = {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] iscsi_write_cache = on {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] iser_helper = tgtadm {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] iser_ip_address = 192.168.122.21 {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] iser_port = 3260 {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] log_color = False {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] log_config_append = None {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] log_dir = None {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] log_file = None {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] log_options = True {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] log_rotate_interval = 1 {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] log_rotate_interval_type = days {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] log_rotation_type = none {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] max_age = 0 {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] max_logfile_count = 30 {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] max_logfile_size_mb = 200 {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] max_over_subscription_ratio = 20.0 {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] message_reap_interval = 86400 {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] message_ttl = 2592000 {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] migration_create_volume_timeout_secs = 300 {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] monkey_patch = False {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] monkey_patch_modules = [] {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] my_ip = 192.168.122.21 {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] no_snapshot_gb_quota = False {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] num_iser_scan_tries = 3 {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] num_shell_tries = 3 {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] num_volume_device_scan_tries = 3 {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] nvmeof_conn_info_version = 1 {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] nvmet_ns_id = 10 {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] nvmet_port_id = 1 {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] osapi_max_limit = 1000 {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] osapi_volume_ext_list = [] {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] osapi_volume_listen = 0.0.0.0 {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] osapi_volume_listen_port = 8776 {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] osapi_volume_use_ssl = False {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] osapi_volume_workers = None {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] per_volume_size_limit = -1 {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] periodic_fuzzy_delay = 60 {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] periodic_interval = 60 {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] project_id_regex = [0-9a-f\-]+ {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:08:20 devstack cinder-volume[78067]: INFO cinder.volume.manager [None req-2357da8d-9f07-4d29-af44-2565ed936753 None None] Starting volume driver LVMVolumeDriver (3.0.0) Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] public_endpoint = None {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] publish_errors = False {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] quota_backup_gigabytes = 1000 {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] quota_backups = 10 {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] quota_gigabytes = 1000 {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] quota_groups = 10 {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] quota_snapshots = 10 {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] quota_volumes = 10 {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] rate_limit_burst = 0 {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] rate_limit_except_level = CRITICAL {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] rate_limit_interval = 0 {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] reinit_driver_count = 3 {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] replication_device = **** {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] report_discard_supported = False {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] report_interval = 120 {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] reservation_clean_interval = 86400 {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:08:20 devstack cinder-volume[78067]: DEBUG oslo_concurrency.processutils [None req-2357da8d-9f07-4d29-af44-2565ed936753 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=78067) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] reservation_expire = 86400 {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] reserved_image_namespaces = [] {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] reserved_percentage = 0 {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] rpc_response_timeout = 120 {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] run_external_periodic_tasks = True {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] scst_target_driver = iscsi {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] scst_target_iqn_name = None {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] service_down_time = 720 {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] shell_completion = None {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] snapshot_name_template = snapshot-%s {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] snapshot_same_host = True {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] split_loggers = False {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] state_path = /opt/stack/data/cinder {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] storage_availability_zone = nova {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] storage_protocol = iSCSI {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] syslog_log_facility = LOG_USER {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] target_helper = lioadm {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] target_ip_address = 192.168.122.21 {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] target_port = 3260 {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] target_protocol = iscsi {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] target_secondary_ip_addresses = [] {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] trace_flags = None {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] transfer_api_class = cinder.transfer.api.API {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] transport_url = **** {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] until_refresh = 0 {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] use_chap_auth = False {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] use_default_quota_class = True {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] use_journal = False {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] use_json = False {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] use_multipath_for_image_xfer = False {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] use_stderr = False {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] use_syslog = False {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] verify_glance_signatures = enabled {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] volume_api_class = cinder.volume.api.API {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] volume_backend_name = None {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] volume_clear = zero {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] volume_clear_ionice = None {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:08:20 devstack cinder-volume[78067]: DEBUG oslo_concurrency.processutils [None req-2357da8d-9f07-4d29-af44-2565ed936753 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.041s {{(pid=78067) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] volume_clear_size = 0 {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] volume_copy_bps_limit = 0 {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] volume_dd_blocksize = 1M {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] volume_name_template = volume-%s {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:08:20 devstack cinder-volume[78067]: DEBUG oslo_concurrency.processutils [None req-2357da8d-9f07-4d29-af44-2565ed936753 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=78067) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] volume_service_inithost_offload = False {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] volume_usage_audit_period = month {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] zoning_mode = None {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] oslo_concurrency.disable_process_locking = False {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] keystone_authtoken.auth_section = None {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] keystone_authtoken.auth_type = password {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] keystone_authtoken.auth_version = None {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] keystone_authtoken.cache = None {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] keystone_authtoken.certfile = None {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] keystone_authtoken.delay_auth_decision = False {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] keystone_authtoken.http_connect_timeout = None {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] keystone_authtoken.include_service_catalog = True {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] keystone_authtoken.insecure = False {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] keystone_authtoken.interface = public {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] keystone_authtoken.keyfile = None {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[78067]: DEBUG oslo_concurrency.processutils [None req-2357da8d-9f07-4d29-af44-2565ed936753 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.024s {{(pid=78067) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:08:20 devstack cinder-volume[78067]: DEBUG oslo_concurrency.processutils [None req-2357da8d-9f07-4d29-af44-2565ed936753 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=78067) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] keystone_authtoken.memcache_password = {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] keystone_authtoken.memcache_username = {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] keystone_authtoken.region_name = None {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] keystone_authtoken.service_token_roles_required = True {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] keystone_authtoken.service_type = None {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] keystone_authtoken.token_cache_time = 300 {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.21/identity {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] cache.backend = dogpile.cache.null {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] cache.backend_argument = **** {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] cache.backend_expiration_time = None {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] cache.config_prefix = cache.oslo {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] cache.debug_cache_backend = False {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] cache.enable_retry_client = False {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] cache.enable_socket_keepalive = False {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] cache.enabled = False {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] cache.expiration_time = 600 {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] cache.hashclient_retry_attempts = 2 {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] cache.memcache_dead_retry = 300 {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] cache.memcache_pool_maxsize = 10 {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] cache.memcache_sasl_enabled = False {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] cache.password = **** {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] cache.proxies = [] {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] cache.redis_db = 0 {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] cache.redis_sentinel_service_name = mymaster {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] cache.redis_server = localhost:6379 {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] cache.retry_attempts = 2 {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] cache.retry_delay = 0.0 {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] cache.socket_keepalive_count = 1 {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[78067]: DEBUG oslo_concurrency.processutils [None req-2357da8d-9f07-4d29-af44-2565ed936753 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.027s {{(pid=78067) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:08:20 devstack cinder-volume[78067]: DEBUG oslo_concurrency.processutils [None req-2357da8d-9f07-4d29-af44-2565ed936753 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=78067) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] cache.socket_keepalive_idle = 1 {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] cache.socket_keepalive_interval = 1 {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] cache.socket_timeout = 1.0 {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] cache.tls_allowed_ciphers = None {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] cache.tls_cafile = None {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] cache.tls_certfile = None {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] cache.tls_enabled = False {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] cache.tls_keyfile = None {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] cache.username = None {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] coordination.backend_url = **** {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] database.asyncio_connection = **** {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] database.asyncio_slave_connection = **** {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] database.backend = sqlalchemy {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] database.connection = **** {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] database.connection_debug = 0 {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] database.connection_parameters = {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] database.connection_recycle_time = 3600 {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] database.connection_trace = False {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] database.db_inc_retry_interval = True {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] database.db_max_retries = 20 {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] database.db_max_retry_interval = 10 {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] database.db_retry_interval = 1 {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] database.max_overflow = 50 {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] database.max_pool_size = 5 {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] database.max_retries = 10 {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] database.mysql_wsrep_sync_wait = None {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] database.pool_timeout = None {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] database.retry_interval = 10 {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] database.slave_connection = **** {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] database.sqlite_synchronous = True {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] database.synchronous_reader = True {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] database.use_db_reconnect = False {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] profiler.connection_string = messaging:// {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] profiler.enabled = False {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] profiler.es_doc_type = notification {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] profiler.es_scroll_size = 10000 {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] profiler.es_scroll_time = 2m {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] profiler.filter_error_trace = False {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] profiler.hmac_keys = **** {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] profiler.sentinel_service_name = mymaster {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] profiler.socket_timeout = 0.1 {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] profiler.trace_requests = False {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] profiler.trace_sqlalchemy = False {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] profiler_jaeger.process_tags = {} {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] profiler_jaeger.service_name_prefix = None {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] profiler_otlp.service_name_prefix = None {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] oslo_policy.enforce_new_defaults = True {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] oslo_policy.policy_default_rule = default {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] oslo_policy.policy_file = policy.yaml {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack sudo[78121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] oslo_policy.remote_timeout = 60.0 {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] privsep_osbrick.group = None {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] privsep_osbrick.helper_command = None {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack sudo[78121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] privsep_osbrick.user = None {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] cinder_sys_admin.group = None {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] cinder_sys_admin.helper_command = None {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] cinder_sys_admin.user = None {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] service_user.auth_section = None {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] service_user.auth_type = password {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] service_user.cafile = None {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] service_user.certfile = None {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] service_user.collect_timing = False {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] service_user.insecure = False {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] service_user.keyfile = None {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] service_user.send_service_user_token = True {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] service_user.split_loggers = False {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] service_user.timeout = None {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] glance.auth_section = None {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] glance.auth_type = password {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] glance.certfile = None {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] glance.collect_timing = False {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] glance.insecure = False {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] glance.keyfile = None {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] glance.region_name = None {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] glance.split_loggers = False {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] glance.timeout = None {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] backend_defaults.backend_availability_zone = None {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] backend_defaults.chap_password = **** {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] backend_defaults.chap_username = {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] backend_defaults.disk_geometry = None {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] backend_defaults.driver_client_cert = None {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] backend_defaults.driver_client_cert_key = None {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] backend_defaults.driver_data_namespace = None {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] backend_defaults.driver_use_ssl = False {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] backend_defaults.enable_unsupported_driver = False {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] backend_defaults.extra_capabilities = {} {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] backend_defaults.filter_function = None {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] backend_defaults.goodness_function = None {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] backend_defaults.iscsi_target_flags = {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] backend_defaults.iscsi_write_cache = on {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] backend_defaults.iser_helper = tgtadm {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] backend_defaults.iser_ip_address = 192.168.122.21 {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] backend_defaults.iser_port = 3260 {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] backend_defaults.lvm_mirrors = 0 {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] backend_defaults.lvm_share_target = False {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] backend_defaults.lvm_type = auto {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] backend_defaults.num_shell_tries = 3 {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] backend_defaults.nvmet_port_id = 1 {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] backend_defaults.replication_device = **** {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] backend_defaults.report_discard_supported = False {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] backend_defaults.reserved_percentage = 0 {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] backend_defaults.scst_target_driver = iscsi {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] backend_defaults.scst_target_iqn_name = None {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] backend_defaults.storage_protocol = iSCSI {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] backend_defaults.target_helper = tgtadm {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] backend_defaults.target_ip_address = 192.168.122.21 {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] backend_defaults.target_port = 3260 {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] backend_defaults.target_protocol = iscsi {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] backend_defaults.trace_flags = None {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] backend_defaults.unique_fqdn_network = True {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] backend_defaults.use_chap_auth = False {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] backend_defaults.volume_backend_name = None {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] backend_defaults.volume_clear = zero {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] backend_defaults.volume_clear_ionice = None {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] backend_defaults.volume_clear_size = 0 {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] backend_defaults.volume_group = cinder-volumes {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] oslo_reports.file_event_handler = None {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] oslo_reports.log_dir = None {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] lvmdriver-1.backend_availability_zone = None {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] lvmdriver-1.backend_host = None {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] lvmdriver-1.chap_password = **** {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] lvmdriver-1.chap_username = None {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] lvmdriver-1.chiscsi_conf = None {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] lvmdriver-1.disk_geometry = None {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] lvmdriver-1.driver_client_cert = None {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] lvmdriver-1.driver_data_namespace = None {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] lvmdriver-1.driver_use_ssl = None {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] lvmdriver-1.extra_capabilities = None {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] lvmdriver-1.filter_function = None {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] lvmdriver-1.goodness_function = None {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] lvmdriver-1.iser_helper = None {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] lvmdriver-1.iser_ip_address = None {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] lvmdriver-1.iser_port = None {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] lvmdriver-1.iser_target_prefix = None {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] lvmdriver-1.lvm_conf_file = None {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] lvmdriver-1.lvm_mirrors = None {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] lvmdriver-1.lvm_share_target = None {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] lvmdriver-1.lvm_type = auto {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] lvmdriver-1.num_shell_tries = None {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] lvmdriver-1.nvmet_port_id = None {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] lvmdriver-1.replication_device = **** {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] lvmdriver-1.report_discard_supported = None {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] lvmdriver-1.reserved_percentage = None {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] lvmdriver-1.scst_target_driver = None {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] lvmdriver-1.storage_protocol = None {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] lvmdriver-1.target_helper = lioadm {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] lvmdriver-1.target_ip_address = None {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] lvmdriver-1.target_port = 3260 {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] lvmdriver-1.target_protocol = iscsi {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] lvmdriver-1.trace_flags = None {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] lvmdriver-1.use_chap_auth = None {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] lvmdriver-1.volume_clear = zero {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] lvmdriver-1.volume_clear_size = None {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] lvmdriver-1.volumes_dir = None {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] oslo_messaging_rabbit.ssl = False {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] oslo_messaging_rabbit.ssl_version = {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] oslo_messaging_notifications.driver = [] {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] oslo_messaging_notifications.retry = -1 {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] oslo_messaging_notifications.transport_url = **** {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] key_manager.fixed_key = **** {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] barbican.barbican_api_version = None {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] barbican.barbican_endpoint = None {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] barbican.barbican_endpoint_type = public {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] barbican.barbican_region_name = None {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] barbican.cafile = None {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] barbican.certfile = None {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] barbican.collect_timing = False {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] barbican.insecure = False {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] barbican.keyfile = None {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] barbican.number_of_retries = 60 {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] barbican.retry_delay = 1 {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] barbican.send_service_user_token = False {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] barbican.split_loggers = False {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] barbican.timeout = None {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] barbican.verify_ssl = True {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] barbican.verify_ssl_path = None {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] barbican_service_user.auth_section = None {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] barbican_service_user.auth_type = None {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] barbican_service_user.cafile = None {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] barbican_service_user.certfile = None {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] barbican_service_user.collect_timing = False {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] barbican_service_user.insecure = False {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] barbican_service_user.keyfile = None {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] barbican_service_user.split_loggers = False {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] barbican_service_user.timeout = None {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] vault.approle_role_id = **** {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] vault.approle_secret_id = **** {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] vault.auth_method = approle {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] vault.auth_path = None {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] vault.kv_mountpoint = secret {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] vault.kv_path = None {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] vault.kv_version = 2 {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] vault.namespace = None {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] vault.root_token_id = **** {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] vault.ssl_ca_crt_file = None {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] vault.timeout = 60.0 {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] vault.token_file = None {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] vault.token_role = None {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] vault.use_ssl = False {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:08:20 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] ******************************************************************************** {{(pid=77912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 31 12:08:20 devstack sudo[78121]: pam_unix(sudo:session): session closed for user root Jul 31 12:08:20 devstack cinder-volume[78067]: DEBUG oslo_concurrency.processutils [None req-2357da8d-9f07-4d29-af44-2565ed936753 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.410s {{(pid=78067) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:08:20 devstack cinder-volume[78067]: DEBUG oslo_concurrency.processutils [None req-2357da8d-9f07-4d29-af44-2565ed936753 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=78067) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:08:20 devstack sudo[78258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 31 12:08:20 devstack sudo[78258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:08:21 devstack sudo[78258]: pam_unix(sudo:session): session closed for user root Jul 31 12:08:21 devstack cinder-volume[78067]: DEBUG oslo_concurrency.processutils [None req-2357da8d-9f07-4d29-af44-2565ed936753 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.329s {{(pid=78067) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:08:21 devstack cinder-volume[78067]: DEBUG oslo_concurrency.processutils [None req-2357da8d-9f07-4d29-af44-2565ed936753 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=78067) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 31 12:08:21 devstack cinder-volume[78067]: INFO cinder.brick.local_dev.lvm [None req-2357da8d-9f07-4d29-af44-2565ed936753 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Jul 31 12:08:21 devstack cinder-volume[78067]: DEBUG oslo_concurrency.processutils [None req-2357da8d-9f07-4d29-af44-2565ed936753 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=78067) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:08:21 devstack cinder-volume[78067]: DEBUG oslo_concurrency.processutils [None req-2357da8d-9f07-4d29-af44-2565ed936753 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=78067) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:08:21 devstack cinder-volume[78067]: DEBUG oslo_concurrency.processutils [None req-2357da8d-9f07-4d29-af44-2565ed936753 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=78067) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:08:21 devstack sudo[78362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 31 12:08:21 devstack sudo[78362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:08:21 devstack sudo[78362]: pam_unix(sudo:session): session closed for user root Jul 31 12:08:21 devstack cinder-volume[78067]: DEBUG oslo_concurrency.processutils [None req-2357da8d-9f07-4d29-af44-2565ed936753 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.256s {{(pid=78067) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:08:21 devstack cinder-volume[78067]: DEBUG cinder.brick.local_dev.lvm [None req-2357da8d-9f07-4d29-af44-2565ed936753 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=78067) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}} Jul 31 12:08:21 devstack cinder-volume[78067]: DEBUG oslo_concurrency.processutils [None req-2357da8d-9f07-4d29-af44-2565ed936753 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=78067) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:08:21 devstack sudo[78460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 31 12:08:21 devstack sudo[78460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:08:22 devstack sudo[78460]: pam_unix(sudo:session): session closed for user root Jul 31 12:08:22 devstack cinder-volume[78067]: DEBUG oslo_concurrency.processutils [None req-2357da8d-9f07-4d29-af44-2565ed936753 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.570s {{(pid=78067) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:08:22 devstack cinder-volume[78067]: DEBUG oslo_concurrency.processutils [None req-2357da8d-9f07-4d29-af44-2565ed936753 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=78067) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:08:22 devstack cinder-volume[78067]: DEBUG oslo_concurrency.processutils [None req-2357da8d-9f07-4d29-af44-2565ed936753 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.014s {{(pid=78067) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:08:22 devstack cinder-volume[78067]: DEBUG oslo_concurrency.processutils [None req-2357da8d-9f07-4d29-af44-2565ed936753 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=78067) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:08:22 devstack sudo[78679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 31 12:08:22 devstack sudo[78679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:08:22 devstack sudo[78679]: pam_unix(sudo:session): session closed for user root Jul 31 12:08:22 devstack cinder-volume[78067]: DEBUG oslo_concurrency.processutils [None req-2357da8d-9f07-4d29-af44-2565ed936753 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.251s {{(pid=78067) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:08:22 devstack cinder-volume[78067]: DEBUG oslo_concurrency.processutils [None req-2357da8d-9f07-4d29-af44-2565ed936753 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=78067) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:08:22 devstack cinder-volume[78067]: DEBUG oslo_concurrency.processutils [None req-2357da8d-9f07-4d29-af44-2565ed936753 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.015s {{(pid=78067) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:08:22 devstack cinder-volume[78067]: DEBUG oslo_concurrency.processutils [None req-2357da8d-9f07-4d29-af44-2565ed936753 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=78067) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:08:22 devstack sudo[78683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Jul 31 12:08:22 devstack sudo[78683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:08:22 devstack sudo[78683]: pam_unix(sudo:session): session closed for user root Jul 31 12:08:22 devstack cinder-volume[78067]: DEBUG oslo_concurrency.processutils [None req-2357da8d-9f07-4d29-af44-2565ed936753 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.340s {{(pid=78067) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:08:22 devstack cinder-volume[78067]: DEBUG oslo_concurrency.processutils [None req-2357da8d-9f07-4d29-af44-2565ed936753 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=78067) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:08:22 devstack sudo[78801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 31 12:08:22 devstack sudo[78801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:08:22 devstack sudo[78801]: pam_unix(sudo:session): session closed for user root Jul 31 12:08:22 devstack cinder-volume[78067]: DEBUG oslo_concurrency.processutils [None req-2357da8d-9f07-4d29-af44-2565ed936753 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.305s {{(pid=78067) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:08:22 devstack cinder-volume[78067]: DEBUG oslo_concurrency.processutils [None req-2357da8d-9f07-4d29-af44-2565ed936753 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=78067) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:08:23 devstack sudo[78811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 31 12:08:23 devstack sudo[78811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:08:23 devstack sudo[78811]: pam_unix(sudo:session): session closed for user root Jul 31 12:08:23 devstack cinder-volume[78067]: DEBUG oslo_concurrency.processutils [None req-2357da8d-9f07-4d29-af44-2565ed936753 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.340s {{(pid=78067) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:08:23 devstack cinder-volume[78067]: DEBUG oslo_concurrency.processutils [None req-2357da8d-9f07-4d29-af44-2565ed936753 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=78067) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:08:23 devstack sudo[78895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 31 12:08:23 devstack sudo[78895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:08:23 devstack sudo[78895]: pam_unix(sudo:session): session closed for user root Jul 31 12:08:23 devstack cinder-volume[78067]: DEBUG oslo_concurrency.processutils [None req-2357da8d-9f07-4d29-af44-2565ed936753 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.289s {{(pid=78067) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:08:23 devstack cinder-volume[78067]: DEBUG oslo_concurrency.processutils [None req-2357da8d-9f07-4d29-af44-2565ed936753 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=78067) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:08:23 devstack sudo[78898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 31 12:08:23 devstack sudo[78898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:08:23 devstack sudo[78898]: pam_unix(sudo:session): session closed for user root Jul 31 12:08:23 devstack cinder-volume[78067]: DEBUG oslo_concurrency.processutils [None req-2357da8d-9f07-4d29-af44-2565ed936753 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.268s {{(pid=78067) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:08:23 devstack cinder-volume[78067]: DEBUG oslo_concurrency.processutils [None req-2357da8d-9f07-4d29-af44-2565ed936753 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=78067) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:08:23 devstack cinder-volume[78067]: DEBUG oslo_concurrency.processutils [None req-2357da8d-9f07-4d29-af44-2565ed936753 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.022s {{(pid=78067) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:08:23 devstack cinder-volume[78067]: DEBUG oslo_concurrency.processutils [None req-2357da8d-9f07-4d29-af44-2565ed936753 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=78067) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:08:23 devstack sudo[78902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 31 12:08:23 devstack sudo[78902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:08:24 devstack sudo[78902]: pam_unix(sudo:session): session closed for user root Jul 31 12:08:24 devstack cinder-volume[78067]: DEBUG oslo_concurrency.processutils [None req-2357da8d-9f07-4d29-af44-2565ed936753 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.287s {{(pid=78067) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:08:24 devstack cinder-volume[78067]: INFO cinder.volume.drivers.lvm [None req-2357da8d-9f07-4d29-af44-2565ed936753 None None] Enabling LVM thin provisioning by default because a thin pool exists. Jul 31 12:08:24 devstack cinder-volume[78067]: DEBUG oslo_concurrency.processutils [None req-2357da8d-9f07-4d29-af44-2565ed936753 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=78067) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:08:24 devstack cinder-volume[78067]: DEBUG oslo_concurrency.processutils [None req-2357da8d-9f07-4d29-af44-2565ed936753 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=78067) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:08:24 devstack cinder-volume[78067]: DEBUG oslo_concurrency.processutils [None req-2357da8d-9f07-4d29-af44-2565ed936753 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=78067) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:08:24 devstack sudo[78907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 31 12:08:24 devstack sudo[78907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:08:24 devstack sudo[78907]: pam_unix(sudo:session): session closed for user root Jul 31 12:08:24 devstack cinder-volume[78067]: DEBUG oslo_concurrency.processutils [None req-2357da8d-9f07-4d29-af44-2565ed936753 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.254s {{(pid=78067) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:08:24 devstack cinder-volume[78067]: DEBUG cinder.volume.drivers.lvm [None req-2357da8d-9f07-4d29-af44-2565ed936753 None None] Updating volume stats {{(pid=78067) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 31 12:08:24 devstack cinder-volume[78067]: DEBUG oslo_concurrency.processutils [None req-2357da8d-9f07-4d29-af44-2565ed936753 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=78067) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:08:24 devstack sudo[78916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 31 12:08:24 devstack sudo[78916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:08:24 devstack sudo[78916]: pam_unix(sudo:session): session closed for user root Jul 31 12:08:24 devstack cinder-volume[78067]: DEBUG oslo_concurrency.processutils [None req-2357da8d-9f07-4d29-af44-2565ed936753 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.256s {{(pid=78067) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:08:24 devstack cinder-volume[78067]: DEBUG oslo_concurrency.processutils [None req-2357da8d-9f07-4d29-af44-2565ed936753 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=78067) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:08:24 devstack sudo[78919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 31 12:08:24 devstack sudo[78919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:08:24 devstack sudo[78919]: pam_unix(sudo:session): session closed for user root Jul 31 12:08:24 devstack cinder-volume[78067]: DEBUG oslo_concurrency.processutils [None req-2357da8d-9f07-4d29-af44-2565ed936753 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.258s {{(pid=78067) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:08:25 devstack cinder-volume[78067]: DEBUG oslo_concurrency.processutils [None req-2357da8d-9f07-4d29-af44-2565ed936753 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=78067) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:08:25 devstack sudo[78922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 31 12:08:25 devstack sudo[78922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:08:25 devstack sudo[78922]: pam_unix(sudo:session): session closed for user root Jul 31 12:08:25 devstack cinder-volume[78067]: DEBUG oslo_concurrency.processutils [None req-2357da8d-9f07-4d29-af44-2565ed936753 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.261s {{(pid=78067) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:08:25 devstack cinder-volume[78067]: DEBUG oslo_concurrency.processutils [None req-2357da8d-9f07-4d29-af44-2565ed936753 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=78067) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:08:25 devstack sudo[78925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 31 12:08:25 devstack sudo[78925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:08:25 devstack sudo[78925]: pam_unix(sudo:session): session closed for user root Jul 31 12:08:25 devstack cinder-volume[78067]: DEBUG oslo_concurrency.processutils [None req-2357da8d-9f07-4d29-af44-2565ed936753 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.259s {{(pid=78067) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:08:25 devstack cinder-volume[78067]: INFO cinder.volume.driver [None req-2357da8d-9f07-4d29-af44-2565ed936753 None None] Driver hasn't implemented _init_vendor_properties() Jul 31 12:08:25 devstack cinder-volume[78067]: DEBUG cinder.volume.driver [None req-2357da8d-9f07-4d29-af44-2565ed936753 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=78067) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 31 12:08:25 devstack cinder-volume[78067]: DEBUG oslo_db.sqlalchemy.engines [None req-2357da8d-9f07-4d29-af44-2565ed936753 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=78067) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 31 12:08:25 devstack cinder-volume[78067]: DEBUG dbcounter [-] [78067] Writer thread running {{(pid=78067) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 31 12:08:25 devstack cinder-volume[78067]: DEBUG cinder.db.api [None req-2357da8d-9f07-4d29-af44-2565ed936753 None None] Building query based on filter {{(pid=78067) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 31 12:08:25 devstack cinder-volume[78067]: DEBUG cinder.image.image_utils [None req-2357da8d-9f07-4d29-af44-2565ed936753 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=78067) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 31 12:08:25 devstack cinder-volume[78067]: INFO cinder.keymgr.migration [None req-83a45de9-71cb-436c-b054-aa8e444bf26e None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 31 12:08:25 devstack cinder-volume[78067]: DEBUG cinder.volume.drivers.lvm [None req-2357da8d-9f07-4d29-af44-2565ed936753 None None] Updating volume stats {{(pid=78067) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 31 12:08:25 devstack cinder-volume[78067]: DEBUG oslo_concurrency.processutils [None req-2357da8d-9f07-4d29-af44-2565ed936753 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=78067) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:08:25 devstack sudo[78931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 31 12:08:25 devstack sudo[78931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:08:25 devstack sudo[78931]: pam_unix(sudo:session): session closed for user root Jul 31 12:08:25 devstack cinder-volume[78067]: DEBUG oslo_concurrency.processutils [None req-2357da8d-9f07-4d29-af44-2565ed936753 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.259s {{(pid=78067) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:08:25 devstack cinder-volume[78067]: DEBUG oslo_concurrency.processutils [None req-2357da8d-9f07-4d29-af44-2565ed936753 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=78067) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:08:25 devstack sudo[78934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 31 12:08:25 devstack sudo[78934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:08:26 devstack sudo[78934]: pam_unix(sudo:session): session closed for user root Jul 31 12:08:26 devstack cinder-volume[78067]: DEBUG oslo_concurrency.processutils [None req-2357da8d-9f07-4d29-af44-2565ed936753 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.285s {{(pid=78067) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:08:26 devstack cinder-volume[78067]: DEBUG oslo_concurrency.processutils [None req-2357da8d-9f07-4d29-af44-2565ed936753 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=78067) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:08:26 devstack sudo[78938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 31 12:08:26 devstack sudo[78938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:08:26 devstack sudo[78938]: pam_unix(sudo:session): session closed for user root Jul 31 12:08:26 devstack cinder-volume[78067]: DEBUG oslo_concurrency.processutils [None req-2357da8d-9f07-4d29-af44-2565ed936753 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.267s {{(pid=78067) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:08:26 devstack cinder-volume[78067]: DEBUG oslo_concurrency.processutils [None req-2357da8d-9f07-4d29-af44-2565ed936753 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=78067) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:08:26 devstack sudo[78943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 31 12:08:26 devstack sudo[78943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:08:26 devstack sudo[78943]: pam_unix(sudo:session): session closed for user root Jul 31 12:08:26 devstack cinder-volume[78067]: DEBUG oslo_concurrency.processutils [None req-2357da8d-9f07-4d29-af44-2565ed936753 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.256s {{(pid=78067) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:08:26 devstack cinder-volume[78067]: DEBUG cinder.manager [None req-2357da8d-9f07-4d29-af44-2565ed936753 None None] Notifying Schedulers of capabilities ... {{(pid=78067) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 12:08:26 devstack cinder-volume[78067]: INFO cinder.volume.manager [None req-2357da8d-9f07-4d29-af44-2565ed936753 None None] Driver initialization completed successfully. Jul 31 12:08:26 devstack cinder-volume[78067]: INFO cinder.manager [None req-2357da8d-9f07-4d29-af44-2565ed936753 None None] Initiating service 2 cleanup Jul 31 12:08:26 devstack cinder-volume[78067]: INFO cinder.manager [None req-2357da8d-9f07-4d29-af44-2565ed936753 None None] Service 2 cleanup completed. Jul 31 12:08:26 devstack cinder-volume[78067]: DEBUG cinder.service [None req-2357da8d-9f07-4d29-af44-2565ed936753 None None] Creating RPC server for service cinder-volume {{(pid=78067) start /opt/stack/cinder/cinder/service.py:231}} Jul 31 12:08:26 devstack cinder-volume[78067]: DEBUG cinder.service [None req-2357da8d-9f07-4d29-af44-2565ed936753 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=78067) start /opt/stack/cinder/cinder/service.py:237}} Jul 31 12:08:26 devstack cinder-volume[78067]: INFO cinder.volume.manager [None req-2357da8d-9f07-4d29-af44-2565ed936753 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Jul 31 12:08:26 devstack cinder-volume[78067]: DEBUG cinder.volume.drivers.lvm [None req-2357da8d-9f07-4d29-af44-2565ed936753 None None] Updating volume stats {{(pid=78067) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 31 12:08:26 devstack cinder-volume[78067]: DEBUG oslo_concurrency.processutils [None req-2357da8d-9f07-4d29-af44-2565ed936753 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=78067) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:08:26 devstack sudo[78946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 31 12:08:26 devstack sudo[78946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:08:27 devstack sudo[78946]: pam_unix(sudo:session): session closed for user root Jul 31 12:08:27 devstack cinder-volume[78067]: DEBUG oslo_concurrency.processutils [None req-2357da8d-9f07-4d29-af44-2565ed936753 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.302s {{(pid=78067) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:08:27 devstack cinder-volume[78067]: DEBUG oslo_concurrency.processutils [None req-2357da8d-9f07-4d29-af44-2565ed936753 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=78067) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:08:27 devstack sudo[78949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 31 12:08:27 devstack sudo[78949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:08:27 devstack sudo[78949]: pam_unix(sudo:session): session closed for user root Jul 31 12:08:27 devstack cinder-volume[78067]: DEBUG oslo_concurrency.processutils [None req-2357da8d-9f07-4d29-af44-2565ed936753 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.257s {{(pid=78067) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:08:27 devstack cinder-volume[78067]: DEBUG oslo_concurrency.processutils [None req-2357da8d-9f07-4d29-af44-2565ed936753 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=78067) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:08:27 devstack sudo[78952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 31 12:08:27 devstack sudo[78952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:08:27 devstack sudo[78952]: pam_unix(sudo:session): session closed for user root Jul 31 12:08:27 devstack cinder-volume[78067]: DEBUG oslo_concurrency.processutils [None req-2357da8d-9f07-4d29-af44-2565ed936753 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.248s {{(pid=78067) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:08:27 devstack cinder-volume[78067]: DEBUG oslo_concurrency.processutils [None req-2357da8d-9f07-4d29-af44-2565ed936753 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=78067) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:08:27 devstack sudo[78958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 31 12:08:27 devstack sudo[78958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:08:27 devstack sudo[78958]: pam_unix(sudo:session): session closed for user root Jul 31 12:08:27 devstack cinder-volume[78067]: DEBUG oslo_concurrency.processutils [None req-2357da8d-9f07-4d29-af44-2565ed936753 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.238s {{(pid=78067) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:08:27 devstack cinder-volume[78067]: INFO cinder.volume.manager [None req-2357da8d-9f07-4d29-af44-2565ed936753 None None] Driver post RPC initialization completed successfully. Jul 31 12:08:30 devstack cinder-volume[77912]: DEBUG dbcounter [-] [77912] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=77912) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 12:08:36 devstack cinder-volume[78067]: DEBUG dbcounter [-] [78067] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=78067) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 12:08:37 devstack cinder-volume[78067]: DEBUG dbcounter [-] [78067] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=78067) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 12:08:55 devstack cinder-volume[78067]: DEBUG oslo_service.periodic_task [None req-f2fec8ec-8f11-498d-b8b5-276836877a1f None None] Running periodic task VolumeManager._thread_info {{(pid=78067) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 31 12:08:55 devstack cinder-volume[78067]: DEBUG cinder.volume.manager [None req-f2fec8ec-8f11-498d-b8b5-276836877a1f None None] thread count: 6 {{(pid=78067) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 31 12:08:55 devstack cinder-volume[78067]: DEBUG cinder.volume.manager [None req-f2fec8ec-8f11-498d-b8b5-276836877a1f None None] thread info: [<_MainThread(MainThread, started 134700913320064)>, , , , , ] {{(pid=78067) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 31 12:09:55 devstack cinder-volume[78067]: DEBUG oslo_service.periodic_task [None req-f2fec8ec-8f11-498d-b8b5-276836877a1f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=78067) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 31 12:09:55 devstack cinder-volume[78067]: DEBUG cinder.volume.drivers.lvm [None req-f2fec8ec-8f11-498d-b8b5-276836877a1f None None] Updating volume stats {{(pid=78067) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 31 12:09:55 devstack cinder-volume[78067]: DEBUG oslo_concurrency.processutils [None req-f2fec8ec-8f11-498d-b8b5-276836877a1f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=78067) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:09:56 devstack sudo[81598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 31 12:09:56 devstack sudo[81598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:09:56 devstack sudo[81598]: pam_unix(sudo:session): session closed for user root Jul 31 12:09:56 devstack cinder-volume[78067]: DEBUG oslo_concurrency.processutils [None req-f2fec8ec-8f11-498d-b8b5-276836877a1f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.263s {{(pid=78067) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:09:56 devstack cinder-volume[78067]: DEBUG oslo_concurrency.processutils [None req-f2fec8ec-8f11-498d-b8b5-276836877a1f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=78067) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:09:56 devstack sudo[81601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 31 12:09:56 devstack sudo[81601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:09:56 devstack sudo[81601]: pam_unix(sudo:session): session closed for user root Jul 31 12:09:56 devstack cinder-volume[78067]: DEBUG oslo_concurrency.processutils [None req-f2fec8ec-8f11-498d-b8b5-276836877a1f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.245s {{(pid=78067) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:09:56 devstack cinder-volume[78067]: DEBUG oslo_concurrency.processutils [None req-f2fec8ec-8f11-498d-b8b5-276836877a1f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=78067) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:09:56 devstack sudo[81604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 31 12:09:56 devstack sudo[81604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:09:56 devstack sudo[81604]: pam_unix(sudo:session): session closed for user root Jul 31 12:09:56 devstack cinder-volume[78067]: DEBUG oslo_concurrency.processutils [None req-f2fec8ec-8f11-498d-b8b5-276836877a1f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.252s {{(pid=78067) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:09:56 devstack cinder-volume[78067]: DEBUG oslo_concurrency.processutils [None req-f2fec8ec-8f11-498d-b8b5-276836877a1f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=78067) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:09:56 devstack sudo[81607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 31 12:09:56 devstack sudo[81607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:09:57 devstack sudo[81607]: pam_unix(sudo:session): session closed for user root Jul 31 12:09:57 devstack cinder-volume[78067]: DEBUG oslo_concurrency.processutils [None req-f2fec8ec-8f11-498d-b8b5-276836877a1f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.259s {{(pid=78067) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:09:57 devstack cinder-volume[78067]: DEBUG cinder.manager [None req-f2fec8ec-8f11-498d-b8b5-276836877a1f None None] Notifying Schedulers of capabilities ... {{(pid=78067) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 12:09:57 devstack cinder-volume[78067]: DEBUG oslo_service.periodic_task [None req-f2fec8ec-8f11-498d-b8b5-276836877a1f None None] Running periodic task VolumeManager._thread_info {{(pid=78067) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 31 12:09:57 devstack cinder-volume[78067]: DEBUG cinder.volume.manager [None req-f2fec8ec-8f11-498d-b8b5-276836877a1f None None] thread count: 6 {{(pid=78067) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 31 12:09:57 devstack cinder-volume[78067]: DEBUG cinder.volume.manager [None req-f2fec8ec-8f11-498d-b8b5-276836877a1f None None] thread info: [<_MainThread(MainThread, started 134700913320064)>, , , , , ] {{(pid=78067) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 31 12:10:37 devstack cinder-volume[78067]: DEBUG dbcounter [-] [78067] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=78067) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 12:10:55 devstack cinder-volume[78067]: DEBUG oslo_service.periodic_task [None req-f2fec8ec-8f11-498d-b8b5-276836877a1f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=78067) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 31 12:10:55 devstack cinder-volume[78067]: DEBUG cinder.volume.drivers.lvm [None req-f2fec8ec-8f11-498d-b8b5-276836877a1f None None] Updating volume stats {{(pid=78067) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 31 12:10:55 devstack cinder-volume[78067]: DEBUG oslo_concurrency.processutils [None req-f2fec8ec-8f11-498d-b8b5-276836877a1f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=78067) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:10:56 devstack sudo[85266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 31 12:10:56 devstack sudo[85266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:10:56 devstack sudo[85266]: pam_unix(sudo:session): session closed for user root Jul 31 12:10:56 devstack cinder-volume[78067]: DEBUG oslo_concurrency.processutils [None req-f2fec8ec-8f11-498d-b8b5-276836877a1f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.291s {{(pid=78067) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:10:56 devstack cinder-volume[78067]: DEBUG oslo_concurrency.processutils [None req-f2fec8ec-8f11-498d-b8b5-276836877a1f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=78067) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:10:56 devstack sudo[85276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 31 12:10:56 devstack sudo[85276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:10:56 devstack sudo[85276]: pam_unix(sudo:session): session closed for user root Jul 31 12:10:56 devstack cinder-volume[78067]: DEBUG oslo_concurrency.processutils [None req-f2fec8ec-8f11-498d-b8b5-276836877a1f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.297s {{(pid=78067) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:10:56 devstack cinder-volume[78067]: DEBUG oslo_concurrency.processutils [None req-f2fec8ec-8f11-498d-b8b5-276836877a1f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=78067) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:10:56 devstack sudo[85304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 31 12:10:56 devstack sudo[85304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:10:56 devstack sudo[85304]: pam_unix(sudo:session): session closed for user root Jul 31 12:10:56 devstack cinder-volume[78067]: DEBUG oslo_concurrency.processutils [None req-f2fec8ec-8f11-498d-b8b5-276836877a1f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.257s {{(pid=78067) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:10:56 devstack cinder-volume[78067]: DEBUG oslo_concurrency.processutils [None req-f2fec8ec-8f11-498d-b8b5-276836877a1f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=78067) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:10:56 devstack sudo[85311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 31 12:10:56 devstack sudo[85311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:10:57 devstack sudo[85311]: pam_unix(sudo:session): session closed for user root Jul 31 12:10:57 devstack cinder-volume[78067]: DEBUG oslo_concurrency.processutils [None req-f2fec8ec-8f11-498d-b8b5-276836877a1f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.270s {{(pid=78067) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:10:57 devstack cinder-volume[78067]: DEBUG cinder.manager [None req-f2fec8ec-8f11-498d-b8b5-276836877a1f None None] Notifying Schedulers of capabilities ... {{(pid=78067) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 12:11:55 devstack cinder-volume[78067]: DEBUG oslo_service.periodic_task [None req-f2fec8ec-8f11-498d-b8b5-276836877a1f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=78067) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 31 12:11:56 devstack cinder-volume[78067]: DEBUG cinder.volume.drivers.lvm [None req-f2fec8ec-8f11-498d-b8b5-276836877a1f None None] Updating volume stats {{(pid=78067) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 31 12:11:56 devstack cinder-volume[78067]: DEBUG oslo_concurrency.processutils [None req-f2fec8ec-8f11-498d-b8b5-276836877a1f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=78067) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:11:56 devstack sudo[86900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 31 12:11:56 devstack sudo[86900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:11:56 devstack sudo[86900]: pam_unix(sudo:session): session closed for user root Jul 31 12:11:56 devstack cinder-volume[78067]: DEBUG oslo_concurrency.processutils [None req-f2fec8ec-8f11-498d-b8b5-276836877a1f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.249s {{(pid=78067) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:11:56 devstack cinder-volume[78067]: DEBUG oslo_concurrency.processutils [None req-f2fec8ec-8f11-498d-b8b5-276836877a1f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=78067) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:11:56 devstack sudo[86903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 31 12:11:56 devstack sudo[86903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:11:56 devstack sudo[86903]: pam_unix(sudo:session): session closed for user root Jul 31 12:11:56 devstack cinder-volume[78067]: DEBUG oslo_concurrency.processutils [None req-f2fec8ec-8f11-498d-b8b5-276836877a1f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.248s {{(pid=78067) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:11:56 devstack cinder-volume[78067]: DEBUG oslo_concurrency.processutils [None req-f2fec8ec-8f11-498d-b8b5-276836877a1f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=78067) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:11:56 devstack sudo[86906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 31 12:11:56 devstack sudo[86906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:11:56 devstack sudo[86906]: pam_unix(sudo:session): session closed for user root Jul 31 12:11:56 devstack cinder-volume[78067]: DEBUG oslo_concurrency.processutils [None req-f2fec8ec-8f11-498d-b8b5-276836877a1f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.290s {{(pid=78067) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:11:56 devstack cinder-volume[78067]: DEBUG oslo_concurrency.processutils [None req-f2fec8ec-8f11-498d-b8b5-276836877a1f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=78067) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:11:56 devstack sudo[86909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 31 12:11:56 devstack sudo[86909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:11:57 devstack sudo[86909]: pam_unix(sudo:session): session closed for user root Jul 31 12:11:57 devstack cinder-volume[78067]: DEBUG oslo_concurrency.processutils [None req-f2fec8ec-8f11-498d-b8b5-276836877a1f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.269s {{(pid=78067) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:11:57 devstack cinder-volume[78067]: DEBUG cinder.manager [None req-f2fec8ec-8f11-498d-b8b5-276836877a1f None None] Notifying Schedulers of capabilities ... {{(pid=78067) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 12:11:57 devstack cinder-volume[78067]: DEBUG oslo_service.periodic_task [None req-f2fec8ec-8f11-498d-b8b5-276836877a1f None None] Running periodic task VolumeManager._thread_info {{(pid=78067) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 31 12:11:57 devstack cinder-volume[78067]: DEBUG cinder.volume.manager [None req-f2fec8ec-8f11-498d-b8b5-276836877a1f None None] thread count: 6 {{(pid=78067) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 31 12:11:57 devstack cinder-volume[78067]: DEBUG cinder.volume.manager [None req-f2fec8ec-8f11-498d-b8b5-276836877a1f None None] thread info: [<_MainThread(MainThread, started 134700913320064)>, , , , , ] {{(pid=78067) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 31 12:12:38 devstack cinder-volume[78067]: DEBUG dbcounter [-] [78067] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=78067) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 12:12:55 devstack cinder-volume[77912]: INFO oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] Caught SIGTERM, stopping children Jul 31 12:12:55 devstack cinder-volume[77912]: DEBUG oslo_concurrency.lockutils [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] Acquiring lock "singleton_lock" {{(pid=77912) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 31 12:12:55 devstack cinder-volume[77912]: DEBUG oslo_concurrency.lockutils [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] Acquired lock "singleton_lock" {{(pid=77912) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 31 12:12:55 devstack cinder-volume[77912]: DEBUG oslo_concurrency.lockutils [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] Releasing lock "singleton_lock" {{(pid=77912) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 31 12:12:55 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] Stop services. {{(pid=77912) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jul 31 12:12:55 devstack cinder-volume[77912]: DEBUG oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] Killing children. {{(pid=77912) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jul 31 12:12:55 devstack cinder-volume[77912]: INFO oslo_service.backend._eventlet.service [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] Waiting on 1 children to exit Jul 31 12:12:56 devstack cinder-volume[78067]: DEBUG oslo_service.periodic_task [None req-f2fec8ec-8f11-498d-b8b5-276836877a1f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=78067) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 31 12:12:56 devstack cinder-volume[78067]: DEBUG cinder.volume.drivers.lvm [None req-f2fec8ec-8f11-498d-b8b5-276836877a1f None None] Updating volume stats {{(pid=78067) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 31 12:12:56 devstack cinder-volume[78067]: DEBUG oslo_concurrency.processutils [None req-f2fec8ec-8f11-498d-b8b5-276836877a1f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=78067) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:12:56 devstack sudo[88196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 31 12:12:56 devstack sudo[88196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:12:56 devstack sudo[88196]: pam_unix(sudo:session): session closed for user root Jul 31 12:12:56 devstack cinder-volume[78067]: DEBUG oslo_concurrency.processutils [None req-f2fec8ec-8f11-498d-b8b5-276836877a1f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.259s {{(pid=78067) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:12:56 devstack cinder-volume[78067]: DEBUG oslo_concurrency.processutils [None req-f2fec8ec-8f11-498d-b8b5-276836877a1f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=78067) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:12:56 devstack sudo[88199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 31 12:12:56 devstack sudo[88199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:12:56 devstack sudo[88199]: pam_unix(sudo:session): session closed for user root Jul 31 12:12:56 devstack cinder-volume[78067]: DEBUG oslo_concurrency.processutils [None req-f2fec8ec-8f11-498d-b8b5-276836877a1f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.258s {{(pid=78067) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:12:56 devstack cinder-volume[78067]: DEBUG oslo_concurrency.processutils [None req-f2fec8ec-8f11-498d-b8b5-276836877a1f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=78067) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:12:56 devstack sudo[88202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 31 12:12:56 devstack sudo[88202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:12:56 devstack sudo[88202]: pam_unix(sudo:session): session closed for user root Jul 31 12:12:56 devstack cinder-volume[78067]: DEBUG oslo_concurrency.processutils [None req-f2fec8ec-8f11-498d-b8b5-276836877a1f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.260s {{(pid=78067) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:12:56 devstack cinder-volume[78067]: DEBUG oslo_concurrency.processutils [None req-f2fec8ec-8f11-498d-b8b5-276836877a1f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=78067) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:12:56 devstack sudo[88205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 31 12:12:56 devstack sudo[88205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:12:57 devstack sudo[88205]: pam_unix(sudo:session): session closed for user root Jul 31 12:12:57 devstack cinder-volume[78067]: DEBUG oslo_concurrency.processutils [None req-f2fec8ec-8f11-498d-b8b5-276836877a1f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.255s {{(pid=78067) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:12:57 devstack cinder-volume[78067]: DEBUG cinder.manager [None req-f2fec8ec-8f11-498d-b8b5-276836877a1f None None] Notifying Schedulers of capabilities ... {{(pid=78067) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 12:12:57 devstack cinder-volume[78067]: DEBUG oslo_service.periodic_task [None req-f2fec8ec-8f11-498d-b8b5-276836877a1f None None] Running periodic task VolumeManager._thread_info {{(pid=78067) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 31 12:12:57 devstack cinder-volume[78067]: DEBUG cinder.volume.manager [None req-f2fec8ec-8f11-498d-b8b5-276836877a1f None None] thread count: 6 {{(pid=78067) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 31 12:12:57 devstack cinder-volume[78067]: DEBUG cinder.volume.manager [None req-f2fec8ec-8f11-498d-b8b5-276836877a1f None None] thread info: [<_MainThread(MainThread, started 134700913320064)>, , , , , ] {{(pid=78067) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 31 12:13:00 devstack cinder-volume[78067]: INFO oslo_service.backend._eventlet.service [-] Parent process has died unexpectedly, exiting Jul 31 12:13:00 devstack cinder-volume[88208]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 31 12:13:00 devstack cinder-volume[88208]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 31 12:13:00 devstack cinder-volume[88208]: we strongly recommend against using it for new projects. Jul 31 12:13:00 devstack cinder-volume[88208]: If you are already using Eventlet, we recommend migrating to a different Jul 31 12:13:00 devstack cinder-volume[88208]: framework. For more detail see Jul 31 12:13:00 devstack cinder-volume[88208]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 31 12:13:00 devstack cinder-volume[88208]: import eventlet # noqa Jul 31 12:13:01 devstack cinder-volume[78067]: DEBUG oslo_concurrency.lockutils [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] Acquiring lock "singleton_lock" {{(pid=78067) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 31 12:13:01 devstack cinder-volume[78067]: DEBUG oslo_concurrency.lockutils [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] Acquired lock "singleton_lock" {{(pid=78067) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 31 12:13:01 devstack cinder-volume[78067]: DEBUG oslo_concurrency.lockutils [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] Releasing lock "singleton_lock" {{(pid=78067) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 31 12:13:01 devstack cinder-volume[78067]: WARNING amqp [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 31 12:13:01 devstack cinder-volume[78067]: WARNING amqp [None req-e7c71de3-49ff-41ac-8cbc-8fe770458e08 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 31 12:13:02 devstack cinder-volume[88208]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=88208) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 31 12:13:02 devstack cinder-volume[88208]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=88208) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 31 12:13:02 devstack cinder-volume[88208]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=88208) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 31 12:13:03 devstack cinder-volume[88208]: INFO dbcounter [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] Registered counter for database cinder Jul 31 12:13:03 devstack cinder-volume[88208]: DEBUG oslo_db.sqlalchemy.engines [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88208) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG dbcounter [-] [88208] Writer thread running {{(pid=88208) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 31 12:13:04 devstack cinder-volume[88208]: INFO cinder.rpc [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 31 12:13:04 devstack cinder-volume[88208]: INFO cinder.rpc [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_db.sqlalchemy.engines [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88208) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 31 12:13:04 devstack cinder-volume[88208]: INFO cinder.volume.manager [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] Determined volume DB was empty at startup. Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG cinder.volume.manager [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] Cinder Volume DB check: vol_db_empty=True {{(pid=88208) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 31 12:13:04 devstack cinder-volume[88208]: INFO cinder.volume.manager [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] Service not found for updating active_backend_id, assuming default for driver init. Jul 31 12:13:04 devstack cinder-volume[88208]: WARNING stevedore.named [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 31 12:13:04 devstack cinder-volume[88208]: WARNING castellan.key_manager [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 31 12:13:04 devstack cinder-volume[88208]: WARNING cinder.keymgr.conf_key_mgr [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 31 12:13:04 devstack cinder-volume[88208]: INFO cinder.volume.manager [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] Image-volume cache disabled for host devstack@QuobyteHD. Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_db.sqlalchemy.engines [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88208) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 31 12:13:04 devstack cinder-volume[88208]: INFO oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] Starting 1 workers Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] Started child 88430 {{(pid=88208) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] Full set of CONF: {{(pid=88208) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] ******************************************************************************** {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] Configuration options gathered from: {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] ================================================================================ {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] allow_availability_zone_fallback = False {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] allow_compression_on_image_upload = False {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] allowed_direct_url_schemes = [] {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] api_rate_limit = True {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] auth_strategy = keystone {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] backend_availability_zone = None {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] backend_host = None {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] backend_name = None {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] backend_stats_polling_interval = 60 {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] backup_api_class = cinder.backup.api.API {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] backup_name_template = backup-%s {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] backup_use_same_host = False {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] backup_use_temp_snapshot = False {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] chap_password = **** {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] chap_username = {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] cinder_internal_tenant_project_id = b7fc95d8943f43808027333fd407c6ae {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] cinder_internal_tenant_user_id = 8dcfb6efe704434190b65e548d703884 {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] cluster = None {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] compression_format = gzip {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] compute_api_class = cinder.compute.nova.API {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] config_dir = [] {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] config_source = [] {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] control_exchange = openstack {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:04 devstack cinder-volume[88430]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] debug = True {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] default_availability_zone = None {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] default_group_type = None {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] default_volume_type = QuobyteHD {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] disk_geometry = None {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] driver_client_cert = None {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] driver_client_cert_key = None {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] driver_data_namespace = None {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] driver_ssl_cert_path = None {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] driver_ssl_cert_verify = False {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] driver_use_ssl = False {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] enable_new_services = True {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] enable_unsupported_driver = False {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] enabled_backends = ['QuobyteHD'] {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] enforce_multipath_for_image_xfer = False {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] filter_function = None {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] glance_api_insecure = False {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] glance_api_servers = ['http://192.168.122.21/image'] {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] glance_api_ssl_compression = False {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] glance_ca_certificates_file = None {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] glance_catalog_info = image:glance:publicURL {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] glance_certfile = None {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] glance_keyfile = None {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] glance_num_retries = 3 {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] glance_request_timeout = None {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] goodness_function = None {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] graceful_shutdown_timeout = 5 {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] group_api_class = cinder.group.api.API {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] host = devstack {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] image_compress_on_upload = True {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] image_conversion_address_space_limit = 1 {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] image_conversion_cpu_limit = 60 {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] image_conversion_disable = False {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] image_upload_use_cinder_backend = False {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] image_upload_use_internal_tenant = False {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] image_volume_cache_enabled = False {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] image_volume_cache_max_count = 0 {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] image_volume_cache_max_size_gb = 0 {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] init_host_max_objects_retrieval = 0 {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] instance_format = [instance: %(uuid)s] {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] iscsi_target_flags = {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] iscsi_write_cache = on {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] iser_helper = tgtadm {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] iser_ip_address = 192.168.122.21 {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] iser_port = 3260 {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] log_color = False {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] log_config_append = None {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] log_dir = None {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] log_file = None {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] log_options = True {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] log_rotate_interval = 1 {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] log_rotate_interval_type = days {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] log_rotation_type = none {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] max_age = 0 {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] max_logfile_count = 30 {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] max_logfile_size_mb = 200 {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] max_over_subscription_ratio = 20.0 {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] message_reap_interval = 86400 {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] message_ttl = 2592000 {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] migration_create_volume_timeout_secs = 300 {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] monkey_patch = False {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] monkey_patch_modules = [] {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] my_ip = 192.168.122.21 {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] no_snapshot_gb_quota = False {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] num_iser_scan_tries = 3 {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] num_shell_tries = 3 {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] num_volume_device_scan_tries = 3 {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] nvmeof_conn_info_version = 1 {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] nvmet_ns_id = 10 {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] nvmet_port_id = 1 {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] osapi_max_limit = 1000 {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] osapi_volume_ext_list = [] {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] osapi_volume_listen = 0.0.0.0 {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] osapi_volume_listen_port = 8776 {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] osapi_volume_use_ssl = False {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] osapi_volume_workers = None {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] per_volume_size_limit = -1 {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] periodic_fuzzy_delay = 60 {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] periodic_interval = 60 {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] project_id_regex = [0-9a-f\-]+ {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] public_endpoint = None {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] publish_errors = False {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] quota_backup_gigabytes = 1000 {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] quota_backups = 10 {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] quota_gigabytes = 1000 {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] quota_groups = 10 {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] quota_snapshots = 10 {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] quota_volumes = 10 {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] rate_limit_burst = 0 {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] rate_limit_except_level = CRITICAL {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] rate_limit_interval = 0 {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] reinit_driver_count = 3 {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] replication_device = **** {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] report_discard_supported = False {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] report_interval = 120 {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] reservation_clean_interval = 86400 {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] reservation_expire = 86400 {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] reserved_image_namespaces = [] {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] reserved_percentage = 0 {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] rpc_response_timeout = 120 {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] run_external_periodic_tasks = True {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] scst_target_driver = iscsi {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] scst_target_iqn_name = None {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] service_down_time = 720 {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] shell_completion = None {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] snapshot_name_template = snapshot-%s {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] split_loggers = False {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] state_path = /opt/stack/data/cinder {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] storage_availability_zone = nova {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] storage_protocol = iSCSI {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] syslog_log_facility = LOG_USER {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] target_helper = lioadm {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] target_ip_address = 192.168.122.21 {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] target_port = 3260 {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] target_protocol = iscsi {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] target_secondary_ip_addresses = [] {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] trace_flags = None {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] transfer_api_class = cinder.transfer.api.API {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] transport_url = **** {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] until_refresh = 0 {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] use_chap_auth = False {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] use_default_quota_class = True {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] use_journal = False {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] use_json = False {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] use_multipath_for_image_xfer = False {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] use_stderr = False {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] use_syslog = False {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] verify_glance_signatures = enabled {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] volume_api_class = cinder.volume.api.API {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] volume_backend_name = None {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] volume_clear = zero {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] volume_clear_ionice = None {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] volume_clear_size = 0 {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] volume_copy_bps_limit = 0 {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] volume_dd_blocksize = 1M {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] volume_name_template = volume-%s {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] volume_service_inithost_offload = False {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] volume_usage_audit_period = month {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] zoning_mode = None {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] oslo_concurrency.disable_process_locking = False {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] os_brick.lightos_discovery_client_address = localhost {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] os_brick.wait_mpath_device_interval = 1 {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] keystone_authtoken.auth_section = None {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] keystone_authtoken.auth_type = password {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] keystone_authtoken.auth_version = None {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] keystone_authtoken.cache = None {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] keystone_authtoken.certfile = None {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] keystone_authtoken.delay_auth_decision = False {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] keystone_authtoken.http_connect_timeout = None {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] keystone_authtoken.include_service_catalog = True {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] keystone_authtoken.insecure = False {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] keystone_authtoken.interface = public {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] keystone_authtoken.keyfile = None {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] keystone_authtoken.memcache_password = {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] keystone_authtoken.memcache_secret_key = **** {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] keystone_authtoken.memcache_security_strategy = None {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] keystone_authtoken.memcache_username = {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] keystone_authtoken.region_name = None {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] keystone_authtoken.service_token_roles_required = True {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] keystone_authtoken.service_type = None {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] keystone_authtoken.token_cache_time = 300 {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.21/identity {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] cache.backend = dogpile.cache.null {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] cache.backend_argument = **** {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] cache.backend_expiration_time = None {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] cache.config_prefix = cache.oslo {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] cache.debug_cache_backend = False {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] cache.enable_retry_client = False {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] cache.enable_socket_keepalive = False {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] cache.enabled = False {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] cache.expiration_time = 600 {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] cache.hashclient_dead_timeout = 60.0 {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] cache.hashclient_retry_attempts = 2 {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] cache.hashclient_retry_timeout = 1.0 {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] cache.memcache_dead_retry = 300 {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] cache.memcache_pool_maxsize = 10 {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] cache.memcache_pool_unused_timeout = 60 {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] cache.memcache_sasl_enabled = False {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] cache.memcache_servers = ['localhost:11211'] {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88430]: INFO cinder.volume.manager [None req-7cf8376c-00b0-4e30-a1aa-bade45b02d3f None None] Starting volume driver QuobyteDriver (1.2) Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] cache.password = **** {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] cache.proxies = [] {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] cache.redis_db = 0 {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] cache.redis_sentinel_service_name = mymaster {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] cache.redis_server = localhost:6379 {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] cache.retry_attempts = 2 {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] cache.retry_delay = 0.0 {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] cache.socket_keepalive_count = 1 {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] cache.socket_keepalive_idle = 1 {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] cache.socket_keepalive_interval = 1 {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] cache.socket_timeout = 1.0 {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] cache.tls_allowed_ciphers = None {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] cache.tls_cafile = None {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] cache.tls_certfile = None {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] cache.tls_enabled = False {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] cache.tls_keyfile = None {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] cache.username = None {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] coordination.backend_url = **** {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] database.asyncio_connection = **** {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] database.asyncio_slave_connection = **** {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] database.backend = sqlalchemy {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] database.connection = **** {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] database.connection_debug = 0 {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] database.connection_parameters = {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] database.connection_recycle_time = 3600 {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] database.connection_trace = False {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] database.db_inc_retry_interval = True {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] database.db_max_retries = 20 {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] database.db_max_retry_interval = 10 {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] database.db_retry_interval = 1 {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88430]: DEBUG cinder.volume.drivers.remotefs [None req-7cf8376c-00b0-4e30-a1aa-bade45b02d3f None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=88430) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] database.max_overflow = 50 {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] database.max_pool_size = 5 {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] database.max_retries = 10 {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] database.mysql_sql_mode = TRADITIONAL {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] database.mysql_wsrep_sync_wait = None {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] database.pool_timeout = None {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] database.retry_interval = 10 {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] database.slave_connection = **** {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] database.sqlite_synchronous = True {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] database.synchronous_reader = True {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] database.use_db_reconnect = False {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] oslo_messaging_metrics.metrics_process_name = {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] profiler.connection_string = messaging:// {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] profiler.enabled = False {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] profiler.es_doc_type = notification {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] profiler.es_scroll_size = 10000 {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] profiler.es_scroll_time = 2m {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] profiler.filter_error_trace = False {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] profiler.hmac_keys = **** {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] profiler.sentinel_service_name = mymaster {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] profiler.socket_timeout = 0.1 {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] profiler.trace_requests = False {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] profiler.trace_sqlalchemy = False {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] profiler_jaeger.process_tags = {} {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] profiler_jaeger.service_name_prefix = None {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] profiler_otlp.service_name_prefix = None {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] oslo_policy.enforce_new_defaults = True {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] oslo_policy.policy_default_rule = default {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] oslo_policy.policy_file = policy.yaml {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] oslo_policy.remote_timeout = 60.0 {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] privsep_osbrick.capabilities = [21, 2] {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] privsep_osbrick.group = None {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] privsep_osbrick.helper_command = None {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] privsep_osbrick.log_daemon_traceback = False {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] privsep_osbrick.thread_pool_size = 4 {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] privsep_osbrick.user = None {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] cinder_sys_admin.group = None {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] cinder_sys_admin.helper_command = None {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] cinder_sys_admin.user = None {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] service_user.auth_section = None {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] service_user.auth_type = password {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] service_user.cafile = None {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] service_user.certfile = None {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] service_user.collect_timing = False {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] service_user.insecure = False {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] service_user.keyfile = None {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] service_user.send_service_user_token = True {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] service_user.split_loggers = False {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] service_user.timeout = None {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] glance.auth_section = None {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] glance.auth_type = password {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] glance.certfile = None {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] glance.collect_timing = False {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] glance.insecure = False {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] glance.keyfile = None {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] glance.region_name = None {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] glance.split_loggers = False {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] glance.timeout = None {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] backend_defaults.backend_availability_zone = None {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] backend_defaults.chap_password = **** {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] backend_defaults.chap_username = {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] backend_defaults.disk_geometry = None {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] backend_defaults.driver_client_cert = None {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] backend_defaults.driver_client_cert_key = None {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] backend_defaults.driver_data_namespace = None {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] backend_defaults.driver_ssl_cert_path = None {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] backend_defaults.driver_use_ssl = False {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] backend_defaults.enable_unsupported_driver = False {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] backend_defaults.extra_capabilities = {} {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] backend_defaults.filter_function = None {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] backend_defaults.goodness_function = None {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] backend_defaults.image_volume_cache_enabled = False {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] backend_defaults.iscsi_target_flags = {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] backend_defaults.iscsi_write_cache = on {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] backend_defaults.iser_helper = tgtadm {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] backend_defaults.iser_ip_address = 192.168.122.21 {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] backend_defaults.iser_port = 3260 {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] backend_defaults.nas_host = {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] backend_defaults.nas_login = admin {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] backend_defaults.nas_mount_options = None {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] backend_defaults.nas_password = **** {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] backend_defaults.nas_private_key = {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] backend_defaults.nas_secure_file_operations = auto {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] backend_defaults.nas_share_path = {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] backend_defaults.nas_ssh_port = 22 {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] backend_defaults.nas_volume_prov_type = thin {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] backend_defaults.num_shell_tries = 3 {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] backend_defaults.nvmet_ns_id = 10 {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] backend_defaults.nvmet_port_id = 1 {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] backend_defaults.quobyte_client_cfg = None {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] backend_defaults.quobyte_volume_url = None {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] backend_defaults.replication_device = **** {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] backend_defaults.report_discard_supported = False {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] backend_defaults.reserved_percentage = 0 {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] backend_defaults.scst_target_driver = iscsi {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] backend_defaults.scst_target_iqn_name = None {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] backend_defaults.storage_protocol = iSCSI {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] backend_defaults.target_helper = tgtadm {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] backend_defaults.target_ip_address = 192.168.122.21 {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] backend_defaults.target_port = 3260 {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] backend_defaults.target_protocol = iscsi {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] backend_defaults.trace_flags = None {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] backend_defaults.unique_fqdn_network = True {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] backend_defaults.use_chap_auth = False {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] backend_defaults.volume_backend_name = None {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] backend_defaults.volume_clear = zero {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] backend_defaults.volume_clear_ionice = None {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] backend_defaults.volume_clear_size = 0 {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] oslo_reports.file_event_handler = None {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] oslo_reports.file_event_handler_interval = 1 {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] oslo_reports.log_dir = None {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] QuobyteHD.backend_availability_zone = None {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] QuobyteHD.backend_host = None {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] QuobyteHD.chap_password = **** {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] QuobyteHD.chap_username = None {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] QuobyteHD.chiscsi_conf = None {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] QuobyteHD.disk_geometry = None {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] QuobyteHD.driver_client_cert = None {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] QuobyteHD.driver_client_cert_key = None {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] QuobyteHD.driver_data_namespace = None {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] QuobyteHD.driver_use_ssl = None {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] QuobyteHD.enable_unsupported_driver = True {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] QuobyteHD.extra_capabilities = None {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] QuobyteHD.filter_function = None {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] QuobyteHD.goodness_function = None {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] QuobyteHD.iscsi_target_flags = None {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] QuobyteHD.iscsi_write_cache = None {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] QuobyteHD.iser_helper = None {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] QuobyteHD.iser_ip_address = None {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] QuobyteHD.iser_port = None {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] QuobyteHD.iser_target_prefix = None {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] QuobyteHD.nas_host = None {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] QuobyteHD.nas_login = None {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] QuobyteHD.nas_mount_options = None {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] QuobyteHD.nas_password = **** {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] QuobyteHD.nas_private_key = None {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] QuobyteHD.nas_secure_file_operations = false {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] QuobyteHD.nas_share_path = None {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] QuobyteHD.nas_ssh_port = None {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] QuobyteHD.nas_volume_prov_type = None {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] QuobyteHD.num_iser_scan_tries = None {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] QuobyteHD.num_shell_tries = None {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] QuobyteHD.nvmet_ns_id = None {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] QuobyteHD.nvmet_port_id = None {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] QuobyteHD.replication_device = **** {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] QuobyteHD.report_discard_supported = None {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] QuobyteHD.reserved_percentage = None {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] QuobyteHD.scst_target_driver = None {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] QuobyteHD.scst_target_iqn_name = None {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] QuobyteHD.storage_protocol = None {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] QuobyteHD.target_helper = None {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] QuobyteHD.target_ip_address = None {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] QuobyteHD.target_port = None {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] QuobyteHD.target_prefix = None {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] QuobyteHD.target_protocol = None {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] QuobyteHD.trace_flags = None {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] QuobyteHD.unique_fqdn_network = None {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] QuobyteHD.use_chap_auth = None {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] QuobyteHD.volume_clear = None {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] QuobyteHD.volume_clear_ionice = None {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] QuobyteHD.volume_clear_size = None {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] QuobyteHD.volume_dd_blocksize = None {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] QuobyteHD.volumes_dir = None {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88430]: DEBUG cinder.volume.drivers.quobyte [None req-7cf8376c-00b0-4e30-a1aa-bade45b02d3f None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=88430) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:307}} Jul 31 12:13:04 devstack cinder-volume[88430]: WARNING cinder.volume.drivers.quobyte [None req-7cf8376c-00b0-4e30-a1aa-bade45b02d3f None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jul 31 12:13:04 devstack cinder-volume[88430]: WARNING cinder.volume.drivers.quobyte [None req-7cf8376c-00b0-4e30-a1aa-bade45b02d3f None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88430]: DEBUG oslo_concurrency.processutils [None req-7cf8376c-00b0-4e30-a1aa-bade45b02d3f None None] Running cmd (subprocess): mount.quobyte {{(pid=88430) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] oslo_messaging_rabbit.hostname = devstack {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] oslo_messaging_rabbit.ssl = False {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] oslo_messaging_rabbit.ssl_version = {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] oslo_messaging_notifications.driver = [] {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] oslo_messaging_notifications.retry = -1 {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] oslo_messaging_notifications.transport_url = **** {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] key_manager.fixed_key = **** {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] barbican.barbican_api_version = None {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] barbican.barbican_endpoint = None {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] barbican.barbican_endpoint_type = public {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] barbican.barbican_region_name = None {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] barbican.cafile = None {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] barbican.certfile = None {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] barbican.collect_timing = False {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] barbican.insecure = False {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] barbican.keyfile = None {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] barbican.number_of_retries = 60 {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] barbican.retry_delay = 1 {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] barbican.send_service_user_token = False {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] barbican.split_loggers = False {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] barbican.timeout = None {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] barbican.verify_ssl = True {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] barbican.verify_ssl_path = None {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] barbican_service_user.auth_section = None {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] barbican_service_user.auth_type = None {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] barbican_service_user.cafile = None {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] barbican_service_user.certfile = None {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] barbican_service_user.collect_timing = False {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] barbican_service_user.insecure = False {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] barbican_service_user.keyfile = None {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] barbican_service_user.split_loggers = False {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] barbican_service_user.timeout = None {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] vault.approle_role_id = **** {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] vault.approle_secret_id = **** {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] vault.auth_method = approle {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] vault.auth_path = None {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] vault.kv_mountpoint = secret {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] vault.kv_path = None {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] vault.kv_version = 2 {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] vault.namespace = None {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] vault.root_token_id = **** {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] vault.ssl_ca_crt_file = None {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] vault.timeout = 60.0 {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] vault.token_file = None {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] vault.token_role = None {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] vault.use_ssl = False {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:04 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] ******************************************************************************** {{(pid=88208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 31 12:13:04 devstack quobyte-client[88435]: Reading configuration file: /etc/quobyte/client.cfg Jul 31 12:13:04 devstack quobyte-client[88435]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Jul 31 12:13:04 devstack cinder-volume[88430]: DEBUG oslo_concurrency.processutils [None req-7cf8376c-00b0-4e30-a1aa-bade45b02d3f None None] CMD "mount.quobyte" returned: 1 in 0.075s {{(pid=88430) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:13:04 devstack cinder-volume[88430]: DEBUG oslo_concurrency.lockutils [None req-7cf8376c-00b0-4e30-a1aa-bade45b02d3f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88430) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:13:04 devstack cinder-volume[88430]: DEBUG oslo_concurrency.lockutils [None req-7cf8376c-00b0-4e30-a1aa-bade45b02d3f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88430) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:13:04 devstack cinder-volume[88430]: DEBUG cinder.volume.drivers.quobyte [None req-7cf8376c-00b0-4e30-a1aa-bade45b02d3f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=88430) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:13:04 devstack cinder-volume[88430]: INFO cinder.volume.drivers.quobyte [None req-7cf8376c-00b0-4e30-a1aa-bade45b02d3f None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 ... Jul 31 12:13:04 devstack cinder-volume[88430]: DEBUG oslo_concurrency.processutils [None req-7cf8376c-00b0-4e30-a1aa-bade45b02d3f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 -c /etc/quobyte/client-cinder.cfg {{(pid=88430) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:13:04 devstack sudo[88436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 -c /etc/quobyte/client-cinder.cfg Jul 31 12:13:04 devstack sudo[88436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:13:05 devstack sudo[88436]: pam_unix(sudo:session): session closed for user root Jul 31 12:13:05 devstack cinder-volume[88430]: DEBUG oslo_concurrency.processutils [None req-7cf8376c-00b0-4e30-a1aa-bade45b02d3f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.389s {{(pid=88430) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:13:05 devstack cinder-volume[88430]: INFO cinder.volume.drivers.quobyte [None req-7cf8376c-00b0-4e30-a1aa-bade45b02d3f None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 succeeded Jul 31 12:13:05 devstack cinder-volume[88430]: DEBUG cinder.volume.drivers.quobyte [None req-7cf8376c-00b0-4e30-a1aa-bade45b02d3f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=88430) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:13:05 devstack cinder-volume[88430]: DEBUG oslo_concurrency.lockutils [None req-7cf8376c-00b0-4e30-a1aa-bade45b02d3f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.402s {{(pid=88430) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:13:05 devstack cinder-volume[88430]: DEBUG oslo_concurrency.processutils [None req-7cf8376c-00b0-4e30-a1aa-bade45b02d3f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 {{(pid=88430) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:13:05 devstack sudo[88505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 Jul 31 12:13:05 devstack sudo[88505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:13:05 devstack sudo[88505]: pam_unix(sudo:session): session closed for user root Jul 31 12:13:05 devstack cinder-volume[88430]: DEBUG oslo_concurrency.processutils [None req-7cf8376c-00b0-4e30-a1aa-bade45b02d3f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2" returned: 0 in 0.318s {{(pid=88430) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:13:05 devstack cinder-volume[88430]: INFO cinder.volume.driver [None req-7cf8376c-00b0-4e30-a1aa-bade45b02d3f None None] Driver hasn't implemented _init_vendor_properties() Jul 31 12:13:05 devstack cinder-volume[88430]: DEBUG cinder.volume.driver [None req-7cf8376c-00b0-4e30-a1aa-bade45b02d3f None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.637077331543, 'free_capacity_gb': 1775.637077331543, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=88430) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 31 12:13:05 devstack cinder-volume[88430]: DEBUG oslo_db.sqlalchemy.engines [None req-7cf8376c-00b0-4e30-a1aa-bade45b02d3f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88430) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 31 12:13:05 devstack cinder-volume[88430]: DEBUG dbcounter [-] [88430] Writer thread running {{(pid=88430) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 31 12:13:05 devstack cinder-volume[88430]: DEBUG cinder.db.api [None req-7cf8376c-00b0-4e30-a1aa-bade45b02d3f None None] Building query based on filter {{(pid=88430) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 31 12:13:05 devstack cinder-volume[88430]: DEBUG cinder.image.image_utils [None req-7cf8376c-00b0-4e30-a1aa-bade45b02d3f None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=88430) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 31 12:13:05 devstack cinder-volume[88430]: INFO cinder.keymgr.migration [None req-2bce892f-b35b-4940-8ed1-144c8d7bc716 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 31 12:13:05 devstack cinder-volume[88430]: DEBUG oslo_concurrency.lockutils [None req-7cf8376c-00b0-4e30-a1aa-bade45b02d3f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88430) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:13:05 devstack cinder-volume[88430]: DEBUG oslo_concurrency.lockutils [None req-7cf8376c-00b0-4e30-a1aa-bade45b02d3f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88430) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:13:05 devstack cinder-volume[88430]: DEBUG cinder.volume.drivers.quobyte [None req-7cf8376c-00b0-4e30-a1aa-bade45b02d3f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=88430) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:13:05 devstack cinder-volume[88430]: DEBUG cinder.volume.drivers.quobyte [None req-7cf8376c-00b0-4e30-a1aa-bade45b02d3f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=88430) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:13:05 devstack cinder-volume[88430]: DEBUG oslo_concurrency.lockutils [None req-7cf8376c-00b0-4e30-a1aa-bade45b02d3f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88430) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:13:05 devstack cinder-volume[88430]: DEBUG oslo_concurrency.processutils [None req-7cf8376c-00b0-4e30-a1aa-bade45b02d3f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 {{(pid=88430) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:13:05 devstack sudo[88509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 Jul 31 12:13:05 devstack sudo[88509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:13:05 devstack sudo[88509]: pam_unix(sudo:session): session closed for user root Jul 31 12:13:05 devstack cinder-volume[88430]: DEBUG oslo_concurrency.processutils [None req-7cf8376c-00b0-4e30-a1aa-bade45b02d3f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2" returned: 0 in 0.275s {{(pid=88430) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:13:05 devstack cinder-volume[88430]: DEBUG cinder.manager [None req-7cf8376c-00b0-4e30-a1aa-bade45b02d3f None None] Notifying Schedulers of capabilities ... {{(pid=88430) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 12:13:05 devstack cinder-volume[88430]: INFO cinder.volume.manager [None req-7cf8376c-00b0-4e30-a1aa-bade45b02d3f None None] Driver initialization completed successfully. Jul 31 12:13:05 devstack cinder-volume[88430]: INFO cinder.manager [None req-7cf8376c-00b0-4e30-a1aa-bade45b02d3f None None] Initiating service 3 cleanup Jul 31 12:13:05 devstack cinder-volume[88430]: INFO cinder.manager [None req-7cf8376c-00b0-4e30-a1aa-bade45b02d3f None None] Service 3 cleanup completed. Jul 31 12:13:05 devstack cinder-volume[88430]: DEBUG cinder.service [None req-7cf8376c-00b0-4e30-a1aa-bade45b02d3f None None] Creating RPC server for service cinder-volume {{(pid=88430) start /opt/stack/cinder/cinder/service.py:231}} Jul 31 12:13:05 devstack cinder-volume[88430]: DEBUG cinder.service [None req-7cf8376c-00b0-4e30-a1aa-bade45b02d3f None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=88430) start /opt/stack/cinder/cinder/service.py:237}} Jul 31 12:13:05 devstack cinder-volume[88430]: INFO cinder.volume.manager [None req-7cf8376c-00b0-4e30-a1aa-bade45b02d3f None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2) Jul 31 12:13:05 devstack cinder-volume[88430]: DEBUG oslo_concurrency.lockutils [None req-7cf8376c-00b0-4e30-a1aa-bade45b02d3f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88430) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:13:05 devstack cinder-volume[88430]: DEBUG oslo_concurrency.lockutils [None req-7cf8376c-00b0-4e30-a1aa-bade45b02d3f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88430) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:13:05 devstack cinder-volume[88430]: DEBUG cinder.volume.drivers.quobyte [None req-7cf8376c-00b0-4e30-a1aa-bade45b02d3f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=88430) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:13:05 devstack cinder-volume[88430]: DEBUG cinder.volume.drivers.quobyte [None req-7cf8376c-00b0-4e30-a1aa-bade45b02d3f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=88430) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:13:05 devstack cinder-volume[88430]: DEBUG oslo_concurrency.lockutils [None req-7cf8376c-00b0-4e30-a1aa-bade45b02d3f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88430) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:13:05 devstack cinder-volume[88430]: DEBUG oslo_concurrency.processutils [None req-7cf8376c-00b0-4e30-a1aa-bade45b02d3f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 {{(pid=88430) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:13:06 devstack sudo[88521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 Jul 31 12:13:06 devstack sudo[88521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:13:06 devstack sudo[88521]: pam_unix(sudo:session): session closed for user root Jul 31 12:13:06 devstack cinder-volume[88430]: DEBUG oslo_concurrency.processutils [None req-7cf8376c-00b0-4e30-a1aa-bade45b02d3f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2" returned: 0 in 0.343s {{(pid=88430) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:13:06 devstack cinder-volume[88430]: INFO cinder.volume.manager [None req-7cf8376c-00b0-4e30-a1aa-bade45b02d3f None None] Driver post RPC initialization completed successfully. Jul 31 12:13:10 devstack cinder-volume[88430]: DEBUG oslo_concurrency.lockutils [None req-1f0875d8-5c76-4437-88b2-357294a1b1e1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88430) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:13:10 devstack cinder-volume[88430]: DEBUG oslo_concurrency.lockutils [None req-1f0875d8-5c76-4437-88b2-357294a1b1e1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88430) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:13:10 devstack cinder-volume[88430]: DEBUG cinder.volume.drivers.quobyte [None req-1f0875d8-5c76-4437-88b2-357294a1b1e1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=88430) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:13:10 devstack cinder-volume[88430]: DEBUG cinder.volume.drivers.quobyte [None req-1f0875d8-5c76-4437-88b2-357294a1b1e1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=88430) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:13:10 devstack cinder-volume[88430]: DEBUG oslo_concurrency.lockutils [None req-1f0875d8-5c76-4437-88b2-357294a1b1e1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88430) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:13:10 devstack cinder-volume[88430]: DEBUG oslo_concurrency.processutils [None req-1f0875d8-5c76-4437-88b2-357294a1b1e1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 {{(pid=88430) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:13:10 devstack sudo[88688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 Jul 31 12:13:10 devstack sudo[88688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:13:10 devstack sudo[88688]: pam_unix(sudo:session): session closed for user root Jul 31 12:13:10 devstack cinder-volume[88430]: DEBUG oslo_concurrency.processutils [None req-1f0875d8-5c76-4437-88b2-357294a1b1e1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2" returned: 0 in 0.243s {{(pid=88430) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:13:10 devstack cinder-volume[88430]: DEBUG cinder.manager [None req-1f0875d8-5c76-4437-88b2-357294a1b1e1 None None] Notifying Schedulers of capabilities ... {{(pid=88430) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 12:13:12 devstack cinder-volume[88430]: DEBUG oslo_service.periodic_task [None req-4cc34018-eaca-498a-ab15-ed7dd9fcedc0 None None] Running periodic task VolumeManager._thread_info {{(pid=88430) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 31 12:13:12 devstack cinder-volume[88430]: DEBUG cinder.volume.manager [None req-4cc34018-eaca-498a-ab15-ed7dd9fcedc0 None None] thread count: 6 {{(pid=88430) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 31 12:13:12 devstack cinder-volume[88430]: DEBUG cinder.volume.manager [None req-4cc34018-eaca-498a-ab15-ed7dd9fcedc0 None None] thread info: [<_MainThread(MainThread, started 131084037410944)>, , , , , ] {{(pid=88430) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 31 12:13:12 devstack cinder-volume[88208]: INFO oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] Caught SIGTERM, stopping children Jul 31 12:13:12 devstack cinder-volume[88208]: DEBUG oslo_concurrency.lockutils [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] Acquiring lock "singleton_lock" {{(pid=88208) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 31 12:13:12 devstack cinder-volume[88208]: DEBUG oslo_concurrency.lockutils [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] Acquired lock "singleton_lock" {{(pid=88208) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 31 12:13:12 devstack cinder-volume[88208]: DEBUG oslo_concurrency.lockutils [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] Releasing lock "singleton_lock" {{(pid=88208) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 31 12:13:12 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] Stop services. {{(pid=88208) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jul 31 12:13:12 devstack cinder-volume[88208]: DEBUG oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] Killing children. {{(pid=88208) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jul 31 12:13:12 devstack cinder-volume[88208]: INFO oslo_service.backend._eventlet.service [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] Waiting on 1 children to exit Jul 31 12:13:15 devstack cinder-volume[88430]: DEBUG dbcounter [-] [88430] Writing DB stats cinder:SELECT=4 {{(pid=88430) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 12:13:16 devstack cinder-volume[88430]: DEBUG dbcounter [-] [88430] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=3 {{(pid=88430) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 12:13:17 devstack cinder-volume[88430]: INFO oslo_service.backend._eventlet.service [-] Parent process has died unexpectedly, exiting Jul 31 12:13:17 devstack cinder-volume[88898]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 31 12:13:17 devstack cinder-volume[88898]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 31 12:13:17 devstack cinder-volume[88898]: we strongly recommend against using it for new projects. Jul 31 12:13:17 devstack cinder-volume[88898]: If you are already using Eventlet, we recommend migrating to a different Jul 31 12:13:17 devstack cinder-volume[88898]: framework. For more detail see Jul 31 12:13:17 devstack cinder-volume[88898]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 31 12:13:17 devstack cinder-volume[88898]: import eventlet # noqa Jul 31 12:13:19 devstack cinder-volume[88430]: DEBUG oslo_concurrency.lockutils [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] Acquiring lock "singleton_lock" {{(pid=88430) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 31 12:13:19 devstack cinder-volume[88430]: DEBUG oslo_concurrency.lockutils [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] Acquired lock "singleton_lock" {{(pid=88430) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 31 12:13:19 devstack cinder-volume[88430]: DEBUG oslo_concurrency.lockutils [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] Releasing lock "singleton_lock" {{(pid=88430) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 31 12:13:19 devstack cinder-volume[88430]: WARNING amqp [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 31 12:13:19 devstack cinder-volume[88430]: WARNING amqp [None req-ddf8aa2b-f0cc-4491-88f3-3de45e4463af None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 31 12:13:20 devstack cinder-volume[88898]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=88898) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 31 12:13:20 devstack cinder-volume[88898]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=88898) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 31 12:13:20 devstack cinder-volume[88898]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=88898) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 31 12:13:21 devstack cinder-volume[88898]: INFO dbcounter [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] Registered counter for database cinder Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_db.sqlalchemy.engines [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88898) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG dbcounter [-] [88898] Writer thread running {{(pid=88898) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 31 12:13:21 devstack cinder-volume[88898]: INFO cinder.rpc [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 31 12:13:21 devstack cinder-volume[88898]: INFO cinder.rpc [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_db.sqlalchemy.engines [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88898) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 31 12:13:21 devstack cinder-volume[88898]: INFO cinder.volume.manager [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] Determined volume DB was empty at startup. Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG cinder.volume.manager [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=88898) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 31 12:13:21 devstack cinder-volume[88898]: WARNING stevedore.named [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 31 12:13:21 devstack cinder-volume[88898]: WARNING castellan.key_manager [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 31 12:13:21 devstack cinder-volume[88898]: WARNING cinder.keymgr.conf_key_mgr [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 31 12:13:21 devstack cinder-volume[88898]: INFO cinder.volume.manager [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] Image-volume cache disabled for host devstack@QuobyteHD. Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_db.sqlalchemy.engines [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88898) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 31 12:13:21 devstack cinder-volume[88898]: INFO oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] Starting 1 workers Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] Started child 89182 {{(pid=88898) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] Full set of CONF: {{(pid=88898) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] ******************************************************************************** {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] Configuration options gathered from: {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] ================================================================================ {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] allow_availability_zone_fallback = False {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] allow_compression_on_image_upload = False {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] allowed_direct_url_schemes = [] {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] api_rate_limit = True {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] auth_strategy = keystone {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:21 devstack cinder-volume[89182]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] backend_availability_zone = None {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] backend_host = None {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] backend_name = None {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] backend_stats_polling_interval = 60 {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] backup_api_class = cinder.backup.api.API {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] backup_name_template = backup-%s {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] backup_use_same_host = False {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] backup_use_temp_snapshot = False {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] chap_password = **** {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] chap_username = {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] cinder_internal_tenant_project_id = b7fc95d8943f43808027333fd407c6ae {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] cinder_internal_tenant_user_id = 8dcfb6efe704434190b65e548d703884 {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] cluster = None {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] compression_format = gzip {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] compute_api_class = cinder.compute.nova.API {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] config_dir = [] {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] config_source = [] {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] control_exchange = openstack {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] debug = True {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] default_availability_zone = None {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] default_group_type = None {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] default_volume_type = QuobyteHD {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] disk_geometry = None {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] driver_client_cert = None {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] driver_client_cert_key = None {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] driver_data_namespace = None {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] driver_ssl_cert_path = None {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] driver_ssl_cert_verify = False {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] driver_use_ssl = False {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] enable_new_services = True {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] enable_unsupported_driver = False {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] enabled_backends = ['QuobyteHD'] {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] enforce_multipath_for_image_xfer = False {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] filter_function = None {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] glance_api_insecure = False {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] glance_api_servers = ['http://192.168.122.21/image'] {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] glance_api_ssl_compression = False {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] glance_ca_certificates_file = None {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] glance_catalog_info = image:glance:publicURL {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] glance_certfile = None {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] glance_keyfile = None {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] glance_num_retries = 3 {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] glance_request_timeout = None {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] goodness_function = None {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] graceful_shutdown_timeout = 5 {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] group_api_class = cinder.group.api.API {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] host = devstack {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] image_compress_on_upload = True {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] image_conversion_address_space_limit = 1 {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] image_conversion_cpu_limit = 60 {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] image_conversion_disable = False {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] image_upload_use_cinder_backend = False {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] image_upload_use_internal_tenant = False {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] image_volume_cache_enabled = False {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] image_volume_cache_max_count = 0 {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] image_volume_cache_max_size_gb = 0 {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] init_host_max_objects_retrieval = 0 {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] instance_format = [instance: %(uuid)s] {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] iscsi_target_flags = {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] iscsi_write_cache = on {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] iser_helper = tgtadm {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] iser_ip_address = 192.168.122.21 {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] iser_port = 3260 {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] log_color = False {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] log_config_append = None {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] log_dir = None {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] log_file = None {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] log_options = True {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] log_rotate_interval = 1 {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] log_rotate_interval_type = days {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] log_rotation_type = none {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] max_age = 0 {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] max_logfile_count = 30 {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] max_logfile_size_mb = 200 {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] max_over_subscription_ratio = 20.0 {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] message_reap_interval = 86400 {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] message_ttl = 2592000 {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] migration_create_volume_timeout_secs = 300 {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] monkey_patch = False {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] monkey_patch_modules = [] {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] my_ip = 192.168.122.21 {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] no_snapshot_gb_quota = False {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] num_iser_scan_tries = 3 {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] num_shell_tries = 3 {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] num_volume_device_scan_tries = 3 {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] nvmeof_conn_info_version = 1 {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] nvmet_ns_id = 10 {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] nvmet_port_id = 1 {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] osapi_max_limit = 1000 {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] osapi_volume_ext_list = [] {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] osapi_volume_listen = 0.0.0.0 {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] osapi_volume_listen_port = 8776 {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] osapi_volume_use_ssl = False {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] osapi_volume_workers = None {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] per_volume_size_limit = -1 {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] periodic_fuzzy_delay = 60 {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] periodic_interval = 60 {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] project_id_regex = [0-9a-f\-]+ {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] public_endpoint = None {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] publish_errors = False {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] quota_backup_gigabytes = 1000 {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] quota_backups = 10 {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] quota_gigabytes = 1000 {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] quota_groups = 10 {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] quota_snapshots = 10 {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] quota_volumes = 10 {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] rate_limit_burst = 0 {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] rate_limit_except_level = CRITICAL {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] rate_limit_interval = 0 {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] reinit_driver_count = 3 {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] replication_device = **** {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] report_discard_supported = False {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] report_interval = 120 {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] reservation_clean_interval = 86400 {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] reservation_expire = 86400 {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] reserved_image_namespaces = [] {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] reserved_percentage = 0 {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:21 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-46acbc8c-4c21-4a95-a2ca-3b0143a75e00 None None] Starting volume driver QuobyteDriver (1.2) Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] rpc_response_timeout = 120 {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:21 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-46acbc8c-4c21-4a95-a2ca-3b0143a75e00 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=89182) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] run_external_periodic_tasks = True {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] scst_target_driver = iscsi {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] scst_target_iqn_name = None {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] service_down_time = 720 {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] shell_completion = None {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] snapshot_name_template = snapshot-%s {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] split_loggers = False {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] state_path = /opt/stack/data/cinder {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] storage_availability_zone = nova {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] storage_protocol = iSCSI {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] syslog_log_facility = LOG_USER {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] target_helper = lioadm {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] target_ip_address = 192.168.122.21 {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] target_port = 3260 {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] target_protocol = iscsi {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] target_secondary_ip_addresses = [] {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] trace_flags = None {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] transfer_api_class = cinder.transfer.api.API {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] transport_url = **** {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] until_refresh = 0 {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] use_chap_auth = False {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] use_default_quota_class = True {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] use_journal = False {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] use_json = False {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] use_multipath_for_image_xfer = False {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] use_stderr = False {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] use_syslog = False {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] verify_glance_signatures = enabled {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] volume_api_class = cinder.volume.api.API {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] volume_backend_name = None {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] volume_clear = zero {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] volume_clear_ionice = None {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] volume_clear_size = 0 {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] volume_copy_bps_limit = 0 {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] volume_dd_blocksize = 1M {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] volume_name_template = volume-%s {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] volume_service_inithost_offload = False {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] volume_usage_audit_period = month {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] zoning_mode = None {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] oslo_concurrency.disable_process_locking = False {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] keystone_authtoken.auth_section = None {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] keystone_authtoken.auth_type = password {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] keystone_authtoken.auth_version = None {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] keystone_authtoken.cache = None {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] keystone_authtoken.certfile = None {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] keystone_authtoken.delay_auth_decision = False {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] keystone_authtoken.http_connect_timeout = None {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] keystone_authtoken.include_service_catalog = True {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] keystone_authtoken.insecure = False {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] keystone_authtoken.interface = public {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] keystone_authtoken.keyfile = None {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] keystone_authtoken.memcache_password = {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] keystone_authtoken.memcache_username = {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] keystone_authtoken.region_name = None {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] keystone_authtoken.service_token_roles_required = True {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] keystone_authtoken.service_type = None {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] keystone_authtoken.token_cache_time = 300 {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.21/identity {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] cache.backend = dogpile.cache.null {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] cache.backend_argument = **** {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] cache.backend_expiration_time = None {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] cache.config_prefix = cache.oslo {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] cache.debug_cache_backend = False {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] cache.enable_retry_client = False {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] cache.enable_socket_keepalive = False {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] cache.enabled = False {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] cache.expiration_time = 600 {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] cache.hashclient_retry_attempts = 2 {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] cache.memcache_dead_retry = 300 {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] cache.memcache_pool_maxsize = 10 {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] cache.memcache_sasl_enabled = False {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] cache.password = **** {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] cache.proxies = [] {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] cache.redis_db = 0 {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] cache.redis_sentinel_service_name = mymaster {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] cache.redis_server = localhost:6379 {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] cache.retry_attempts = 2 {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] cache.retry_delay = 0.0 {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] cache.socket_keepalive_count = 1 {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] cache.socket_keepalive_idle = 1 {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] cache.socket_keepalive_interval = 1 {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] cache.socket_timeout = 1.0 {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] cache.tls_allowed_ciphers = None {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] cache.tls_cafile = None {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] cache.tls_certfile = None {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] cache.tls_enabled = False {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] cache.tls_keyfile = None {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] cache.username = None {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] coordination.backend_url = **** {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] database.asyncio_connection = **** {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] database.asyncio_slave_connection = **** {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] database.backend = sqlalchemy {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] database.connection = **** {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] database.connection_debug = 0 {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] database.connection_parameters = {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] database.connection_recycle_time = 3600 {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] database.connection_trace = False {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] database.db_inc_retry_interval = True {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] database.db_max_retries = 20 {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] database.db_max_retry_interval = 10 {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] database.db_retry_interval = 1 {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] database.max_overflow = 50 {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] database.max_pool_size = 5 {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] database.max_retries = 10 {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] database.mysql_wsrep_sync_wait = None {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] database.pool_timeout = None {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] database.retry_interval = 10 {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] database.slave_connection = **** {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] database.sqlite_synchronous = True {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] database.synchronous_reader = True {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] database.use_db_reconnect = False {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] profiler.connection_string = messaging:// {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] profiler.enabled = False {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] profiler.es_doc_type = notification {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] profiler.es_scroll_size = 10000 {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] profiler.es_scroll_time = 2m {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] profiler.filter_error_trace = False {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] profiler.hmac_keys = **** {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] profiler.sentinel_service_name = mymaster {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] profiler.socket_timeout = 0.1 {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] profiler.trace_requests = False {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] profiler.trace_sqlalchemy = False {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] profiler_jaeger.process_tags = {} {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] profiler_jaeger.service_name_prefix = None {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] profiler_otlp.service_name_prefix = None {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] oslo_policy.enforce_new_defaults = True {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] oslo_policy.policy_default_rule = default {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] oslo_policy.policy_file = policy.yaml {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] oslo_policy.remote_timeout = 60.0 {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] privsep_osbrick.group = None {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] privsep_osbrick.helper_command = None {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] privsep_osbrick.user = None {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] cinder_sys_admin.group = None {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] cinder_sys_admin.helper_command = None {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] cinder_sys_admin.user = None {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] service_user.auth_section = None {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] service_user.auth_type = password {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] service_user.cafile = None {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] service_user.certfile = None {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] service_user.collect_timing = False {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] service_user.insecure = False {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] service_user.keyfile = None {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-46acbc8c-4c21-4a95-a2ca-3b0143a75e00 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=89182) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:307}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] service_user.send_service_user_token = True {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[89182]: WARNING cinder.volume.drivers.quobyte [None req-46acbc8c-4c21-4a95-a2ca-3b0143a75e00 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] service_user.split_loggers = False {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[89182]: WARNING cinder.volume.drivers.quobyte [None req-46acbc8c-4c21-4a95-a2ca-3b0143a75e00 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] service_user.timeout = None {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] glance.auth_section = None {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] glance.auth_type = password {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-46acbc8c-4c21-4a95-a2ca-3b0143a75e00 None None] Running cmd (subprocess): mount.quobyte {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] glance.certfile = None {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] glance.collect_timing = False {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] glance.insecure = False {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] glance.keyfile = None {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] glance.region_name = None {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] glance.split_loggers = False {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] glance.timeout = None {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] backend_defaults.backend_availability_zone = None {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] backend_defaults.chap_password = **** {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] backend_defaults.chap_username = {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] backend_defaults.disk_geometry = None {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] backend_defaults.driver_client_cert = None {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] backend_defaults.driver_client_cert_key = None {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] backend_defaults.driver_data_namespace = None {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] backend_defaults.driver_use_ssl = False {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] backend_defaults.enable_unsupported_driver = False {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] backend_defaults.extra_capabilities = {} {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] backend_defaults.filter_function = None {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] backend_defaults.goodness_function = None {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] backend_defaults.iscsi_target_flags = {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] backend_defaults.iscsi_write_cache = on {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] backend_defaults.iser_helper = tgtadm {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] backend_defaults.iser_ip_address = 192.168.122.21 {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] backend_defaults.iser_port = 3260 {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] backend_defaults.nas_host = {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] backend_defaults.nas_login = admin {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] backend_defaults.nas_mount_options = None {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] backend_defaults.nas_password = **** {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] backend_defaults.nas_private_key = {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] backend_defaults.nas_share_path = {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] backend_defaults.nas_ssh_port = 22 {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] backend_defaults.num_shell_tries = 3 {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] backend_defaults.nvmet_port_id = 1 {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] backend_defaults.quobyte_client_cfg = None {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] backend_defaults.quobyte_volume_url = None {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] backend_defaults.replication_device = **** {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] backend_defaults.report_discard_supported = False {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] backend_defaults.reserved_percentage = 0 {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] backend_defaults.scst_target_driver = iscsi {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] backend_defaults.scst_target_iqn_name = None {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] backend_defaults.storage_protocol = iSCSI {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] backend_defaults.target_helper = tgtadm {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] backend_defaults.target_ip_address = 192.168.122.21 {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] backend_defaults.target_port = 3260 {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] backend_defaults.target_protocol = iscsi {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] backend_defaults.trace_flags = None {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] backend_defaults.unique_fqdn_network = True {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] backend_defaults.use_chap_auth = False {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] backend_defaults.volume_backend_name = None {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] backend_defaults.volume_clear = zero {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] backend_defaults.volume_clear_ionice = None {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] backend_defaults.volume_clear_size = 0 {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] oslo_reports.file_event_handler = None {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] oslo_reports.log_dir = None {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] QuobyteHD.backend_availability_zone = None {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] QuobyteHD.backend_host = None {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] QuobyteHD.chap_password = **** {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] QuobyteHD.chap_username = None {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] QuobyteHD.chiscsi_conf = None {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] QuobyteHD.disk_geometry = None {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] QuobyteHD.driver_client_cert = None {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] QuobyteHD.driver_client_cert_key = None {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] QuobyteHD.driver_data_namespace = None {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] QuobyteHD.driver_use_ssl = None {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] QuobyteHD.extra_capabilities = None {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] QuobyteHD.filter_function = None {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] QuobyteHD.goodness_function = None {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] QuobyteHD.iscsi_target_flags = None {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] QuobyteHD.iscsi_write_cache = None {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] QuobyteHD.iser_helper = None {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] QuobyteHD.iser_ip_address = None {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] QuobyteHD.iser_port = None {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] QuobyteHD.iser_target_prefix = None {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] QuobyteHD.nas_host = None {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack quobyte-client[89183]: Reading configuration file: /etc/quobyte/client.cfg Jul 31 12:13:21 devstack quobyte-client[89183]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] QuobyteHD.nas_login = None {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] QuobyteHD.nas_mount_options = None {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] QuobyteHD.nas_password = **** {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] QuobyteHD.nas_private_key = None {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] QuobyteHD.nas_share_path = None {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-46acbc8c-4c21-4a95-a2ca-3b0143a75e00 None None] CMD "mount.quobyte" returned: 1 in 0.054s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] QuobyteHD.nas_ssh_port = None {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-46acbc8c-4c21-4a95-a2ca-3b0143a75e00 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-46acbc8c-4c21-4a95-a2ca-3b0143a75e00 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] QuobyteHD.num_shell_tries = None {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-46acbc8c-4c21-4a95-a2ca-3b0143a75e00 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] QuobyteHD.nvmet_ns_id = None {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] QuobyteHD.nvmet_port_id = None {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] QuobyteHD.replication_device = **** {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] QuobyteHD.report_discard_supported = None {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] QuobyteHD.reserved_percentage = None {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] QuobyteHD.scst_target_driver = None {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] QuobyteHD.storage_protocol = None {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] QuobyteHD.target_helper = None {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-46acbc8c-4c21-4a95-a2ca-3b0143a75e00 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] QuobyteHD.target_ip_address = None {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-46acbc8c-4c21-4a95-a2ca-3b0143a75e00 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] QuobyteHD.target_port = None {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] QuobyteHD.target_prefix = None {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-46acbc8c-4c21-4a95-a2ca-3b0143a75e00 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] QuobyteHD.target_protocol = None {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] QuobyteHD.trace_flags = None {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] QuobyteHD.unique_fqdn_network = None {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] QuobyteHD.use_chap_auth = None {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] QuobyteHD.volume_clear = None {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] QuobyteHD.volume_clear_ionice = None {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] QuobyteHD.volume_clear_size = None {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] QuobyteHD.volumes_dir = None {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] oslo_messaging_rabbit.ssl = False {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] oslo_messaging_rabbit.ssl_version = {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] oslo_messaging_notifications.driver = [] {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] oslo_messaging_notifications.retry = -1 {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] oslo_messaging_notifications.transport_url = **** {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] key_manager.fixed_key = **** {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] barbican.barbican_api_version = None {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] barbican.barbican_endpoint = None {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] barbican.barbican_endpoint_type = public {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] barbican.barbican_region_name = None {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] barbican.cafile = None {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] barbican.certfile = None {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] barbican.collect_timing = False {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] barbican.insecure = False {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] barbican.keyfile = None {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack sudo[89187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] barbican.number_of_retries = 60 {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] barbican.retry_delay = 1 {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] barbican.send_service_user_token = False {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack sudo[89187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] barbican.split_loggers = False {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] barbican.timeout = None {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] barbican.verify_ssl = True {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] barbican.verify_ssl_path = None {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] barbican_service_user.auth_section = None {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] barbican_service_user.auth_type = None {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] barbican_service_user.cafile = None {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] barbican_service_user.certfile = None {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] barbican_service_user.collect_timing = False {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] barbican_service_user.insecure = False {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] barbican_service_user.keyfile = None {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] barbican_service_user.split_loggers = False {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] barbican_service_user.timeout = None {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] vault.approle_role_id = **** {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] vault.approle_secret_id = **** {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] vault.auth_method = approle {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] vault.auth_path = None {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] vault.kv_mountpoint = secret {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] vault.kv_path = None {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] vault.kv_version = 2 {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] vault.namespace = None {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] vault.root_token_id = **** {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] vault.ssl_ca_crt_file = None {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] vault.timeout = 60.0 {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] vault.token_file = None {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] vault.token_role = None {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] vault.use_ssl = False {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 12:13:21 devstack cinder-volume[88898]: DEBUG oslo_service.backend._eventlet.service [None req-5b9d4ff7-21c5-41e8-a633-b11ad3890c82 None None] ******************************************************************************** {{(pid=88898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 31 12:13:22 devstack sudo[89187]: pam_unix(sudo:session): session closed for user root Jul 31 12:13:22 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-46acbc8c-4c21-4a95-a2ca-3b0143a75e00 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2" returned: 0 in 0.233s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:13:22 devstack cinder-volume[89182]: INFO cinder.volume.driver [None req-46acbc8c-4c21-4a95-a2ca-3b0143a75e00 None None] Driver hasn't implemented _init_vendor_properties() Jul 31 12:13:22 devstack cinder-volume[89182]: DEBUG cinder.volume.driver [None req-46acbc8c-4c21-4a95-a2ca-3b0143a75e00 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.637077331543, 'free_capacity_gb': 1775.637077331543, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=89182) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 31 12:13:22 devstack cinder-volume[89182]: DEBUG oslo_db.sqlalchemy.engines [None req-46acbc8c-4c21-4a95-a2ca-3b0143a75e00 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=89182) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 31 12:13:22 devstack cinder-volume[89182]: DEBUG dbcounter [-] [89182] Writer thread running {{(pid=89182) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 31 12:13:22 devstack cinder-volume[89182]: DEBUG cinder.db.api [None req-46acbc8c-4c21-4a95-a2ca-3b0143a75e00 None None] Building query based on filter {{(pid=89182) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 31 12:13:22 devstack cinder-volume[89182]: DEBUG cinder.image.image_utils [None req-46acbc8c-4c21-4a95-a2ca-3b0143a75e00 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=89182) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 31 12:13:22 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-46acbc8c-4c21-4a95-a2ca-3b0143a75e00 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:13:22 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-46acbc8c-4c21-4a95-a2ca-3b0143a75e00 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:13:22 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-46acbc8c-4c21-4a95-a2ca-3b0143a75e00 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:13:22 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-46acbc8c-4c21-4a95-a2ca-3b0143a75e00 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:13:22 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-46acbc8c-4c21-4a95-a2ca-3b0143a75e00 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:13:22 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-46acbc8c-4c21-4a95-a2ca-3b0143a75e00 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:13:22 devstack cinder-volume[89182]: INFO cinder.keymgr.migration [None req-4a43b07d-8e8f-41b2-8f75-e322929c0c9d None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 31 12:13:22 devstack sudo[89190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 Jul 31 12:13:22 devstack sudo[89190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:13:22 devstack sudo[89190]: pam_unix(sudo:session): session closed for user root Jul 31 12:13:22 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-46acbc8c-4c21-4a95-a2ca-3b0143a75e00 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2" returned: 0 in 0.228s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:13:22 devstack cinder-volume[89182]: DEBUG cinder.manager [None req-46acbc8c-4c21-4a95-a2ca-3b0143a75e00 None None] Notifying Schedulers of capabilities ... {{(pid=89182) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 12:13:22 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-46acbc8c-4c21-4a95-a2ca-3b0143a75e00 None None] Driver initialization completed successfully. Jul 31 12:13:22 devstack cinder-volume[89182]: INFO cinder.manager [None req-46acbc8c-4c21-4a95-a2ca-3b0143a75e00 None None] Initiating service 3 cleanup Jul 31 12:13:22 devstack cinder-volume[89182]: INFO cinder.manager [None req-46acbc8c-4c21-4a95-a2ca-3b0143a75e00 None None] Service 3 cleanup completed. Jul 31 12:13:22 devstack cinder-volume[89182]: DEBUG cinder.service [None req-46acbc8c-4c21-4a95-a2ca-3b0143a75e00 None None] Creating RPC server for service cinder-volume {{(pid=89182) start /opt/stack/cinder/cinder/service.py:231}} Jul 31 12:13:22 devstack cinder-volume[89182]: DEBUG cinder.service [None req-46acbc8c-4c21-4a95-a2ca-3b0143a75e00 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=89182) start /opt/stack/cinder/cinder/service.py:237}} Jul 31 12:13:22 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-46acbc8c-4c21-4a95-a2ca-3b0143a75e00 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2) Jul 31 12:13:22 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-46acbc8c-4c21-4a95-a2ca-3b0143a75e00 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:13:22 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-46acbc8c-4c21-4a95-a2ca-3b0143a75e00 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:13:22 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-46acbc8c-4c21-4a95-a2ca-3b0143a75e00 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:13:22 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-46acbc8c-4c21-4a95-a2ca-3b0143a75e00 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:13:22 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-46acbc8c-4c21-4a95-a2ca-3b0143a75e00 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:13:22 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-46acbc8c-4c21-4a95-a2ca-3b0143a75e00 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:13:22 devstack sudo[89193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 Jul 31 12:13:22 devstack sudo[89193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:13:22 devstack sudo[89193]: pam_unix(sudo:session): session closed for user root Jul 31 12:13:22 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-46acbc8c-4c21-4a95-a2ca-3b0143a75e00 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2" returned: 0 in 0.239s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:13:22 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-46acbc8c-4c21-4a95-a2ca-3b0143a75e00 None None] Driver post RPC initialization completed successfully. Jul 31 12:13:31 devstack cinder-volume[88898]: DEBUG dbcounter [-] [88898] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=88898) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 12:13:32 devstack cinder-volume[89182]: DEBUG dbcounter [-] [89182] Writing DB stats cinder:SELECT=4 {{(pid=89182) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 12:13:32 devstack cinder-volume[89182]: DEBUG dbcounter [-] [89182] Writing DB stats cinder:SELECT=6,cinder:UPDATE=1 {{(pid=89182) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 12:14:20 devstack cinder-volume[89182]: DEBUG cinder.volume.flows.manager.create_volume [None req-f5a82fad-2c97-4e1e-b4c0-90977e6385c9 tempest-TaggedAttachmentsTest-1522025151 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89182) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 12:14:20 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-f5a82fad-2c97-4e1e-b4c0-90977e6385c9 tempest-TaggedAttachmentsTest-1522025151 None] Flow 'volume_create_manager' (317eec7c-e044-49da-915a-01f167299ac4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:14:20 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-f5a82fad-2c97-4e1e-b4c0-90977e6385c9 tempest-TaggedAttachmentsTest-1522025151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3b08d8c-da10-4950-af57-df2d03df979d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:14:20 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-f5a82fad-2c97-4e1e-b4c0-90977e6385c9 tempest-TaggedAttachmentsTest-1522025151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3b08d8c-da10-4950-af57-df2d03df979d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:14:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-35296503',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f4a70a7-a49c-4ea0-ada7-7e07baf67575,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='325b8db61c1743b394ca644a8e19a3b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:14:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:14:20Z,use_quota=True,user_id='afb5e4a4519b4d198a53ab5f194575fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:14:20 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-f5a82fad-2c97-4e1e-b4c0-90977e6385c9 tempest-TaggedAttachmentsTest-1522025151 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (877050e1-b294-4e13-aff2-ec2cb4790a52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:14:20 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-f5a82fad-2c97-4e1e-b4c0-90977e6385c9 tempest-TaggedAttachmentsTest-1522025151 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (877050e1-b294-4e13-aff2-ec2cb4790a52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:14:20 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-f5a82fad-2c97-4e1e-b4c0-90977e6385c9 tempest-TaggedAttachmentsTest-1522025151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c5d3374-c413-452b-a787-43a94b325ee5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:14:20 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-f5a82fad-2c97-4e1e-b4c0-90977e6385c9 tempest-TaggedAttachmentsTest-1522025151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c5d3374-c413-452b-a787-43a94b325ee5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3f4a70a7-a49c-4ea0-ada7-7e07baf67575', 'volume_name': 'volume-3f4a70a7-a49c-4ea0-ada7-7e07baf67575', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:14:20 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-f5a82fad-2c97-4e1e-b4c0-90977e6385c9 tempest-TaggedAttachmentsTest-1522025151 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a72634ca-264d-4d00-950b-fb46e139eb14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:14:20 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-f5a82fad-2c97-4e1e-b4c0-90977e6385c9 tempest-TaggedAttachmentsTest-1522025151 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a72634ca-264d-4d00-950b-fb46e139eb14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:14:20 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-f5a82fad-2c97-4e1e-b4c0-90977e6385c9 tempest-TaggedAttachmentsTest-1522025151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0de19198-7a08-4891-bee9-2d3c9d19e8fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:14:20 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-f5a82fad-2c97-4e1e-b4c0-90977e6385c9 tempest-TaggedAttachmentsTest-1522025151 None] Volume 3f4a70a7-a49c-4ea0-ada7-7e07baf67575: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3f4a70a7-a49c-4ea0-ada7-7e07baf67575', 'volume_size': 1} Jul 31 12:14:20 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-f5a82fad-2c97-4e1e-b4c0-90977e6385c9 tempest-TaggedAttachmentsTest-1522025151 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:14:20 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-f5a82fad-2c97-4e1e-b4c0-90977e6385c9 tempest-TaggedAttachmentsTest-1522025151 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:14:20 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-f5a82fad-2c97-4e1e-b4c0-90977e6385c9 tempest-TaggedAttachmentsTest-1522025151 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:14:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-35296503',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f4a70a7-a49c-4ea0-ada7-7e07baf67575,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='325b8db61c1743b394ca644a8e19a3b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:14:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:14:20Z,use_quota=True,user_id='afb5e4a4519b4d198a53ab5f194575fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)}" {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 12:14:20 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-f5a82fad-2c97-4e1e-b4c0-90977e6385c9 tempest-TaggedAttachmentsTest-1522025151 None] Creating volume 3f4a70a7-a49c-4ea0-ada7-7e07baf67575 {{(pid=89182) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 12:14:20 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-f5a82fad-2c97-4e1e-b4c0-90977e6385c9 tempest-TaggedAttachmentsTest-1522025151 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:14:20 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-f5a82fad-2c97-4e1e-b4c0-90977e6385c9 tempest-TaggedAttachmentsTest-1522025151 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:14:20 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-f5a82fad-2c97-4e1e-b4c0-90977e6385c9 tempest-TaggedAttachmentsTest-1522025151 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:14:20 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-f5a82fad-2c97-4e1e-b4c0-90977e6385c9 tempest-TaggedAttachmentsTest-1522025151 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:14:20 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-f5a82fad-2c97-4e1e-b4c0-90977e6385c9 tempest-TaggedAttachmentsTest-1522025151 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:14:20 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-f5a82fad-2c97-4e1e-b4c0-90977e6385c9 tempest-TaggedAttachmentsTest-1522025151 None] Selected osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 as target Quobyte volume. {{(pid=89182) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 12:14:20 devstack cinder-volume[89182]: INFO cinder.volume.drivers.remotefs [None req-f5a82fad-2c97-4e1e-b4c0-90977e6385c9 tempest-TaggedAttachmentsTest-1522025151 None] casted to osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 Jul 31 12:14:20 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-f5a82fad-2c97-4e1e-b4c0-90977e6385c9 tempest-TaggedAttachmentsTest-1522025151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-3f4a70a7-a49c-4ea0-ada7-7e07baf67575 1073741824 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:14:20 devstack sudo[89464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-3f4a70a7-a49c-4ea0-ada7-7e07baf67575 1073741824 Jul 31 12:14:20 devstack sudo[89464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:14:20 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-f5a82fad-2c97-4e1e-b4c0-90977e6385c9 tempest-TaggedAttachmentsTest-1522025151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-3f4a70a7-a49c-4ea0-ada7-7e07baf67575 1073741824" returned: 0 in 0.652s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:14:20 devstack sudo[89464]: pam_unix(sudo:session): session closed for user root Jul 31 12:14:21 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-f5a82fad-2c97-4e1e-b4c0-90977e6385c9 tempest-TaggedAttachmentsTest-1522025151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-3f4a70a7-a49c-4ea0-ada7-7e07baf67575 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:14:21 devstack sudo[89786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-3f4a70a7-a49c-4ea0-ada7-7e07baf67575 Jul 31 12:14:21 devstack sudo[89786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:14:21 devstack sudo[89786]: pam_unix(sudo:session): session closed for user root Jul 31 12:14:21 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-f5a82fad-2c97-4e1e-b4c0-90977e6385c9 tempest-TaggedAttachmentsTest-1522025151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-3f4a70a7-a49c-4ea0-ada7-7e07baf67575" returned: 0 in 0.432s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:14:21 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-f5a82fad-2c97-4e1e-b4c0-90977e6385c9 tempest-TaggedAttachmentsTest-1522025151 None] <== create_volume: return (1187ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'} {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 12:14:21 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-f5a82fad-2c97-4e1e-b4c0-90977e6385c9 tempest-TaggedAttachmentsTest-1522025151 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.193s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:14:21 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-f5a82fad-2c97-4e1e-b4c0-90977e6385c9 tempest-TaggedAttachmentsTest-1522025151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0de19198-7a08-4891-bee9-2d3c9d19e8fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f4a70a7-a49c-4ea0-ada7-7e07baf67575', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:14:21 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-f5a82fad-2c97-4e1e-b4c0-90977e6385c9 tempest-TaggedAttachmentsTest-1522025151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca7a855f-7c2e-4531-955e-df494668cb07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:14:21 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-f5a82fad-2c97-4e1e-b4c0-90977e6385c9 tempest-TaggedAttachmentsTest-1522025151 None] Volume volume-3f4a70a7-a49c-4ea0-ada7-7e07baf67575 (3f4a70a7-a49c-4ea0-ada7-7e07baf67575): created successfully Jul 31 12:14:21 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-f5a82fad-2c97-4e1e-b4c0-90977e6385c9 tempest-TaggedAttachmentsTest-1522025151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca7a855f-7c2e-4531-955e-df494668cb07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:14:21 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-f5a82fad-2c97-4e1e-b4c0-90977e6385c9 tempest-TaggedAttachmentsTest-1522025151 None] Flow 'volume_create_manager' (317eec7c-e044-49da-915a-01f167299ac4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:14:21 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-f5a82fad-2c97-4e1e-b4c0-90977e6385c9 tempest-TaggedAttachmentsTest-1522025151 None] Created volume successfully. Jul 31 12:14:21 devstack cinder-volume[89182]: DEBUG oslo_service.periodic_task [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89182) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 31 12:14:21 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:14:21 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:14:21 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:14:21 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:14:21 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:14:21 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:14:21 devstack sudo[89797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 Jul 31 12:14:21 devstack sudo[89797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:14:22 devstack sudo[89797]: pam_unix(sudo:session): session closed for user root Jul 31 12:14:22 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2" returned: 0 in 0.411s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:14:22 devstack cinder-volume[89182]: DEBUG cinder.manager [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] Notifying Schedulers of capabilities ... {{(pid=89182) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 12:14:22 devstack cinder-volume[89182]: DEBUG oslo_service.periodic_task [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] Running periodic task VolumeManager._thread_info {{(pid=89182) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 31 12:14:22 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] thread count: 6 {{(pid=89182) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 31 12:14:22 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] thread info: [<_MainThread(MainThread, started 136154603720832)>, , , , , ] {{(pid=89182) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 31 12:14:31 devstack cinder-volume[89182]: DEBUG dbcounter [-] [89182] Writing DB stats cinder:UPDATE=3,cinder:SELECT=1,cinder:INSERT=1 {{(pid=89182) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 12:14:31 devstack cinder-volume[89182]: DEBUG dbcounter [-] [89182] Writing DB stats cinder:SELECT=3,cinder:UPDATE=3,cinder:DELETE=1 {{(pid=89182) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 12:14:31 devstack cinder-volume[89182]: DEBUG cinder.volume.flows.manager.create_volume [None req-b752b892-142a-4b39-afe7-e324119fb0d5 tempest-DeleteServersTestJSON-1158804306 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89182) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 12:14:31 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-b752b892-142a-4b39-afe7-e324119fb0d5 tempest-DeleteServersTestJSON-1158804306 None] Flow 'volume_create_manager' (e6cfbbe7-0b5b-442e-ba71-97e6c11b3dab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:14:31 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-b752b892-142a-4b39-afe7-e324119fb0d5 tempest-DeleteServersTestJSON-1158804306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d643116e-cb00-4b77-8e69-9d3e6a49b1d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:14:32 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-b752b892-142a-4b39-afe7-e324119fb0d5 tempest-DeleteServersTestJSON-1158804306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d643116e-cb00-4b77-8e69-9d3e6a49b1d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:14:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1900531437',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d85002d0-fb4f-4422-9b10-b7ba3d5dca2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1adf4b1891804daf82922ea1296adf6f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:14:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:14:32Z,use_quota=True,user_id='350319e28d424331b4224b54735ab209',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:14:32 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-b752b892-142a-4b39-afe7-e324119fb0d5 tempest-DeleteServersTestJSON-1158804306 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11c40db8-c79a-4698-b17e-b35905be844c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:14:32 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-b752b892-142a-4b39-afe7-e324119fb0d5 tempest-DeleteServersTestJSON-1158804306 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11c40db8-c79a-4698-b17e-b35905be844c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:14:32 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-b752b892-142a-4b39-afe7-e324119fb0d5 tempest-DeleteServersTestJSON-1158804306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0afbb7d-978b-4506-b958-bd67e6454616) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:14:32 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-b752b892-142a-4b39-afe7-e324119fb0d5 tempest-DeleteServersTestJSON-1158804306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0afbb7d-978b-4506-b958-bd67e6454616) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd85002d0-fb4f-4422-9b10-b7ba3d5dca2e', 'volume_name': 'volume-d85002d0-fb4f-4422-9b10-b7ba3d5dca2e', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:14:32 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-b752b892-142a-4b39-afe7-e324119fb0d5 tempest-DeleteServersTestJSON-1158804306 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dee54c59-2fee-452c-bfb6-a83ece463ca1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:14:32 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-b752b892-142a-4b39-afe7-e324119fb0d5 tempest-DeleteServersTestJSON-1158804306 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dee54c59-2fee-452c-bfb6-a83ece463ca1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:14:32 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-b752b892-142a-4b39-afe7-e324119fb0d5 tempest-DeleteServersTestJSON-1158804306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8202d75e-22a9-49f4-a7af-4416f3bc4ffb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:14:32 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-b752b892-142a-4b39-afe7-e324119fb0d5 tempest-DeleteServersTestJSON-1158804306 None] Volume d85002d0-fb4f-4422-9b10-b7ba3d5dca2e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d85002d0-fb4f-4422-9b10-b7ba3d5dca2e', 'volume_size': 1} Jul 31 12:14:32 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-b752b892-142a-4b39-afe7-e324119fb0d5 tempest-DeleteServersTestJSON-1158804306 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:14:32 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-b752b892-142a-4b39-afe7-e324119fb0d5 tempest-DeleteServersTestJSON-1158804306 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.007s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:14:32 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-b752b892-142a-4b39-afe7-e324119fb0d5 tempest-DeleteServersTestJSON-1158804306 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:14:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1900531437',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d85002d0-fb4f-4422-9b10-b7ba3d5dca2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1adf4b1891804daf82922ea1296adf6f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:14:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:14:32Z,use_quota=True,user_id='350319e28d424331b4224b54735ab209',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)}" {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 12:14:32 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-b752b892-142a-4b39-afe7-e324119fb0d5 tempest-DeleteServersTestJSON-1158804306 None] Creating volume d85002d0-fb4f-4422-9b10-b7ba3d5dca2e {{(pid=89182) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 12:14:32 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-b752b892-142a-4b39-afe7-e324119fb0d5 tempest-DeleteServersTestJSON-1158804306 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:14:32 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-b752b892-142a-4b39-afe7-e324119fb0d5 tempest-DeleteServersTestJSON-1158804306 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:14:32 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-b752b892-142a-4b39-afe7-e324119fb0d5 tempest-DeleteServersTestJSON-1158804306 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:14:32 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-b752b892-142a-4b39-afe7-e324119fb0d5 tempest-DeleteServersTestJSON-1158804306 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:14:32 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-b752b892-142a-4b39-afe7-e324119fb0d5 tempest-DeleteServersTestJSON-1158804306 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:14:32 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-b752b892-142a-4b39-afe7-e324119fb0d5 tempest-DeleteServersTestJSON-1158804306 None] Selected osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 as target Quobyte volume. {{(pid=89182) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 12:14:32 devstack cinder-volume[89182]: INFO cinder.volume.drivers.remotefs [None req-b752b892-142a-4b39-afe7-e324119fb0d5 tempest-DeleteServersTestJSON-1158804306 None] casted to osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 Jul 31 12:14:32 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-b752b892-142a-4b39-afe7-e324119fb0d5 tempest-DeleteServersTestJSON-1158804306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-d85002d0-fb4f-4422-9b10-b7ba3d5dca2e 1073741824 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:14:32 devstack sudo[89997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-d85002d0-fb4f-4422-9b10-b7ba3d5dca2e 1073741824 Jul 31 12:14:32 devstack sudo[89997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:14:33 devstack sudo[89997]: pam_unix(sudo:session): session closed for user root Jul 31 12:14:33 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-b752b892-142a-4b39-afe7-e324119fb0d5 tempest-DeleteServersTestJSON-1158804306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-d85002d0-fb4f-4422-9b10-b7ba3d5dca2e 1073741824" returned: 0 in 1.388s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:14:33 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-b752b892-142a-4b39-afe7-e324119fb0d5 tempest-DeleteServersTestJSON-1158804306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-d85002d0-fb4f-4422-9b10-b7ba3d5dca2e {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:14:33 devstack sudo[90008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-d85002d0-fb4f-4422-9b10-b7ba3d5dca2e Jul 31 12:14:33 devstack sudo[90008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:14:34 devstack sudo[90008]: pam_unix(sudo:session): session closed for user root Jul 31 12:14:34 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-b752b892-142a-4b39-afe7-e324119fb0d5 tempest-DeleteServersTestJSON-1158804306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-d85002d0-fb4f-4422-9b10-b7ba3d5dca2e" returned: 0 in 0.935s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:14:34 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-b752b892-142a-4b39-afe7-e324119fb0d5 tempest-DeleteServersTestJSON-1158804306 None] <== create_volume: return (2424ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'} {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 12:14:34 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-b752b892-142a-4b39-afe7-e324119fb0d5 tempest-DeleteServersTestJSON-1158804306 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.426s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:14:34 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-b752b892-142a-4b39-afe7-e324119fb0d5 tempest-DeleteServersTestJSON-1158804306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8202d75e-22a9-49f4-a7af-4416f3bc4ffb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d85002d0-fb4f-4422-9b10-b7ba3d5dca2e', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:14:34 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-b752b892-142a-4b39-afe7-e324119fb0d5 tempest-DeleteServersTestJSON-1158804306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a8e2037-5793-4145-a131-123c36363dd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:14:34 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-b752b892-142a-4b39-afe7-e324119fb0d5 tempest-DeleteServersTestJSON-1158804306 None] Volume volume-d85002d0-fb4f-4422-9b10-b7ba3d5dca2e (d85002d0-fb4f-4422-9b10-b7ba3d5dca2e): created successfully Jul 31 12:14:34 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-b752b892-142a-4b39-afe7-e324119fb0d5 tempest-DeleteServersTestJSON-1158804306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a8e2037-5793-4145-a131-123c36363dd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:14:34 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-b752b892-142a-4b39-afe7-e324119fb0d5 tempest-DeleteServersTestJSON-1158804306 None] Flow 'volume_create_manager' (e6cfbbe7-0b5b-442e-ba71-97e6c11b3dab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:14:34 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-b752b892-142a-4b39-afe7-e324119fb0d5 tempest-DeleteServersTestJSON-1158804306 None] Created volume successfully. Jul 31 12:14:40 devstack cinder-volume[89182]: WARNING py.warnings [req-06c2e7a2-450e-4c28-9a57-56aa2578e7b6 req-8e861b92-22cf-4229-9656-1dec7814d89e tempest-DeleteServersTestJSON-1158804306 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volume_attachment". Apply join condition(s) between each element to resolve. Jul 31 12:14:40 devstack cinder-volume[89182]: .first() Jul 31 12:14:40 devstack cinder-volume[89182]: Jul 31 12:14:40 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [req-06c2e7a2-450e-4c28-9a57-56aa2578e7b6 req-8e861b92-22cf-4229-9656-1dec7814d89e tempest-DeleteServersTestJSON-1158804306 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:14:40 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [req-06c2e7a2-450e-4c28-9a57-56aa2578e7b6 req-8e861b92-22cf-4229-9656-1dec7814d89e tempest-DeleteServersTestJSON-1158804306 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:14:40 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [req-06c2e7a2-450e-4c28-9a57-56aa2578e7b6 req-8e861b92-22cf-4229-9656-1dec7814d89e tempest-DeleteServersTestJSON-1158804306 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:14:40 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [req-06c2e7a2-450e-4c28-9a57-56aa2578e7b6 req-8e861b92-22cf-4229-9656-1dec7814d89e tempest-DeleteServersTestJSON-1158804306 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88', 'name': 'volume-d85002d0-fb4f-4422-9b10-b7ba3d5dca2e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7fe2e9fd-7ed2-44c2-b9be-bab89b52958b', 'enforce_multipath': True} {{(pid=89182) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 31 12:14:40 devstack cinder-volume[89182]: INFO cinder.volume.manager [req-06c2e7a2-450e-4c28-9a57-56aa2578e7b6 req-8e861b92-22cf-4229-9656-1dec7814d89e tempest-DeleteServersTestJSON-1158804306 None] attachment_update completed successfully. Jul 31 12:14:47 devstack cinder-volume[89182]: INFO cinder.volume.manager [req-522147e6-f308-4f34-a674-b489c14146f2 req-8515df22-0040-4380-b511-c9fa90060d6d tempest-DeleteServersTestJSON-1158804306 None] Terminate volume connection completed successfully. Jul 31 12:14:47 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [req-522147e6-f308-4f34-a674-b489c14146f2 req-8515df22-0040-4380-b511-c9fa90060d6d tempest-DeleteServersTestJSON-1158804306 None] Deleting attachment 7fe2e9fd-7ed2-44c2-b9be-bab89b52958b. {{(pid=89182) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 31 12:14:49 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-074c9d16-18d3-4fbe-966e-f08709176d34 tempest-DeleteServersTestJSON-1158804306 None] Acquiring lock "cinder-d85002d0-fb4f-4422-9b10-b7ba3d5dca2e-delete_volume" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:14:49 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-074c9d16-18d3-4fbe-966e-f08709176d34 tempest-DeleteServersTestJSON-1158804306 None] Lock "cinder-d85002d0-fb4f-4422-9b10-b7ba3d5dca2e-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:14:49 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-074c9d16-18d3-4fbe-966e-f08709176d34 tempest-DeleteServersTestJSON-1158804306 None] Acquiring lock "cinder-quobyte-d85002d0-fb4f-4422-9b10-b7ba3d5dca2e" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:14:49 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-074c9d16-18d3-4fbe-966e-f08709176d34 tempest-DeleteServersTestJSON-1158804306 None] Lock "cinder-quobyte-d85002d0-fb4f-4422-9b10-b7ba3d5dca2e" acquired by "delete_volume" :: waited 0.033s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:14:49 devstack cinder-volume[89182]: INFO oslo.privsep.daemon [None req-074c9d16-18d3-4fbe-966e-f08709176d34 tempest-DeleteServersTestJSON-1158804306 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpoppaq50_/privsep.sock'] Jul 31 12:14:49 devstack sudo[90702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpoppaq50_/privsep.sock Jul 31 12:14:49 devstack sudo[90702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:14:50 devstack cinder-volume[89182]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning: Jul 31 12:14:50 devstack cinder-volume[89182]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 31 12:14:50 devstack cinder-volume[89182]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jul 31 12:14:50 devstack cinder-volume[89182]: WARNING oslo.privsep.daemon [-] privsep log: Jul 31 12:14:50 devstack cinder-volume[89182]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jul 31 12:14:50 devstack cinder-volume[89182]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jul 31 12:14:50 devstack cinder-volume[89182]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 31 12:14:50 devstack cinder-volume[89182]: WARNING oslo.privsep.daemon [-] privsep log: Jul 31 12:14:50 devstack cinder-volume[89182]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Jul 31 12:14:51 devstack sudo[90702]: pam_unix(sudo:session): session closed for user root Jul 31 12:14:51 devstack cinder-volume[89182]: INFO oslo.privsep.daemon [None req-074c9d16-18d3-4fbe-966e-f08709176d34 tempest-DeleteServersTestJSON-1158804306 None] Spawned new privsep daemon via rootwrap Jul 31 12:14:51 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [None req-074c9d16-18d3-4fbe-966e-f08709176d34 tempest-DeleteServersTestJSON-1158804306 None] Accepted privsep connection to /tmp/tmpoppaq50_/privsep.sock {{(pid=89182) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Jul 31 12:14:51 devstack cinder-volume[89182]: INFO oslo.privsep.daemon [-] privsep daemon starting Jul 31 12:14:51 devstack cinder-volume[89182]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Jul 31 12:14:51 devstack cinder-volume[89182]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Jul 31 12:14:51 devstack cinder-volume[89182]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 90705 Jul 31 12:14:51 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2332229-5996-41fc-be9f-452ae204ea27]: (2,) {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:14:51 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f181b64-4407-474c-b2ac-17cc06810bab]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:14:51 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-074c9d16-18d3-4fbe-966e-f08709176d34 tempest-DeleteServersTestJSON-1158804306 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-d85002d0-fb4f-4422-9b10-b7ba3d5dca2e {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:14:51 devstack sudo[90707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-d85002d0-fb4f-4422-9b10-b7ba3d5dca2e Jul 31 12:14:51 devstack sudo[90707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:14:51 devstack sudo[90707]: pam_unix(sudo:session): session closed for user root Jul 31 12:14:51 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-074c9d16-18d3-4fbe-966e-f08709176d34 tempest-DeleteServersTestJSON-1158804306 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-d85002d0-fb4f-4422-9b10-b7ba3d5dca2e" returned: 0 in 0.658s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:14:51 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-074c9d16-18d3-4fbe-966e-f08709176d34 tempest-DeleteServersTestJSON-1158804306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-d85002d0-fb4f-4422-9b10-b7ba3d5dca2e {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:14:51 devstack sudo[90715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-d85002d0-fb4f-4422-9b10-b7ba3d5dca2e Jul 31 12:14:51 devstack sudo[90715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:14:52 devstack sudo[90715]: pam_unix(sudo:session): session closed for user root Jul 31 12:14:52 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-074c9d16-18d3-4fbe-966e-f08709176d34 tempest-DeleteServersTestJSON-1158804306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-d85002d0-fb4f-4422-9b10-b7ba3d5dca2e" returned: 0 in 0.424s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:14:52 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-074c9d16-18d3-4fbe-966e-f08709176d34 tempest-DeleteServersTestJSON-1158804306 None] Lock "cinder-quobyte-d85002d0-fb4f-4422-9b10-b7ba3d5dca2e" released by "delete_volume" :: held 2.631s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:14:52 devstack cinder-volume[89182]: WARNING cinder.quota [None req-074c9d16-18d3-4fbe-966e-f08709176d34 tempest-DeleteServersTestJSON-1158804306 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 31 12:14:52 devstack cinder-volume[89182]: WARNING cinder.quota [None req-074c9d16-18d3-4fbe-966e-f08709176d34 tempest-DeleteServersTestJSON-1158804306 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 31 12:14:52 devstack cinder-volume[89182]: DEBUG cinder.quota [None req-074c9d16-18d3-4fbe-966e-f08709176d34 tempest-DeleteServersTestJSON-1158804306 None] Created reservations ['dc3e8878-ac93-429a-9cba-9f13e5b85b28', '63545738-1940-4f41-8933-7a4adbe5afce', '344e80fc-8143-48b1-a16d-8694f909b483', '41e12980-b297-4283-9d5a-cd99f271f32b'] {{(pid=89182) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 12:14:52 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-074c9d16-18d3-4fbe-966e-f08709176d34 tempest-DeleteServersTestJSON-1158804306 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:14:52 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-074c9d16-18d3-4fbe-966e-f08709176d34 tempest-DeleteServersTestJSON-1158804306 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:14:52 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-074c9d16-18d3-4fbe-966e-f08709176d34 tempest-DeleteServersTestJSON-1158804306 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:14:52 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-074c9d16-18d3-4fbe-966e-f08709176d34 tempest-DeleteServersTestJSON-1158804306 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:14:52 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-074c9d16-18d3-4fbe-966e-f08709176d34 tempest-DeleteServersTestJSON-1158804306 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:14:52 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-074c9d16-18d3-4fbe-966e-f08709176d34 tempest-DeleteServersTestJSON-1158804306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:14:52 devstack sudo[90719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 Jul 31 12:14:52 devstack sudo[90719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:14:52 devstack sudo[90719]: pam_unix(sudo:session): session closed for user root Jul 31 12:14:52 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-074c9d16-18d3-4fbe-966e-f08709176d34 tempest-DeleteServersTestJSON-1158804306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2" returned: 0 in 0.346s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:14:53 devstack cinder-volume[89182]: DEBUG cinder.manager [None req-074c9d16-18d3-4fbe-966e-f08709176d34 tempest-DeleteServersTestJSON-1158804306 None] Notifying Schedulers of capabilities ... {{(pid=89182) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 12:14:53 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-074c9d16-18d3-4fbe-966e-f08709176d34 tempest-DeleteServersTestJSON-1158804306 None] Deleted volume successfully. Jul 31 12:14:53 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-074c9d16-18d3-4fbe-966e-f08709176d34 tempest-DeleteServersTestJSON-1158804306 None] Lock "cinder-d85002d0-fb4f-4422-9b10-b7ba3d5dca2e-delete_volume" released by "delete_volume" :: held 3.413s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:14:58 devstack cinder-volume[89182]: DEBUG cinder.volume.flows.manager.create_volume [None req-95031a73-d607-448a-adfb-8badcd412546 tempest-ServerActionsTestOtherA-721546481 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89182) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 12:14:58 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-95031a73-d607-448a-adfb-8badcd412546 tempest-ServerActionsTestOtherA-721546481 None] Flow 'volume_create_manager' (90257cd8-cf7d-440d-a4d4-a0b73c1f8c8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:14:58 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-95031a73-d607-448a-adfb-8badcd412546 tempest-ServerActionsTestOtherA-721546481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b068afb-40d3-488a-b134-750fb79198d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:14:58 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-95031a73-d607-448a-adfb-8badcd412546 tempest-ServerActionsTestOtherA-721546481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b068afb-40d3-488a-b134-750fb79198d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:14:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-229882155',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58e3eb03-8b43-4942-8387-27ac4293420c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5da77cb40a0f41cc8d96dac1e8f9c072',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:14:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:14:58Z,use_quota=True,user_id='aaa5284cda904c408e1dd6ee7316646a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:14:58 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-95031a73-d607-448a-adfb-8badcd412546 tempest-ServerActionsTestOtherA-721546481 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (719cb120-52bf-4fa6-a17b-9d322c85cfc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:14:58 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-95031a73-d607-448a-adfb-8badcd412546 tempest-ServerActionsTestOtherA-721546481 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (719cb120-52bf-4fa6-a17b-9d322c85cfc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:14:58 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-95031a73-d607-448a-adfb-8badcd412546 tempest-ServerActionsTestOtherA-721546481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b80ce7f-5fef-4d10-87ef-43f3ac3d511f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:14:58 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-95031a73-d607-448a-adfb-8badcd412546 tempest-ServerActionsTestOtherA-721546481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b80ce7f-5fef-4d10-87ef-43f3ac3d511f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '58e3eb03-8b43-4942-8387-27ac4293420c', 'volume_name': 'volume-58e3eb03-8b43-4942-8387-27ac4293420c', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:14:58 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-95031a73-d607-448a-adfb-8badcd412546 tempest-ServerActionsTestOtherA-721546481 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39f07d42-5df7-4758-a12d-212c4c111d8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:14:58 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-95031a73-d607-448a-adfb-8badcd412546 tempest-ServerActionsTestOtherA-721546481 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39f07d42-5df7-4758-a12d-212c4c111d8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:14:58 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-95031a73-d607-448a-adfb-8badcd412546 tempest-ServerActionsTestOtherA-721546481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84fa43d3-e1b3-4177-9c37-5d9fb8231a7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:14:58 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-95031a73-d607-448a-adfb-8badcd412546 tempest-ServerActionsTestOtherA-721546481 None] Volume 58e3eb03-8b43-4942-8387-27ac4293420c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-58e3eb03-8b43-4942-8387-27ac4293420c', 'volume_size': 1} Jul 31 12:14:58 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-95031a73-d607-448a-adfb-8badcd412546 tempest-ServerActionsTestOtherA-721546481 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:14:58 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-95031a73-d607-448a-adfb-8badcd412546 tempest-ServerActionsTestOtherA-721546481 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:14:58 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-95031a73-d607-448a-adfb-8badcd412546 tempest-ServerActionsTestOtherA-721546481 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:14:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-229882155',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58e3eb03-8b43-4942-8387-27ac4293420c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5da77cb40a0f41cc8d96dac1e8f9c072',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:14:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:14:58Z,use_quota=True,user_id='aaa5284cda904c408e1dd6ee7316646a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)}" {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 12:14:58 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-95031a73-d607-448a-adfb-8badcd412546 tempest-ServerActionsTestOtherA-721546481 None] Creating volume 58e3eb03-8b43-4942-8387-27ac4293420c {{(pid=89182) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 12:14:58 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-95031a73-d607-448a-adfb-8badcd412546 tempest-ServerActionsTestOtherA-721546481 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:14:58 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-95031a73-d607-448a-adfb-8badcd412546 tempest-ServerActionsTestOtherA-721546481 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:14:58 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-95031a73-d607-448a-adfb-8badcd412546 tempest-ServerActionsTestOtherA-721546481 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:14:58 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-95031a73-d607-448a-adfb-8badcd412546 tempest-ServerActionsTestOtherA-721546481 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:14:58 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-95031a73-d607-448a-adfb-8badcd412546 tempest-ServerActionsTestOtherA-721546481 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:14:58 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-95031a73-d607-448a-adfb-8badcd412546 tempest-ServerActionsTestOtherA-721546481 None] Selected osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 as target Quobyte volume. {{(pid=89182) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 12:14:58 devstack cinder-volume[89182]: INFO cinder.volume.drivers.remotefs [None req-95031a73-d607-448a-adfb-8badcd412546 tempest-ServerActionsTestOtherA-721546481 None] casted to osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 Jul 31 12:14:58 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-95031a73-d607-448a-adfb-8badcd412546 tempest-ServerActionsTestOtherA-721546481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-58e3eb03-8b43-4942-8387-27ac4293420c 1073741824 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:14:58 devstack sudo[90729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-58e3eb03-8b43-4942-8387-27ac4293420c 1073741824 Jul 31 12:14:58 devstack sudo[90729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:14:59 devstack sudo[90729]: pam_unix(sudo:session): session closed for user root Jul 31 12:14:59 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-95031a73-d607-448a-adfb-8badcd412546 tempest-ServerActionsTestOtherA-721546481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-58e3eb03-8b43-4942-8387-27ac4293420c 1073741824" returned: 0 in 0.704s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:14:59 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-95031a73-d607-448a-adfb-8badcd412546 tempest-ServerActionsTestOtherA-721546481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-58e3eb03-8b43-4942-8387-27ac4293420c {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:14:59 devstack sudo[90736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-58e3eb03-8b43-4942-8387-27ac4293420c Jul 31 12:14:59 devstack sudo[90736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:14:59 devstack sudo[90736]: pam_unix(sudo:session): session closed for user root Jul 31 12:14:59 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-95031a73-d607-448a-adfb-8badcd412546 tempest-ServerActionsTestOtherA-721546481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-58e3eb03-8b43-4942-8387-27ac4293420c" returned: 0 in 0.277s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:14:59 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-95031a73-d607-448a-adfb-8badcd412546 tempest-ServerActionsTestOtherA-721546481 None] <== create_volume: return (1044ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'} {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 12:14:59 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-95031a73-d607-448a-adfb-8badcd412546 tempest-ServerActionsTestOtherA-721546481 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.050s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:14:59 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-95031a73-d607-448a-adfb-8badcd412546 tempest-ServerActionsTestOtherA-721546481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84fa43d3-e1b3-4177-9c37-5d9fb8231a7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-58e3eb03-8b43-4942-8387-27ac4293420c', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:14:59 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-95031a73-d607-448a-adfb-8badcd412546 tempest-ServerActionsTestOtherA-721546481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14b28da0-6c6f-47ce-b3db-0bfc6421c9f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:14:59 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-95031a73-d607-448a-adfb-8badcd412546 tempest-ServerActionsTestOtherA-721546481 None] Volume volume-58e3eb03-8b43-4942-8387-27ac4293420c (58e3eb03-8b43-4942-8387-27ac4293420c): created successfully Jul 31 12:14:59 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-95031a73-d607-448a-adfb-8badcd412546 tempest-ServerActionsTestOtherA-721546481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14b28da0-6c6f-47ce-b3db-0bfc6421c9f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:14:59 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-95031a73-d607-448a-adfb-8badcd412546 tempest-ServerActionsTestOtherA-721546481 None] Flow 'volume_create_manager' (90257cd8-cf7d-440d-a4d4-a0b73c1f8c8b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:14:59 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-95031a73-d607-448a-adfb-8badcd412546 tempest-ServerActionsTestOtherA-721546481 None] Created volume successfully. Jul 31 12:15:03 devstack cinder-volume[89182]: DEBUG cinder.volume.flows.manager.create_volume [req-7920ee53-e8f0-4374-a4e7-500ee3f292fa req-aace2ca5-7ae6-49b9-8f62-fd83b532a084 tempest-VolumesSnapshotsTestJSON-1944727269 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89182) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 12:15:03 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [req-7920ee53-e8f0-4374-a4e7-500ee3f292fa req-aace2ca5-7ae6-49b9-8f62-fd83b532a084 tempest-VolumesSnapshotsTestJSON-1944727269 None] Flow 'volume_create_manager' (7993b255-a153-41ba-b20e-525e425e1b8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:15:03 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [req-7920ee53-e8f0-4374-a4e7-500ee3f292fa req-aace2ca5-7ae6-49b9-8f62-fd83b532a084 tempest-VolumesSnapshotsTestJSON-1944727269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c6b810f-a394-483e-88f0-228bd8a32f24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:15:03 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [req-7920ee53-e8f0-4374-a4e7-500ee3f292fa req-aace2ca5-7ae6-49b9-8f62-fd83b532a084 tempest-VolumesSnapshotsTestJSON-1944727269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c6b810f-a394-483e-88f0-228bd8a32f24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:15:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1662385324',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7fd60558-c47a-4de8-8775-1723d1d1b6d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8f7d203359a40dda4733df564b77f6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:15:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:15:03Z,use_quota=True,user_id='195beef655324074b53eae15a7a796d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:15:03 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [req-7920ee53-e8f0-4374-a4e7-500ee3f292fa req-aace2ca5-7ae6-49b9-8f62-fd83b532a084 tempest-VolumesSnapshotsTestJSON-1944727269 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8dcd068-fd34-45b3-b79e-9b5bfd6fb210) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:15:03 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [req-7920ee53-e8f0-4374-a4e7-500ee3f292fa req-aace2ca5-7ae6-49b9-8f62-fd83b532a084 tempest-VolumesSnapshotsTestJSON-1944727269 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8dcd068-fd34-45b3-b79e-9b5bfd6fb210) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:15:03 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [req-7920ee53-e8f0-4374-a4e7-500ee3f292fa req-aace2ca5-7ae6-49b9-8f62-fd83b532a084 tempest-VolumesSnapshotsTestJSON-1944727269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba5ffebd-18ff-43e3-a5a2-5c19aab88af5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:15:03 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [req-7920ee53-e8f0-4374-a4e7-500ee3f292fa req-aace2ca5-7ae6-49b9-8f62-fd83b532a084 tempest-VolumesSnapshotsTestJSON-1944727269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba5ffebd-18ff-43e3-a5a2-5c19aab88af5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7fd60558-c47a-4de8-8775-1723d1d1b6d6', 'volume_name': 'volume-7fd60558-c47a-4de8-8775-1723d1d1b6d6', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:15:03 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [req-7920ee53-e8f0-4374-a4e7-500ee3f292fa req-aace2ca5-7ae6-49b9-8f62-fd83b532a084 tempest-VolumesSnapshotsTestJSON-1944727269 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1e060a1-67e4-4da8-b9f6-a310cd269c7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:15:03 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [req-7920ee53-e8f0-4374-a4e7-500ee3f292fa req-aace2ca5-7ae6-49b9-8f62-fd83b532a084 tempest-VolumesSnapshotsTestJSON-1944727269 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1e060a1-67e4-4da8-b9f6-a310cd269c7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:15:03 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [req-7920ee53-e8f0-4374-a4e7-500ee3f292fa req-aace2ca5-7ae6-49b9-8f62-fd83b532a084 tempest-VolumesSnapshotsTestJSON-1944727269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f3c3b5e-a341-429f-a376-6cfc848af752) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:15:03 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [req-7920ee53-e8f0-4374-a4e7-500ee3f292fa req-aace2ca5-7ae6-49b9-8f62-fd83b532a084 tempest-VolumesSnapshotsTestJSON-1944727269 None] Volume 7fd60558-c47a-4de8-8775-1723d1d1b6d6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7fd60558-c47a-4de8-8775-1723d1d1b6d6', 'volume_size': 1} Jul 31 12:15:03 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [req-7920ee53-e8f0-4374-a4e7-500ee3f292fa req-aace2ca5-7ae6-49b9-8f62-fd83b532a084 tempest-VolumesSnapshotsTestJSON-1944727269 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:15:03 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [req-7920ee53-e8f0-4374-a4e7-500ee3f292fa req-aace2ca5-7ae6-49b9-8f62-fd83b532a084 tempest-VolumesSnapshotsTestJSON-1944727269 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:15:03 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [req-7920ee53-e8f0-4374-a4e7-500ee3f292fa req-aace2ca5-7ae6-49b9-8f62-fd83b532a084 tempest-VolumesSnapshotsTestJSON-1944727269 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:15:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1662385324',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7fd60558-c47a-4de8-8775-1723d1d1b6d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8f7d203359a40dda4733df564b77f6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:15:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:15:03Z,use_quota=True,user_id='195beef655324074b53eae15a7a796d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)}" {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 12:15:03 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [req-7920ee53-e8f0-4374-a4e7-500ee3f292fa req-aace2ca5-7ae6-49b9-8f62-fd83b532a084 tempest-VolumesSnapshotsTestJSON-1944727269 None] Creating volume 7fd60558-c47a-4de8-8775-1723d1d1b6d6 {{(pid=89182) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 12:15:03 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [req-7920ee53-e8f0-4374-a4e7-500ee3f292fa req-aace2ca5-7ae6-49b9-8f62-fd83b532a084 tempest-VolumesSnapshotsTestJSON-1944727269 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:15:03 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [req-7920ee53-e8f0-4374-a4e7-500ee3f292fa req-aace2ca5-7ae6-49b9-8f62-fd83b532a084 tempest-VolumesSnapshotsTestJSON-1944727269 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:15:03 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [req-7920ee53-e8f0-4374-a4e7-500ee3f292fa req-aace2ca5-7ae6-49b9-8f62-fd83b532a084 tempest-VolumesSnapshotsTestJSON-1944727269 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:15:03 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [req-7920ee53-e8f0-4374-a4e7-500ee3f292fa req-aace2ca5-7ae6-49b9-8f62-fd83b532a084 tempest-VolumesSnapshotsTestJSON-1944727269 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:15:03 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [req-7920ee53-e8f0-4374-a4e7-500ee3f292fa req-aace2ca5-7ae6-49b9-8f62-fd83b532a084 tempest-VolumesSnapshotsTestJSON-1944727269 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:15:03 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [req-7920ee53-e8f0-4374-a4e7-500ee3f292fa req-aace2ca5-7ae6-49b9-8f62-fd83b532a084 tempest-VolumesSnapshotsTestJSON-1944727269 None] Selected osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 as target Quobyte volume. {{(pid=89182) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 12:15:03 devstack cinder-volume[89182]: INFO cinder.volume.drivers.remotefs [req-7920ee53-e8f0-4374-a4e7-500ee3f292fa req-aace2ca5-7ae6-49b9-8f62-fd83b532a084 tempest-VolumesSnapshotsTestJSON-1944727269 None] casted to osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 Jul 31 12:15:03 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [req-7920ee53-e8f0-4374-a4e7-500ee3f292fa req-aace2ca5-7ae6-49b9-8f62-fd83b532a084 tempest-VolumesSnapshotsTestJSON-1944727269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-7fd60558-c47a-4de8-8775-1723d1d1b6d6 1073741824 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:15:03 devstack sudo[90765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-7fd60558-c47a-4de8-8775-1723d1d1b6d6 1073741824 Jul 31 12:15:03 devstack sudo[90765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:15:04 devstack sudo[90765]: pam_unix(sudo:session): session closed for user root Jul 31 12:15:04 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [req-7920ee53-e8f0-4374-a4e7-500ee3f292fa req-aace2ca5-7ae6-49b9-8f62-fd83b532a084 tempest-VolumesSnapshotsTestJSON-1944727269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-7fd60558-c47a-4de8-8775-1723d1d1b6d6 1073741824" returned: 0 in 0.516s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:15:04 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [req-7920ee53-e8f0-4374-a4e7-500ee3f292fa req-aace2ca5-7ae6-49b9-8f62-fd83b532a084 tempest-VolumesSnapshotsTestJSON-1944727269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-7fd60558-c47a-4de8-8775-1723d1d1b6d6 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:15:04 devstack sudo[90771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-7fd60558-c47a-4de8-8775-1723d1d1b6d6 Jul 31 12:15:04 devstack sudo[90771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:15:04 devstack sudo[90771]: pam_unix(sudo:session): session closed for user root Jul 31 12:15:04 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [req-7920ee53-e8f0-4374-a4e7-500ee3f292fa req-aace2ca5-7ae6-49b9-8f62-fd83b532a084 tempest-VolumesSnapshotsTestJSON-1944727269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-7fd60558-c47a-4de8-8775-1723d1d1b6d6" returned: 0 in 0.384s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:15:04 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [req-7920ee53-e8f0-4374-a4e7-500ee3f292fa req-aace2ca5-7ae6-49b9-8f62-fd83b532a084 tempest-VolumesSnapshotsTestJSON-1944727269 None] <== create_volume: return (946ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'} {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 12:15:04 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [req-7920ee53-e8f0-4374-a4e7-500ee3f292fa req-aace2ca5-7ae6-49b9-8f62-fd83b532a084 tempest-VolumesSnapshotsTestJSON-1944727269 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.949s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:15:04 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [req-7920ee53-e8f0-4374-a4e7-500ee3f292fa req-aace2ca5-7ae6-49b9-8f62-fd83b532a084 tempest-VolumesSnapshotsTestJSON-1944727269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f3c3b5e-a341-429f-a376-6cfc848af752) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7fd60558-c47a-4de8-8775-1723d1d1b6d6', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:15:04 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [req-7920ee53-e8f0-4374-a4e7-500ee3f292fa req-aace2ca5-7ae6-49b9-8f62-fd83b532a084 tempest-VolumesSnapshotsTestJSON-1944727269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7f350f8-3e44-431b-a093-1340d6b1c026) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:15:04 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [req-7920ee53-e8f0-4374-a4e7-500ee3f292fa req-aace2ca5-7ae6-49b9-8f62-fd83b532a084 tempest-VolumesSnapshotsTestJSON-1944727269 None] Volume volume-7fd60558-c47a-4de8-8775-1723d1d1b6d6 (7fd60558-c47a-4de8-8775-1723d1d1b6d6): created successfully Jul 31 12:15:04 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [req-7920ee53-e8f0-4374-a4e7-500ee3f292fa req-aace2ca5-7ae6-49b9-8f62-fd83b532a084 tempest-VolumesSnapshotsTestJSON-1944727269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7f350f8-3e44-431b-a093-1340d6b1c026) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:15:04 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [req-7920ee53-e8f0-4374-a4e7-500ee3f292fa req-aace2ca5-7ae6-49b9-8f62-fd83b532a084 tempest-VolumesSnapshotsTestJSON-1944727269 None] Flow 'volume_create_manager' (7993b255-a153-41ba-b20e-525e425e1b8a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:15:04 devstack cinder-volume[89182]: INFO cinder.volume.manager [req-7920ee53-e8f0-4374-a4e7-500ee3f292fa req-aace2ca5-7ae6-49b9-8f62-fd83b532a084 tempest-VolumesSnapshotsTestJSON-1944727269 None] Created volume successfully. Jul 31 12:15:06 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [req-ade3cc9d-8377-405b-88a7-6af0e2c4060e req-8952bf00-1f00-464e-b132-af2d4b349306 tempest-VolumesSnapshotsTestJSON-1944727269 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:15:06 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [req-ade3cc9d-8377-405b-88a7-6af0e2c4060e req-8952bf00-1f00-464e-b132-af2d4b349306 tempest-VolumesSnapshotsTestJSON-1944727269 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:15:06 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [req-ade3cc9d-8377-405b-88a7-6af0e2c4060e req-8952bf00-1f00-464e-b132-af2d4b349306 tempest-VolumesSnapshotsTestJSON-1944727269 None] Creating offline snapshot 03fd8247-9aae-488c-a6cd-240d6e74870e of volume 7fd60558-c47a-4de8-8775-1723d1d1b6d6 {{(pid=89182) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 31 12:15:06 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[8467e0f1-7c77-41a9-90c8-29a84f891296]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:15:06 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [req-ade3cc9d-8377-405b-88a7-6af0e2c4060e req-8952bf00-1f00-464e-b132-af2d4b349306 tempest-VolumesSnapshotsTestJSON-1944727269 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-7fd60558-c47a-4de8-8775-1723d1d1b6d6 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:15:06 devstack sudo[90793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-7fd60558-c47a-4de8-8775-1723d1d1b6d6 Jul 31 12:15:06 devstack sudo[90793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:15:06 devstack sudo[90793]: pam_unix(sudo:session): session closed for user root Jul 31 12:15:06 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [req-ade3cc9d-8377-405b-88a7-6af0e2c4060e req-8952bf00-1f00-464e-b132-af2d4b349306 tempest-VolumesSnapshotsTestJSON-1944727269 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-7fd60558-c47a-4de8-8775-1723d1d1b6d6" returned: 0 in 0.473s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:15:06 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [req-ade3cc9d-8377-405b-88a7-6af0e2c4060e req-8952bf00-1f00-464e-b132-af2d4b349306 tempest-VolumesSnapshotsTestJSON-1944727269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-7fd60558-c47a-4de8-8775-1723d1d1b6d6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-7fd60558-c47a-4de8-8775-1723d1d1b6d6.03fd8247-9aae-488c-a6cd-240d6e74870e 1G {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:15:06 devstack sudo[90801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-7fd60558-c47a-4de8-8775-1723d1d1b6d6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-7fd60558-c47a-4de8-8775-1723d1d1b6d6.03fd8247-9aae-488c-a6cd-240d6e74870e 1G Jul 31 12:15:06 devstack sudo[90801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:15:07 devstack sudo[90801]: pam_unix(sudo:session): session closed for user root Jul 31 12:15:07 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [req-ade3cc9d-8377-405b-88a7-6af0e2c4060e req-8952bf00-1f00-464e-b132-af2d4b349306 tempest-VolumesSnapshotsTestJSON-1944727269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-7fd60558-c47a-4de8-8775-1723d1d1b6d6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-7fd60558-c47a-4de8-8775-1723d1d1b6d6.03fd8247-9aae-488c-a6cd-240d6e74870e 1G" returned: 0 in 0.414s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:15:07 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [req-ade3cc9d-8377-405b-88a7-6af0e2c4060e req-8952bf00-1f00-464e-b132-af2d4b349306 tempest-VolumesSnapshotsTestJSON-1944727269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7fd60558-c47a-4de8-8775-1723d1d1b6d6 -F qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-7fd60558-c47a-4de8-8775-1723d1d1b6d6.03fd8247-9aae-488c-a6cd-240d6e74870e {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:15:07 devstack sudo[90807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7fd60558-c47a-4de8-8775-1723d1d1b6d6 -F qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-7fd60558-c47a-4de8-8775-1723d1d1b6d6.03fd8247-9aae-488c-a6cd-240d6e74870e Jul 31 12:15:07 devstack sudo[90807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:15:07 devstack sudo[90807]: pam_unix(sudo:session): session closed for user root Jul 31 12:15:07 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [req-ade3cc9d-8377-405b-88a7-6af0e2c4060e req-8952bf00-1f00-464e-b132-af2d4b349306 tempest-VolumesSnapshotsTestJSON-1944727269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7fd60558-c47a-4de8-8775-1723d1d1b6d6 -F qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-7fd60558-c47a-4de8-8775-1723d1d1b6d6.03fd8247-9aae-488c-a6cd-240d6e74870e" returned: 0 in 0.309s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:15:07 devstack cinder-volume[89182]: WARNING cinder.volume.drivers.remotefs [req-ade3cc9d-8377-405b-88a7-6af0e2c4060e req-8952bf00-1f00-464e-b132-af2d4b349306 tempest-VolumesSnapshotsTestJSON-1944727269 None] /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-7fd60558-c47a-4de8-8775-1723d1d1b6d6.03fd8247-9aae-488c-a6cd-240d6e74870e is being set with open permissions: ugo+rw Jul 31 12:15:07 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [req-ade3cc9d-8377-405b-88a7-6af0e2c4060e req-8952bf00-1f00-464e-b132-af2d4b349306 tempest-VolumesSnapshotsTestJSON-1944727269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-7fd60558-c47a-4de8-8775-1723d1d1b6d6.03fd8247-9aae-488c-a6cd-240d6e74870e {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:15:07 devstack sudo[90817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-7fd60558-c47a-4de8-8775-1723d1d1b6d6.03fd8247-9aae-488c-a6cd-240d6e74870e Jul 31 12:15:07 devstack sudo[90817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:15:07 devstack sudo[90817]: pam_unix(sudo:session): session closed for user root Jul 31 12:15:07 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [req-ade3cc9d-8377-405b-88a7-6af0e2c4060e req-8952bf00-1f00-464e-b132-af2d4b349306 tempest-VolumesSnapshotsTestJSON-1944727269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-7fd60558-c47a-4de8-8775-1723d1d1b6d6.03fd8247-9aae-488c-a6cd-240d6e74870e" returned: 0 in 0.324s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:15:07 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [req-ade3cc9d-8377-405b-88a7-6af0e2c4060e req-8952bf00-1f00-464e-b132-af2d4b349306 tempest-VolumesSnapshotsTestJSON-1944727269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-7fd60558-c47a-4de8-8775-1723d1d1b6d6.info {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:15:07 devstack sudo[90825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-7fd60558-c47a-4de8-8775-1723d1d1b6d6.info Jul 31 12:15:07 devstack sudo[90825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:15:08 devstack sudo[90825]: pam_unix(sudo:session): session closed for user root Jul 31 12:15:08 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [req-ade3cc9d-8377-405b-88a7-6af0e2c4060e req-8952bf00-1f00-464e-b132-af2d4b349306 tempest-VolumesSnapshotsTestJSON-1944727269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-7fd60558-c47a-4de8-8775-1723d1d1b6d6.info" returned: 0 in 0.400s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:15:08 devstack cinder-volume[89182]: WARNING cinder.volume.drivers.remotefs [req-ade3cc9d-8377-405b-88a7-6af0e2c4060e req-8952bf00-1f00-464e-b132-af2d4b349306 tempest-VolumesSnapshotsTestJSON-1944727269 None] /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-7fd60558-c47a-4de8-8775-1723d1d1b6d6.info is being set with open permissions: ugo+rw Jul 31 12:15:08 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [req-ade3cc9d-8377-405b-88a7-6af0e2c4060e req-8952bf00-1f00-464e-b132-af2d4b349306 tempest-VolumesSnapshotsTestJSON-1944727269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-7fd60558-c47a-4de8-8775-1723d1d1b6d6.info {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:15:08 devstack sudo[90846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-7fd60558-c47a-4de8-8775-1723d1d1b6d6.info Jul 31 12:15:08 devstack sudo[90846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:15:08 devstack sudo[90846]: pam_unix(sudo:session): session closed for user root Jul 31 12:15:08 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [req-ade3cc9d-8377-405b-88a7-6af0e2c4060e req-8952bf00-1f00-464e-b132-af2d4b349306 tempest-VolumesSnapshotsTestJSON-1944727269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-7fd60558-c47a-4de8-8775-1723d1d1b6d6.info" returned: 0 in 0.489s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:15:08 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [req-ade3cc9d-8377-405b-88a7-6af0e2c4060e req-8952bf00-1f00-464e-b132-af2d4b349306 tempest-VolumesSnapshotsTestJSON-1944727269 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.604s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:15:08 devstack cinder-volume[89182]: INFO cinder.volume.manager [req-ade3cc9d-8377-405b-88a7-6af0e2c4060e req-8952bf00-1f00-464e-b132-af2d4b349306 tempest-VolumesSnapshotsTestJSON-1944727269 None] Create snapshot completed successfully Jul 31 12:15:09 devstack cinder-volume[89182]: DEBUG cinder.coordination [req-b8cdcf40-c348-4b22-ae37-a1efb6db6730 req-5ad9fa54-8b2c-481e-8eb2-b83697262726 tempest-VolumesSnapshotsTestJSON-1944727269 None] Acquiring lock "cinder-03fd8247-9aae-488c-a6cd-240d6e74870e-delete_snapshot" by "delete_snapshot" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:15:09 devstack cinder-volume[89182]: DEBUG cinder.coordination [req-b8cdcf40-c348-4b22-ae37-a1efb6db6730 req-5ad9fa54-8b2c-481e-8eb2-b83697262726 tempest-VolumesSnapshotsTestJSON-1944727269 None] Lock "cinder-03fd8247-9aae-488c-a6cd-240d6e74870e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:15:09 devstack cinder-volume[89182]: DEBUG cinder.coordination [req-b8cdcf40-c348-4b22-ae37-a1efb6db6730 req-5ad9fa54-8b2c-481e-8eb2-b83697262726 tempest-VolumesSnapshotsTestJSON-1944727269 None] Acquiring lock "cinder-quobyte-7fd60558-c47a-4de8-8775-1723d1d1b6d6" by "delete_snapshot" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:15:09 devstack cinder-volume[89182]: DEBUG cinder.coordination [req-b8cdcf40-c348-4b22-ae37-a1efb6db6730 req-5ad9fa54-8b2c-481e-8eb2-b83697262726 tempest-VolumesSnapshotsTestJSON-1944727269 None] Lock "cinder-quobyte-7fd60558-c47a-4de8-8775-1723d1d1b6d6" acquired by "delete_snapshot" :: waited 0.031s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:15:09 devstack cinder-volume[89182]: DEBUG cinder.coordination [req-b8cdcf40-c348-4b22-ae37-a1efb6db6730 req-5ad9fa54-8b2c-481e-8eb2-b83697262726 tempest-VolumesSnapshotsTestJSON-1944727269 None] Acquiring lock "cinder-quobyte-03fd8247-9aae-488c-a6cd-240d6e74870e" by "_delete_snapshot" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:15:09 devstack cinder-volume[89182]: DEBUG cinder.coordination [req-b8cdcf40-c348-4b22-ae37-a1efb6db6730 req-5ad9fa54-8b2c-481e-8eb2-b83697262726 tempest-VolumesSnapshotsTestJSON-1944727269 None] Lock "cinder-quobyte-03fd8247-9aae-488c-a6cd-240d6e74870e" acquired by "_delete_snapshot" :: waited 0.044s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:15:10 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [req-b8cdcf40-c348-4b22-ae37-a1efb6db6730 req-5ad9fa54-8b2c-481e-8eb2-b83697262726 tempest-VolumesSnapshotsTestJSON-1944727269 None] Deleting offline snapshot 03fd8247-9aae-488c-a6cd-240d6e74870e of volume 7fd60558-c47a-4de8-8775-1723d1d1b6d6 {{(pid=89182) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 31 12:15:10 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [req-b8cdcf40-c348-4b22-ae37-a1efb6db6730 req-5ad9fa54-8b2c-481e-8eb2-b83697262726 tempest-VolumesSnapshotsTestJSON-1944727269 None] snapshot_file for this snap is: volume-7fd60558-c47a-4de8-8775-1723d1d1b6d6.03fd8247-9aae-488c-a6cd-240d6e74870e {{(pid=89182) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 31 12:15:10 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9f1eb36-f15d-452a-af94-b79902289e06]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:15:10 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [req-b8cdcf40-c348-4b22-ae37-a1efb6db6730 req-5ad9fa54-8b2c-481e-8eb2-b83697262726 tempest-VolumesSnapshotsTestJSON-1944727269 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-7fd60558-c47a-4de8-8775-1723d1d1b6d6.03fd8247-9aae-488c-a6cd-240d6e74870e {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:15:10 devstack sudo[90882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-7fd60558-c47a-4de8-8775-1723d1d1b6d6.03fd8247-9aae-488c-a6cd-240d6e74870e Jul 31 12:15:10 devstack sudo[90882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:15:10 devstack sudo[90882]: pam_unix(sudo:session): session closed for user root Jul 31 12:15:10 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [req-b8cdcf40-c348-4b22-ae37-a1efb6db6730 req-5ad9fa54-8b2c-481e-8eb2-b83697262726 tempest-VolumesSnapshotsTestJSON-1944727269 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-7fd60558-c47a-4de8-8775-1723d1d1b6d6.03fd8247-9aae-488c-a6cd-240d6e74870e" returned: 0 in 0.659s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:15:10 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [req-b8cdcf40-c348-4b22-ae37-a1efb6db6730 req-5ad9fa54-8b2c-481e-8eb2-b83697262726 tempest-VolumesSnapshotsTestJSON-1944727269 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7fd60558-c47a-4de8-8775-1723d1d1b6d6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89182) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 12:15:10 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f2454c9-6e80-412b-9d78-11b6de459c5f]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:15:10 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [req-b8cdcf40-c348-4b22-ae37-a1efb6db6730 req-5ad9fa54-8b2c-481e-8eb2-b83697262726 tempest-VolumesSnapshotsTestJSON-1944727269 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-7fd60558-c47a-4de8-8775-1723d1d1b6d6 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:15:10 devstack sudo[90890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-7fd60558-c47a-4de8-8775-1723d1d1b6d6 Jul 31 12:15:10 devstack sudo[90890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:15:11 devstack sudo[90890]: pam_unix(sudo:session): session closed for user root Jul 31 12:15:11 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [req-b8cdcf40-c348-4b22-ae37-a1efb6db6730 req-5ad9fa54-8b2c-481e-8eb2-b83697262726 tempest-VolumesSnapshotsTestJSON-1944727269 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-7fd60558-c47a-4de8-8775-1723d1d1b6d6" returned: 0 in 0.509s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:15:11 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [req-b8cdcf40-c348-4b22-ae37-a1efb6db6730 req-5ad9fa54-8b2c-481e-8eb2-b83697262726 tempest-VolumesSnapshotsTestJSON-1944727269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-7fd60558-c47a-4de8-8775-1723d1d1b6d6.03fd8247-9aae-488c-a6cd-240d6e74870e {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:15:11 devstack sudo[90896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-7fd60558-c47a-4de8-8775-1723d1d1b6d6.03fd8247-9aae-488c-a6cd-240d6e74870e Jul 31 12:15:11 devstack sudo[90896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:15:11 devstack sudo[90896]: pam_unix(sudo:session): session closed for user root Jul 31 12:15:11 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [req-b8cdcf40-c348-4b22-ae37-a1efb6db6730 req-5ad9fa54-8b2c-481e-8eb2-b83697262726 tempest-VolumesSnapshotsTestJSON-1944727269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-7fd60558-c47a-4de8-8775-1723d1d1b6d6.03fd8247-9aae-488c-a6cd-240d6e74870e" returned: 0 in 0.464s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:15:11 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [req-b8cdcf40-c348-4b22-ae37-a1efb6db6730 req-5ad9fa54-8b2c-481e-8eb2-b83697262726 tempest-VolumesSnapshotsTestJSON-1944727269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-7fd60558-c47a-4de8-8775-1723d1d1b6d6.03fd8247-9aae-488c-a6cd-240d6e74870e {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:15:11 devstack sudo[90901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-7fd60558-c47a-4de8-8775-1723d1d1b6d6.03fd8247-9aae-488c-a6cd-240d6e74870e Jul 31 12:15:11 devstack sudo[90901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:15:12 devstack sudo[90901]: pam_unix(sudo:session): session closed for user root Jul 31 12:15:12 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [req-b8cdcf40-c348-4b22-ae37-a1efb6db6730 req-5ad9fa54-8b2c-481e-8eb2-b83697262726 tempest-VolumesSnapshotsTestJSON-1944727269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-7fd60558-c47a-4de8-8775-1723d1d1b6d6.03fd8247-9aae-488c-a6cd-240d6e74870e" returned: 0 in 0.307s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:15:12 devstack cinder-volume[89182]: DEBUG cinder.coordination [req-b8cdcf40-c348-4b22-ae37-a1efb6db6730 req-5ad9fa54-8b2c-481e-8eb2-b83697262726 tempest-VolumesSnapshotsTestJSON-1944727269 None] Lock "cinder-quobyte-03fd8247-9aae-488c-a6cd-240d6e74870e" released by "_delete_snapshot" :: held 2.130s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:15:12 devstack cinder-volume[89182]: DEBUG cinder.coordination [req-b8cdcf40-c348-4b22-ae37-a1efb6db6730 req-5ad9fa54-8b2c-481e-8eb2-b83697262726 tempest-VolumesSnapshotsTestJSON-1944727269 None] Lock "cinder-quobyte-7fd60558-c47a-4de8-8775-1723d1d1b6d6" released by "delete_snapshot" :: held 2.185s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:15:12 devstack cinder-volume[89182]: WARNING cinder.quota [req-b8cdcf40-c348-4b22-ae37-a1efb6db6730 req-5ad9fa54-8b2c-481e-8eb2-b83697262726 tempest-VolumesSnapshotsTestJSON-1944727269 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 31 12:15:12 devstack cinder-volume[89182]: DEBUG cinder.quota [req-b8cdcf40-c348-4b22-ae37-a1efb6db6730 req-5ad9fa54-8b2c-481e-8eb2-b83697262726 tempest-VolumesSnapshotsTestJSON-1944727269 None] Created reservations ['d8600e4e-5aa1-48b9-b8e0-042aad1d3d66', '479d88ab-a666-4d82-842d-4947763d8650', 'b6097790-efd5-461d-959d-f640af493951', 'f7a2a485-7c0a-45a4-a69d-9e428fe07964'] {{(pid=89182) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 12:15:12 devstack cinder-volume[89182]: INFO cinder.volume.manager [req-b8cdcf40-c348-4b22-ae37-a1efb6db6730 req-5ad9fa54-8b2c-481e-8eb2-b83697262726 tempest-VolumesSnapshotsTestJSON-1944727269 None] Delete snapshot completed successfully. Jul 31 12:15:12 devstack cinder-volume[89182]: DEBUG cinder.coordination [req-b8cdcf40-c348-4b22-ae37-a1efb6db6730 req-5ad9fa54-8b2c-481e-8eb2-b83697262726 tempest-VolumesSnapshotsTestJSON-1944727269 None] Lock "cinder-03fd8247-9aae-488c-a6cd-240d6e74870e-delete_snapshot" released by "delete_snapshot" :: held 2.575s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:15:13 devstack cinder-volume[89182]: DEBUG cinder.coordination [req-ff03e1ad-717b-4106-9cb1-7fe33e897fea req-953a7b34-15fd-4437-8223-da80473ee54b tempest-VolumesSnapshotsTestJSON-1944727269 None] Acquiring lock "cinder-7fd60558-c47a-4de8-8775-1723d1d1b6d6-delete_volume" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:15:13 devstack cinder-volume[89182]: DEBUG cinder.coordination [req-ff03e1ad-717b-4106-9cb1-7fe33e897fea req-953a7b34-15fd-4437-8223-da80473ee54b tempest-VolumesSnapshotsTestJSON-1944727269 None] Lock "cinder-7fd60558-c47a-4de8-8775-1723d1d1b6d6-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:15:13 devstack cinder-volume[89182]: DEBUG cinder.coordination [req-ff03e1ad-717b-4106-9cb1-7fe33e897fea req-953a7b34-15fd-4437-8223-da80473ee54b tempest-VolumesSnapshotsTestJSON-1944727269 None] Acquiring lock "cinder-quobyte-7fd60558-c47a-4de8-8775-1723d1d1b6d6" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:15:13 devstack cinder-volume[89182]: DEBUG cinder.coordination [req-ff03e1ad-717b-4106-9cb1-7fe33e897fea req-953a7b34-15fd-4437-8223-da80473ee54b tempest-VolumesSnapshotsTestJSON-1944727269 None] Lock "cinder-quobyte-7fd60558-c47a-4de8-8775-1723d1d1b6d6" acquired by "delete_volume" :: waited 0.020s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:15:13 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6023740-a66b-4179-9c21-a875800a0d1d]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:15:13 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [req-ff03e1ad-717b-4106-9cb1-7fe33e897fea req-953a7b34-15fd-4437-8223-da80473ee54b tempest-VolumesSnapshotsTestJSON-1944727269 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-7fd60558-c47a-4de8-8775-1723d1d1b6d6 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:15:13 devstack sudo[90911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-7fd60558-c47a-4de8-8775-1723d1d1b6d6 Jul 31 12:15:13 devstack sudo[90911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:15:14 devstack sudo[90911]: pam_unix(sudo:session): session closed for user root Jul 31 12:15:14 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [req-ff03e1ad-717b-4106-9cb1-7fe33e897fea req-953a7b34-15fd-4437-8223-da80473ee54b tempest-VolumesSnapshotsTestJSON-1944727269 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-7fd60558-c47a-4de8-8775-1723d1d1b6d6" returned: 0 in 0.532s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:15:14 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [req-ff03e1ad-717b-4106-9cb1-7fe33e897fea req-953a7b34-15fd-4437-8223-da80473ee54b tempest-VolumesSnapshotsTestJSON-1944727269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-7fd60558-c47a-4de8-8775-1723d1d1b6d6 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:15:14 devstack sudo[90917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-7fd60558-c47a-4de8-8775-1723d1d1b6d6 Jul 31 12:15:14 devstack sudo[90917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:15:14 devstack sudo[90917]: pam_unix(sudo:session): session closed for user root Jul 31 12:15:14 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [req-ff03e1ad-717b-4106-9cb1-7fe33e897fea req-953a7b34-15fd-4437-8223-da80473ee54b tempest-VolumesSnapshotsTestJSON-1944727269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-7fd60558-c47a-4de8-8775-1723d1d1b6d6" returned: 0 in 0.312s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:15:14 devstack cinder-volume[89182]: DEBUG cinder.coordination [req-ff03e1ad-717b-4106-9cb1-7fe33e897fea req-953a7b34-15fd-4437-8223-da80473ee54b tempest-VolumesSnapshotsTestJSON-1944727269 None] Lock "cinder-quobyte-7fd60558-c47a-4de8-8775-1723d1d1b6d6" released by "delete_volume" :: held 0.954s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:15:14 devstack cinder-volume[89182]: DEBUG cinder.quota [req-ff03e1ad-717b-4106-9cb1-7fe33e897fea req-953a7b34-15fd-4437-8223-da80473ee54b tempest-VolumesSnapshotsTestJSON-1944727269 None] Created reservations ['29ee801e-6a9f-415a-abd4-1e10a6f4b2c7', 'bc570a09-6ed5-4fb7-bc5b-2fa723cc363a', 'da23bee6-8554-429c-8b6d-e209b0ae30ee', '2e7b94cb-1ec7-4ed4-8a25-962eeb869707'] {{(pid=89182) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 12:15:14 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [req-ff03e1ad-717b-4106-9cb1-7fe33e897fea req-953a7b34-15fd-4437-8223-da80473ee54b tempest-VolumesSnapshotsTestJSON-1944727269 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:15:14 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [req-ff03e1ad-717b-4106-9cb1-7fe33e897fea req-953a7b34-15fd-4437-8223-da80473ee54b tempest-VolumesSnapshotsTestJSON-1944727269 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:15:14 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [req-ff03e1ad-717b-4106-9cb1-7fe33e897fea req-953a7b34-15fd-4437-8223-da80473ee54b tempest-VolumesSnapshotsTestJSON-1944727269 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:15:14 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [req-ff03e1ad-717b-4106-9cb1-7fe33e897fea req-953a7b34-15fd-4437-8223-da80473ee54b tempest-VolumesSnapshotsTestJSON-1944727269 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:15:14 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [req-ff03e1ad-717b-4106-9cb1-7fe33e897fea req-953a7b34-15fd-4437-8223-da80473ee54b tempest-VolumesSnapshotsTestJSON-1944727269 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:15:14 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [req-ff03e1ad-717b-4106-9cb1-7fe33e897fea req-953a7b34-15fd-4437-8223-da80473ee54b tempest-VolumesSnapshotsTestJSON-1944727269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:15:14 devstack sudo[90920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 Jul 31 12:15:14 devstack sudo[90920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:15:15 devstack sudo[90920]: pam_unix(sudo:session): session closed for user root Jul 31 12:15:15 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [req-ff03e1ad-717b-4106-9cb1-7fe33e897fea req-953a7b34-15fd-4437-8223-da80473ee54b tempest-VolumesSnapshotsTestJSON-1944727269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2" returned: 0 in 0.468s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:15:15 devstack cinder-volume[89182]: DEBUG cinder.manager [req-ff03e1ad-717b-4106-9cb1-7fe33e897fea req-953a7b34-15fd-4437-8223-da80473ee54b tempest-VolumesSnapshotsTestJSON-1944727269 None] Notifying Schedulers of capabilities ... {{(pid=89182) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 12:15:15 devstack cinder-volume[89182]: INFO cinder.volume.manager [req-ff03e1ad-717b-4106-9cb1-7fe33e897fea req-953a7b34-15fd-4437-8223-da80473ee54b tempest-VolumesSnapshotsTestJSON-1944727269 None] Deleted volume successfully. Jul 31 12:15:15 devstack cinder-volume[89182]: DEBUG cinder.coordination [req-ff03e1ad-717b-4106-9cb1-7fe33e897fea req-953a7b34-15fd-4437-8223-da80473ee54b tempest-VolumesSnapshotsTestJSON-1944727269 None] Lock "cinder-7fd60558-c47a-4de8-8775-1723d1d1b6d6-delete_volume" released by "delete_volume" :: held 1.697s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:15:21 devstack cinder-volume[89182]: DEBUG oslo_service.periodic_task [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89182) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 31 12:15:21 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:15:21 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:15:21 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:15:21 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:15:21 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:15:21 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:15:22 devstack sudo[90983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 Jul 31 12:15:22 devstack sudo[90983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:15:22 devstack sudo[90983]: pam_unix(sudo:session): session closed for user root Jul 31 12:15:22 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2" returned: 0 in 0.576s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:15:22 devstack cinder-volume[89182]: DEBUG cinder.manager [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] Notifying Schedulers of capabilities ... {{(pid=89182) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 12:15:22 devstack cinder-volume[89182]: DEBUG oslo_service.periodic_task [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] Running periodic task VolumeManager._thread_info {{(pid=89182) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 31 12:15:22 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] thread count: 8 {{(pid=89182) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 31 12:15:22 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] thread info: [<_MainThread(MainThread, started 136154603720832)>, , , , , , , ] {{(pid=89182) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 31 12:15:23 devstack cinder-volume[89182]: DEBUG cinder.volume.flows.manager.create_volume [None req-ffc030ff-bd86-4495-a791-dca84329f358 tempest-VolumesTestJSON-216924624 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89182) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 12:15:23 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-ffc030ff-bd86-4495-a791-dca84329f358 tempest-VolumesTestJSON-216924624 None] Flow 'volume_create_manager' (494ec0c1-1234-41cf-bf05-98cce0a94bbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:15:23 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-ffc030ff-bd86-4495-a791-dca84329f358 tempest-VolumesTestJSON-216924624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b867147-ab13-49e3-8109-06b10c8ef62b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:15:23 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-ffc030ff-bd86-4495-a791-dca84329f358 tempest-VolumesTestJSON-216924624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b867147-ab13-49e3-8109-06b10c8ef62b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:15:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-621702596',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35222f17-e541-49bc-a617-3266f14d9e1d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3099619fe8f04cca946bf480c6fd7b57',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:15:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:15:23Z,use_quota=True,user_id='2e07562aceda4569b0df7d3ddb3a9f4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:15:23 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-ffc030ff-bd86-4495-a791-dca84329f358 tempest-VolumesTestJSON-216924624 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3be35d5a-7bb0-47ae-9066-c709ae9cf237) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:15:23 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-ffc030ff-bd86-4495-a791-dca84329f358 tempest-VolumesTestJSON-216924624 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3be35d5a-7bb0-47ae-9066-c709ae9cf237) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:15:23 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-ffc030ff-bd86-4495-a791-dca84329f358 tempest-VolumesTestJSON-216924624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5deaa067-1bb5-4dd5-b442-0b59064e75ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:15:23 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-ffc030ff-bd86-4495-a791-dca84329f358 tempest-VolumesTestJSON-216924624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5deaa067-1bb5-4dd5-b442-0b59064e75ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '35222f17-e541-49bc-a617-3266f14d9e1d', 'volume_name': 'volume-35222f17-e541-49bc-a617-3266f14d9e1d', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:15:23 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-ffc030ff-bd86-4495-a791-dca84329f358 tempest-VolumesTestJSON-216924624 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1766a196-d785-4520-8b34-305921cacde1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:15:23 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-ffc030ff-bd86-4495-a791-dca84329f358 tempest-VolumesTestJSON-216924624 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1766a196-d785-4520-8b34-305921cacde1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:15:23 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-ffc030ff-bd86-4495-a791-dca84329f358 tempest-VolumesTestJSON-216924624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cdc95c33-4cf2-435d-94c8-dc89d1419675) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:15:23 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-ffc030ff-bd86-4495-a791-dca84329f358 tempest-VolumesTestJSON-216924624 None] Volume 35222f17-e541-49bc-a617-3266f14d9e1d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-35222f17-e541-49bc-a617-3266f14d9e1d', 'volume_size': 1} Jul 31 12:15:23 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-ffc030ff-bd86-4495-a791-dca84329f358 tempest-VolumesTestJSON-216924624 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:15:23 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-ffc030ff-bd86-4495-a791-dca84329f358 tempest-VolumesTestJSON-216924624 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:15:23 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-ffc030ff-bd86-4495-a791-dca84329f358 tempest-VolumesTestJSON-216924624 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:15:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-621702596',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35222f17-e541-49bc-a617-3266f14d9e1d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3099619fe8f04cca946bf480c6fd7b57',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:15:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:15:23Z,use_quota=True,user_id='2e07562aceda4569b0df7d3ddb3a9f4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)}" {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 12:15:23 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-ffc030ff-bd86-4495-a791-dca84329f358 tempest-VolumesTestJSON-216924624 None] Creating volume 35222f17-e541-49bc-a617-3266f14d9e1d {{(pid=89182) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 12:15:23 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-ffc030ff-bd86-4495-a791-dca84329f358 tempest-VolumesTestJSON-216924624 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:15:23 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-ffc030ff-bd86-4495-a791-dca84329f358 tempest-VolumesTestJSON-216924624 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:15:23 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-ffc030ff-bd86-4495-a791-dca84329f358 tempest-VolumesTestJSON-216924624 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:15:23 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-ffc030ff-bd86-4495-a791-dca84329f358 tempest-VolumesTestJSON-216924624 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:15:23 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-ffc030ff-bd86-4495-a791-dca84329f358 tempest-VolumesTestJSON-216924624 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:15:23 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-ffc030ff-bd86-4495-a791-dca84329f358 tempest-VolumesTestJSON-216924624 None] Selected osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 as target Quobyte volume. {{(pid=89182) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 12:15:23 devstack cinder-volume[89182]: INFO cinder.volume.drivers.remotefs [None req-ffc030ff-bd86-4495-a791-dca84329f358 tempest-VolumesTestJSON-216924624 None] casted to osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 Jul 31 12:15:23 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-ffc030ff-bd86-4495-a791-dca84329f358 tempest-VolumesTestJSON-216924624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-35222f17-e541-49bc-a617-3266f14d9e1d 1073741824 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:15:23 devstack sudo[91036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-35222f17-e541-49bc-a617-3266f14d9e1d 1073741824 Jul 31 12:15:23 devstack sudo[91036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:15:24 devstack sudo[91036]: pam_unix(sudo:session): session closed for user root Jul 31 12:15:24 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-ffc030ff-bd86-4495-a791-dca84329f358 tempest-VolumesTestJSON-216924624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-35222f17-e541-49bc-a617-3266f14d9e1d 1073741824" returned: 0 in 0.613s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:15:24 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-ffc030ff-bd86-4495-a791-dca84329f358 tempest-VolumesTestJSON-216924624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-35222f17-e541-49bc-a617-3266f14d9e1d {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:15:24 devstack sudo[91056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-35222f17-e541-49bc-a617-3266f14d9e1d Jul 31 12:15:24 devstack sudo[91056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:15:24 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [req-edacae6b-9c8b-42d3-87d3-de7b58f43a44 req-212a3c83-7351-4d4a-8093-ee602c56ea27 tempest-TaggedAttachmentsTest-1522025151 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:15:24 devstack sudo[91056]: pam_unix(sudo:session): session closed for user root Jul 31 12:15:24 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-ffc030ff-bd86-4495-a791-dca84329f358 tempest-VolumesTestJSON-216924624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-35222f17-e541-49bc-a617-3266f14d9e1d" returned: 0 in 0.322s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:15:24 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-ffc030ff-bd86-4495-a791-dca84329f358 tempest-VolumesTestJSON-216924624 None] <== create_volume: return (990ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'} {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 12:15:24 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-ffc030ff-bd86-4495-a791-dca84329f358 tempest-VolumesTestJSON-216924624 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.992s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:15:24 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [req-edacae6b-9c8b-42d3-87d3-de7b58f43a44 req-212a3c83-7351-4d4a-8093-ee602c56ea27 tempest-TaggedAttachmentsTest-1522025151 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.060s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:15:24 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-ffc030ff-bd86-4495-a791-dca84329f358 tempest-VolumesTestJSON-216924624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cdc95c33-4cf2-435d-94c8-dc89d1419675) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-35222f17-e541-49bc-a617-3266f14d9e1d', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:15:24 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-ffc030ff-bd86-4495-a791-dca84329f358 tempest-VolumesTestJSON-216924624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36a8e7ad-a6a1-4be7-b598-3b208023a8a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:15:24 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [req-edacae6b-9c8b-42d3-87d3-de7b58f43a44 req-212a3c83-7351-4d4a-8093-ee602c56ea27 tempest-TaggedAttachmentsTest-1522025151 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.098s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:15:24 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-ffc030ff-bd86-4495-a791-dca84329f358 tempest-VolumesTestJSON-216924624 None] Volume volume-35222f17-e541-49bc-a617-3266f14d9e1d (35222f17-e541-49bc-a617-3266f14d9e1d): created successfully Jul 31 12:15:24 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-ffc030ff-bd86-4495-a791-dca84329f358 tempest-VolumesTestJSON-216924624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36a8e7ad-a6a1-4be7-b598-3b208023a8a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:15:24 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-ffc030ff-bd86-4495-a791-dca84329f358 tempest-VolumesTestJSON-216924624 None] Flow 'volume_create_manager' (494ec0c1-1234-41cf-bf05-98cce0a94bbe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:15:24 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-ffc030ff-bd86-4495-a791-dca84329f358 tempest-VolumesTestJSON-216924624 None] Created volume successfully. Jul 31 12:15:24 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [req-edacae6b-9c8b-42d3-87d3-de7b58f43a44 req-212a3c83-7351-4d4a-8093-ee602c56ea27 tempest-TaggedAttachmentsTest-1522025151 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88', 'name': 'volume-3f4a70a7-a49c-4ea0-ada7-7e07baf67575', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '21d297f5-6c9c-487a-844c-f9f15bf0fb99', 'enforce_multipath': True} {{(pid=89182) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 31 12:15:24 devstack cinder-volume[89182]: INFO cinder.volume.manager [req-edacae6b-9c8b-42d3-87d3-de7b58f43a44 req-212a3c83-7351-4d4a-8093-ee602c56ea27 tempest-TaggedAttachmentsTest-1522025151 None] attachment_update completed successfully. Jul 31 12:15:25 devstack cinder-volume[89182]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b381842-f228-4d1b-bdb6-37b956ed0e04 tempest-VolumesTestJSON-216924624 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89182) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 12:15:25 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-5b381842-f228-4d1b-bdb6-37b956ed0e04 tempest-VolumesTestJSON-216924624 None] Flow 'volume_create_manager' (7abb057f-08e8-4902-862e-236421e9d049) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:15:25 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-5b381842-f228-4d1b-bdb6-37b956ed0e04 tempest-VolumesTestJSON-216924624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebe573d9-b497-4ddf-92f5-6ccb6f1f467c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:15:25 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-5b381842-f228-4d1b-bdb6-37b956ed0e04 tempest-VolumesTestJSON-216924624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebe573d9-b497-4ddf-92f5-6ccb6f1f467c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:15:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-855988135',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d096a4b0-6b2e-4f96-81b1-b64a0b8bf948,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3099619fe8f04cca946bf480c6fd7b57',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:15:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:15:26Z,use_quota=True,user_id='2e07562aceda4569b0df7d3ddb3a9f4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:15:25 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-5b381842-f228-4d1b-bdb6-37b956ed0e04 tempest-VolumesTestJSON-216924624 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0125c9bb-a614-418c-87e7-5accc5a3a909) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:15:25 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-5b381842-f228-4d1b-bdb6-37b956ed0e04 tempest-VolumesTestJSON-216924624 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0125c9bb-a614-418c-87e7-5accc5a3a909) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:15:25 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-5b381842-f228-4d1b-bdb6-37b956ed0e04 tempest-VolumesTestJSON-216924624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d012fb0-97aa-4a39-93d7-ad4e60ce3757) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:15:25 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-5b381842-f228-4d1b-bdb6-37b956ed0e04 tempest-VolumesTestJSON-216924624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d012fb0-97aa-4a39-93d7-ad4e60ce3757) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd096a4b0-6b2e-4f96-81b1-b64a0b8bf948', 'volume_name': 'volume-d096a4b0-6b2e-4f96-81b1-b64a0b8bf948', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:15:25 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-5b381842-f228-4d1b-bdb6-37b956ed0e04 tempest-VolumesTestJSON-216924624 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b26a390-011e-4019-80a1-fd8006cddee9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:15:25 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-5b381842-f228-4d1b-bdb6-37b956ed0e04 tempest-VolumesTestJSON-216924624 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b26a390-011e-4019-80a1-fd8006cddee9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:15:25 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-5b381842-f228-4d1b-bdb6-37b956ed0e04 tempest-VolumesTestJSON-216924624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5af2f0db-ba34-46e5-ad80-8a7959126b93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:15:25 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-5b381842-f228-4d1b-bdb6-37b956ed0e04 tempest-VolumesTestJSON-216924624 None] Volume d096a4b0-6b2e-4f96-81b1-b64a0b8bf948: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d096a4b0-6b2e-4f96-81b1-b64a0b8bf948', 'volume_size': 1} Jul 31 12:15:25 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-5b381842-f228-4d1b-bdb6-37b956ed0e04 tempest-VolumesTestJSON-216924624 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:15:25 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-5b381842-f228-4d1b-bdb6-37b956ed0e04 tempest-VolumesTestJSON-216924624 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:15:25 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-5b381842-f228-4d1b-bdb6-37b956ed0e04 tempest-VolumesTestJSON-216924624 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:15:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-855988135',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d096a4b0-6b2e-4f96-81b1-b64a0b8bf948,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3099619fe8f04cca946bf480c6fd7b57',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:15:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:15:26Z,use_quota=True,user_id='2e07562aceda4569b0df7d3ddb3a9f4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)}" {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 12:15:25 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-5b381842-f228-4d1b-bdb6-37b956ed0e04 tempest-VolumesTestJSON-216924624 None] Creating volume d096a4b0-6b2e-4f96-81b1-b64a0b8bf948 {{(pid=89182) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 12:15:25 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-5b381842-f228-4d1b-bdb6-37b956ed0e04 tempest-VolumesTestJSON-216924624 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:15:25 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-5b381842-f228-4d1b-bdb6-37b956ed0e04 tempest-VolumesTestJSON-216924624 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:15:25 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-5b381842-f228-4d1b-bdb6-37b956ed0e04 tempest-VolumesTestJSON-216924624 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:15:25 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-5b381842-f228-4d1b-bdb6-37b956ed0e04 tempest-VolumesTestJSON-216924624 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:15:25 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-5b381842-f228-4d1b-bdb6-37b956ed0e04 tempest-VolumesTestJSON-216924624 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:15:25 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-5b381842-f228-4d1b-bdb6-37b956ed0e04 tempest-VolumesTestJSON-216924624 None] Selected osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 as target Quobyte volume. {{(pid=89182) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 12:15:25 devstack cinder-volume[89182]: INFO cinder.volume.drivers.remotefs [None req-5b381842-f228-4d1b-bdb6-37b956ed0e04 tempest-VolumesTestJSON-216924624 None] casted to osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 Jul 31 12:15:25 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-5b381842-f228-4d1b-bdb6-37b956ed0e04 tempest-VolumesTestJSON-216924624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-d096a4b0-6b2e-4f96-81b1-b64a0b8bf948 1073741824 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:15:25 devstack sudo[91449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-d096a4b0-6b2e-4f96-81b1-b64a0b8bf948 1073741824 Jul 31 12:15:25 devstack sudo[91449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:15:26 devstack sudo[91449]: pam_unix(sudo:session): session closed for user root Jul 31 12:15:26 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-5b381842-f228-4d1b-bdb6-37b956ed0e04 tempest-VolumesTestJSON-216924624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-d096a4b0-6b2e-4f96-81b1-b64a0b8bf948 1073741824" returned: 0 in 0.519s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:15:26 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-5b381842-f228-4d1b-bdb6-37b956ed0e04 tempest-VolumesTestJSON-216924624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-d096a4b0-6b2e-4f96-81b1-b64a0b8bf948 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:15:26 devstack sudo[91494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-d096a4b0-6b2e-4f96-81b1-b64a0b8bf948 Jul 31 12:15:26 devstack sudo[91494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:15:26 devstack sudo[91494]: pam_unix(sudo:session): session closed for user root Jul 31 12:15:26 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-5b381842-f228-4d1b-bdb6-37b956ed0e04 tempest-VolumesTestJSON-216924624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-d096a4b0-6b2e-4f96-81b1-b64a0b8bf948" returned: 0 in 0.272s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:15:26 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-5b381842-f228-4d1b-bdb6-37b956ed0e04 tempest-VolumesTestJSON-216924624 None] <== create_volume: return (849ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'} {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 12:15:26 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-5b381842-f228-4d1b-bdb6-37b956ed0e04 tempest-VolumesTestJSON-216924624 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.852s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:15:26 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-5b381842-f228-4d1b-bdb6-37b956ed0e04 tempest-VolumesTestJSON-216924624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5af2f0db-ba34-46e5-ad80-8a7959126b93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d096a4b0-6b2e-4f96-81b1-b64a0b8bf948', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:15:26 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-5b381842-f228-4d1b-bdb6-37b956ed0e04 tempest-VolumesTestJSON-216924624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6d5a36e-d5ec-40aa-ae1f-2bdacd52349a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:15:26 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-5b381842-f228-4d1b-bdb6-37b956ed0e04 tempest-VolumesTestJSON-216924624 None] Volume volume-d096a4b0-6b2e-4f96-81b1-b64a0b8bf948 (d096a4b0-6b2e-4f96-81b1-b64a0b8bf948): created successfully Jul 31 12:15:26 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-5b381842-f228-4d1b-bdb6-37b956ed0e04 tempest-VolumesTestJSON-216924624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6d5a36e-d5ec-40aa-ae1f-2bdacd52349a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:15:26 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-5b381842-f228-4d1b-bdb6-37b956ed0e04 tempest-VolumesTestJSON-216924624 None] Flow 'volume_create_manager' (7abb057f-08e8-4902-862e-236421e9d049) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:15:26 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-5b381842-f228-4d1b-bdb6-37b956ed0e04 tempest-VolumesTestJSON-216924624 None] Created volume successfully. Jul 31 12:15:27 devstack cinder-volume[89182]: INFO cinder.volume.manager [req-1085310d-fa98-415e-bda6-e62718c62a15 req-c292a3b9-d13d-401a-b69d-c00c93d8fb26 tempest-TaggedAttachmentsTest-1522025151 None] Terminate volume connection completed successfully. Jul 31 12:15:27 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [req-1085310d-fa98-415e-bda6-e62718c62a15 req-c292a3b9-d13d-401a-b69d-c00c93d8fb26 tempest-TaggedAttachmentsTest-1522025151 None] Deleting attachment 21d297f5-6c9c-487a-844c-f9f15bf0fb99. {{(pid=89182) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 31 12:15:28 devstack cinder-volume[89182]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e996e6f-3244-4a52-9dca-03e0d645f7de tempest-VolumesTestJSON-216924624 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89182) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 12:15:28 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-4e996e6f-3244-4a52-9dca-03e0d645f7de tempest-VolumesTestJSON-216924624 None] Flow 'volume_create_manager' (b0915265-9d2e-4f26-b6c0-3aab78101d36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:15:28 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-4e996e6f-3244-4a52-9dca-03e0d645f7de tempest-VolumesTestJSON-216924624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df01aa51-34ba-4cb7-b388-0fd7b8b8ef2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:15:28 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-4e996e6f-3244-4a52-9dca-03e0d645f7de tempest-VolumesTestJSON-216924624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df01aa51-34ba-4cb7-b388-0fd7b8b8ef2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:15:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-81732552',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7c5179f-f55e-453d-90ac-6b71605d3a48,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3099619fe8f04cca946bf480c6fd7b57',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:15:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:15:28Z,use_quota=True,user_id='2e07562aceda4569b0df7d3ddb3a9f4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:15:28 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-4e996e6f-3244-4a52-9dca-03e0d645f7de tempest-VolumesTestJSON-216924624 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7a6c929-d804-4067-9518-ef15edcb6197) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:15:28 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-4e996e6f-3244-4a52-9dca-03e0d645f7de tempest-VolumesTestJSON-216924624 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7a6c929-d804-4067-9518-ef15edcb6197) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:15:28 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-4e996e6f-3244-4a52-9dca-03e0d645f7de tempest-VolumesTestJSON-216924624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5e934a0-3cc0-4c78-af51-af71334edac3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:15:28 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-4e996e6f-3244-4a52-9dca-03e0d645f7de tempest-VolumesTestJSON-216924624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5e934a0-3cc0-4c78-af51-af71334edac3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c7c5179f-f55e-453d-90ac-6b71605d3a48', 'volume_name': 'volume-c7c5179f-f55e-453d-90ac-6b71605d3a48', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:15:28 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-4e996e6f-3244-4a52-9dca-03e0d645f7de tempest-VolumesTestJSON-216924624 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c5e064a-1d8b-4550-a231-79396dc33a50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:15:28 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-4e996e6f-3244-4a52-9dca-03e0d645f7de tempest-VolumesTestJSON-216924624 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c5e064a-1d8b-4550-a231-79396dc33a50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:15:28 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-4e996e6f-3244-4a52-9dca-03e0d645f7de tempest-VolumesTestJSON-216924624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e015867-e56c-41ad-8b9a-6cf719797574) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:15:28 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-4e996e6f-3244-4a52-9dca-03e0d645f7de tempest-VolumesTestJSON-216924624 None] Volume c7c5179f-f55e-453d-90ac-6b71605d3a48: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c7c5179f-f55e-453d-90ac-6b71605d3a48', 'volume_size': 1} Jul 31 12:15:28 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-4e996e6f-3244-4a52-9dca-03e0d645f7de tempest-VolumesTestJSON-216924624 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:15:28 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-4e996e6f-3244-4a52-9dca-03e0d645f7de tempest-VolumesTestJSON-216924624 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:15:28 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-4e996e6f-3244-4a52-9dca-03e0d645f7de tempest-VolumesTestJSON-216924624 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:15:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-81732552',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7c5179f-f55e-453d-90ac-6b71605d3a48,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3099619fe8f04cca946bf480c6fd7b57',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:15:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:15:28Z,use_quota=True,user_id='2e07562aceda4569b0df7d3ddb3a9f4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)}" {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 12:15:28 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-4e996e6f-3244-4a52-9dca-03e0d645f7de tempest-VolumesTestJSON-216924624 None] Creating volume c7c5179f-f55e-453d-90ac-6b71605d3a48 {{(pid=89182) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 12:15:28 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-4e996e6f-3244-4a52-9dca-03e0d645f7de tempest-VolumesTestJSON-216924624 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:15:28 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-4e996e6f-3244-4a52-9dca-03e0d645f7de tempest-VolumesTestJSON-216924624 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:15:28 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-4e996e6f-3244-4a52-9dca-03e0d645f7de tempest-VolumesTestJSON-216924624 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:15:28 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-4e996e6f-3244-4a52-9dca-03e0d645f7de tempest-VolumesTestJSON-216924624 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:15:28 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-4e996e6f-3244-4a52-9dca-03e0d645f7de tempest-VolumesTestJSON-216924624 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:15:28 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-4e996e6f-3244-4a52-9dca-03e0d645f7de tempest-VolumesTestJSON-216924624 None] Selected osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 as target Quobyte volume. {{(pid=89182) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 12:15:28 devstack cinder-volume[89182]: INFO cinder.volume.drivers.remotefs [None req-4e996e6f-3244-4a52-9dca-03e0d645f7de tempest-VolumesTestJSON-216924624 None] casted to osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 Jul 31 12:15:28 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-4e996e6f-3244-4a52-9dca-03e0d645f7de tempest-VolumesTestJSON-216924624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-c7c5179f-f55e-453d-90ac-6b71605d3a48 1073741824 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:15:28 devstack sudo[91529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-c7c5179f-f55e-453d-90ac-6b71605d3a48 1073741824 Jul 31 12:15:28 devstack sudo[91529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:15:29 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-4e996e6f-3244-4a52-9dca-03e0d645f7de tempest-VolumesTestJSON-216924624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-c7c5179f-f55e-453d-90ac-6b71605d3a48 1073741824" returned: 0 in 0.742s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:15:29 devstack sudo[91529]: pam_unix(sudo:session): session closed for user root Jul 31 12:15:29 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-4e996e6f-3244-4a52-9dca-03e0d645f7de tempest-VolumesTestJSON-216924624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-c7c5179f-f55e-453d-90ac-6b71605d3a48 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:15:29 devstack sudo[91549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-c7c5179f-f55e-453d-90ac-6b71605d3a48 Jul 31 12:15:29 devstack sudo[91549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:15:29 devstack sudo[91549]: pam_unix(sudo:session): session closed for user root Jul 31 12:15:29 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-4e996e6f-3244-4a52-9dca-03e0d645f7de tempest-VolumesTestJSON-216924624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-c7c5179f-f55e-453d-90ac-6b71605d3a48" returned: 0 in 0.301s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:15:29 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-4e996e6f-3244-4a52-9dca-03e0d645f7de tempest-VolumesTestJSON-216924624 None] <== create_volume: return (1178ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'} {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 12:15:29 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-4e996e6f-3244-4a52-9dca-03e0d645f7de tempest-VolumesTestJSON-216924624 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.181s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:15:29 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-4e996e6f-3244-4a52-9dca-03e0d645f7de tempest-VolumesTestJSON-216924624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e015867-e56c-41ad-8b9a-6cf719797574) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c7c5179f-f55e-453d-90ac-6b71605d3a48', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:15:29 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-4e996e6f-3244-4a52-9dca-03e0d645f7de tempest-VolumesTestJSON-216924624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bfc8cf0e-f4f6-40c0-99b2-4a3f1779f836) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:15:29 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-4e996e6f-3244-4a52-9dca-03e0d645f7de tempest-VolumesTestJSON-216924624 None] Volume volume-c7c5179f-f55e-453d-90ac-6b71605d3a48 (c7c5179f-f55e-453d-90ac-6b71605d3a48): created successfully Jul 31 12:15:29 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-4e996e6f-3244-4a52-9dca-03e0d645f7de tempest-VolumesTestJSON-216924624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bfc8cf0e-f4f6-40c0-99b2-4a3f1779f836) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:15:29 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-4e996e6f-3244-4a52-9dca-03e0d645f7de tempest-VolumesTestJSON-216924624 None] Flow 'volume_create_manager' (b0915265-9d2e-4f26-b6c0-3aab78101d36) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:15:29 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-4e996e6f-3244-4a52-9dca-03e0d645f7de tempest-VolumesTestJSON-216924624 None] Created volume successfully. Jul 31 12:15:32 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-c6d0bafc-ab15-4094-bb77-623608f7c080 tempest-VolumesTestJSON-216924624 None] Acquiring lock "cinder-c7c5179f-f55e-453d-90ac-6b71605d3a48-delete_volume" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:15:32 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-c6d0bafc-ab15-4094-bb77-623608f7c080 tempest-VolumesTestJSON-216924624 None] Lock "cinder-c7c5179f-f55e-453d-90ac-6b71605d3a48-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:15:32 devstack cinder-volume[89182]: DEBUG dbcounter [-] [89182] Writing DB stats cinder:SELECT=51,cinder:UPDATE=46,cinder:INSERT=5,cinder:DELETE=1 {{(pid=89182) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 12:15:32 devstack cinder-volume[89182]: DEBUG dbcounter [-] [89182] Writing DB stats cinder:SELECT=43,cinder:UPDATE=44,cinder:DELETE=8,cinder:INSERT=14 {{(pid=89182) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 12:15:32 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-c6d0bafc-ab15-4094-bb77-623608f7c080 tempest-VolumesTestJSON-216924624 None] Acquiring lock "cinder-quobyte-c7c5179f-f55e-453d-90ac-6b71605d3a48" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:15:32 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-c6d0bafc-ab15-4094-bb77-623608f7c080 tempest-VolumesTestJSON-216924624 None] Lock "cinder-quobyte-c7c5179f-f55e-453d-90ac-6b71605d3a48" acquired by "delete_volume" :: waited 0.025s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:15:32 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[79b949b8-9fb3-4e17-9f1c-80bbfd295ea2]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:15:32 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-c6d0bafc-ab15-4094-bb77-623608f7c080 tempest-VolumesTestJSON-216924624 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-c7c5179f-f55e-453d-90ac-6b71605d3a48 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:15:32 devstack sudo[91561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-c7c5179f-f55e-453d-90ac-6b71605d3a48 Jul 31 12:15:32 devstack sudo[91561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:15:32 devstack sudo[91561]: pam_unix(sudo:session): session closed for user root Jul 31 12:15:32 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-c6d0bafc-ab15-4094-bb77-623608f7c080 tempest-VolumesTestJSON-216924624 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-c7c5179f-f55e-453d-90ac-6b71605d3a48" returned: 0 in 0.410s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:15:32 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-c6d0bafc-ab15-4094-bb77-623608f7c080 tempest-VolumesTestJSON-216924624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-c7c5179f-f55e-453d-90ac-6b71605d3a48 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:15:32 devstack sudo[91568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-c7c5179f-f55e-453d-90ac-6b71605d3a48 Jul 31 12:15:32 devstack sudo[91568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:15:33 devstack sudo[91568]: pam_unix(sudo:session): session closed for user root Jul 31 12:15:33 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-c6d0bafc-ab15-4094-bb77-623608f7c080 tempest-VolumesTestJSON-216924624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-c7c5179f-f55e-453d-90ac-6b71605d3a48" returned: 0 in 0.329s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:15:33 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-c6d0bafc-ab15-4094-bb77-623608f7c080 tempest-VolumesTestJSON-216924624 None] Lock "cinder-quobyte-c7c5179f-f55e-453d-90ac-6b71605d3a48" released by "delete_volume" :: held 0.795s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:15:33 devstack cinder-volume[89182]: DEBUG cinder.quota [None req-c6d0bafc-ab15-4094-bb77-623608f7c080 tempest-VolumesTestJSON-216924624 None] Created reservations ['8cd26295-b026-4edd-a21d-7d33336574d9', '23ecb65a-f346-4a57-bea9-99397038fecb', 'e326c370-47fd-47e5-8b43-d9b220e2e33c', 'c5c0d9c0-42f2-4f05-9ec4-bfb6199076d3'] {{(pid=89182) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 12:15:33 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-c6d0bafc-ab15-4094-bb77-623608f7c080 tempest-VolumesTestJSON-216924624 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:15:33 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-c6d0bafc-ab15-4094-bb77-623608f7c080 tempest-VolumesTestJSON-216924624 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:15:33 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-c6d0bafc-ab15-4094-bb77-623608f7c080 tempest-VolumesTestJSON-216924624 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:15:33 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-c6d0bafc-ab15-4094-bb77-623608f7c080 tempest-VolumesTestJSON-216924624 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:15:33 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-c6d0bafc-ab15-4094-bb77-623608f7c080 tempest-VolumesTestJSON-216924624 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:15:33 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-c6d0bafc-ab15-4094-bb77-623608f7c080 tempest-VolumesTestJSON-216924624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:15:33 devstack sudo[91571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 Jul 31 12:15:33 devstack sudo[91571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:15:33 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-a1d345ef-39a2-4c87-92bf-96b2c88ba8d7 tempest-VolumesTestJSON-216924624 None] Acquiring lock "cinder-d096a4b0-6b2e-4f96-81b1-b64a0b8bf948-delete_volume" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:15:33 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-a1d345ef-39a2-4c87-92bf-96b2c88ba8d7 tempest-VolumesTestJSON-216924624 None] Lock "cinder-d096a4b0-6b2e-4f96-81b1-b64a0b8bf948-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:15:33 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-a1d345ef-39a2-4c87-92bf-96b2c88ba8d7 tempest-VolumesTestJSON-216924624 None] Acquiring lock "cinder-quobyte-d096a4b0-6b2e-4f96-81b1-b64a0b8bf948" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:15:33 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-a1d345ef-39a2-4c87-92bf-96b2c88ba8d7 tempest-VolumesTestJSON-216924624 None] Lock "cinder-quobyte-d096a4b0-6b2e-4f96-81b1-b64a0b8bf948" acquired by "delete_volume" :: waited 0.034s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:15:33 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ef2b7a0-e948-4f9c-9f79-8d93d440dd06]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:15:33 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-a1d345ef-39a2-4c87-92bf-96b2c88ba8d7 tempest-VolumesTestJSON-216924624 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-d096a4b0-6b2e-4f96-81b1-b64a0b8bf948 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:15:33 devstack sudo[91571]: pam_unix(sudo:session): session closed for user root Jul 31 12:15:33 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-c6d0bafc-ab15-4094-bb77-623608f7c080 tempest-VolumesTestJSON-216924624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2" returned: 0 in 0.391s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:15:33 devstack cinder-volume[89182]: DEBUG cinder.manager [None req-c6d0bafc-ab15-4094-bb77-623608f7c080 tempest-VolumesTestJSON-216924624 None] Notifying Schedulers of capabilities ... {{(pid=89182) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 12:15:33 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-c6d0bafc-ab15-4094-bb77-623608f7c080 tempest-VolumesTestJSON-216924624 None] Deleted volume successfully. Jul 31 12:15:33 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-c6d0bafc-ab15-4094-bb77-623608f7c080 tempest-VolumesTestJSON-216924624 None] Lock "cinder-c7c5179f-f55e-453d-90ac-6b71605d3a48-delete_volume" released by "delete_volume" :: held 1.505s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:15:33 devstack sudo[91573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-d096a4b0-6b2e-4f96-81b1-b64a0b8bf948 Jul 31 12:15:33 devstack sudo[91573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:15:34 devstack sudo[91573]: pam_unix(sudo:session): session closed for user root Jul 31 12:15:34 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-a1d345ef-39a2-4c87-92bf-96b2c88ba8d7 tempest-VolumesTestJSON-216924624 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-d096a4b0-6b2e-4f96-81b1-b64a0b8bf948" returned: 0 in 0.597s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:15:34 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-a1d345ef-39a2-4c87-92bf-96b2c88ba8d7 tempest-VolumesTestJSON-216924624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-d096a4b0-6b2e-4f96-81b1-b64a0b8bf948 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:15:34 devstack sudo[91584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-d096a4b0-6b2e-4f96-81b1-b64a0b8bf948 Jul 31 12:15:34 devstack sudo[91584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:15:34 devstack sudo[91584]: pam_unix(sudo:session): session closed for user root Jul 31 12:15:34 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-a1d345ef-39a2-4c87-92bf-96b2c88ba8d7 tempest-VolumesTestJSON-216924624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-d096a4b0-6b2e-4f96-81b1-b64a0b8bf948" returned: 0 in 0.429s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:15:34 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-a1d345ef-39a2-4c87-92bf-96b2c88ba8d7 tempest-VolumesTestJSON-216924624 None] Lock "cinder-quobyte-d096a4b0-6b2e-4f96-81b1-b64a0b8bf948" released by "delete_volume" :: held 1.128s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:15:34 devstack cinder-volume[89182]: DEBUG cinder.quota [None req-a1d345ef-39a2-4c87-92bf-96b2c88ba8d7 tempest-VolumesTestJSON-216924624 None] Created reservations ['b709ac5e-c68f-448d-9595-4945f134bcd1', '069b8c13-9749-43b8-95fa-519f54d7ba57', '64c6f493-a04a-4f7d-8f36-8664d49ccb57', '3e4e7103-abe7-409e-87d8-bdca60f100f9'] {{(pid=89182) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 12:15:34 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-a1d345ef-39a2-4c87-92bf-96b2c88ba8d7 tempest-VolumesTestJSON-216924624 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:15:34 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-a1d345ef-39a2-4c87-92bf-96b2c88ba8d7 tempest-VolumesTestJSON-216924624 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:15:34 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-a1d345ef-39a2-4c87-92bf-96b2c88ba8d7 tempest-VolumesTestJSON-216924624 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:15:35 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-a1d345ef-39a2-4c87-92bf-96b2c88ba8d7 tempest-VolumesTestJSON-216924624 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:15:35 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-a1d345ef-39a2-4c87-92bf-96b2c88ba8d7 tempest-VolumesTestJSON-216924624 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:15:35 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-a1d345ef-39a2-4c87-92bf-96b2c88ba8d7 tempest-VolumesTestJSON-216924624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:15:35 devstack sudo[91589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 Jul 31 12:15:35 devstack sudo[91589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:15:35 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [req-cacf439a-fa37-4847-94c7-c20dc7fddb3a req-30605e2a-fb46-47a9-9aa9-aaa17bbf362b tempest-ServerActionsTestOtherA-721546481 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:15:35 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [req-cacf439a-fa37-4847-94c7-c20dc7fddb3a req-30605e2a-fb46-47a9-9aa9-aaa17bbf362b tempest-ServerActionsTestOtherA-721546481 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:15:35 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [req-cacf439a-fa37-4847-94c7-c20dc7fddb3a req-30605e2a-fb46-47a9-9aa9-aaa17bbf362b tempest-ServerActionsTestOtherA-721546481 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.025s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:15:35 devstack sudo[91589]: pam_unix(sudo:session): session closed for user root Jul 31 12:15:35 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-a1d345ef-39a2-4c87-92bf-96b2c88ba8d7 tempest-VolumesTestJSON-216924624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2" returned: 0 in 0.511s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:15:35 devstack cinder-volume[89182]: DEBUG cinder.manager [None req-a1d345ef-39a2-4c87-92bf-96b2c88ba8d7 tempest-VolumesTestJSON-216924624 None] Notifying Schedulers of capabilities ... {{(pid=89182) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 12:15:35 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-a1d345ef-39a2-4c87-92bf-96b2c88ba8d7 tempest-VolumesTestJSON-216924624 None] Deleted volume successfully. Jul 31 12:15:35 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [req-cacf439a-fa37-4847-94c7-c20dc7fddb3a req-30605e2a-fb46-47a9-9aa9-aaa17bbf362b tempest-ServerActionsTestOtherA-721546481 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88', 'name': 'volume-58e3eb03-8b43-4942-8387-27ac4293420c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a9180d5d-51c9-417e-8287-40ec85c27169', 'enforce_multipath': True} {{(pid=89182) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 31 12:15:35 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-a1d345ef-39a2-4c87-92bf-96b2c88ba8d7 tempest-VolumesTestJSON-216924624 None] Lock "cinder-d096a4b0-6b2e-4f96-81b1-b64a0b8bf948-delete_volume" released by "delete_volume" :: held 2.077s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:15:35 devstack cinder-volume[89182]: INFO cinder.volume.manager [req-cacf439a-fa37-4847-94c7-c20dc7fddb3a req-30605e2a-fb46-47a9-9aa9-aaa17bbf362b tempest-ServerActionsTestOtherA-721546481 None] attachment_update completed successfully. Jul 31 12:15:35 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-a189d9cd-aa5b-4f73-9efc-01d04238fd55 tempest-VolumesTestJSON-216924624 None] Acquiring lock "cinder-35222f17-e541-49bc-a617-3266f14d9e1d-delete_volume" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:15:36 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-a189d9cd-aa5b-4f73-9efc-01d04238fd55 tempest-VolumesTestJSON-216924624 None] Lock "cinder-35222f17-e541-49bc-a617-3266f14d9e1d-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:15:36 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-a189d9cd-aa5b-4f73-9efc-01d04238fd55 tempest-VolumesTestJSON-216924624 None] Acquiring lock "cinder-quobyte-35222f17-e541-49bc-a617-3266f14d9e1d" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:15:36 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-a189d9cd-aa5b-4f73-9efc-01d04238fd55 tempest-VolumesTestJSON-216924624 None] Lock "cinder-quobyte-35222f17-e541-49bc-a617-3266f14d9e1d" acquired by "delete_volume" :: waited 0.023s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:15:36 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[6aa4a879-5e67-4a76-9982-19dfaba6a330]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:15:36 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-a189d9cd-aa5b-4f73-9efc-01d04238fd55 tempest-VolumesTestJSON-216924624 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-35222f17-e541-49bc-a617-3266f14d9e1d {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:15:36 devstack sudo[91691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-35222f17-e541-49bc-a617-3266f14d9e1d Jul 31 12:15:36 devstack sudo[91691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:15:36 devstack sudo[91691]: pam_unix(sudo:session): session closed for user root Jul 31 12:15:36 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-a189d9cd-aa5b-4f73-9efc-01d04238fd55 tempest-VolumesTestJSON-216924624 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-35222f17-e541-49bc-a617-3266f14d9e1d" returned: 0 in 0.507s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:15:36 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-a189d9cd-aa5b-4f73-9efc-01d04238fd55 tempest-VolumesTestJSON-216924624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-35222f17-e541-49bc-a617-3266f14d9e1d {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:15:36 devstack sudo[92016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-35222f17-e541-49bc-a617-3266f14d9e1d Jul 31 12:15:36 devstack sudo[92016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:15:37 devstack sudo[92016]: pam_unix(sudo:session): session closed for user root Jul 31 12:15:37 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-a189d9cd-aa5b-4f73-9efc-01d04238fd55 tempest-VolumesTestJSON-216924624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-35222f17-e541-49bc-a617-3266f14d9e1d" returned: 0 in 0.496s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:15:37 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-a189d9cd-aa5b-4f73-9efc-01d04238fd55 tempest-VolumesTestJSON-216924624 None] Lock "cinder-quobyte-35222f17-e541-49bc-a617-3266f14d9e1d" released by "delete_volume" :: held 1.073s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:15:37 devstack cinder-volume[89182]: DEBUG cinder.quota [None req-a189d9cd-aa5b-4f73-9efc-01d04238fd55 tempest-VolumesTestJSON-216924624 None] Created reservations ['6fc30b8b-54f8-412e-b753-78b48fe96d1d', 'b9bf9842-7f02-47c2-aa3b-a67adb71a4c4', '780d9d4a-b424-435d-876b-d7d4704b2976', '07546a72-982f-497a-bba3-ef0360e08e41'] {{(pid=89182) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 12:15:37 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-a189d9cd-aa5b-4f73-9efc-01d04238fd55 tempest-VolumesTestJSON-216924624 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:15:37 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-a189d9cd-aa5b-4f73-9efc-01d04238fd55 tempest-VolumesTestJSON-216924624 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:15:37 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-a189d9cd-aa5b-4f73-9efc-01d04238fd55 tempest-VolumesTestJSON-216924624 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:15:37 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-a189d9cd-aa5b-4f73-9efc-01d04238fd55 tempest-VolumesTestJSON-216924624 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:15:37 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-a189d9cd-aa5b-4f73-9efc-01d04238fd55 tempest-VolumesTestJSON-216924624 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:15:37 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-a189d9cd-aa5b-4f73-9efc-01d04238fd55 tempest-VolumesTestJSON-216924624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:15:37 devstack sudo[92020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 Jul 31 12:15:37 devstack sudo[92020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:15:37 devstack sudo[92020]: pam_unix(sudo:session): session closed for user root Jul 31 12:15:37 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-a189d9cd-aa5b-4f73-9efc-01d04238fd55 tempest-VolumesTestJSON-216924624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2" returned: 0 in 0.293s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:15:37 devstack cinder-volume[89182]: DEBUG cinder.manager [None req-a189d9cd-aa5b-4f73-9efc-01d04238fd55 tempest-VolumesTestJSON-216924624 None] Notifying Schedulers of capabilities ... {{(pid=89182) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 12:15:37 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-a189d9cd-aa5b-4f73-9efc-01d04238fd55 tempest-VolumesTestJSON-216924624 None] Deleted volume successfully. Jul 31 12:15:37 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-a189d9cd-aa5b-4f73-9efc-01d04238fd55 tempest-VolumesTestJSON-216924624 None] Lock "cinder-35222f17-e541-49bc-a617-3266f14d9e1d-delete_volume" released by "delete_volume" :: held 1.834s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:15:40 devstack cinder-volume[89182]: INFO cinder.volume.manager [req-4c31f82f-c04e-4256-bca1-8a8a41768ef8 req-deb8f395-27b6-40e0-b0c1-45d90bb40770 tempest-ServerActionsTestOtherA-721546481 None] Terminate volume connection completed successfully. Jul 31 12:15:40 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [req-4c31f82f-c04e-4256-bca1-8a8a41768ef8 req-deb8f395-27b6-40e0-b0c1-45d90bb40770 tempest-ServerActionsTestOtherA-721546481 None] Deleting attachment a9180d5d-51c9-417e-8287-40ec85c27169. {{(pid=89182) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 31 12:15:41 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [req-4c31f82f-c04e-4256-bca1-8a8a41768ef8 req-fc092548-2122-4d82-8260-ab9543848ed0 tempest-ServerActionsTestOtherA-721546481 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:15:41 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [req-4c31f82f-c04e-4256-bca1-8a8a41768ef8 req-fc092548-2122-4d82-8260-ab9543848ed0 tempest-ServerActionsTestOtherA-721546481 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:15:41 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [req-4c31f82f-c04e-4256-bca1-8a8a41768ef8 req-fc092548-2122-4d82-8260-ab9543848ed0 tempest-ServerActionsTestOtherA-721546481 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.028s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:15:41 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [req-4c31f82f-c04e-4256-bca1-8a8a41768ef8 req-fc092548-2122-4d82-8260-ab9543848ed0 tempest-ServerActionsTestOtherA-721546481 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88', 'name': 'volume-58e3eb03-8b43-4942-8387-27ac4293420c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '07554777-1576-4faa-af99-05a5025b2897', 'enforce_multipath': True} {{(pid=89182) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 31 12:15:41 devstack cinder-volume[89182]: INFO cinder.volume.manager [req-4c31f82f-c04e-4256-bca1-8a8a41768ef8 req-fc092548-2122-4d82-8260-ab9543848ed0 tempest-ServerActionsTestOtherA-721546481 None] attachment_update completed successfully. Jul 31 12:15:44 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-15a068b3-9a34-473c-9389-e3ae5a9185ab tempest-TaggedAttachmentsTest-1522025151 None] Acquiring lock "cinder-3f4a70a7-a49c-4ea0-ada7-7e07baf67575-delete_volume" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:15:44 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-15a068b3-9a34-473c-9389-e3ae5a9185ab tempest-TaggedAttachmentsTest-1522025151 None] Lock "cinder-3f4a70a7-a49c-4ea0-ada7-7e07baf67575-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:15:44 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-15a068b3-9a34-473c-9389-e3ae5a9185ab tempest-TaggedAttachmentsTest-1522025151 None] Acquiring lock "cinder-quobyte-3f4a70a7-a49c-4ea0-ada7-7e07baf67575" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:15:44 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-15a068b3-9a34-473c-9389-e3ae5a9185ab tempest-TaggedAttachmentsTest-1522025151 None] Lock "cinder-quobyte-3f4a70a7-a49c-4ea0-ada7-7e07baf67575" acquired by "delete_volume" :: waited 0.023s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:15:44 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[f15c2dcd-ae90-4668-ab64-c71ed93f2429]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:15:44 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-15a068b3-9a34-473c-9389-e3ae5a9185ab tempest-TaggedAttachmentsTest-1522025151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-3f4a70a7-a49c-4ea0-ada7-7e07baf67575 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:15:45 devstack sudo[92553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-3f4a70a7-a49c-4ea0-ada7-7e07baf67575 Jul 31 12:15:45 devstack sudo[92553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:15:45 devstack sudo[92553]: pam_unix(sudo:session): session closed for user root Jul 31 12:15:45 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-15a068b3-9a34-473c-9389-e3ae5a9185ab tempest-TaggedAttachmentsTest-1522025151 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-3f4a70a7-a49c-4ea0-ada7-7e07baf67575" returned: 0 in 0.796s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:15:45 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-15a068b3-9a34-473c-9389-e3ae5a9185ab tempest-TaggedAttachmentsTest-1522025151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-3f4a70a7-a49c-4ea0-ada7-7e07baf67575 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:15:45 devstack sudo[92601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-3f4a70a7-a49c-4ea0-ada7-7e07baf67575 Jul 31 12:15:45 devstack sudo[92601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:15:46 devstack sudo[92601]: pam_unix(sudo:session): session closed for user root Jul 31 12:15:46 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-15a068b3-9a34-473c-9389-e3ae5a9185ab tempest-TaggedAttachmentsTest-1522025151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-3f4a70a7-a49c-4ea0-ada7-7e07baf67575" returned: 0 in 0.544s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:15:46 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-15a068b3-9a34-473c-9389-e3ae5a9185ab tempest-TaggedAttachmentsTest-1522025151 None] Lock "cinder-quobyte-3f4a70a7-a49c-4ea0-ada7-7e07baf67575" released by "delete_volume" :: held 1.432s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:15:46 devstack cinder-volume[89182]: DEBUG cinder.quota [None req-15a068b3-9a34-473c-9389-e3ae5a9185ab tempest-TaggedAttachmentsTest-1522025151 None] Created reservations ['e555f3f6-b80f-4a82-9c91-c05791b95cd8', 'cb615cf7-4b57-404b-9211-32ef0c59c450', '5a3e3a7e-f5a1-46e5-8b82-59b434c2b6ab', 'bf9970ea-7e84-4a79-b5e0-e37995606408'] {{(pid=89182) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 12:15:46 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-15a068b3-9a34-473c-9389-e3ae5a9185ab tempest-TaggedAttachmentsTest-1522025151 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:15:46 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-15a068b3-9a34-473c-9389-e3ae5a9185ab tempest-TaggedAttachmentsTest-1522025151 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:15:46 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-15a068b3-9a34-473c-9389-e3ae5a9185ab tempest-TaggedAttachmentsTest-1522025151 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:15:46 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-15a068b3-9a34-473c-9389-e3ae5a9185ab tempest-TaggedAttachmentsTest-1522025151 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:15:46 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-15a068b3-9a34-473c-9389-e3ae5a9185ab tempest-TaggedAttachmentsTest-1522025151 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:15:46 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-15a068b3-9a34-473c-9389-e3ae5a9185ab tempest-TaggedAttachmentsTest-1522025151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:15:46 devstack sudo[92640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 Jul 31 12:15:46 devstack sudo[92640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:15:46 devstack sudo[92640]: pam_unix(sudo:session): session closed for user root Jul 31 12:15:46 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-15a068b3-9a34-473c-9389-e3ae5a9185ab tempest-TaggedAttachmentsTest-1522025151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2" returned: 0 in 0.372s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:15:46 devstack cinder-volume[89182]: DEBUG cinder.manager [None req-15a068b3-9a34-473c-9389-e3ae5a9185ab tempest-TaggedAttachmentsTest-1522025151 None] Notifying Schedulers of capabilities ... {{(pid=89182) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 12:15:46 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-15a068b3-9a34-473c-9389-e3ae5a9185ab tempest-TaggedAttachmentsTest-1522025151 None] Deleted volume successfully. Jul 31 12:15:46 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-15a068b3-9a34-473c-9389-e3ae5a9185ab tempest-TaggedAttachmentsTest-1522025151 None] Lock "cinder-3f4a70a7-a49c-4ea0-ada7-7e07baf67575-delete_volume" released by "delete_volume" :: held 2.208s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:15:51 devstack cinder-volume[89182]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f638761-4643-44c1-b986-e67a96e535e4 tempest-VolumesAdminNegativeTest-1670950433 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89182) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 12:15:51 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-7f638761-4643-44c1-b986-e67a96e535e4 tempest-VolumesAdminNegativeTest-1670950433 None] Flow 'volume_create_manager' (1053e133-0387-4c24-8501-3ac21e466aef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:15:51 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-7f638761-4643-44c1-b986-e67a96e535e4 tempest-VolumesAdminNegativeTest-1670950433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86530d94-d09b-4c9b-9db0-6ee012b94297) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:15:51 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-7f638761-4643-44c1-b986-e67a96e535e4 tempest-VolumesAdminNegativeTest-1670950433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86530d94-d09b-4c9b-9db0-6ee012b94297) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:15:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1230219255',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=900c093c-b27e-4cdb-ab78-f8d8dda43874,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='786db96458ae402cbdddc60606d0326b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:15:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:15:51Z,use_quota=True,user_id='511bdba730d44b8f9d8f1bb22a7d3fc9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:15:51 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-7f638761-4643-44c1-b986-e67a96e535e4 tempest-VolumesAdminNegativeTest-1670950433 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8c55865-0883-4a75-bf20-ff50c875e247) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:15:51 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-7f638761-4643-44c1-b986-e67a96e535e4 tempest-VolumesAdminNegativeTest-1670950433 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8c55865-0883-4a75-bf20-ff50c875e247) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:15:51 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-7f638761-4643-44c1-b986-e67a96e535e4 tempest-VolumesAdminNegativeTest-1670950433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19123be5-b2e4-4e47-9053-fc4f9cd5812b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:15:51 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-7f638761-4643-44c1-b986-e67a96e535e4 tempest-VolumesAdminNegativeTest-1670950433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19123be5-b2e4-4e47-9053-fc4f9cd5812b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '900c093c-b27e-4cdb-ab78-f8d8dda43874', 'volume_name': 'volume-900c093c-b27e-4cdb-ab78-f8d8dda43874', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:15:51 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-7f638761-4643-44c1-b986-e67a96e535e4 tempest-VolumesAdminNegativeTest-1670950433 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1abcfa3d-c75e-4ed9-bb27-31c801903e40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:15:51 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-7f638761-4643-44c1-b986-e67a96e535e4 tempest-VolumesAdminNegativeTest-1670950433 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1abcfa3d-c75e-4ed9-bb27-31c801903e40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:15:51 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-7f638761-4643-44c1-b986-e67a96e535e4 tempest-VolumesAdminNegativeTest-1670950433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cfbcd4ca-de0a-4b1e-acc4-fd6460454007) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:15:51 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-7f638761-4643-44c1-b986-e67a96e535e4 tempest-VolumesAdminNegativeTest-1670950433 None] Volume 900c093c-b27e-4cdb-ab78-f8d8dda43874: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-900c093c-b27e-4cdb-ab78-f8d8dda43874', 'volume_size': 1} Jul 31 12:15:51 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-7f638761-4643-44c1-b986-e67a96e535e4 tempest-VolumesAdminNegativeTest-1670950433 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:15:51 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-7f638761-4643-44c1-b986-e67a96e535e4 tempest-VolumesAdminNegativeTest-1670950433 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:15:51 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-7f638761-4643-44c1-b986-e67a96e535e4 tempest-VolumesAdminNegativeTest-1670950433 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:15:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1230219255',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=900c093c-b27e-4cdb-ab78-f8d8dda43874,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='786db96458ae402cbdddc60606d0326b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:15:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:15:51Z,use_quota=True,user_id='511bdba730d44b8f9d8f1bb22a7d3fc9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)}" {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 12:15:51 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-7f638761-4643-44c1-b986-e67a96e535e4 tempest-VolumesAdminNegativeTest-1670950433 None] Creating volume 900c093c-b27e-4cdb-ab78-f8d8dda43874 {{(pid=89182) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 12:15:51 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-7f638761-4643-44c1-b986-e67a96e535e4 tempest-VolumesAdminNegativeTest-1670950433 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:15:51 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-7f638761-4643-44c1-b986-e67a96e535e4 tempest-VolumesAdminNegativeTest-1670950433 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:15:51 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-7f638761-4643-44c1-b986-e67a96e535e4 tempest-VolumesAdminNegativeTest-1670950433 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:15:51 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-7f638761-4643-44c1-b986-e67a96e535e4 tempest-VolumesAdminNegativeTest-1670950433 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:15:51 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-7f638761-4643-44c1-b986-e67a96e535e4 tempest-VolumesAdminNegativeTest-1670950433 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:15:51 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-7f638761-4643-44c1-b986-e67a96e535e4 tempest-VolumesAdminNegativeTest-1670950433 None] Selected osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 as target Quobyte volume. {{(pid=89182) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 12:15:51 devstack cinder-volume[89182]: INFO cinder.volume.drivers.remotefs [None req-7f638761-4643-44c1-b986-e67a96e535e4 tempest-VolumesAdminNegativeTest-1670950433 None] casted to osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 Jul 31 12:15:51 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-7f638761-4643-44c1-b986-e67a96e535e4 tempest-VolumesAdminNegativeTest-1670950433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-900c093c-b27e-4cdb-ab78-f8d8dda43874 1073741824 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:15:51 devstack sudo[92680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-900c093c-b27e-4cdb-ab78-f8d8dda43874 1073741824 Jul 31 12:15:51 devstack sudo[92680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:15:52 devstack sudo[92680]: pam_unix(sudo:session): session closed for user root Jul 31 12:15:52 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-7f638761-4643-44c1-b986-e67a96e535e4 tempest-VolumesAdminNegativeTest-1670950433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-900c093c-b27e-4cdb-ab78-f8d8dda43874 1073741824" returned: 0 in 0.906s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:15:52 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-7f638761-4643-44c1-b986-e67a96e535e4 tempest-VolumesAdminNegativeTest-1670950433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-900c093c-b27e-4cdb-ab78-f8d8dda43874 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:15:52 devstack sudo[92687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-900c093c-b27e-4cdb-ab78-f8d8dda43874 Jul 31 12:15:52 devstack sudo[92687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:15:52 devstack sudo[92687]: pam_unix(sudo:session): session closed for user root Jul 31 12:15:52 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-7f638761-4643-44c1-b986-e67a96e535e4 tempest-VolumesAdminNegativeTest-1670950433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-900c093c-b27e-4cdb-ab78-f8d8dda43874" returned: 0 in 0.379s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:15:52 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-7f638761-4643-44c1-b986-e67a96e535e4 tempest-VolumesAdminNegativeTest-1670950433 None] <== create_volume: return (1388ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'} {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 12:15:52 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-7f638761-4643-44c1-b986-e67a96e535e4 tempest-VolumesAdminNegativeTest-1670950433 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.391s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:15:52 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-7f638761-4643-44c1-b986-e67a96e535e4 tempest-VolumesAdminNegativeTest-1670950433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cfbcd4ca-de0a-4b1e-acc4-fd6460454007) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-900c093c-b27e-4cdb-ab78-f8d8dda43874', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:15:52 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-7f638761-4643-44c1-b986-e67a96e535e4 tempest-VolumesAdminNegativeTest-1670950433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11b0f82e-944e-4e0b-b5cf-5a00b8305d54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:15:52 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-7f638761-4643-44c1-b986-e67a96e535e4 tempest-VolumesAdminNegativeTest-1670950433 None] Volume volume-900c093c-b27e-4cdb-ab78-f8d8dda43874 (900c093c-b27e-4cdb-ab78-f8d8dda43874): created successfully Jul 31 12:15:52 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-7f638761-4643-44c1-b986-e67a96e535e4 tempest-VolumesAdminNegativeTest-1670950433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11b0f82e-944e-4e0b-b5cf-5a00b8305d54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:15:52 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-7f638761-4643-44c1-b986-e67a96e535e4 tempest-VolumesAdminNegativeTest-1670950433 None] Flow 'volume_create_manager' (1053e133-0387-4c24-8501-3ac21e466aef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:15:52 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-7f638761-4643-44c1-b986-e67a96e535e4 tempest-VolumesAdminNegativeTest-1670950433 None] Created volume successfully. Jul 31 12:15:54 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-e590e713-3ff7-4e36-91ae-ab9df52667e5 tempest-VolumesAdminNegativeTest-1670950433 None] Acquiring lock "cinder-900c093c-b27e-4cdb-ab78-f8d8dda43874-delete_volume" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:15:54 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-e590e713-3ff7-4e36-91ae-ab9df52667e5 tempest-VolumesAdminNegativeTest-1670950433 None] Lock "cinder-900c093c-b27e-4cdb-ab78-f8d8dda43874-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:15:54 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-e590e713-3ff7-4e36-91ae-ab9df52667e5 tempest-VolumesAdminNegativeTest-1670950433 None] Acquiring lock "cinder-quobyte-900c093c-b27e-4cdb-ab78-f8d8dda43874" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:15:54 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-e590e713-3ff7-4e36-91ae-ab9df52667e5 tempest-VolumesAdminNegativeTest-1670950433 None] Lock "cinder-quobyte-900c093c-b27e-4cdb-ab78-f8d8dda43874" acquired by "delete_volume" :: waited 0.028s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:15:54 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[89f8f141-41f1-4184-81fd-9d2cbb4816bf]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:15:54 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-e590e713-3ff7-4e36-91ae-ab9df52667e5 tempest-VolumesAdminNegativeTest-1670950433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-900c093c-b27e-4cdb-ab78-f8d8dda43874 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:15:54 devstack sudo[92690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-900c093c-b27e-4cdb-ab78-f8d8dda43874 Jul 31 12:15:54 devstack sudo[92690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:15:55 devstack sudo[92690]: pam_unix(sudo:session): session closed for user root Jul 31 12:15:55 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-e590e713-3ff7-4e36-91ae-ab9df52667e5 tempest-VolumesAdminNegativeTest-1670950433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-900c093c-b27e-4cdb-ab78-f8d8dda43874" returned: 0 in 0.757s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:15:55 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-e590e713-3ff7-4e36-91ae-ab9df52667e5 tempest-VolumesAdminNegativeTest-1670950433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-900c093c-b27e-4cdb-ab78-f8d8dda43874 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:15:55 devstack sudo[92696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-900c093c-b27e-4cdb-ab78-f8d8dda43874 Jul 31 12:15:55 devstack sudo[92696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:15:55 devstack sudo[92696]: pam_unix(sudo:session): session closed for user root Jul 31 12:15:55 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-e590e713-3ff7-4e36-91ae-ab9df52667e5 tempest-VolumesAdminNegativeTest-1670950433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-900c093c-b27e-4cdb-ab78-f8d8dda43874" returned: 0 in 0.411s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:15:55 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-e590e713-3ff7-4e36-91ae-ab9df52667e5 tempest-VolumesAdminNegativeTest-1670950433 None] Lock "cinder-quobyte-900c093c-b27e-4cdb-ab78-f8d8dda43874" released by "delete_volume" :: held 1.232s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:15:55 devstack cinder-volume[89182]: DEBUG cinder.quota [None req-e590e713-3ff7-4e36-91ae-ab9df52667e5 tempest-VolumesAdminNegativeTest-1670950433 None] Created reservations ['f73aceb2-7a85-4ed1-a315-dde2747fcc27', '96026dad-1ddc-49c3-99a1-1d1212dd84c5', '49066850-ba1d-448f-bab5-7b573f662f62', '3df94a1f-c79b-4a66-aecf-ea65871fc0db'] {{(pid=89182) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 12:15:56 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-e590e713-3ff7-4e36-91ae-ab9df52667e5 tempest-VolumesAdminNegativeTest-1670950433 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:15:56 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-e590e713-3ff7-4e36-91ae-ab9df52667e5 tempest-VolumesAdminNegativeTest-1670950433 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:15:56 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-e590e713-3ff7-4e36-91ae-ab9df52667e5 tempest-VolumesAdminNegativeTest-1670950433 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:15:56 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-e590e713-3ff7-4e36-91ae-ab9df52667e5 tempest-VolumesAdminNegativeTest-1670950433 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:15:56 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-e590e713-3ff7-4e36-91ae-ab9df52667e5 tempest-VolumesAdminNegativeTest-1670950433 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:15:56 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-e590e713-3ff7-4e36-91ae-ab9df52667e5 tempest-VolumesAdminNegativeTest-1670950433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:15:56 devstack sudo[92714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 Jul 31 12:15:56 devstack sudo[92714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:15:56 devstack sudo[92714]: pam_unix(sudo:session): session closed for user root Jul 31 12:15:56 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-e590e713-3ff7-4e36-91ae-ab9df52667e5 tempest-VolumesAdminNegativeTest-1670950433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2" returned: 0 in 0.374s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:15:56 devstack cinder-volume[89182]: DEBUG cinder.manager [None req-e590e713-3ff7-4e36-91ae-ab9df52667e5 tempest-VolumesAdminNegativeTest-1670950433 None] Notifying Schedulers of capabilities ... {{(pid=89182) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 12:15:56 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-e590e713-3ff7-4e36-91ae-ab9df52667e5 tempest-VolumesAdminNegativeTest-1670950433 None] Deleted volume successfully. Jul 31 12:15:56 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-e590e713-3ff7-4e36-91ae-ab9df52667e5 tempest-VolumesAdminNegativeTest-1670950433 None] Lock "cinder-900c093c-b27e-4cdb-ab78-f8d8dda43874-delete_volume" released by "delete_volume" :: held 2.087s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:16:06 devstack cinder-volume[89182]: DEBUG dbcounter [-] [89182] Writing DB stats cinder:SELECT=34,cinder:INSERT=14,cinder:UPDATE=50,cinder:DELETE=3 {{(pid=89182) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 12:16:06 devstack cinder-volume[89182]: DEBUG dbcounter [-] [89182] Writing DB stats cinder:SELECT=47,cinder:INSERT=7,cinder:UPDATE=41,cinder:DELETE=3 {{(pid=89182) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 12:16:07 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-0f01184c-282a-49ec-a9bd-ee84519600b7 tempest-GroupSnapshotsV319Test-1305335471 None] Group tempest-GroupSnapshotsV319Test-Group-1185519859: creating Jul 31 12:16:07 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-0f01184c-282a-49ec-a9bd-ee84519600b7 tempest-GroupSnapshotsV319Test-1305335471 None] Group tempest-GroupSnapshotsV319Test-Group-1185519859: created successfully Jul 31 12:16:07 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-0f01184c-282a-49ec-a9bd-ee84519600b7 tempest-GroupSnapshotsV319Test-1305335471 None] Create group completed successfully. Jul 31 12:16:08 devstack cinder-volume[89182]: DEBUG cinder.volume.flows.manager.create_volume [None req-cd7a3e24-9d54-4421-8b66-3d61623ac03b tempest-GroupSnapshotsV319Test-1305335471 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89182) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 12:16:08 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-cd7a3e24-9d54-4421-8b66-3d61623ac03b tempest-GroupSnapshotsV319Test-1305335471 None] Flow 'volume_create_manager' (4388c56d-5b6d-4662-a6a9-9b28e7d120f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:16:08 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-cd7a3e24-9d54-4421-8b66-3d61623ac03b tempest-GroupSnapshotsV319Test-1305335471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6d75830-343f-47f1-9933-6cf1b0556ce4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:16:08 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-cd7a3e24-9d54-4421-8b66-3d61623ac03b tempest-GroupSnapshotsV319Test-1305335471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6d75830-343f-47f1-9933-6cf1b0556ce4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:16:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-665790917',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=17d673ce-a07d-4520-9205-757a2ded2bc6,host='devstack@QuobyteHD#QuobyteHD',id=419633a4-b6d0-440b-995b-000f6cbf3bb5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96c8d6ca569a4f4fb57de4982d775aa3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:16:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:16:09Z,use_quota=True,user_id='6af0de0953d74117bf4d63d6c8595963',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2762a22d-ed72-4e12-bbf3-3519e0026ebb),volume_type_id=2762a22d-ed72-4e12-bbf3-3519e0026ebb)' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:16:08 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-cd7a3e24-9d54-4421-8b66-3d61623ac03b tempest-GroupSnapshotsV319Test-1305335471 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6632fee9-5959-446a-94b7-9d587d2034b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:16:08 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-cd7a3e24-9d54-4421-8b66-3d61623ac03b tempest-GroupSnapshotsV319Test-1305335471 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6632fee9-5959-446a-94b7-9d587d2034b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:16:08 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-cd7a3e24-9d54-4421-8b66-3d61623ac03b tempest-GroupSnapshotsV319Test-1305335471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2cb0d861-d447-42db-a46a-c6797e6a463b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:16:08 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-cd7a3e24-9d54-4421-8b66-3d61623ac03b tempest-GroupSnapshotsV319Test-1305335471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2cb0d861-d447-42db-a46a-c6797e6a463b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '419633a4-b6d0-440b-995b-000f6cbf3bb5', 'volume_name': 'volume-419633a4-b6d0-440b-995b-000f6cbf3bb5', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:16:08 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-cd7a3e24-9d54-4421-8b66-3d61623ac03b tempest-GroupSnapshotsV319Test-1305335471 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e798a6f-7be6-4b6a-a446-5654cf60ec43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:16:08 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-cd7a3e24-9d54-4421-8b66-3d61623ac03b tempest-GroupSnapshotsV319Test-1305335471 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e798a6f-7be6-4b6a-a446-5654cf60ec43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:16:08 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-cd7a3e24-9d54-4421-8b66-3d61623ac03b tempest-GroupSnapshotsV319Test-1305335471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36f845f1-7c74-4a73-848d-ecf2a2809db9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:16:08 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-cd7a3e24-9d54-4421-8b66-3d61623ac03b tempest-GroupSnapshotsV319Test-1305335471 None] Volume 419633a4-b6d0-440b-995b-000f6cbf3bb5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-419633a4-b6d0-440b-995b-000f6cbf3bb5', 'volume_size': 1} Jul 31 12:16:08 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-cd7a3e24-9d54-4421-8b66-3d61623ac03b tempest-GroupSnapshotsV319Test-1305335471 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:16:08 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-cd7a3e24-9d54-4421-8b66-3d61623ac03b tempest-GroupSnapshotsV319Test-1305335471 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:16:08 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-cd7a3e24-9d54-4421-8b66-3d61623ac03b tempest-GroupSnapshotsV319Test-1305335471 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=17d673ce-a07d-4520-9205-757a2ded2bc6,created_at=2026-07-31T10:16:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-665790917',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=17d673ce-a07d-4520-9205-757a2ded2bc6,host='devstack@QuobyteHD#QuobyteHD',id=419633a4-b6d0-440b-995b-000f6cbf3bb5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96c8d6ca569a4f4fb57de4982d775aa3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:16:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:16:09Z,use_quota=True,user_id='6af0de0953d74117bf4d63d6c8595963',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2762a22d-ed72-4e12-bbf3-3519e0026ebb),volume_type_id=2762a22d-ed72-4e12-bbf3-3519e0026ebb)}" {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 12:16:08 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-cd7a3e24-9d54-4421-8b66-3d61623ac03b tempest-GroupSnapshotsV319Test-1305335471 None] Creating volume 419633a4-b6d0-440b-995b-000f6cbf3bb5 {{(pid=89182) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 12:16:08 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-cd7a3e24-9d54-4421-8b66-3d61623ac03b tempest-GroupSnapshotsV319Test-1305335471 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:16:08 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-cd7a3e24-9d54-4421-8b66-3d61623ac03b tempest-GroupSnapshotsV319Test-1305335471 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:16:08 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-cd7a3e24-9d54-4421-8b66-3d61623ac03b tempest-GroupSnapshotsV319Test-1305335471 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:16:08 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-cd7a3e24-9d54-4421-8b66-3d61623ac03b tempest-GroupSnapshotsV319Test-1305335471 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:16:08 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-cd7a3e24-9d54-4421-8b66-3d61623ac03b tempest-GroupSnapshotsV319Test-1305335471 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:16:08 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-cd7a3e24-9d54-4421-8b66-3d61623ac03b tempest-GroupSnapshotsV319Test-1305335471 None] Selected osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 as target Quobyte volume. {{(pid=89182) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 12:16:08 devstack cinder-volume[89182]: INFO cinder.volume.drivers.remotefs [None req-cd7a3e24-9d54-4421-8b66-3d61623ac03b tempest-GroupSnapshotsV319Test-1305335471 None] casted to osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 Jul 31 12:16:08 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-cd7a3e24-9d54-4421-8b66-3d61623ac03b tempest-GroupSnapshotsV319Test-1305335471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-419633a4-b6d0-440b-995b-000f6cbf3bb5 1073741824 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:16:09 devstack sudo[92802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-419633a4-b6d0-440b-995b-000f6cbf3bb5 1073741824 Jul 31 12:16:09 devstack sudo[92802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:16:09 devstack sudo[92802]: pam_unix(sudo:session): session closed for user root Jul 31 12:16:09 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-cd7a3e24-9d54-4421-8b66-3d61623ac03b tempest-GroupSnapshotsV319Test-1305335471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-419633a4-b6d0-440b-995b-000f6cbf3bb5 1073741824" returned: 0 in 0.644s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:16:09 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-cd7a3e24-9d54-4421-8b66-3d61623ac03b tempest-GroupSnapshotsV319Test-1305335471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-419633a4-b6d0-440b-995b-000f6cbf3bb5 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:16:09 devstack sudo[92808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-419633a4-b6d0-440b-995b-000f6cbf3bb5 Jul 31 12:16:09 devstack sudo[92808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:16:10 devstack sudo[92808]: pam_unix(sudo:session): session closed for user root Jul 31 12:16:10 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-cd7a3e24-9d54-4421-8b66-3d61623ac03b tempest-GroupSnapshotsV319Test-1305335471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-419633a4-b6d0-440b-995b-000f6cbf3bb5" returned: 0 in 0.424s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:16:10 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-cd7a3e24-9d54-4421-8b66-3d61623ac03b tempest-GroupSnapshotsV319Test-1305335471 None] <== create_volume: return (1125ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'} {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 12:16:10 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-cd7a3e24-9d54-4421-8b66-3d61623ac03b tempest-GroupSnapshotsV319Test-1305335471 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.127s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:16:10 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-cd7a3e24-9d54-4421-8b66-3d61623ac03b tempest-GroupSnapshotsV319Test-1305335471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36f845f1-7c74-4a73-848d-ecf2a2809db9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-419633a4-b6d0-440b-995b-000f6cbf3bb5', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:16:10 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-cd7a3e24-9d54-4421-8b66-3d61623ac03b tempest-GroupSnapshotsV319Test-1305335471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d621068-ccf3-4b15-a1fd-3d9136b7ae8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:16:10 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-cd7a3e24-9d54-4421-8b66-3d61623ac03b tempest-GroupSnapshotsV319Test-1305335471 None] Volume volume-419633a4-b6d0-440b-995b-000f6cbf3bb5 (419633a4-b6d0-440b-995b-000f6cbf3bb5): created successfully Jul 31 12:16:10 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-cd7a3e24-9d54-4421-8b66-3d61623ac03b tempest-GroupSnapshotsV319Test-1305335471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d621068-ccf3-4b15-a1fd-3d9136b7ae8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:16:10 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-cd7a3e24-9d54-4421-8b66-3d61623ac03b tempest-GroupSnapshotsV319Test-1305335471 None] Flow 'volume_create_manager' (4388c56d-5b6d-4662-a6a9-9b28e7d120f8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:16:10 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-cd7a3e24-9d54-4421-8b66-3d61623ac03b tempest-GroupSnapshotsV319Test-1305335471 None] Created volume successfully. Jul 31 12:16:11 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-e6b268a9-bf31-4a80-97a5-536593afe451 tempest-GroupSnapshotsV319Test-1305335471 None] GroupSnapshot 2a17a036-1d09-4b47-bb4a-34a95aabcf25: creating. Jul 31 12:16:11 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-e6b268a9-bf31-4a80-97a5-536593afe451 tempest-GroupSnapshotsV319Test-1305335471 None] Group snapshot 2a17a036-1d09-4b47-bb4a-34a95aabcf25: creating. {{(pid=89182) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 31 12:16:11 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-e6b268a9-bf31-4a80-97a5-536593afe451 tempest-GroupSnapshotsV319Test-1305335471 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:16:11 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-e6b268a9-bf31-4a80-97a5-536593afe451 tempest-GroupSnapshotsV319Test-1305335471 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:16:12 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-e6b268a9-bf31-4a80-97a5-536593afe451 tempest-GroupSnapshotsV319Test-1305335471 None] Creating offline snapshot 16d4b4ed-ec2e-4b6c-b139-80208a7e51e9 of volume 419633a4-b6d0-440b-995b-000f6cbf3bb5 {{(pid=89182) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 31 12:16:12 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[e574bf63-84f7-4866-b210-6c8424795d0f]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:16:12 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-e6b268a9-bf31-4a80-97a5-536593afe451 tempest-GroupSnapshotsV319Test-1305335471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-419633a4-b6d0-440b-995b-000f6cbf3bb5 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:16:12 devstack sudo[92815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-419633a4-b6d0-440b-995b-000f6cbf3bb5 Jul 31 12:16:12 devstack sudo[92815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:16:12 devstack cinder-volume[89182]: INFO cinder.volume.manager [req-92c4ff1d-3b78-4c36-8948-a46ef2299ad7 req-4285d6bf-88ef-421d-8b60-06d5e2321251 tempest-ServerActionsTestOtherA-721546481 None] Terminate volume connection completed successfully. Jul 31 12:16:12 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [req-92c4ff1d-3b78-4c36-8948-a46ef2299ad7 req-4285d6bf-88ef-421d-8b60-06d5e2321251 tempest-ServerActionsTestOtherA-721546481 None] Deleting attachment 07554777-1576-4faa-af99-05a5025b2897. {{(pid=89182) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 31 12:16:12 devstack sudo[92815]: pam_unix(sudo:session): session closed for user root Jul 31 12:16:12 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-e6b268a9-bf31-4a80-97a5-536593afe451 tempest-GroupSnapshotsV319Test-1305335471 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-419633a4-b6d0-440b-995b-000f6cbf3bb5" returned: 0 in 0.495s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:16:12 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-e6b268a9-bf31-4a80-97a5-536593afe451 tempest-GroupSnapshotsV319Test-1305335471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-419633a4-b6d0-440b-995b-000f6cbf3bb5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-419633a4-b6d0-440b-995b-000f6cbf3bb5.16d4b4ed-ec2e-4b6c-b139-80208a7e51e9 1G {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:16:12 devstack sudo[92827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-419633a4-b6d0-440b-995b-000f6cbf3bb5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-419633a4-b6d0-440b-995b-000f6cbf3bb5.16d4b4ed-ec2e-4b6c-b139-80208a7e51e9 1G Jul 31 12:16:12 devstack sudo[92827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:16:12 devstack cinder-volume[89182]: DEBUG cinder.volume.flows.manager.create_volume [None req-43a7d95a-3a05-4dd0-9983-c8693b3e1ebd tempest-VolumeRetypeWithoutMigrationTest-1239305266 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89182) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 12:16:12 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-43a7d95a-3a05-4dd0-9983-c8693b3e1ebd tempest-VolumeRetypeWithoutMigrationTest-1239305266 None] Flow 'volume_create_manager' (db2895df-97b9-4890-b6ce-b970408a6c83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:16:12 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-43a7d95a-3a05-4dd0-9983-c8693b3e1ebd tempest-VolumeRetypeWithoutMigrationTest-1239305266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23882275-136a-4c45-b3ee-0d15d9cb0d1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:16:12 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-43a7d95a-3a05-4dd0-9983-c8693b3e1ebd tempest-VolumeRetypeWithoutMigrationTest-1239305266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23882275-136a-4c45-b3ee-0d15d9cb0d1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:16:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-524285141',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25a2ba9d-ec0b-4904-91c7-9ef971b15fc1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='77dbb414ea744377a0cc0a3a57dd6ab5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:16:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:16:13Z,use_quota=True,user_id='82d604533a5049fc99465b8c2c40a991',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8e3b67e-774f-4a9b-b9e3-57ceaa45ae5d),volume_type_id=f8e3b67e-774f-4a9b-b9e3-57ceaa45ae5d)' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:16:12 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-43a7d95a-3a05-4dd0-9983-c8693b3e1ebd tempest-VolumeRetypeWithoutMigrationTest-1239305266 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dfbbabd8-845b-443f-ad8b-b6b33f5e401a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:16:12 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-43a7d95a-3a05-4dd0-9983-c8693b3e1ebd tempest-VolumeRetypeWithoutMigrationTest-1239305266 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dfbbabd8-845b-443f-ad8b-b6b33f5e401a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:16:12 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-43a7d95a-3a05-4dd0-9983-c8693b3e1ebd tempest-VolumeRetypeWithoutMigrationTest-1239305266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c93f9bf-988f-4ee0-be5d-3f88b23dbc52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:16:12 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-43a7d95a-3a05-4dd0-9983-c8693b3e1ebd tempest-VolumeRetypeWithoutMigrationTest-1239305266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c93f9bf-988f-4ee0-be5d-3f88b23dbc52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '25a2ba9d-ec0b-4904-91c7-9ef971b15fc1', 'volume_name': 'volume-25a2ba9d-ec0b-4904-91c7-9ef971b15fc1', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:16:13 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-43a7d95a-3a05-4dd0-9983-c8693b3e1ebd tempest-VolumeRetypeWithoutMigrationTest-1239305266 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb459e5a-63c2-41b0-99d6-75a9692b38c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:16:13 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-43a7d95a-3a05-4dd0-9983-c8693b3e1ebd tempest-VolumeRetypeWithoutMigrationTest-1239305266 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb459e5a-63c2-41b0-99d6-75a9692b38c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:16:13 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-43a7d95a-3a05-4dd0-9983-c8693b3e1ebd tempest-VolumeRetypeWithoutMigrationTest-1239305266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (227cccd0-c3c2-42ff-a6e2-ac139c3f222f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:16:13 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-43a7d95a-3a05-4dd0-9983-c8693b3e1ebd tempest-VolumeRetypeWithoutMigrationTest-1239305266 None] Volume 25a2ba9d-ec0b-4904-91c7-9ef971b15fc1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-25a2ba9d-ec0b-4904-91c7-9ef971b15fc1', 'volume_size': 1} Jul 31 12:16:13 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-43a7d95a-3a05-4dd0-9983-c8693b3e1ebd tempest-VolumeRetypeWithoutMigrationTest-1239305266 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:16:13 devstack sudo[92827]: pam_unix(sudo:session): session closed for user root Jul 31 12:16:13 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-e6b268a9-bf31-4a80-97a5-536593afe451 tempest-GroupSnapshotsV319Test-1305335471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-419633a4-b6d0-440b-995b-000f6cbf3bb5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-419633a4-b6d0-440b-995b-000f6cbf3bb5.16d4b4ed-ec2e-4b6c-b139-80208a7e51e9 1G" returned: 0 in 0.610s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:16:13 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-e6b268a9-bf31-4a80-97a5-536593afe451 tempest-GroupSnapshotsV319Test-1305335471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-419633a4-b6d0-440b-995b-000f6cbf3bb5 -F qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-419633a4-b6d0-440b-995b-000f6cbf3bb5.16d4b4ed-ec2e-4b6c-b139-80208a7e51e9 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:16:13 devstack sudo[92836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-419633a4-b6d0-440b-995b-000f6cbf3bb5 -F qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-419633a4-b6d0-440b-995b-000f6cbf3bb5.16d4b4ed-ec2e-4b6c-b139-80208a7e51e9 Jul 31 12:16:13 devstack sudo[92836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:16:13 devstack sudo[92836]: pam_unix(sudo:session): session closed for user root Jul 31 12:16:13 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-e6b268a9-bf31-4a80-97a5-536593afe451 tempest-GroupSnapshotsV319Test-1305335471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-419633a4-b6d0-440b-995b-000f6cbf3bb5 -F qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-419633a4-b6d0-440b-995b-000f6cbf3bb5.16d4b4ed-ec2e-4b6c-b139-80208a7e51e9" returned: 0 in 0.359s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:16:13 devstack cinder-volume[89182]: WARNING cinder.volume.drivers.remotefs [None req-e6b268a9-bf31-4a80-97a5-536593afe451 tempest-GroupSnapshotsV319Test-1305335471 None] /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-419633a4-b6d0-440b-995b-000f6cbf3bb5.16d4b4ed-ec2e-4b6c-b139-80208a7e51e9 is being set with open permissions: ugo+rw: NotImplementedError Jul 31 12:16:13 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-e6b268a9-bf31-4a80-97a5-536593afe451 tempest-GroupSnapshotsV319Test-1305335471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-419633a4-b6d0-440b-995b-000f6cbf3bb5.16d4b4ed-ec2e-4b6c-b139-80208a7e51e9 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:16:13 devstack sudo[92845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-419633a4-b6d0-440b-995b-000f6cbf3bb5.16d4b4ed-ec2e-4b6c-b139-80208a7e51e9 Jul 31 12:16:13 devstack sudo[92845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:16:13 devstack sudo[92845]: pam_unix(sudo:session): session closed for user root Jul 31 12:16:13 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-e6b268a9-bf31-4a80-97a5-536593afe451 tempest-GroupSnapshotsV319Test-1305335471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-419633a4-b6d0-440b-995b-000f6cbf3bb5.16d4b4ed-ec2e-4b6c-b139-80208a7e51e9" returned: 0 in 0.331s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:16:13 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-e6b268a9-bf31-4a80-97a5-536593afe451 tempest-GroupSnapshotsV319Test-1305335471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-419633a4-b6d0-440b-995b-000f6cbf3bb5.info {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:16:13 devstack sudo[92868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-419633a4-b6d0-440b-995b-000f6cbf3bb5.info Jul 31 12:16:13 devstack sudo[92868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:16:14 devstack sudo[92868]: pam_unix(sudo:session): session closed for user root Jul 31 12:16:14 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-e6b268a9-bf31-4a80-97a5-536593afe451 tempest-GroupSnapshotsV319Test-1305335471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-419633a4-b6d0-440b-995b-000f6cbf3bb5.info" returned: 0 in 0.317s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:16:14 devstack cinder-volume[89182]: WARNING cinder.volume.drivers.remotefs [None req-e6b268a9-bf31-4a80-97a5-536593afe451 tempest-GroupSnapshotsV319Test-1305335471 None] /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-419633a4-b6d0-440b-995b-000f6cbf3bb5.info is being set with open permissions: ugo+rw: NotImplementedError Jul 31 12:16:14 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-e6b268a9-bf31-4a80-97a5-536593afe451 tempest-GroupSnapshotsV319Test-1305335471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-419633a4-b6d0-440b-995b-000f6cbf3bb5.info {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:16:14 devstack sudo[92875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-419633a4-b6d0-440b-995b-000f6cbf3bb5.info Jul 31 12:16:14 devstack sudo[92875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:16:14 devstack sudo[92875]: pam_unix(sudo:session): session closed for user root Jul 31 12:16:14 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-e6b268a9-bf31-4a80-97a5-536593afe451 tempest-GroupSnapshotsV319Test-1305335471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-419633a4-b6d0-440b-995b-000f6cbf3bb5.info" returned: 0 in 0.318s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:16:14 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-e6b268a9-bf31-4a80-97a5-536593afe451 tempest-GroupSnapshotsV319Test-1305335471 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.547s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:16:14 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-43a7d95a-3a05-4dd0-9983-c8693b3e1ebd tempest-VolumeRetypeWithoutMigrationTest-1239305266 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.544s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:16:14 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-43a7d95a-3a05-4dd0-9983-c8693b3e1ebd tempest-VolumeRetypeWithoutMigrationTest-1239305266 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:16:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-524285141',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25a2ba9d-ec0b-4904-91c7-9ef971b15fc1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='77dbb414ea744377a0cc0a3a57dd6ab5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:16:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:16:13Z,use_quota=True,user_id='82d604533a5049fc99465b8c2c40a991',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8e3b67e-774f-4a9b-b9e3-57ceaa45ae5d),volume_type_id=f8e3b67e-774f-4a9b-b9e3-57ceaa45ae5d)}" {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 12:16:14 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-43a7d95a-3a05-4dd0-9983-c8693b3e1ebd tempest-VolumeRetypeWithoutMigrationTest-1239305266 None] Creating volume 25a2ba9d-ec0b-4904-91c7-9ef971b15fc1 {{(pid=89182) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 12:16:14 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-43a7d95a-3a05-4dd0-9983-c8693b3e1ebd tempest-VolumeRetypeWithoutMigrationTest-1239305266 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:16:14 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-43a7d95a-3a05-4dd0-9983-c8693b3e1ebd tempest-VolumeRetypeWithoutMigrationTest-1239305266 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:16:14 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-43a7d95a-3a05-4dd0-9983-c8693b3e1ebd tempest-VolumeRetypeWithoutMigrationTest-1239305266 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:16:14 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-43a7d95a-3a05-4dd0-9983-c8693b3e1ebd tempest-VolumeRetypeWithoutMigrationTest-1239305266 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:16:14 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-43a7d95a-3a05-4dd0-9983-c8693b3e1ebd tempest-VolumeRetypeWithoutMigrationTest-1239305266 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:16:14 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-43a7d95a-3a05-4dd0-9983-c8693b3e1ebd tempest-VolumeRetypeWithoutMigrationTest-1239305266 None] Selected osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 as target Quobyte volume. {{(pid=89182) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 12:16:14 devstack cinder-volume[89182]: INFO cinder.volume.drivers.remotefs [None req-43a7d95a-3a05-4dd0-9983-c8693b3e1ebd tempest-VolumeRetypeWithoutMigrationTest-1239305266 None] casted to osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 Jul 31 12:16:14 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-43a7d95a-3a05-4dd0-9983-c8693b3e1ebd tempest-VolumeRetypeWithoutMigrationTest-1239305266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-25a2ba9d-ec0b-4904-91c7-9ef971b15fc1 1073741824 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:16:14 devstack sudo[92879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-25a2ba9d-ec0b-4904-91c7-9ef971b15fc1 1073741824 Jul 31 12:16:14 devstack sudo[92879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:16:14 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-e6b268a9-bf31-4a80-97a5-536593afe451 tempest-GroupSnapshotsV319Test-1305335471 None] group_snapshot 2a17a036-1d09-4b47-bb4a-34a95aabcf25: created successfully Jul 31 12:16:15 devstack sudo[92879]: pam_unix(sudo:session): session closed for user root Jul 31 12:16:15 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-43a7d95a-3a05-4dd0-9983-c8693b3e1ebd tempest-VolumeRetypeWithoutMigrationTest-1239305266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-25a2ba9d-ec0b-4904-91c7-9ef971b15fc1 1073741824" returned: 0 in 0.647s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:16:15 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-43a7d95a-3a05-4dd0-9983-c8693b3e1ebd tempest-VolumeRetypeWithoutMigrationTest-1239305266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-25a2ba9d-ec0b-4904-91c7-9ef971b15fc1 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:16:15 devstack sudo[92888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-25a2ba9d-ec0b-4904-91c7-9ef971b15fc1 Jul 31 12:16:15 devstack sudo[92888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:16:15 devstack sudo[92888]: pam_unix(sudo:session): session closed for user root Jul 31 12:16:15 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-43a7d95a-3a05-4dd0-9983-c8693b3e1ebd tempest-VolumeRetypeWithoutMigrationTest-1239305266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-25a2ba9d-ec0b-4904-91c7-9ef971b15fc1" returned: 0 in 0.358s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:16:15 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-43a7d95a-3a05-4dd0-9983-c8693b3e1ebd tempest-VolumeRetypeWithoutMigrationTest-1239305266 None] <== create_volume: return (1087ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'} {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 12:16:15 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-43a7d95a-3a05-4dd0-9983-c8693b3e1ebd tempest-VolumeRetypeWithoutMigrationTest-1239305266 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.091s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:16:15 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-43a7d95a-3a05-4dd0-9983-c8693b3e1ebd tempest-VolumeRetypeWithoutMigrationTest-1239305266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (227cccd0-c3c2-42ff-a6e2-ac139c3f222f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-25a2ba9d-ec0b-4904-91c7-9ef971b15fc1', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:16:15 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-43a7d95a-3a05-4dd0-9983-c8693b3e1ebd tempest-VolumeRetypeWithoutMigrationTest-1239305266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4a4e85c-3a40-4be8-99cc-3f5c001aec27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:16:15 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-43a7d95a-3a05-4dd0-9983-c8693b3e1ebd tempest-VolumeRetypeWithoutMigrationTest-1239305266 None] Volume volume-25a2ba9d-ec0b-4904-91c7-9ef971b15fc1 (25a2ba9d-ec0b-4904-91c7-9ef971b15fc1): created successfully Jul 31 12:16:15 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-43a7d95a-3a05-4dd0-9983-c8693b3e1ebd tempest-VolumeRetypeWithoutMigrationTest-1239305266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4a4e85c-3a40-4be8-99cc-3f5c001aec27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:16:15 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-43a7d95a-3a05-4dd0-9983-c8693b3e1ebd tempest-VolumeRetypeWithoutMigrationTest-1239305266 None] Flow 'volume_create_manager' (db2895df-97b9-4890-b6ce-b970408a6c83) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:16:15 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-43a7d95a-3a05-4dd0-9983-c8693b3e1ebd tempest-VolumeRetypeWithoutMigrationTest-1239305266 None] Created volume successfully. Jul 31 12:16:15 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-58ee705b-f910-4f7d-9702-06f457d6f075 tempest-GroupSnapshotsV319Test-1305335471 None] group_snapshot 2a17a036-1d09-4b47-bb4a-34a95aabcf25: deleting Jul 31 12:16:15 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-58ee705b-f910-4f7d-9702-06f457d6f075 tempest-GroupSnapshotsV319Test-1305335471 None] group_snapshot 2a17a036-1d09-4b47-bb4a-34a95aabcf25: deleting {{(pid=89182) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 31 12:16:15 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-58ee705b-f910-4f7d-9702-06f457d6f075 tempest-GroupSnapshotsV319Test-1305335471 None] Acquiring lock "cinder-quobyte-419633a4-b6d0-440b-995b-000f6cbf3bb5" by "delete_snapshot" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:16:15 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-58ee705b-f910-4f7d-9702-06f457d6f075 tempest-GroupSnapshotsV319Test-1305335471 None] Lock "cinder-quobyte-419633a4-b6d0-440b-995b-000f6cbf3bb5" acquired by "delete_snapshot" :: waited 0.024s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:16:15 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-58ee705b-f910-4f7d-9702-06f457d6f075 tempest-GroupSnapshotsV319Test-1305335471 None] Acquiring lock "cinder-quobyte-16d4b4ed-ec2e-4b6c-b139-80208a7e51e9" by "_delete_snapshot" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:16:15 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-58ee705b-f910-4f7d-9702-06f457d6f075 tempest-GroupSnapshotsV319Test-1305335471 None] Lock "cinder-quobyte-16d4b4ed-ec2e-4b6c-b139-80208a7e51e9" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:16:15 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-58ee705b-f910-4f7d-9702-06f457d6f075 tempest-GroupSnapshotsV319Test-1305335471 None] Deleting offline snapshot 16d4b4ed-ec2e-4b6c-b139-80208a7e51e9 of volume 419633a4-b6d0-440b-995b-000f6cbf3bb5 {{(pid=89182) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 31 12:16:15 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-58ee705b-f910-4f7d-9702-06f457d6f075 tempest-GroupSnapshotsV319Test-1305335471 None] snapshot_file for this snap is: volume-419633a4-b6d0-440b-995b-000f6cbf3bb5.16d4b4ed-ec2e-4b6c-b139-80208a7e51e9 {{(pid=89182) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 31 12:16:15 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[449e5db3-eae9-40a9-bb1f-5151954d62fb]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:16:15 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-58ee705b-f910-4f7d-9702-06f457d6f075 tempest-GroupSnapshotsV319Test-1305335471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-419633a4-b6d0-440b-995b-000f6cbf3bb5.16d4b4ed-ec2e-4b6c-b139-80208a7e51e9 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:16:16 devstack sudo[92892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-419633a4-b6d0-440b-995b-000f6cbf3bb5.16d4b4ed-ec2e-4b6c-b139-80208a7e51e9 Jul 31 12:16:16 devstack sudo[92892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:16:16 devstack sudo[92892]: pam_unix(sudo:session): session closed for user root Jul 31 12:16:16 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-58ee705b-f910-4f7d-9702-06f457d6f075 tempest-GroupSnapshotsV319Test-1305335471 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-419633a4-b6d0-440b-995b-000f6cbf3bb5.16d4b4ed-ec2e-4b6c-b139-80208a7e51e9" returned: 0 in 0.594s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:16:16 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-58ee705b-f910-4f7d-9702-06f457d6f075 tempest-GroupSnapshotsV319Test-1305335471 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-419633a4-b6d0-440b-995b-000f6cbf3bb5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89182) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 12:16:16 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[bde4b1af-7d88-4bd5-ac77-bb97fd45bdec]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:16:16 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-58ee705b-f910-4f7d-9702-06f457d6f075 tempest-GroupSnapshotsV319Test-1305335471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-419633a4-b6d0-440b-995b-000f6cbf3bb5 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:16:16 devstack sudo[92899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-419633a4-b6d0-440b-995b-000f6cbf3bb5 Jul 31 12:16:16 devstack sudo[92899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:16:16 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-6f2ecf24-05db-4085-a66b-c34114ada3f7 tempest-VolumeRetypeWithoutMigrationTest-1239305266 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:16:16 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-6f2ecf24-05db-4085-a66b-c34114ada3f7 tempest-VolumeRetypeWithoutMigrationTest-1239305266 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:16:16 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-6f2ecf24-05db-4085-a66b-c34114ada3f7 tempest-VolumeRetypeWithoutMigrationTest-1239305266 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:16:16 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-6f2ecf24-05db-4085-a66b-c34114ada3f7 tempest-VolumeRetypeWithoutMigrationTest-1239305266 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:16:16 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-6f2ecf24-05db-4085-a66b-c34114ada3f7 tempest-VolumeRetypeWithoutMigrationTest-1239305266 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:16:16 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-6f2ecf24-05db-4085-a66b-c34114ada3f7 tempest-VolumeRetypeWithoutMigrationTest-1239305266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:16:16 devstack sudo[92901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 Jul 31 12:16:16 devstack sudo[92901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:16:17 devstack sudo[92899]: pam_unix(sudo:session): session closed for user root Jul 31 12:16:17 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-58ee705b-f910-4f7d-9702-06f457d6f075 tempest-GroupSnapshotsV319Test-1305335471 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-419633a4-b6d0-440b-995b-000f6cbf3bb5" returned: 0 in 0.456s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:16:17 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-58ee705b-f910-4f7d-9702-06f457d6f075 tempest-GroupSnapshotsV319Test-1305335471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-419633a4-b6d0-440b-995b-000f6cbf3bb5.16d4b4ed-ec2e-4b6c-b139-80208a7e51e9 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:16:17 devstack sudo[92907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-419633a4-b6d0-440b-995b-000f6cbf3bb5.16d4b4ed-ec2e-4b6c-b139-80208a7e51e9 Jul 31 12:16:17 devstack sudo[92907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:16:17 devstack sudo[92901]: pam_unix(sudo:session): session closed for user root Jul 31 12:16:17 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-6f2ecf24-05db-4085-a66b-c34114ada3f7 tempest-VolumeRetypeWithoutMigrationTest-1239305266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2" returned: 0 in 0.303s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:16:17 devstack cinder-volume[89182]: DEBUG cinder.manager [None req-6f2ecf24-05db-4085-a66b-c34114ada3f7 tempest-VolumeRetypeWithoutMigrationTest-1239305266 None] Notifying Schedulers of capabilities ... {{(pid=89182) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 12:16:17 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-6f2ecf24-05db-4085-a66b-c34114ada3f7 tempest-VolumeRetypeWithoutMigrationTest-1239305266 None] Retype volume completed successfully. Jul 31 12:16:17 devstack sudo[92907]: pam_unix(sudo:session): session closed for user root Jul 31 12:16:17 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-58ee705b-f910-4f7d-9702-06f457d6f075 tempest-GroupSnapshotsV319Test-1305335471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-419633a4-b6d0-440b-995b-000f6cbf3bb5.16d4b4ed-ec2e-4b6c-b139-80208a7e51e9" returned: 0 in 0.499s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:16:17 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-58ee705b-f910-4f7d-9702-06f457d6f075 tempest-GroupSnapshotsV319Test-1305335471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-419633a4-b6d0-440b-995b-000f6cbf3bb5.16d4b4ed-ec2e-4b6c-b139-80208a7e51e9 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:16:17 devstack sudo[92916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-419633a4-b6d0-440b-995b-000f6cbf3bb5.16d4b4ed-ec2e-4b6c-b139-80208a7e51e9 Jul 31 12:16:17 devstack sudo[92916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:16:17 devstack sudo[92916]: pam_unix(sudo:session): session closed for user root Jul 31 12:16:17 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-58ee705b-f910-4f7d-9702-06f457d6f075 tempest-GroupSnapshotsV319Test-1305335471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-419633a4-b6d0-440b-995b-000f6cbf3bb5.16d4b4ed-ec2e-4b6c-b139-80208a7e51e9" returned: 0 in 0.309s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:16:17 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-58ee705b-f910-4f7d-9702-06f457d6f075 tempest-GroupSnapshotsV319Test-1305335471 None] Lock "cinder-quobyte-16d4b4ed-ec2e-4b6c-b139-80208a7e51e9" released by "_delete_snapshot" :: held 2.005s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:16:17 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-58ee705b-f910-4f7d-9702-06f457d6f075 tempest-GroupSnapshotsV319Test-1305335471 None] Lock "cinder-quobyte-419633a4-b6d0-440b-995b-000f6cbf3bb5" released by "delete_snapshot" :: held 2.034s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:16:18 devstack cinder-volume[89182]: WARNING cinder.quota [None req-58ee705b-f910-4f7d-9702-06f457d6f075 tempest-GroupSnapshotsV319Test-1305335471 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1181164497 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1181164497, it is now deprecated. Please use the default quota class for default quota. Jul 31 12:16:18 devstack cinder-volume[89182]: WARNING cinder.quota [None req-58ee705b-f910-4f7d-9702-06f457d6f075 tempest-GroupSnapshotsV319Test-1305335471 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1181164497 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1181164497, it is now deprecated. Please use the default quota class for default quota. Jul 31 12:16:18 devstack cinder-volume[89182]: DEBUG cinder.quota [None req-58ee705b-f910-4f7d-9702-06f457d6f075 tempest-GroupSnapshotsV319Test-1305335471 None] Created reservations ['d2fb6611-10ba-4b4d-8f02-6d28a3636ec6', '17c0a9ff-8e02-419a-929b-a10e2b3ef4f7', 'a3f5278c-0a3b-44e5-8ffe-a16bc555f8fb', 'd0b69089-abb1-4bd2-8807-a71002806686'] {{(pid=89182) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 12:16:18 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-0390cd64-f56a-4a56-818e-a3fd89ddeac4 tempest-VolumeRetypeWithoutMigrationTest-1239305266 None] Acquiring lock "cinder-25a2ba9d-ec0b-4904-91c7-9ef971b15fc1-delete_volume" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:16:18 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-0390cd64-f56a-4a56-818e-a3fd89ddeac4 tempest-VolumeRetypeWithoutMigrationTest-1239305266 None] Lock "cinder-25a2ba9d-ec0b-4904-91c7-9ef971b15fc1-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:16:18 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-58ee705b-f910-4f7d-9702-06f457d6f075 tempest-GroupSnapshotsV319Test-1305335471 None] group_snapshot 2a17a036-1d09-4b47-bb4a-34a95aabcf25: deleted successfully Jul 31 12:16:18 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-0390cd64-f56a-4a56-818e-a3fd89ddeac4 tempest-VolumeRetypeWithoutMigrationTest-1239305266 None] Acquiring lock "cinder-quobyte-25a2ba9d-ec0b-4904-91c7-9ef971b15fc1" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:16:18 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-0390cd64-f56a-4a56-818e-a3fd89ddeac4 tempest-VolumeRetypeWithoutMigrationTest-1239305266 None] Lock "cinder-quobyte-25a2ba9d-ec0b-4904-91c7-9ef971b15fc1" acquired by "delete_volume" :: waited 0.023s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:16:18 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[08c869ea-d19c-4c7b-9047-5e7ac8a72979]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:16:18 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-0390cd64-f56a-4a56-818e-a3fd89ddeac4 tempest-VolumeRetypeWithoutMigrationTest-1239305266 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-25a2ba9d-ec0b-4904-91c7-9ef971b15fc1 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:16:18 devstack sudo[92927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-25a2ba9d-ec0b-4904-91c7-9ef971b15fc1 Jul 31 12:16:18 devstack sudo[92927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:16:18 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-4ba3e422-5fe4-4ab1-93fe-b1c817d05495 tempest-GroupSnapshotsV319Test-1305335471 None] Acquiring lock "cinder-quobyte-419633a4-b6d0-440b-995b-000f6cbf3bb5" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:16:18 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-4ba3e422-5fe4-4ab1-93fe-b1c817d05495 tempest-GroupSnapshotsV319Test-1305335471 None] Lock "cinder-quobyte-419633a4-b6d0-440b-995b-000f6cbf3bb5" acquired by "delete_volume" :: waited 0.018s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:16:18 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a5152c3-427d-447b-9bd0-7408eba19edd]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:16:18 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-4ba3e422-5fe4-4ab1-93fe-b1c817d05495 tempest-GroupSnapshotsV319Test-1305335471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-419633a4-b6d0-440b-995b-000f6cbf3bb5 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:16:18 devstack sudo[92927]: pam_unix(sudo:session): session closed for user root Jul 31 12:16:18 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-0390cd64-f56a-4a56-818e-a3fd89ddeac4 tempest-VolumeRetypeWithoutMigrationTest-1239305266 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-25a2ba9d-ec0b-4904-91c7-9ef971b15fc1" returned: 0 in 0.453s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:16:18 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-0390cd64-f56a-4a56-818e-a3fd89ddeac4 tempest-VolumeRetypeWithoutMigrationTest-1239305266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-25a2ba9d-ec0b-4904-91c7-9ef971b15fc1 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:16:18 devstack sudo[92933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-25a2ba9d-ec0b-4904-91c7-9ef971b15fc1 Jul 31 12:16:18 devstack sudo[92933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:16:19 devstack sudo[92932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-419633a4-b6d0-440b-995b-000f6cbf3bb5 Jul 31 12:16:19 devstack sudo[92932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:16:19 devstack sudo[92933]: pam_unix(sudo:session): session closed for user root Jul 31 12:16:19 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-0390cd64-f56a-4a56-818e-a3fd89ddeac4 tempest-VolumeRetypeWithoutMigrationTest-1239305266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-25a2ba9d-ec0b-4904-91c7-9ef971b15fc1" returned: 0 in 0.312s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:16:19 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-0390cd64-f56a-4a56-818e-a3fd89ddeac4 tempest-VolumeRetypeWithoutMigrationTest-1239305266 None] Lock "cinder-quobyte-25a2ba9d-ec0b-4904-91c7-9ef971b15fc1" released by "delete_volume" :: held 0.841s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:16:19 devstack cinder-volume[89182]: WARNING cinder.quota [None req-0390cd64-f56a-4a56-818e-a3fd89ddeac4 tempest-VolumeRetypeWithoutMigrationTest-1239305266 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jul 31 12:16:19 devstack cinder-volume[89182]: WARNING cinder.quota [None req-0390cd64-f56a-4a56-818e-a3fd89ddeac4 tempest-VolumeRetypeWithoutMigrationTest-1239305266 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jul 31 12:16:19 devstack cinder-volume[89182]: DEBUG cinder.quota [None req-0390cd64-f56a-4a56-818e-a3fd89ddeac4 tempest-VolumeRetypeWithoutMigrationTest-1239305266 None] Created reservations ['ee6112e6-d423-4262-a348-47caabb12631', '55187a3a-258d-4342-93c5-cfaa1a8be28f', '63fef06b-13c8-4e14-841d-bf4875bf75ab', '980e138f-0016-4ff3-a3a8-fa35e160f2f2'] {{(pid=89182) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 12:16:19 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-0390cd64-f56a-4a56-818e-a3fd89ddeac4 tempest-VolumeRetypeWithoutMigrationTest-1239305266 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:16:19 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-0390cd64-f56a-4a56-818e-a3fd89ddeac4 tempest-VolumeRetypeWithoutMigrationTest-1239305266 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:16:19 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-0390cd64-f56a-4a56-818e-a3fd89ddeac4 tempest-VolumeRetypeWithoutMigrationTest-1239305266 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:16:19 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-0390cd64-f56a-4a56-818e-a3fd89ddeac4 tempest-VolumeRetypeWithoutMigrationTest-1239305266 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:16:19 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-0390cd64-f56a-4a56-818e-a3fd89ddeac4 tempest-VolumeRetypeWithoutMigrationTest-1239305266 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:16:19 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-0390cd64-f56a-4a56-818e-a3fd89ddeac4 tempest-VolumeRetypeWithoutMigrationTest-1239305266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:16:19 devstack cinder-volume[89182]: DEBUG cinder.volume.flows.manager.create_volume [None req-b1ad7c06-dc32-47db-ad40-12c4e41683ef tempest-ServerActionsTestOtherA-721546481 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89182) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 12:16:19 devstack sudo[92932]: pam_unix(sudo:session): session closed for user root Jul 31 12:16:19 devstack sudo[92940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 Jul 31 12:16:19 devstack sudo[92940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:16:19 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-b1ad7c06-dc32-47db-ad40-12c4e41683ef tempest-ServerActionsTestOtherA-721546481 None] Flow 'volume_create_manager' (c0a105fa-c3bd-4070-a938-e754aedfd930) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:16:19 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-b1ad7c06-dc32-47db-ad40-12c4e41683ef tempest-ServerActionsTestOtherA-721546481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf7351f7-69c4-4a51-942f-8de9a2405cb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:16:19 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-4ba3e422-5fe4-4ab1-93fe-b1c817d05495 tempest-GroupSnapshotsV319Test-1305335471 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-419633a4-b6d0-440b-995b-000f6cbf3bb5" returned: 0 in 0.605s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:16:19 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-4ba3e422-5fe4-4ab1-93fe-b1c817d05495 tempest-GroupSnapshotsV319Test-1305335471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-419633a4-b6d0-440b-995b-000f6cbf3bb5 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:16:19 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-b1ad7c06-dc32-47db-ad40-12c4e41683ef tempest-ServerActionsTestOtherA-721546481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf7351f7-69c4-4a51-942f-8de9a2405cb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:16:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1552739207',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=885fab30-9c14-41a8-8e74-9847acb8523d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5da77cb40a0f41cc8d96dac1e8f9c072',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:16:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:16:19Z,use_quota=True,user_id='aaa5284cda904c408e1dd6ee7316646a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:16:19 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-b1ad7c06-dc32-47db-ad40-12c4e41683ef tempest-ServerActionsTestOtherA-721546481 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51b682a8-b34d-4278-8522-4283ae7b9647) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:16:19 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-b1ad7c06-dc32-47db-ad40-12c4e41683ef tempest-ServerActionsTestOtherA-721546481 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51b682a8-b34d-4278-8522-4283ae7b9647) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:16:19 devstack sudo[92942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-419633a4-b6d0-440b-995b-000f6cbf3bb5 Jul 31 12:16:19 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-b1ad7c06-dc32-47db-ad40-12c4e41683ef tempest-ServerActionsTestOtherA-721546481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58db6df8-511b-4f1a-a8bf-2fb2040dd40f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:16:19 devstack cinder-volume[89182]: DEBUG cinder.image.glance [None req-b1ad7c06-dc32-47db-ad40-12c4e41683ef tempest-ServerActionsTestOtherA-721546481 None] Creating Keystone auth plugin from conf {{(pid=89182) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 31 12:16:19 devstack sudo[92942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:16:19 devstack sudo[92940]: pam_unix(sudo:session): session closed for user root Jul 31 12:16:19 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-0390cd64-f56a-4a56-818e-a3fd89ddeac4 tempest-VolumeRetypeWithoutMigrationTest-1239305266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2" returned: 0 in 0.341s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:16:19 devstack cinder-volume[89182]: DEBUG cinder.manager [None req-0390cd64-f56a-4a56-818e-a3fd89ddeac4 tempest-VolumeRetypeWithoutMigrationTest-1239305266 None] Notifying Schedulers of capabilities ... {{(pid=89182) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 12:16:19 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-0390cd64-f56a-4a56-818e-a3fd89ddeac4 tempest-VolumeRetypeWithoutMigrationTest-1239305266 None] Deleted volume successfully. Jul 31 12:16:19 devstack sudo[92942]: pam_unix(sudo:session): session closed for user root Jul 31 12:16:19 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-4ba3e422-5fe4-4ab1-93fe-b1c817d05495 tempest-GroupSnapshotsV319Test-1305335471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-419633a4-b6d0-440b-995b-000f6cbf3bb5" returned: 0 in 0.341s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:16:19 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-4ba3e422-5fe4-4ab1-93fe-b1c817d05495 tempest-GroupSnapshotsV319Test-1305335471 None] Lock "cinder-quobyte-419633a4-b6d0-440b-995b-000f6cbf3bb5" released by "delete_volume" :: held 1.027s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:16:19 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-0390cd64-f56a-4a56-818e-a3fd89ddeac4 tempest-VolumeRetypeWithoutMigrationTest-1239305266 None] Lock "cinder-25a2ba9d-ec0b-4904-91c7-9ef971b15fc1-delete_volume" released by "delete_volume" :: held 1.638s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:16:20 devstack cinder-volume[89182]: DEBUG cinder.quota [None req-4ba3e422-5fe4-4ab1-93fe-b1c817d05495 tempest-GroupSnapshotsV319Test-1305335471 None] Created reservations ['45252426-69f1-4b34-ba34-bfa9ea187c40'] {{(pid=89182) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 12:16:20 devstack cinder-volume[89182]: WARNING cinder.quota [None req-4ba3e422-5fe4-4ab1-93fe-b1c817d05495 tempest-GroupSnapshotsV319Test-1305335471 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1181164497 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1181164497, it is now deprecated. Please use the default quota class for default quota. Jul 31 12:16:20 devstack cinder-volume[89182]: DEBUG cinder.quota [None req-4ba3e422-5fe4-4ab1-93fe-b1c817d05495 tempest-GroupSnapshotsV319Test-1305335471 None] Created reservations ['8db82153-2a5e-449b-8bf9-173cd800d288', '5c335816-547d-48e0-ae44-e710ec1704eb', 'dca770f2-04a0-467e-9436-c5984f8c75c7', '9fa37f3d-9bc9-45e5-b6ca-f599abc7f05e'] {{(pid=89182) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 12:16:20 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-4ba3e422-5fe4-4ab1-93fe-b1c817d05495 tempest-GroupSnapshotsV319Test-1305335471 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:16:20 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-4ba3e422-5fe4-4ab1-93fe-b1c817d05495 tempest-GroupSnapshotsV319Test-1305335471 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:16:20 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-4ba3e422-5fe4-4ab1-93fe-b1c817d05495 tempest-GroupSnapshotsV319Test-1305335471 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:16:20 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-4ba3e422-5fe4-4ab1-93fe-b1c817d05495 tempest-GroupSnapshotsV319Test-1305335471 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:16:20 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-4ba3e422-5fe4-4ab1-93fe-b1c817d05495 tempest-GroupSnapshotsV319Test-1305335471 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:16:20 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-4ba3e422-5fe4-4ab1-93fe-b1c817d05495 tempest-GroupSnapshotsV319Test-1305335471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:16:20 devstack sudo[92946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 Jul 31 12:16:20 devstack sudo[92946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:16:20 devstack sudo[92946]: pam_unix(sudo:session): session closed for user root Jul 31 12:16:20 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-4ba3e422-5fe4-4ab1-93fe-b1c817d05495 tempest-GroupSnapshotsV319Test-1305335471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2" returned: 0 in 0.272s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:16:20 devstack cinder-volume[89182]: DEBUG cinder.manager [None req-4ba3e422-5fe4-4ab1-93fe-b1c817d05495 tempest-GroupSnapshotsV319Test-1305335471 None] Notifying Schedulers of capabilities ... {{(pid=89182) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 12:16:20 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-4ba3e422-5fe4-4ab1-93fe-b1c817d05495 tempest-GroupSnapshotsV319Test-1305335471 None] Delete group completed successfully. Jul 31 12:16:20 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-b1ad7c06-dc32-47db-ad40-12c4e41683ef tempest-ServerActionsTestOtherA-721546481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58db6df8-511b-4f1a-a8bf-2fb2040dd40f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '885fab30-9c14-41a8-8e74-9847acb8523d', 'volume_name': 'volume-885fab30-9c14-41a8-8e74-9847acb8523d', 'volume_size': 1, 'image_id': '4cbd0fd2-77a8-43ca-bc93-b0249d6daea0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4cbd0fd2-77a8-43ca-bc93-b0249d6daea0', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3f77cb0dad9a46948c9357c65b22aef5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4cbd0fd2-77a8-43ca-bc93-b0249d6daea0', 'created_at': datetime.datetime(2026, 7, 31, 10, 8, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 31, 10, 8, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4cbd0fd2-77a8-43ca-bc93-b0249d6daea0/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:16:20 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-b1ad7c06-dc32-47db-ad40-12c4e41683ef tempest-ServerActionsTestOtherA-721546481 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (658602cd-f355-4510-bd72-aa499db3db72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:16:20 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-b1ad7c06-dc32-47db-ad40-12c4e41683ef tempest-ServerActionsTestOtherA-721546481 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (658602cd-f355-4510-bd72-aa499db3db72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:16:20 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-b1ad7c06-dc32-47db-ad40-12c4e41683ef tempest-ServerActionsTestOtherA-721546481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e60a7954-d58b-4e0b-af60-1cb54281fef1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:16:20 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-b1ad7c06-dc32-47db-ad40-12c4e41683ef tempest-ServerActionsTestOtherA-721546481 None] Volume 885fab30-9c14-41a8-8e74-9847acb8523d: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-885fab30-9c14-41a8-8e74-9847acb8523d', 'volume_size': 1, 'image_id': '4cbd0fd2-77a8-43ca-bc93-b0249d6daea0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4cbd0fd2-77a8-43ca-bc93-b0249d6daea0', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3f77cb0dad9a46948c9357c65b22aef5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4cbd0fd2-77a8-43ca-bc93-b0249d6daea0', 'created_at': datetime.datetime(2026, 7, 31, 10, 8, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 31, 10, 8, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4cbd0fd2-77a8-43ca-bc93-b0249d6daea0/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 31 12:16:20 devstack cinder-volume[89182]: DEBUG cinder.volume.flows.manager.create_volume [None req-b1ad7c06-dc32-47db-ad40-12c4e41683ef tempest-ServerActionsTestOtherA-721546481 None] Trying to clone 885fab30-9c14-41a8-8e74-9847acb8523d from image 4cbd0fd2-77a8-43ca-bc93-b0249d6daea0 at location (None, [{'url': 'file:///opt/stack/data/glance/images/4cbd0fd2-77a8-43ca-bc93-b0249d6daea0', 'metadata': {}}]). {{(pid=89182) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 31 12:16:21 devstack cinder-volume[89182]: DEBUG cinder.image.image_utils [None req-b1ad7c06-dc32-47db-ad40-12c4e41683ef tempest-ServerActionsTestOtherA-721546481 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_4cbd0fd2-77a8-43ca-bc93-b0249d6daea0_7p1zujlddevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=89182) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 31 12:16:21 devstack cinder-volume[89182]: INFO cinder.image.image_utils [None req-b1ad7c06-dc32-47db-ad40-12c4e41683ef tempest-ServerActionsTestOtherA-721546481 None] Image download 20.69 MB at 20.69 MB/s Jul 31 12:16:21 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[5deea755-7d9f-4812-8717-cc7da14b4bff]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:16:21 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-b1ad7c06-dc32-47db-ad40-12c4e41683ef tempest-ServerActionsTestOtherA-721546481 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4cbd0fd2-77a8-43ca-bc93-b0249d6daea0_7p1zujlddevstack@QuobyteHD {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:16:21 devstack sudo[92970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4cbd0fd2-77a8-43ca-bc93-b0249d6daea0_7p1zujlddevstack@QuobyteHD Jul 31 12:16:21 devstack sudo[92970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:16:21 devstack sudo[92970]: pam_unix(sudo:session): session closed for user root Jul 31 12:16:21 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-b1ad7c06-dc32-47db-ad40-12c4e41683ef tempest-ServerActionsTestOtherA-721546481 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4cbd0fd2-77a8-43ca-bc93-b0249d6daea0_7p1zujlddevstack@QuobyteHD" returned: 0 in 0.399s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:16:22 devstack cinder-volume[89182]: DEBUG cinder.image.image_utils [None req-b1ad7c06-dc32-47db-ad40-12c4e41683ef tempest-ServerActionsTestOtherA-721546481 None] Temporary image 4cbd0fd2-77a8-43ca-bc93-b0249d6daea0 is fetched for user aaa5284cda904c408e1dd6ee7316646a. {{(pid=89182) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 31 12:16:22 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b642dd2-1b34-4c3e-ad90-e3c6fe5f651f]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:16:22 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-b1ad7c06-dc32-47db-ad40-12c4e41683ef tempest-ServerActionsTestOtherA-721546481 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4cbd0fd2-77a8-43ca-bc93-b0249d6daea0_7p1zujlddevstack@QuobyteHD {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:16:22 devstack sudo[92975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4cbd0fd2-77a8-43ca-bc93-b0249d6daea0_7p1zujlddevstack@QuobyteHD Jul 31 12:16:22 devstack sudo[92975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:16:22 devstack sudo[92975]: pam_unix(sudo:session): session closed for user root Jul 31 12:16:22 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-b1ad7c06-dc32-47db-ad40-12c4e41683ef tempest-ServerActionsTestOtherA-721546481 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4cbd0fd2-77a8-43ca-bc93-b0249d6daea0_7p1zujlddevstack@QuobyteHD" returned: 0 in 0.368s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:16:22 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-b1ad7c06-dc32-47db-ad40-12c4e41683ef tempest-ServerActionsTestOtherA-721546481 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:16:22 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-b1ad7c06-dc32-47db-ad40-12c4e41683ef tempest-ServerActionsTestOtherA-721546481 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:16:22 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-b1ad7c06-dc32-47db-ad40-12c4e41683ef tempest-ServerActionsTestOtherA-721546481 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:16:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1552739207',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=885fab30-9c14-41a8-8e74-9847acb8523d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5da77cb40a0f41cc8d96dac1e8f9c072',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:16:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:16:19Z,use_quota=True,user_id='aaa5284cda904c408e1dd6ee7316646a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)}" {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 12:16:22 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-b1ad7c06-dc32-47db-ad40-12c4e41683ef tempest-ServerActionsTestOtherA-721546481 None] Creating volume 885fab30-9c14-41a8-8e74-9847acb8523d {{(pid=89182) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 12:16:22 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-b1ad7c06-dc32-47db-ad40-12c4e41683ef tempest-ServerActionsTestOtherA-721546481 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:16:22 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-b1ad7c06-dc32-47db-ad40-12c4e41683ef tempest-ServerActionsTestOtherA-721546481 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:16:22 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-b1ad7c06-dc32-47db-ad40-12c4e41683ef tempest-ServerActionsTestOtherA-721546481 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:16:22 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-b1ad7c06-dc32-47db-ad40-12c4e41683ef tempest-ServerActionsTestOtherA-721546481 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:16:22 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-b1ad7c06-dc32-47db-ad40-12c4e41683ef tempest-ServerActionsTestOtherA-721546481 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:16:22 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-b1ad7c06-dc32-47db-ad40-12c4e41683ef tempest-ServerActionsTestOtherA-721546481 None] Selected osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 as target Quobyte volume. {{(pid=89182) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 12:16:22 devstack cinder-volume[89182]: INFO cinder.volume.drivers.remotefs [None req-b1ad7c06-dc32-47db-ad40-12c4e41683ef tempest-ServerActionsTestOtherA-721546481 None] casted to osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 Jul 31 12:16:22 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-b1ad7c06-dc32-47db-ad40-12c4e41683ef tempest-ServerActionsTestOtherA-721546481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-885fab30-9c14-41a8-8e74-9847acb8523d 1073741824 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:16:22 devstack sudo[92980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-885fab30-9c14-41a8-8e74-9847acb8523d 1073741824 Jul 31 12:16:22 devstack sudo[92980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:16:22 devstack sudo[92980]: pam_unix(sudo:session): session closed for user root Jul 31 12:16:22 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-b1ad7c06-dc32-47db-ad40-12c4e41683ef tempest-ServerActionsTestOtherA-721546481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-885fab30-9c14-41a8-8e74-9847acb8523d 1073741824" returned: 0 in 0.475s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:16:23 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-b1ad7c06-dc32-47db-ad40-12c4e41683ef tempest-ServerActionsTestOtherA-721546481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-885fab30-9c14-41a8-8e74-9847acb8523d {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:16:23 devstack sudo[92986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-885fab30-9c14-41a8-8e74-9847acb8523d Jul 31 12:16:23 devstack sudo[92986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:16:23 devstack sudo[92986]: pam_unix(sudo:session): session closed for user root Jul 31 12:16:23 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-b1ad7c06-dc32-47db-ad40-12c4e41683ef tempest-ServerActionsTestOtherA-721546481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-885fab30-9c14-41a8-8e74-9847acb8523d" returned: 0 in 0.263s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:16:23 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-b1ad7c06-dc32-47db-ad40-12c4e41683ef tempest-ServerActionsTestOtherA-721546481 None] <== create_volume: return (797ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'} {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 12:16:23 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-b1ad7c06-dc32-47db-ad40-12c4e41683ef tempest-ServerActionsTestOtherA-721546481 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.800s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:16:23 devstack cinder-volume[89182]: DEBUG cinder.volume.volume_utils [None req-b1ad7c06-dc32-47db-ad40-12c4e41683ef tempest-ServerActionsTestOtherA-721546481 None] Attempting download of 4cbd0fd2-77a8-43ca-bc93-b0249d6daea0 ((None, [{'url': 'file:///opt/stack/data/glance/images/4cbd0fd2-77a8-43ca-bc93-b0249d6daea0', 'metadata': {}}])) to volume 885fab30-9c14-41a8-8e74-9847acb8523d. {{(pid=89182) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 31 12:16:23 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[a461b0a9-120d-49bf-b4af-68362a6fd260]: (4, 'raw') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:16:23 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-b1ad7c06-dc32-47db-ad40-12c4e41683ef tempest-ServerActionsTestOtherA-721546481 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4cbd0fd2-77a8-43ca-bc93-b0249d6daea0_qmhq5hu6 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:16:23 devstack sudo[92989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4cbd0fd2-77a8-43ca-bc93-b0249d6daea0_qmhq5hu6 Jul 31 12:16:23 devstack sudo[92989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:16:23 devstack sudo[92989]: pam_unix(sudo:session): session closed for user root Jul 31 12:16:23 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-b1ad7c06-dc32-47db-ad40-12c4e41683ef tempest-ServerActionsTestOtherA-721546481 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4cbd0fd2-77a8-43ca-bc93-b0249d6daea0_qmhq5hu6" returned: 0 in 0.367s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:16:23 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-b1ad7c06-dc32-47db-ad40-12c4e41683ef tempest-ServerActionsTestOtherA-721546481 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4cbd0fd2-77a8-43ca-bc93-b0249d6daea0_qmhq5hu6 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:16:23 devstack sudo[92993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4cbd0fd2-77a8-43ca-bc93-b0249d6daea0_qmhq5hu6 Jul 31 12:16:23 devstack sudo[92993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:16:24 devstack sudo[92993]: pam_unix(sudo:session): session closed for user root Jul 31 12:16:24 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-b1ad7c06-dc32-47db-ad40-12c4e41683ef tempest-ServerActionsTestOtherA-721546481 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4cbd0fd2-77a8-43ca-bc93-b0249d6daea0_qmhq5hu6" returned: 1 in 0.398s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:16:24 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-b1ad7c06-dc32-47db-ad40-12c4e41683ef tempest-ServerActionsTestOtherA-721546481 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4cbd0fd2-77a8-43ca-bc93-b0249d6daea0_qmhq5hu6' failed. Not Retrying. {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 31 12:16:24 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cce5587-c357-49ff-bc99-b52ae13a33c3]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:16:24 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-b1ad7c06-dc32-47db-ad40-12c4e41683ef tempest-ServerActionsTestOtherA-721546481 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4cbd0fd2-77a8-43ca-bc93-b0249d6daea0_7p1zujlddevstack@QuobyteHD {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:16:24 devstack sudo[92997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4cbd0fd2-77a8-43ca-bc93-b0249d6daea0_7p1zujlddevstack@QuobyteHD Jul 31 12:16:24 devstack sudo[92997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:16:24 devstack sudo[92997]: pam_unix(sudo:session): session closed for user root Jul 31 12:16:24 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-b1ad7c06-dc32-47db-ad40-12c4e41683ef tempest-ServerActionsTestOtherA-721546481 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4cbd0fd2-77a8-43ca-bc93-b0249d6daea0_7p1zujlddevstack@QuobyteHD" returned: 0 in 0.391s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:16:24 devstack cinder-volume[89182]: DEBUG cinder.image.image_utils [None req-b1ad7c06-dc32-47db-ad40-12c4e41683ef tempest-ServerActionsTestOtherA-721546481 None] 4cbd0fd2-77a8-43ca-bc93-b0249d6daea0 was qcow2, converting to qcow2 {{(pid=89182) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 31 12:16:24 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-b1ad7c06-dc32-47db-ad40-12c4e41683ef tempest-ServerActionsTestOtherA-721546481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4cbd0fd2-77a8-43ca-bc93-b0249d6daea0_7p1zujlddevstack@QuobyteHD /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-885fab30-9c14-41a8-8e74-9847acb8523d {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:16:24 devstack sudo[93003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4cbd0fd2-77a8-43ca-bc93-b0249d6daea0_7p1zujlddevstack@QuobyteHD /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-885fab30-9c14-41a8-8e74-9847acb8523d Jul 31 12:16:24 devstack sudo[93003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:16:26 devstack sudo[93003]: pam_unix(sudo:session): session closed for user root Jul 31 12:16:26 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-b1ad7c06-dc32-47db-ad40-12c4e41683ef tempest-ServerActionsTestOtherA-721546481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4cbd0fd2-77a8-43ca-bc93-b0249d6daea0_7p1zujlddevstack@QuobyteHD /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-885fab30-9c14-41a8-8e74-9847acb8523d" returned: 0 in 2.421s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:16:26 devstack cinder-volume[89182]: DEBUG cinder.image.image_utils [None req-b1ad7c06-dc32-47db-ad40-12c4e41683ef tempest-ServerActionsTestOtherA-721546481 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_4cbd0fd2-77a8-43ca-bc93-b0249d6daea0_7p1zujlddevstack@QuobyteHD, size 112.00 MB, duration 2.42 sec, destination /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-885fab30-9c14-41a8-8e74-9847acb8523d {{(pid=89182) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 31 12:16:26 devstack cinder-volume[89182]: INFO cinder.image.image_utils [None req-b1ad7c06-dc32-47db-ad40-12c4e41683ef tempest-ServerActionsTestOtherA-721546481 None] Converted 112.00 MB image at 46.24 MB/s Jul 31 12:16:26 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-b1ad7c06-dc32-47db-ad40-12c4e41683ef tempest-ServerActionsTestOtherA-721546481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-885fab30-9c14-41a8-8e74-9847acb8523d 1G {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:16:27 devstack sudo[93046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-885fab30-9c14-41a8-8e74-9847acb8523d 1G Jul 31 12:16:27 devstack sudo[93046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:16:27 devstack sudo[93046]: pam_unix(sudo:session): session closed for user root Jul 31 12:16:27 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-b1ad7c06-dc32-47db-ad40-12c4e41683ef tempest-ServerActionsTestOtherA-721546481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-885fab30-9c14-41a8-8e74-9847acb8523d 1G" returned: 0 in 0.524s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:16:27 devstack cinder-volume[89182]: DEBUG cinder.volume.volume_utils [None req-b1ad7c06-dc32-47db-ad40-12c4e41683ef tempest-ServerActionsTestOtherA-721546481 None] Downloaded image 4cbd0fd2-77a8-43ca-bc93-b0249d6daea0 ((None, [{'url': 'file:///opt/stack/data/glance/images/4cbd0fd2-77a8-43ca-bc93-b0249d6daea0', 'metadata': {}}])) to volume 885fab30-9c14-41a8-8e74-9847acb8523d successfully. {{(pid=89182) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 31 12:16:27 devstack cinder-volume[89182]: DEBUG cinder.image.image_utils [None req-b1ad7c06-dc32-47db-ad40-12c4e41683ef tempest-ServerActionsTestOtherA-721546481 None] Temporary image 4cbd0fd2-77a8-43ca-bc93-b0249d6daea0 for user aaa5284cda904c408e1dd6ee7316646a is deleted. {{(pid=89182) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 31 12:16:27 devstack cinder-volume[89182]: DEBUG cinder.volume.volume_utils [None req-b1ad7c06-dc32-47db-ad40-12c4e41683ef tempest-ServerActionsTestOtherA-721546481 None] Marking volume 885fab30-9c14-41a8-8e74-9847acb8523d as bootable. {{(pid=89182) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 31 12:16:27 devstack cinder-volume[89182]: DEBUG cinder.volume.flows.manager.create_volume [None req-b1ad7c06-dc32-47db-ad40-12c4e41683ef tempest-ServerActionsTestOtherA-721546481 None] Copying metadata from image 4cbd0fd2-77a8-43ca-bc93-b0249d6daea0 to 885fab30-9c14-41a8-8e74-9847acb8523d. {{(pid=89182) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 31 12:16:27 devstack cinder-volume[89182]: DEBUG cinder.volume.flows.manager.create_volume [None req-b1ad7c06-dc32-47db-ad40-12c4e41683ef tempest-ServerActionsTestOtherA-721546481 None] Creating volume glance metadata for volume 885fab30-9c14-41a8-8e74-9847acb8523d backed by image 4cbd0fd2-77a8-43ca-bc93-b0249d6daea0 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '4cbd0fd2-77a8-43ca-bc93-b0249d6daea0', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=89182) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 31 12:16:27 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-b1ad7c06-dc32-47db-ad40-12c4e41683ef tempest-ServerActionsTestOtherA-721546481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e60a7954-d58b-4e0b-af60-1cb54281fef1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-885fab30-9c14-41a8-8e74-9847acb8523d', 'volume_size': 1, 'image_id': '4cbd0fd2-77a8-43ca-bc93-b0249d6daea0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4cbd0fd2-77a8-43ca-bc93-b0249d6daea0', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3f77cb0dad9a46948c9357c65b22aef5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4cbd0fd2-77a8-43ca-bc93-b0249d6daea0', 'created_at': datetime.datetime(2026, 7, 31, 10, 8, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 31, 10, 8, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4cbd0fd2-77a8-43ca-bc93-b0249d6daea0/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:16:27 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-b1ad7c06-dc32-47db-ad40-12c4e41683ef tempest-ServerActionsTestOtherA-721546481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d010447c-81f2-46fd-a18f-aa899369c154) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:16:27 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-b1ad7c06-dc32-47db-ad40-12c4e41683ef tempest-ServerActionsTestOtherA-721546481 None] Volume volume-885fab30-9c14-41a8-8e74-9847acb8523d (885fab30-9c14-41a8-8e74-9847acb8523d): created successfully Jul 31 12:16:27 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-b1ad7c06-dc32-47db-ad40-12c4e41683ef tempest-ServerActionsTestOtherA-721546481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d010447c-81f2-46fd-a18f-aa899369c154) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:16:27 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-b1ad7c06-dc32-47db-ad40-12c4e41683ef tempest-ServerActionsTestOtherA-721546481 None] Flow 'volume_create_manager' (c0a105fa-c3bd-4070-a938-e754aedfd930) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:16:27 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-b1ad7c06-dc32-47db-ad40-12c4e41683ef tempest-ServerActionsTestOtherA-721546481 None] Created volume successfully. Jul 31 12:16:28 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-d8091382-0a54-48c8-9ad8-b16cf2e5f1e8 tempest-GroupsTest-2022448916 None] Group tempest-Group1-803728180: creating Jul 31 12:16:28 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-d8091382-0a54-48c8-9ad8-b16cf2e5f1e8 tempest-GroupsTest-2022448916 None] Group tempest-Group1-803728180: created successfully Jul 31 12:16:28 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-d8091382-0a54-48c8-9ad8-b16cf2e5f1e8 tempest-GroupsTest-2022448916 None] Create group completed successfully. Jul 31 12:16:30 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-9667c455-8f31-4969-8069-490f7a05895b tempest-GroupsTest-2022448916 None] Group tempest-Group2-827491620: creating Jul 31 12:16:30 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-9667c455-8f31-4969-8069-490f7a05895b tempest-GroupsTest-2022448916 None] Group tempest-Group2-827491620: created successfully Jul 31 12:16:30 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-9667c455-8f31-4969-8069-490f7a05895b tempest-GroupsTest-2022448916 None] Create group completed successfully. Jul 31 12:16:31 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [req-63e1a176-ca53-45b0-92db-fc72e83e1419 req-14282156-0e20-49c9-b007-a761d4166558 tempest-ServerActionsTestOtherA-721546481 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:16:31 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [req-63e1a176-ca53-45b0-92db-fc72e83e1419 req-14282156-0e20-49c9-b007-a761d4166558 tempest-ServerActionsTestOtherA-721546481 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:16:31 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [req-63e1a176-ca53-45b0-92db-fc72e83e1419 req-14282156-0e20-49c9-b007-a761d4166558 tempest-ServerActionsTestOtherA-721546481 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.021s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:16:31 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [req-63e1a176-ca53-45b0-92db-fc72e83e1419 req-14282156-0e20-49c9-b007-a761d4166558 tempest-ServerActionsTestOtherA-721546481 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88', 'name': 'volume-885fab30-9c14-41a8-8e74-9847acb8523d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0f1f05fb-f457-4a8d-b6dd-8f36d9be0ad3', 'enforce_multipath': True} {{(pid=89182) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 31 12:16:31 devstack cinder-volume[89182]: INFO cinder.volume.manager [req-63e1a176-ca53-45b0-92db-fc72e83e1419 req-14282156-0e20-49c9-b007-a761d4166558 tempest-ServerActionsTestOtherA-721546481 None] attachment_update completed successfully. Jul 31 12:16:32 devstack cinder-volume[89182]: DEBUG cinder.volume.flows.manager.create_volume [None req-5481292a-d3f6-43f6-9d4b-a89a75e497fd tempest-GroupsTest-2022448916 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89182) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 12:16:32 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-5481292a-d3f6-43f6-9d4b-a89a75e497fd tempest-GroupsTest-2022448916 None] Flow 'volume_create_manager' (935f76f0-c107-484e-8e71-edee0f35af99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:16:32 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-5481292a-d3f6-43f6-9d4b-a89a75e497fd tempest-GroupsTest-2022448916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8f87cea-8310-4b39-8907-226b1cd402df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:16:32 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-5481292a-d3f6-43f6-9d4b-a89a75e497fd tempest-GroupsTest-2022448916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8f87cea-8310-4b39-8907-226b1cd402df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:16:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1153856643',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=cdaa038a-5842-4829-bccb-e9d720afb5cd,host='devstack@QuobyteHD#QuobyteHD',id=f588d4f1-8a25-441c-b911-018f21fd4a13,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf48458faa1b4a158d8a2af37b1a2d3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:16:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:16:32Z,use_quota=True,user_id='74dd362feb2e409dbb199439188593aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc31c290-9872-4aa8-b8db-bda56bddc6b6),volume_type_id=bc31c290-9872-4aa8-b8db-bda56bddc6b6)' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:16:32 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-5481292a-d3f6-43f6-9d4b-a89a75e497fd tempest-GroupsTest-2022448916 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc8465a8-4793-47d0-9e39-13febc8ea1f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:16:32 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-5481292a-d3f6-43f6-9d4b-a89a75e497fd tempest-GroupsTest-2022448916 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc8465a8-4793-47d0-9e39-13febc8ea1f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:16:32 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-5481292a-d3f6-43f6-9d4b-a89a75e497fd tempest-GroupsTest-2022448916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c2d330e-7422-4f6e-8906-e00a054bd11a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:16:32 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-5481292a-d3f6-43f6-9d4b-a89a75e497fd tempest-GroupsTest-2022448916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c2d330e-7422-4f6e-8906-e00a054bd11a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f588d4f1-8a25-441c-b911-018f21fd4a13', 'volume_name': 'volume-f588d4f1-8a25-441c-b911-018f21fd4a13', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:16:32 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-5481292a-d3f6-43f6-9d4b-a89a75e497fd tempest-GroupsTest-2022448916 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9dc3e722-a756-4248-a3be-87cd7d49384c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:16:32 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-5481292a-d3f6-43f6-9d4b-a89a75e497fd tempest-GroupsTest-2022448916 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9dc3e722-a756-4248-a3be-87cd7d49384c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:16:32 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-5481292a-d3f6-43f6-9d4b-a89a75e497fd tempest-GroupsTest-2022448916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ceefdb85-faf4-433f-b567-7972e8b125b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:16:32 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-5481292a-d3f6-43f6-9d4b-a89a75e497fd tempest-GroupsTest-2022448916 None] Volume f588d4f1-8a25-441c-b911-018f21fd4a13: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f588d4f1-8a25-441c-b911-018f21fd4a13', 'volume_size': 1} Jul 31 12:16:32 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-5481292a-d3f6-43f6-9d4b-a89a75e497fd tempest-GroupsTest-2022448916 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:16:32 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-5481292a-d3f6-43f6-9d4b-a89a75e497fd tempest-GroupsTest-2022448916 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:16:32 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-5481292a-d3f6-43f6-9d4b-a89a75e497fd tempest-GroupsTest-2022448916 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=cdaa038a-5842-4829-bccb-e9d720afb5cd,created_at=2026-07-31T10:16:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1153856643',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=cdaa038a-5842-4829-bccb-e9d720afb5cd,host='devstack@QuobyteHD#QuobyteHD',id=f588d4f1-8a25-441c-b911-018f21fd4a13,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf48458faa1b4a158d8a2af37b1a2d3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:16:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:16:32Z,use_quota=True,user_id='74dd362feb2e409dbb199439188593aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc31c290-9872-4aa8-b8db-bda56bddc6b6),volume_type_id=bc31c290-9872-4aa8-b8db-bda56bddc6b6)}" {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 12:16:32 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-5481292a-d3f6-43f6-9d4b-a89a75e497fd tempest-GroupsTest-2022448916 None] Creating volume f588d4f1-8a25-441c-b911-018f21fd4a13 {{(pid=89182) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 12:16:32 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-5481292a-d3f6-43f6-9d4b-a89a75e497fd tempest-GroupsTest-2022448916 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:16:32 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-5481292a-d3f6-43f6-9d4b-a89a75e497fd tempest-GroupsTest-2022448916 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:16:32 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-5481292a-d3f6-43f6-9d4b-a89a75e497fd tempest-GroupsTest-2022448916 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:16:32 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-5481292a-d3f6-43f6-9d4b-a89a75e497fd tempest-GroupsTest-2022448916 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:16:32 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-5481292a-d3f6-43f6-9d4b-a89a75e497fd tempest-GroupsTest-2022448916 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:16:32 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-5481292a-d3f6-43f6-9d4b-a89a75e497fd tempest-GroupsTest-2022448916 None] Selected osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 as target Quobyte volume. {{(pid=89182) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 12:16:32 devstack cinder-volume[89182]: INFO cinder.volume.drivers.remotefs [None req-5481292a-d3f6-43f6-9d4b-a89a75e497fd tempest-GroupsTest-2022448916 None] casted to osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 Jul 31 12:16:32 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-5481292a-d3f6-43f6-9d4b-a89a75e497fd tempest-GroupsTest-2022448916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-f588d4f1-8a25-441c-b911-018f21fd4a13 1073741824 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:16:32 devstack sudo[93070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-f588d4f1-8a25-441c-b911-018f21fd4a13 1073741824 Jul 31 12:16:32 devstack sudo[93070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:16:33 devstack sudo[93070]: pam_unix(sudo:session): session closed for user root Jul 31 12:16:33 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-5481292a-d3f6-43f6-9d4b-a89a75e497fd tempest-GroupsTest-2022448916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-f588d4f1-8a25-441c-b911-018f21fd4a13 1073741824" returned: 0 in 0.644s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:16:33 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-5481292a-d3f6-43f6-9d4b-a89a75e497fd tempest-GroupsTest-2022448916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-f588d4f1-8a25-441c-b911-018f21fd4a13 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:16:33 devstack sudo[93077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-f588d4f1-8a25-441c-b911-018f21fd4a13 Jul 31 12:16:33 devstack sudo[93077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:16:33 devstack sudo[93077]: pam_unix(sudo:session): session closed for user root Jul 31 12:16:33 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-5481292a-d3f6-43f6-9d4b-a89a75e497fd tempest-GroupsTest-2022448916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-f588d4f1-8a25-441c-b911-018f21fd4a13" returned: 0 in 0.342s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:16:33 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-5481292a-d3f6-43f6-9d4b-a89a75e497fd tempest-GroupsTest-2022448916 None] <== create_volume: return (1086ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'} {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 12:16:33 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-5481292a-d3f6-43f6-9d4b-a89a75e497fd tempest-GroupsTest-2022448916 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.090s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:16:33 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-5481292a-d3f6-43f6-9d4b-a89a75e497fd tempest-GroupsTest-2022448916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ceefdb85-faf4-433f-b567-7972e8b125b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f588d4f1-8a25-441c-b911-018f21fd4a13', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:16:33 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-5481292a-d3f6-43f6-9d4b-a89a75e497fd tempest-GroupsTest-2022448916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64572d03-4c4d-46d6-aff9-eae64d7ae446) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:16:33 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-5481292a-d3f6-43f6-9d4b-a89a75e497fd tempest-GroupsTest-2022448916 None] Volume volume-f588d4f1-8a25-441c-b911-018f21fd4a13 (f588d4f1-8a25-441c-b911-018f21fd4a13): created successfully Jul 31 12:16:33 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-5481292a-d3f6-43f6-9d4b-a89a75e497fd tempest-GroupsTest-2022448916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64572d03-4c4d-46d6-aff9-eae64d7ae446) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:16:33 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-5481292a-d3f6-43f6-9d4b-a89a75e497fd tempest-GroupsTest-2022448916 None] Flow 'volume_create_manager' (935f76f0-c107-484e-8e71-edee0f35af99) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:16:33 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-5481292a-d3f6-43f6-9d4b-a89a75e497fd tempest-GroupsTest-2022448916 None] Created volume successfully. Jul 31 12:16:35 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-b4fb8e7d-0e28-4f4a-ba1c-1fb8adb8569e tempest-GroupsTest-2022448916 None] Acquiring lock "cinder-quobyte-f588d4f1-8a25-441c-b911-018f21fd4a13" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:16:35 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-b4fb8e7d-0e28-4f4a-ba1c-1fb8adb8569e tempest-GroupsTest-2022448916 None] Lock "cinder-quobyte-f588d4f1-8a25-441c-b911-018f21fd4a13" acquired by "delete_volume" :: waited 0.024s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:16:35 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[d26048d4-3893-47ec-a66a-8a68824fed59]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:16:35 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-b4fb8e7d-0e28-4f4a-ba1c-1fb8adb8569e tempest-GroupsTest-2022448916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-f588d4f1-8a25-441c-b911-018f21fd4a13 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:16:36 devstack sudo[93081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-f588d4f1-8a25-441c-b911-018f21fd4a13 Jul 31 12:16:36 devstack sudo[93081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:16:36 devstack sudo[93081]: pam_unix(sudo:session): session closed for user root Jul 31 12:16:36 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-b4fb8e7d-0e28-4f4a-ba1c-1fb8adb8569e tempest-GroupsTest-2022448916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-f588d4f1-8a25-441c-b911-018f21fd4a13" returned: 0 in 0.483s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:16:36 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-b4fb8e7d-0e28-4f4a-ba1c-1fb8adb8569e tempest-GroupsTest-2022448916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-f588d4f1-8a25-441c-b911-018f21fd4a13 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:16:36 devstack sudo[93088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-f588d4f1-8a25-441c-b911-018f21fd4a13 Jul 31 12:16:36 devstack sudo[93088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:16:36 devstack sudo[93088]: pam_unix(sudo:session): session closed for user root Jul 31 12:16:36 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-b4fb8e7d-0e28-4f4a-ba1c-1fb8adb8569e tempest-GroupsTest-2022448916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-f588d4f1-8a25-441c-b911-018f21fd4a13" returned: 0 in 0.331s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:16:36 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-b4fb8e7d-0e28-4f4a-ba1c-1fb8adb8569e tempest-GroupsTest-2022448916 None] Lock "cinder-quobyte-f588d4f1-8a25-441c-b911-018f21fd4a13" released by "delete_volume" :: held 0.869s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:16:36 devstack cinder-volume[89182]: DEBUG cinder.quota [None req-b4fb8e7d-0e28-4f4a-ba1c-1fb8adb8569e tempest-GroupsTest-2022448916 None] Created reservations ['0a696c81-2a9e-4373-be6a-4e7d5216eef1'] {{(pid=89182) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 12:16:36 devstack cinder-volume[89182]: WARNING cinder.quota [None req-b4fb8e7d-0e28-4f4a-ba1c-1fb8adb8569e tempest-GroupsTest-2022448916 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1162762637 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1162762637, it is now deprecated. Please use the default quota class for default quota. Jul 31 12:16:36 devstack cinder-volume[89182]: WARNING cinder.quota [None req-b4fb8e7d-0e28-4f4a-ba1c-1fb8adb8569e tempest-GroupsTest-2022448916 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1162762637 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1162762637, it is now deprecated. Please use the default quota class for default quota. Jul 31 12:16:36 devstack cinder-volume[89182]: DEBUG cinder.quota [None req-b4fb8e7d-0e28-4f4a-ba1c-1fb8adb8569e tempest-GroupsTest-2022448916 None] Created reservations ['1e7db0be-b958-4bd0-944f-d3695951acda', 'bbb13212-bd0f-4c6b-809c-b85ad8c060a5', '35e39c9f-ea11-425b-9128-4849c26fb66d', '7b9d3139-96ab-4bb8-86a6-e57f6f5d746a'] {{(pid=89182) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 12:16:37 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-b4fb8e7d-0e28-4f4a-ba1c-1fb8adb8569e tempest-GroupsTest-2022448916 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:16:37 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-b4fb8e7d-0e28-4f4a-ba1c-1fb8adb8569e tempest-GroupsTest-2022448916 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:16:37 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-b4fb8e7d-0e28-4f4a-ba1c-1fb8adb8569e tempest-GroupsTest-2022448916 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:16:37 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-b4fb8e7d-0e28-4f4a-ba1c-1fb8adb8569e tempest-GroupsTest-2022448916 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:16:37 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-b4fb8e7d-0e28-4f4a-ba1c-1fb8adb8569e tempest-GroupsTest-2022448916 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:16:37 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-b4fb8e7d-0e28-4f4a-ba1c-1fb8adb8569e tempest-GroupsTest-2022448916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:16:37 devstack sudo[93093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 Jul 31 12:16:37 devstack sudo[93093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:16:37 devstack cinder-volume[89182]: DEBUG cinder.quota [None req-aa6cace4-bb40-4bc7-a8e1-606333cea91d tempest-GroupsTest-2022448916 None] Created reservations ['711d5c67-7b73-4b7e-b666-9329699504b2'] {{(pid=89182) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 12:16:37 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-aa6cace4-bb40-4bc7-a8e1-606333cea91d tempest-GroupsTest-2022448916 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:16:37 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-aa6cace4-bb40-4bc7-a8e1-606333cea91d tempest-GroupsTest-2022448916 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:16:37 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-aa6cace4-bb40-4bc7-a8e1-606333cea91d tempest-GroupsTest-2022448916 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:16:37 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-aa6cace4-bb40-4bc7-a8e1-606333cea91d tempest-GroupsTest-2022448916 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:16:37 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-aa6cace4-bb40-4bc7-a8e1-606333cea91d tempest-GroupsTest-2022448916 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:16:37 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-aa6cace4-bb40-4bc7-a8e1-606333cea91d tempest-GroupsTest-2022448916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:16:37 devstack sudo[93117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 Jul 31 12:16:37 devstack sudo[93117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:16:37 devstack sudo[93093]: pam_unix(sudo:session): session closed for user root Jul 31 12:16:37 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-b4fb8e7d-0e28-4f4a-ba1c-1fb8adb8569e tempest-GroupsTest-2022448916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2" returned: 0 in 0.615s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:16:37 devstack cinder-volume[89182]: DEBUG cinder.manager [None req-b4fb8e7d-0e28-4f4a-ba1c-1fb8adb8569e tempest-GroupsTest-2022448916 None] Notifying Schedulers of capabilities ... {{(pid=89182) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 12:16:37 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-b4fb8e7d-0e28-4f4a-ba1c-1fb8adb8569e tempest-GroupsTest-2022448916 None] Delete group completed successfully. Jul 31 12:16:37 devstack sudo[93117]: pam_unix(sudo:session): session closed for user root Jul 31 12:16:37 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-aa6cace4-bb40-4bc7-a8e1-606333cea91d tempest-GroupsTest-2022448916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2" returned: 0 in 0.399s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:16:37 devstack cinder-volume[89182]: DEBUG cinder.manager [None req-aa6cace4-bb40-4bc7-a8e1-606333cea91d tempest-GroupsTest-2022448916 None] Notifying Schedulers of capabilities ... {{(pid=89182) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 12:16:37 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-aa6cace4-bb40-4bc7-a8e1-606333cea91d tempest-GroupsTest-2022448916 None] Delete group completed successfully. Jul 31 12:16:38 devstack cinder-volume[89182]: DEBUG cinder.volume.flows.manager.create_volume [None req-af1a6b1c-e9b2-4613-a074-dca350105c1e tempest-VolumesTransfersV357Test-690310749 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89182) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 12:16:38 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-af1a6b1c-e9b2-4613-a074-dca350105c1e tempest-VolumesTransfersV357Test-690310749 None] Flow 'volume_create_manager' (e31c1119-1bf2-4fae-aaab-da286e3be938) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:16:38 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-af1a6b1c-e9b2-4613-a074-dca350105c1e tempest-VolumesTransfersV357Test-690310749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc0a665f-835c-4f7b-9976-47f06896a8ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:16:38 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-af1a6b1c-e9b2-4613-a074-dca350105c1e tempest-VolumesTransfersV357Test-690310749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc0a665f-835c-4f7b-9976-47f06896a8ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:16:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1820732998',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1bc72f4-3e88-4243-af60-281e70457fb8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9482ac3eef7f4565ab356fd7dcacbef7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:16:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:16:38Z,use_quota=True,user_id='594fba7d166b48148631ec059eb5a561',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:16:38 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-af1a6b1c-e9b2-4613-a074-dca350105c1e tempest-VolumesTransfersV357Test-690310749 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c944379f-7545-4b31-9a81-364e5e01c100) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:16:38 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-af1a6b1c-e9b2-4613-a074-dca350105c1e tempest-VolumesTransfersV357Test-690310749 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c944379f-7545-4b31-9a81-364e5e01c100) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:16:38 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-af1a6b1c-e9b2-4613-a074-dca350105c1e tempest-VolumesTransfersV357Test-690310749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6cd64182-fae3-416e-b585-4122beae829c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:16:38 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-af1a6b1c-e9b2-4613-a074-dca350105c1e tempest-VolumesTransfersV357Test-690310749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6cd64182-fae3-416e-b585-4122beae829c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f1bc72f4-3e88-4243-af60-281e70457fb8', 'volume_name': 'volume-f1bc72f4-3e88-4243-af60-281e70457fb8', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:16:38 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-af1a6b1c-e9b2-4613-a074-dca350105c1e tempest-VolumesTransfersV357Test-690310749 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0413f41b-66f0-40f0-b651-c8580892a721) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:16:38 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-af1a6b1c-e9b2-4613-a074-dca350105c1e tempest-VolumesTransfersV357Test-690310749 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0413f41b-66f0-40f0-b651-c8580892a721) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:16:38 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-af1a6b1c-e9b2-4613-a074-dca350105c1e tempest-VolumesTransfersV357Test-690310749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d149b3dc-ecd0-44c4-b7d3-6c3b6b80e86f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:16:38 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-af1a6b1c-e9b2-4613-a074-dca350105c1e tempest-VolumesTransfersV357Test-690310749 None] Volume f1bc72f4-3e88-4243-af60-281e70457fb8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f1bc72f4-3e88-4243-af60-281e70457fb8', 'volume_size': 1} Jul 31 12:16:38 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-af1a6b1c-e9b2-4613-a074-dca350105c1e tempest-VolumesTransfersV357Test-690310749 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:16:38 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-af1a6b1c-e9b2-4613-a074-dca350105c1e tempest-VolumesTransfersV357Test-690310749 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:16:38 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-af1a6b1c-e9b2-4613-a074-dca350105c1e tempest-VolumesTransfersV357Test-690310749 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:16:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1820732998',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1bc72f4-3e88-4243-af60-281e70457fb8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9482ac3eef7f4565ab356fd7dcacbef7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:16:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:16:38Z,use_quota=True,user_id='594fba7d166b48148631ec059eb5a561',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)}" {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 12:16:38 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-af1a6b1c-e9b2-4613-a074-dca350105c1e tempest-VolumesTransfersV357Test-690310749 None] Creating volume f1bc72f4-3e88-4243-af60-281e70457fb8 {{(pid=89182) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 12:16:38 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-af1a6b1c-e9b2-4613-a074-dca350105c1e tempest-VolumesTransfersV357Test-690310749 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:16:38 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-af1a6b1c-e9b2-4613-a074-dca350105c1e tempest-VolumesTransfersV357Test-690310749 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:16:38 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-af1a6b1c-e9b2-4613-a074-dca350105c1e tempest-VolumesTransfersV357Test-690310749 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:16:38 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-af1a6b1c-e9b2-4613-a074-dca350105c1e tempest-VolumesTransfersV357Test-690310749 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:16:38 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-af1a6b1c-e9b2-4613-a074-dca350105c1e tempest-VolumesTransfersV357Test-690310749 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:16:38 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-af1a6b1c-e9b2-4613-a074-dca350105c1e tempest-VolumesTransfersV357Test-690310749 None] Selected osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 as target Quobyte volume. {{(pid=89182) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 12:16:38 devstack cinder-volume[89182]: INFO cinder.volume.drivers.remotefs [None req-af1a6b1c-e9b2-4613-a074-dca350105c1e tempest-VolumesTransfersV357Test-690310749 None] casted to osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 Jul 31 12:16:38 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-af1a6b1c-e9b2-4613-a074-dca350105c1e tempest-VolumesTransfersV357Test-690310749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-f1bc72f4-3e88-4243-af60-281e70457fb8 1073741824 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:16:38 devstack sudo[93508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-f1bc72f4-3e88-4243-af60-281e70457fb8 1073741824 Jul 31 12:16:38 devstack sudo[93508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:16:39 devstack sudo[93508]: pam_unix(sudo:session): session closed for user root Jul 31 12:16:39 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-af1a6b1c-e9b2-4613-a074-dca350105c1e tempest-VolumesTransfersV357Test-690310749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-f1bc72f4-3e88-4243-af60-281e70457fb8 1073741824" returned: 0 in 0.691s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:16:39 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-af1a6b1c-e9b2-4613-a074-dca350105c1e tempest-VolumesTransfersV357Test-690310749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-f1bc72f4-3e88-4243-af60-281e70457fb8 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:16:39 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-b9f987e4-2ba5-4d57-b48a-18f53c851115 tempest-GroupsTest-2022448916 None] Group tempest-GroupsTest-Group-122118564: creating Jul 31 12:16:39 devstack sudo[93530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-f1bc72f4-3e88-4243-af60-281e70457fb8 Jul 31 12:16:39 devstack sudo[93530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:16:39 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-b9f987e4-2ba5-4d57-b48a-18f53c851115 tempest-GroupsTest-2022448916 None] Group tempest-GroupsTest-Group-122118564: created successfully Jul 31 12:16:39 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-b9f987e4-2ba5-4d57-b48a-18f53c851115 tempest-GroupsTest-2022448916 None] Create group completed successfully. Jul 31 12:16:39 devstack sudo[93530]: pam_unix(sudo:session): session closed for user root Jul 31 12:16:39 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-af1a6b1c-e9b2-4613-a074-dca350105c1e tempest-VolumesTransfersV357Test-690310749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-f1bc72f4-3e88-4243-af60-281e70457fb8" returned: 0 in 0.332s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:16:39 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-af1a6b1c-e9b2-4613-a074-dca350105c1e tempest-VolumesTransfersV357Test-690310749 None] <== create_volume: return (1167ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'} {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 12:16:39 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-af1a6b1c-e9b2-4613-a074-dca350105c1e tempest-VolumesTransfersV357Test-690310749 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.172s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:16:39 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-af1a6b1c-e9b2-4613-a074-dca350105c1e tempest-VolumesTransfersV357Test-690310749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d149b3dc-ecd0-44c4-b7d3-6c3b6b80e86f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f1bc72f4-3e88-4243-af60-281e70457fb8', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:16:39 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-af1a6b1c-e9b2-4613-a074-dca350105c1e tempest-VolumesTransfersV357Test-690310749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (efbb603b-8baa-4065-b0c8-2dc5f26b61d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:16:39 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-af1a6b1c-e9b2-4613-a074-dca350105c1e tempest-VolumesTransfersV357Test-690310749 None] Volume volume-f1bc72f4-3e88-4243-af60-281e70457fb8 (f1bc72f4-3e88-4243-af60-281e70457fb8): created successfully Jul 31 12:16:39 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-af1a6b1c-e9b2-4613-a074-dca350105c1e tempest-VolumesTransfersV357Test-690310749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (efbb603b-8baa-4065-b0c8-2dc5f26b61d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:16:39 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-af1a6b1c-e9b2-4613-a074-dca350105c1e tempest-VolumesTransfersV357Test-690310749 None] Flow 'volume_create_manager' (e31c1119-1bf2-4fae-aaab-da286e3be938) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:16:39 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-af1a6b1c-e9b2-4613-a074-dca350105c1e tempest-VolumesTransfersV357Test-690310749 None] Created volume successfully. Jul 31 12:16:42 devstack cinder-volume[89182]: DEBUG cinder.volume.flows.manager.create_volume [None req-88d6005a-f8ae-4cb5-a6f1-3a580e30e31b tempest-GroupsTest-2022448916 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89182) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 12:16:42 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-88d6005a-f8ae-4cb5-a6f1-3a580e30e31b tempest-GroupsTest-2022448916 None] Flow 'volume_create_manager' (795a4fc7-595a-45f8-b50c-b46239647c98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:16:42 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-88d6005a-f8ae-4cb5-a6f1-3a580e30e31b tempest-GroupsTest-2022448916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5052596c-8916-4974-9569-6f054e216304) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:16:42 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-88d6005a-f8ae-4cb5-a6f1-3a580e30e31b tempest-GroupsTest-2022448916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5052596c-8916-4974-9569-6f054e216304) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:16:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-46321966',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=29e72c9c-0c90-4fda-8a4c-2d4bbc2b8da6,host='devstack@QuobyteHD#QuobyteHD',id=aa0dfe82-7041-4bdf-8ba4-cb8715d13d04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf48458faa1b4a158d8a2af37b1a2d3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:16:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:16:42Z,use_quota=True,user_id='74dd362feb2e409dbb199439188593aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fad85fd8-a70b-45f2-acac-16c3ae7a68f9),volume_type_id=fad85fd8-a70b-45f2-acac-16c3ae7a68f9)' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:16:42 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-88d6005a-f8ae-4cb5-a6f1-3a580e30e31b tempest-GroupsTest-2022448916 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5573ea5-9ef9-48f6-b527-e7e7cc980033) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:16:42 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-88d6005a-f8ae-4cb5-a6f1-3a580e30e31b tempest-GroupsTest-2022448916 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5573ea5-9ef9-48f6-b527-e7e7cc980033) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:16:42 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-88d6005a-f8ae-4cb5-a6f1-3a580e30e31b tempest-GroupsTest-2022448916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58c857e0-8777-4886-9e16-af3cd6fca398) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:16:42 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-88d6005a-f8ae-4cb5-a6f1-3a580e30e31b tempest-GroupsTest-2022448916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58c857e0-8777-4886-9e16-af3cd6fca398) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aa0dfe82-7041-4bdf-8ba4-cb8715d13d04', 'volume_name': 'volume-aa0dfe82-7041-4bdf-8ba4-cb8715d13d04', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:16:42 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-88d6005a-f8ae-4cb5-a6f1-3a580e30e31b tempest-GroupsTest-2022448916 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (680cd974-e50d-4254-a7e9-dd86b28a0622) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:16:42 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-88d6005a-f8ae-4cb5-a6f1-3a580e30e31b tempest-GroupsTest-2022448916 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (680cd974-e50d-4254-a7e9-dd86b28a0622) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:16:42 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-88d6005a-f8ae-4cb5-a6f1-3a580e30e31b tempest-GroupsTest-2022448916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc4d3801-979e-4fd1-8dfa-2af14026a0ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:16:42 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-88d6005a-f8ae-4cb5-a6f1-3a580e30e31b tempest-GroupsTest-2022448916 None] Volume aa0dfe82-7041-4bdf-8ba4-cb8715d13d04: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aa0dfe82-7041-4bdf-8ba4-cb8715d13d04', 'volume_size': 1} Jul 31 12:16:42 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-88d6005a-f8ae-4cb5-a6f1-3a580e30e31b tempest-GroupsTest-2022448916 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:16:42 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-88d6005a-f8ae-4cb5-a6f1-3a580e30e31b tempest-GroupsTest-2022448916 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:16:42 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-88d6005a-f8ae-4cb5-a6f1-3a580e30e31b tempest-GroupsTest-2022448916 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=29e72c9c-0c90-4fda-8a4c-2d4bbc2b8da6,created_at=2026-07-31T10:16:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-46321966',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=29e72c9c-0c90-4fda-8a4c-2d4bbc2b8da6,host='devstack@QuobyteHD#QuobyteHD',id=aa0dfe82-7041-4bdf-8ba4-cb8715d13d04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf48458faa1b4a158d8a2af37b1a2d3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:16:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:16:42Z,use_quota=True,user_id='74dd362feb2e409dbb199439188593aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fad85fd8-a70b-45f2-acac-16c3ae7a68f9),volume_type_id=fad85fd8-a70b-45f2-acac-16c3ae7a68f9)}" {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 12:16:42 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-88d6005a-f8ae-4cb5-a6f1-3a580e30e31b tempest-GroupsTest-2022448916 None] Creating volume aa0dfe82-7041-4bdf-8ba4-cb8715d13d04 {{(pid=89182) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 12:16:42 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-88d6005a-f8ae-4cb5-a6f1-3a580e30e31b tempest-GroupsTest-2022448916 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:16:42 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-88d6005a-f8ae-4cb5-a6f1-3a580e30e31b tempest-GroupsTest-2022448916 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:16:42 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-88d6005a-f8ae-4cb5-a6f1-3a580e30e31b tempest-GroupsTest-2022448916 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:16:42 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-88d6005a-f8ae-4cb5-a6f1-3a580e30e31b tempest-GroupsTest-2022448916 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:16:42 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-88d6005a-f8ae-4cb5-a6f1-3a580e30e31b tempest-GroupsTest-2022448916 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:16:42 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-88d6005a-f8ae-4cb5-a6f1-3a580e30e31b tempest-GroupsTest-2022448916 None] Selected osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 as target Quobyte volume. {{(pid=89182) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 12:16:42 devstack cinder-volume[89182]: INFO cinder.volume.drivers.remotefs [None req-88d6005a-f8ae-4cb5-a6f1-3a580e30e31b tempest-GroupsTest-2022448916 None] casted to osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 Jul 31 12:16:42 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-88d6005a-f8ae-4cb5-a6f1-3a580e30e31b tempest-GroupsTest-2022448916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-aa0dfe82-7041-4bdf-8ba4-cb8715d13d04 1073741824 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:16:42 devstack sudo[93569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-aa0dfe82-7041-4bdf-8ba4-cb8715d13d04 1073741824 Jul 31 12:16:42 devstack sudo[93569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:16:42 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-82d8cfa3-9dc1-4c5d-8d87-4ecc7ac13328 tempest-VolumesTransfersV357Test-609122866 None] Transfer volume completed successfully. Jul 31 12:16:43 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-8a089f33-b807-4391-a279-c9f55f314f84 tempest-VolumesTransfersV357Test-172790153 None] Acquiring lock "cinder-f1bc72f4-3e88-4243-af60-281e70457fb8-delete_volume" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:16:43 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-8a089f33-b807-4391-a279-c9f55f314f84 tempest-VolumesTransfersV357Test-172790153 None] Lock "cinder-f1bc72f4-3e88-4243-af60-281e70457fb8-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:16:43 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-8a089f33-b807-4391-a279-c9f55f314f84 tempest-VolumesTransfersV357Test-172790153 None] Acquiring lock "cinder-quobyte-f1bc72f4-3e88-4243-af60-281e70457fb8" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:16:43 devstack sudo[93569]: pam_unix(sudo:session): session closed for user root Jul 31 12:16:43 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-88d6005a-f8ae-4cb5-a6f1-3a580e30e31b tempest-GroupsTest-2022448916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-aa0dfe82-7041-4bdf-8ba4-cb8715d13d04 1073741824" returned: 0 in 1.290s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:16:43 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-8a089f33-b807-4391-a279-c9f55f314f84 tempest-VolumesTransfersV357Test-172790153 None] Lock "cinder-quobyte-f1bc72f4-3e88-4243-af60-281e70457fb8" acquired by "delete_volume" :: waited 0.076s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:16:43 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[e952a92e-05a3-4b1b-9b20-6e7b276028bf]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:16:43 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-8a089f33-b807-4391-a279-c9f55f314f84 tempest-VolumesTransfersV357Test-172790153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-f1bc72f4-3e88-4243-af60-281e70457fb8 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:16:43 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-88d6005a-f8ae-4cb5-a6f1-3a580e30e31b tempest-GroupsTest-2022448916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-aa0dfe82-7041-4bdf-8ba4-cb8715d13d04 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:16:43 devstack sudo[93575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-aa0dfe82-7041-4bdf-8ba4-cb8715d13d04 Jul 31 12:16:43 devstack sudo[93575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:16:43 devstack sudo[93574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-f1bc72f4-3e88-4243-af60-281e70457fb8 Jul 31 12:16:43 devstack sudo[93574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:16:44 devstack sudo[93574]: pam_unix(sudo:session): session closed for user root Jul 31 12:16:44 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-8a089f33-b807-4391-a279-c9f55f314f84 tempest-VolumesTransfersV357Test-172790153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-f1bc72f4-3e88-4243-af60-281e70457fb8" returned: 0 in 0.476s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:16:44 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-8a089f33-b807-4391-a279-c9f55f314f84 tempest-VolumesTransfersV357Test-172790153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-f1bc72f4-3e88-4243-af60-281e70457fb8 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:16:44 devstack sudo[93575]: pam_unix(sudo:session): session closed for user root Jul 31 12:16:44 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-88d6005a-f8ae-4cb5-a6f1-3a580e30e31b tempest-GroupsTest-2022448916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-aa0dfe82-7041-4bdf-8ba4-cb8715d13d04" returned: 0 in 0.482s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:16:44 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-88d6005a-f8ae-4cb5-a6f1-3a580e30e31b tempest-GroupsTest-2022448916 None] <== create_volume: return (1955ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'} {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 12:16:44 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-88d6005a-f8ae-4cb5-a6f1-3a580e30e31b tempest-GroupsTest-2022448916 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.964s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:16:44 devstack sudo[93583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-f1bc72f4-3e88-4243-af60-281e70457fb8 Jul 31 12:16:44 devstack sudo[93583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:16:44 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-88d6005a-f8ae-4cb5-a6f1-3a580e30e31b tempest-GroupsTest-2022448916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc4d3801-979e-4fd1-8dfa-2af14026a0ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aa0dfe82-7041-4bdf-8ba4-cb8715d13d04', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:16:44 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-88d6005a-f8ae-4cb5-a6f1-3a580e30e31b tempest-GroupsTest-2022448916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8f8550b-efc6-4637-a515-67bf84dcfe9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:16:44 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-88d6005a-f8ae-4cb5-a6f1-3a580e30e31b tempest-GroupsTest-2022448916 None] Volume volume-aa0dfe82-7041-4bdf-8ba4-cb8715d13d04 (aa0dfe82-7041-4bdf-8ba4-cb8715d13d04): created successfully Jul 31 12:16:44 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-88d6005a-f8ae-4cb5-a6f1-3a580e30e31b tempest-GroupsTest-2022448916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8f8550b-efc6-4637-a515-67bf84dcfe9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:16:44 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-88d6005a-f8ae-4cb5-a6f1-3a580e30e31b tempest-GroupsTest-2022448916 None] Flow 'volume_create_manager' (795a4fc7-595a-45f8-b50c-b46239647c98) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:16:44 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-88d6005a-f8ae-4cb5-a6f1-3a580e30e31b tempest-GroupsTest-2022448916 None] Created volume successfully. Jul 31 12:16:44 devstack sudo[93583]: pam_unix(sudo:session): session closed for user root Jul 31 12:16:44 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-8a089f33-b807-4391-a279-c9f55f314f84 tempest-VolumesTransfersV357Test-172790153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-f1bc72f4-3e88-4243-af60-281e70457fb8" returned: 0 in 0.434s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:16:44 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-8a089f33-b807-4391-a279-c9f55f314f84 tempest-VolumesTransfersV357Test-172790153 None] Lock "cinder-quobyte-f1bc72f4-3e88-4243-af60-281e70457fb8" released by "delete_volume" :: held 1.030s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:16:44 devstack cinder-volume[89182]: DEBUG cinder.quota [None req-8a089f33-b807-4391-a279-c9f55f314f84 tempest-VolumesTransfersV357Test-172790153 None] Created reservations ['f8d34d1e-a3cf-497d-87e7-fb7108a3205e', 'a9037252-7306-4515-b360-d3a8522ebe7f', 'a0a99e14-d1fc-4239-a1de-d78d53ef713d', '511792d9-5062-44ae-9a6d-54ac6e39577c'] {{(pid=89182) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 12:16:44 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-8a089f33-b807-4391-a279-c9f55f314f84 tempest-VolumesTransfersV357Test-172790153 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:16:44 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-8a089f33-b807-4391-a279-c9f55f314f84 tempest-VolumesTransfersV357Test-172790153 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:16:44 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-8a089f33-b807-4391-a279-c9f55f314f84 tempest-VolumesTransfersV357Test-172790153 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:16:44 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-8a089f33-b807-4391-a279-c9f55f314f84 tempest-VolumesTransfersV357Test-172790153 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:16:44 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-8a089f33-b807-4391-a279-c9f55f314f84 tempest-VolumesTransfersV357Test-172790153 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:16:44 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-8a089f33-b807-4391-a279-c9f55f314f84 tempest-VolumesTransfersV357Test-172790153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:16:44 devstack sudo[93588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 Jul 31 12:16:44 devstack sudo[93588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:16:45 devstack sudo[93588]: pam_unix(sudo:session): session closed for user root Jul 31 12:16:45 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-8a089f33-b807-4391-a279-c9f55f314f84 tempest-VolumesTransfersV357Test-172790153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2" returned: 0 in 0.390s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:16:45 devstack cinder-volume[89182]: DEBUG cinder.manager [None req-8a089f33-b807-4391-a279-c9f55f314f84 tempest-VolumesTransfersV357Test-172790153 None] Notifying Schedulers of capabilities ... {{(pid=89182) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 12:16:45 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-8a089f33-b807-4391-a279-c9f55f314f84 tempest-VolumesTransfersV357Test-172790153 None] Deleted volume successfully. Jul 31 12:16:45 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-8a089f33-b807-4391-a279-c9f55f314f84 tempest-VolumesTransfersV357Test-172790153 None] Lock "cinder-f1bc72f4-3e88-4243-af60-281e70457fb8-delete_volume" released by "delete_volume" :: held 1.894s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:16:47 devstack cinder-volume[89182]: DEBUG cinder.volume.flows.manager.create_volume [None req-13841afc-a0bf-4297-98ec-6d298355ad36 tempest-GroupsTest-2022448916 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89182) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 12:16:47 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-13841afc-a0bf-4297-98ec-6d298355ad36 tempest-GroupsTest-2022448916 None] Flow 'volume_create_manager' (829f7a5d-486a-4130-8218-efedea9b5a2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:16:47 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-13841afc-a0bf-4297-98ec-6d298355ad36 tempest-GroupsTest-2022448916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1b586d1-21c1-407a-b903-70b28fab40b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:16:47 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-13841afc-a0bf-4297-98ec-6d298355ad36 tempest-GroupsTest-2022448916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1b586d1-21c1-407a-b903-70b28fab40b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:16:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2017834852',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=29e72c9c-0c90-4fda-8a4c-2d4bbc2b8da6,host='devstack@QuobyteHD#QuobyteHD',id=982bb757-54c4-4959-ace0-c25bff8740ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf48458faa1b4a158d8a2af37b1a2d3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:16:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:16:47Z,use_quota=True,user_id='74dd362feb2e409dbb199439188593aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fad85fd8-a70b-45f2-acac-16c3ae7a68f9),volume_type_id=fad85fd8-a70b-45f2-acac-16c3ae7a68f9)' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:16:47 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-13841afc-a0bf-4297-98ec-6d298355ad36 tempest-GroupsTest-2022448916 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (574fec3a-e326-4141-8647-b9c584d417ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:16:47 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-13841afc-a0bf-4297-98ec-6d298355ad36 tempest-GroupsTest-2022448916 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (574fec3a-e326-4141-8647-b9c584d417ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:16:47 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-13841afc-a0bf-4297-98ec-6d298355ad36 tempest-GroupsTest-2022448916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7174e407-b9ec-474e-8c49-8500a1b72f83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:16:47 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-13841afc-a0bf-4297-98ec-6d298355ad36 tempest-GroupsTest-2022448916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7174e407-b9ec-474e-8c49-8500a1b72f83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '982bb757-54c4-4959-ace0-c25bff8740ad', 'volume_name': 'volume-982bb757-54c4-4959-ace0-c25bff8740ad', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:16:47 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-13841afc-a0bf-4297-98ec-6d298355ad36 tempest-GroupsTest-2022448916 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de393c48-2da3-44cd-9d9f-d38aa8707239) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:16:47 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-13841afc-a0bf-4297-98ec-6d298355ad36 tempest-GroupsTest-2022448916 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de393c48-2da3-44cd-9d9f-d38aa8707239) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:16:47 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-13841afc-a0bf-4297-98ec-6d298355ad36 tempest-GroupsTest-2022448916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76fb920d-30a8-47b7-acbb-9ab9d27cf5be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:16:47 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-13841afc-a0bf-4297-98ec-6d298355ad36 tempest-GroupsTest-2022448916 None] Volume 982bb757-54c4-4959-ace0-c25bff8740ad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-982bb757-54c4-4959-ace0-c25bff8740ad', 'volume_size': 1} Jul 31 12:16:47 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-13841afc-a0bf-4297-98ec-6d298355ad36 tempest-GroupsTest-2022448916 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:16:47 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-13841afc-a0bf-4297-98ec-6d298355ad36 tempest-GroupsTest-2022448916 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:16:47 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-13841afc-a0bf-4297-98ec-6d298355ad36 tempest-GroupsTest-2022448916 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=29e72c9c-0c90-4fda-8a4c-2d4bbc2b8da6,created_at=2026-07-31T10:16:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2017834852',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=29e72c9c-0c90-4fda-8a4c-2d4bbc2b8da6,host='devstack@QuobyteHD#QuobyteHD',id=982bb757-54c4-4959-ace0-c25bff8740ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf48458faa1b4a158d8a2af37b1a2d3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:16:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:16:47Z,use_quota=True,user_id='74dd362feb2e409dbb199439188593aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fad85fd8-a70b-45f2-acac-16c3ae7a68f9),volume_type_id=fad85fd8-a70b-45f2-acac-16c3ae7a68f9)}" {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 12:16:47 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-13841afc-a0bf-4297-98ec-6d298355ad36 tempest-GroupsTest-2022448916 None] Creating volume 982bb757-54c4-4959-ace0-c25bff8740ad {{(pid=89182) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 12:16:47 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-13841afc-a0bf-4297-98ec-6d298355ad36 tempest-GroupsTest-2022448916 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:16:47 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-13841afc-a0bf-4297-98ec-6d298355ad36 tempest-GroupsTest-2022448916 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:16:47 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-13841afc-a0bf-4297-98ec-6d298355ad36 tempest-GroupsTest-2022448916 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:16:47 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-13841afc-a0bf-4297-98ec-6d298355ad36 tempest-GroupsTest-2022448916 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:16:47 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-13841afc-a0bf-4297-98ec-6d298355ad36 tempest-GroupsTest-2022448916 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:16:47 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-13841afc-a0bf-4297-98ec-6d298355ad36 tempest-GroupsTest-2022448916 None] Selected osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 as target Quobyte volume. {{(pid=89182) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 12:16:47 devstack cinder-volume[89182]: INFO cinder.volume.drivers.remotefs [None req-13841afc-a0bf-4297-98ec-6d298355ad36 tempest-GroupsTest-2022448916 None] casted to osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 Jul 31 12:16:47 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-13841afc-a0bf-4297-98ec-6d298355ad36 tempest-GroupsTest-2022448916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-982bb757-54c4-4959-ace0-c25bff8740ad 1073741824 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:16:47 devstack sudo[93672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-982bb757-54c4-4959-ace0-c25bff8740ad 1073741824 Jul 31 12:16:47 devstack sudo[93672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:16:47 devstack cinder-volume[89182]: DEBUG cinder.volume.flows.manager.create_volume [None req-19ba35f7-92de-4301-8d07-507ffc701d7c tempest-VolumesTransfersV357Test-690310749 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89182) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 12:16:47 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-19ba35f7-92de-4301-8d07-507ffc701d7c tempest-VolumesTransfersV357Test-690310749 None] Flow 'volume_create_manager' (84073742-6d9e-4b53-ba12-0a53099fee70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:16:47 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-19ba35f7-92de-4301-8d07-507ffc701d7c tempest-VolumesTransfersV357Test-690310749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89eac5ce-59c1-4db6-8da5-0853c069e61c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:16:47 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-19ba35f7-92de-4301-8d07-507ffc701d7c tempest-VolumesTransfersV357Test-690310749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89eac5ce-59c1-4db6-8da5-0853c069e61c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:16:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1826674718',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e302bda9-a50d-4652-a4d0-a6a3126ed946,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9482ac3eef7f4565ab356fd7dcacbef7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:16:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:16:47Z,use_quota=True,user_id='594fba7d166b48148631ec059eb5a561',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:16:47 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-19ba35f7-92de-4301-8d07-507ffc701d7c tempest-VolumesTransfersV357Test-690310749 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3193ca68-8084-43bb-b3ee-094adfece17e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:16:47 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-19ba35f7-92de-4301-8d07-507ffc701d7c tempest-VolumesTransfersV357Test-690310749 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3193ca68-8084-43bb-b3ee-094adfece17e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:16:47 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-19ba35f7-92de-4301-8d07-507ffc701d7c tempest-VolumesTransfersV357Test-690310749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0271d9c-47b1-4035-b72c-d5d2cb5686f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:16:47 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-19ba35f7-92de-4301-8d07-507ffc701d7c tempest-VolumesTransfersV357Test-690310749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0271d9c-47b1-4035-b72c-d5d2cb5686f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e302bda9-a50d-4652-a4d0-a6a3126ed946', 'volume_name': 'volume-e302bda9-a50d-4652-a4d0-a6a3126ed946', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:16:47 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-19ba35f7-92de-4301-8d07-507ffc701d7c tempest-VolumesTransfersV357Test-690310749 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a85ea74-e5a7-4e22-8038-5b2dc12fb916) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:16:47 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-19ba35f7-92de-4301-8d07-507ffc701d7c tempest-VolumesTransfersV357Test-690310749 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a85ea74-e5a7-4e22-8038-5b2dc12fb916) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:16:48 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-19ba35f7-92de-4301-8d07-507ffc701d7c tempest-VolumesTransfersV357Test-690310749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43f80194-8dd6-49fd-9b39-e78301da5b94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:16:48 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-19ba35f7-92de-4301-8d07-507ffc701d7c tempest-VolumesTransfersV357Test-690310749 None] Volume e302bda9-a50d-4652-a4d0-a6a3126ed946: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e302bda9-a50d-4652-a4d0-a6a3126ed946', 'volume_size': 1} Jul 31 12:16:48 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-19ba35f7-92de-4301-8d07-507ffc701d7c tempest-VolumesTransfersV357Test-690310749 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:16:48 devstack sudo[93672]: pam_unix(sudo:session): session closed for user root Jul 31 12:16:48 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-13841afc-a0bf-4297-98ec-6d298355ad36 tempest-GroupsTest-2022448916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-982bb757-54c4-4959-ace0-c25bff8740ad 1073741824" returned: 0 in 0.779s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:16:48 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-13841afc-a0bf-4297-98ec-6d298355ad36 tempest-GroupsTest-2022448916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-982bb757-54c4-4959-ace0-c25bff8740ad {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:16:48 devstack sudo[93694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-982bb757-54c4-4959-ace0-c25bff8740ad Jul 31 12:16:48 devstack sudo[93694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:16:48 devstack sudo[93694]: pam_unix(sudo:session): session closed for user root Jul 31 12:16:48 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-13841afc-a0bf-4297-98ec-6d298355ad36 tempest-GroupsTest-2022448916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-982bb757-54c4-4959-ace0-c25bff8740ad" returned: 0 in 0.382s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:16:48 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-13841afc-a0bf-4297-98ec-6d298355ad36 tempest-GroupsTest-2022448916 None] <== create_volume: return (1255ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'} {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 12:16:48 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-13841afc-a0bf-4297-98ec-6d298355ad36 tempest-GroupsTest-2022448916 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.261s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:16:49 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-19ba35f7-92de-4301-8d07-507ffc701d7c tempest-VolumesTransfersV357Test-690310749 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.002s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:16:49 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-19ba35f7-92de-4301-8d07-507ffc701d7c tempest-VolumesTransfersV357Test-690310749 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:16:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1826674718',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e302bda9-a50d-4652-a4d0-a6a3126ed946,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9482ac3eef7f4565ab356fd7dcacbef7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:16:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:16:47Z,use_quota=True,user_id='594fba7d166b48148631ec059eb5a561',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)}" {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 12:16:49 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-19ba35f7-92de-4301-8d07-507ffc701d7c tempest-VolumesTransfersV357Test-690310749 None] Creating volume e302bda9-a50d-4652-a4d0-a6a3126ed946 {{(pid=89182) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 12:16:49 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-19ba35f7-92de-4301-8d07-507ffc701d7c tempest-VolumesTransfersV357Test-690310749 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:16:49 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-19ba35f7-92de-4301-8d07-507ffc701d7c tempest-VolumesTransfersV357Test-690310749 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.012s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:16:49 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-19ba35f7-92de-4301-8d07-507ffc701d7c tempest-VolumesTransfersV357Test-690310749 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:16:49 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-19ba35f7-92de-4301-8d07-507ffc701d7c tempest-VolumesTransfersV357Test-690310749 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:16:49 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-19ba35f7-92de-4301-8d07-507ffc701d7c tempest-VolumesTransfersV357Test-690310749 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:16:49 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-19ba35f7-92de-4301-8d07-507ffc701d7c tempest-VolumesTransfersV357Test-690310749 None] Selected osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 as target Quobyte volume. {{(pid=89182) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 12:16:49 devstack cinder-volume[89182]: INFO cinder.volume.drivers.remotefs [None req-19ba35f7-92de-4301-8d07-507ffc701d7c tempest-VolumesTransfersV357Test-690310749 None] casted to osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 Jul 31 12:16:49 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-19ba35f7-92de-4301-8d07-507ffc701d7c tempest-VolumesTransfersV357Test-690310749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e302bda9-a50d-4652-a4d0-a6a3126ed946 1073741824 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:16:49 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-13841afc-a0bf-4297-98ec-6d298355ad36 tempest-GroupsTest-2022448916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76fb920d-30a8-47b7-acbb-9ab9d27cf5be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-982bb757-54c4-4959-ace0-c25bff8740ad', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:16:49 devstack sudo[93700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e302bda9-a50d-4652-a4d0-a6a3126ed946 1073741824 Jul 31 12:16:49 devstack sudo[93700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:16:49 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-13841afc-a0bf-4297-98ec-6d298355ad36 tempest-GroupsTest-2022448916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0279e8b7-5eec-4407-bc56-6a484a8fa0db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:16:49 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-13841afc-a0bf-4297-98ec-6d298355ad36 tempest-GroupsTest-2022448916 None] Volume volume-982bb757-54c4-4959-ace0-c25bff8740ad (982bb757-54c4-4959-ace0-c25bff8740ad): created successfully Jul 31 12:16:49 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-13841afc-a0bf-4297-98ec-6d298355ad36 tempest-GroupsTest-2022448916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0279e8b7-5eec-4407-bc56-6a484a8fa0db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:16:49 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-13841afc-a0bf-4297-98ec-6d298355ad36 tempest-GroupsTest-2022448916 None] Flow 'volume_create_manager' (829f7a5d-486a-4130-8218-efedea9b5a2f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:16:49 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-13841afc-a0bf-4297-98ec-6d298355ad36 tempest-GroupsTest-2022448916 None] Created volume successfully. Jul 31 12:16:49 devstack sudo[93700]: pam_unix(sudo:session): session closed for user root Jul 31 12:16:49 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-19ba35f7-92de-4301-8d07-507ffc701d7c tempest-VolumesTransfersV357Test-690310749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e302bda9-a50d-4652-a4d0-a6a3126ed946 1073741824" returned: 0 in 0.883s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:16:50 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-19ba35f7-92de-4301-8d07-507ffc701d7c tempest-VolumesTransfersV357Test-690310749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e302bda9-a50d-4652-a4d0-a6a3126ed946 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:16:50 devstack sudo[93706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e302bda9-a50d-4652-a4d0-a6a3126ed946 Jul 31 12:16:50 devstack sudo[93706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:16:50 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-6215645c-efb8-4541-b5a0-c14434c0be75 tempest-GroupsTest-2022448916 None] Update group completed successfully. Jul 31 12:16:50 devstack sudo[93706]: pam_unix(sudo:session): session closed for user root Jul 31 12:16:50 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-19ba35f7-92de-4301-8d07-507ffc701d7c tempest-VolumesTransfersV357Test-690310749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e302bda9-a50d-4652-a4d0-a6a3126ed946" returned: 0 in 0.419s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:16:50 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-19ba35f7-92de-4301-8d07-507ffc701d7c tempest-VolumesTransfersV357Test-690310749 None] <== create_volume: return (1405ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'} {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 12:16:50 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-19ba35f7-92de-4301-8d07-507ffc701d7c tempest-VolumesTransfersV357Test-690310749 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.424s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:16:50 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-19ba35f7-92de-4301-8d07-507ffc701d7c tempest-VolumesTransfersV357Test-690310749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43f80194-8dd6-49fd-9b39-e78301da5b94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e302bda9-a50d-4652-a4d0-a6a3126ed946', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:16:50 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-19ba35f7-92de-4301-8d07-507ffc701d7c tempest-VolumesTransfersV357Test-690310749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d643731e-327a-4837-af40-b9070603c9b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:16:50 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-19ba35f7-92de-4301-8d07-507ffc701d7c tempest-VolumesTransfersV357Test-690310749 None] Volume volume-e302bda9-a50d-4652-a4d0-a6a3126ed946 (e302bda9-a50d-4652-a4d0-a6a3126ed946): created successfully Jul 31 12:16:50 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-19ba35f7-92de-4301-8d07-507ffc701d7c tempest-VolumesTransfersV357Test-690310749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d643731e-327a-4837-af40-b9070603c9b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:16:50 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-19ba35f7-92de-4301-8d07-507ffc701d7c tempest-VolumesTransfersV357Test-690310749 None] Flow 'volume_create_manager' (84073742-6d9e-4b53-ba12-0a53099fee70) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:16:50 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-19ba35f7-92de-4301-8d07-507ffc701d7c tempest-VolumesTransfersV357Test-690310749 None] Created volume successfully. Jul 31 12:16:52 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-22624308-20c4-410a-bca5-e44b913128e6 tempest-VolumesTransfersV357Test-172790153 None] Acquiring lock "cinder-e302bda9-a50d-4652-a4d0-a6a3126ed946-delete_volume" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:16:52 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-22624308-20c4-410a-bca5-e44b913128e6 tempest-VolumesTransfersV357Test-172790153 None] Lock "cinder-e302bda9-a50d-4652-a4d0-a6a3126ed946-delete_volume" acquired by "delete_volume" :: waited 0.074s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:16:52 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-22624308-20c4-410a-bca5-e44b913128e6 tempest-VolumesTransfersV357Test-172790153 None] Acquiring lock "cinder-quobyte-e302bda9-a50d-4652-a4d0-a6a3126ed946" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:16:52 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-b1257eec-8c35-444b-b4b3-53a08d6e1c0d tempest-GroupsTest-2022448916 None] Update group completed successfully. Jul 31 12:16:52 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-22624308-20c4-410a-bca5-e44b913128e6 tempest-VolumesTransfersV357Test-172790153 None] Lock "cinder-quobyte-e302bda9-a50d-4652-a4d0-a6a3126ed946" acquired by "delete_volume" :: waited 0.040s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:16:52 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[c11acf80-0ccb-4257-a4e3-1b055b24c47a]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:16:52 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-22624308-20c4-410a-bca5-e44b913128e6 tempest-VolumesTransfersV357Test-172790153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e302bda9-a50d-4652-a4d0-a6a3126ed946 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:16:52 devstack sudo[93713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e302bda9-a50d-4652-a4d0-a6a3126ed946 Jul 31 12:16:52 devstack sudo[93713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:16:53 devstack sudo[93713]: pam_unix(sudo:session): session closed for user root Jul 31 12:16:53 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-22624308-20c4-410a-bca5-e44b913128e6 tempest-VolumesTransfersV357Test-172790153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e302bda9-a50d-4652-a4d0-a6a3126ed946" returned: 0 in 0.735s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:16:53 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-22624308-20c4-410a-bca5-e44b913128e6 tempest-VolumesTransfersV357Test-172790153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e302bda9-a50d-4652-a4d0-a6a3126ed946 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:16:53 devstack sudo[93719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e302bda9-a50d-4652-a4d0-a6a3126ed946 Jul 31 12:16:53 devstack sudo[93719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:16:53 devstack sudo[93719]: pam_unix(sudo:session): session closed for user root Jul 31 12:16:53 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-22624308-20c4-410a-bca5-e44b913128e6 tempest-VolumesTransfersV357Test-172790153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e302bda9-a50d-4652-a4d0-a6a3126ed946" returned: 0 in 0.638s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:16:53 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-22624308-20c4-410a-bca5-e44b913128e6 tempest-VolumesTransfersV357Test-172790153 None] Lock "cinder-quobyte-e302bda9-a50d-4652-a4d0-a6a3126ed946" released by "delete_volume" :: held 1.465s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:16:54 devstack cinder-volume[89182]: DEBUG cinder.quota [None req-22624308-20c4-410a-bca5-e44b913128e6 tempest-VolumesTransfersV357Test-172790153 None] Created reservations ['5020c8f6-69d8-4805-af92-c89e1cc3801f', '480bc7ab-b875-4ebb-bd0d-085bbaeaa8df', '49e7f6f3-818a-4bac-a55e-0ed861fe52e6', 'fa7106aa-8071-4124-aafa-6dde2bb83dbc'] {{(pid=89182) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 12:16:54 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-22624308-20c4-410a-bca5-e44b913128e6 tempest-VolumesTransfersV357Test-172790153 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:16:54 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-22624308-20c4-410a-bca5-e44b913128e6 tempest-VolumesTransfersV357Test-172790153 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:16:54 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-22624308-20c4-410a-bca5-e44b913128e6 tempest-VolumesTransfersV357Test-172790153 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:16:54 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-22624308-20c4-410a-bca5-e44b913128e6 tempest-VolumesTransfersV357Test-172790153 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:16:54 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-22624308-20c4-410a-bca5-e44b913128e6 tempest-VolumesTransfersV357Test-172790153 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:16:54 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-22624308-20c4-410a-bca5-e44b913128e6 tempest-VolumesTransfersV357Test-172790153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:16:54 devstack sudo[93724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 Jul 31 12:16:54 devstack sudo[93724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:16:54 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-5c4ee55b-30ce-4990-b89c-15f14fd592e5 tempest-GroupsTest-2022448916 None] Acquiring lock "cinder-quobyte-982bb757-54c4-4959-ace0-c25bff8740ad" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:16:54 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-5c4ee55b-30ce-4990-b89c-15f14fd592e5 tempest-GroupsTest-2022448916 None] Lock "cinder-quobyte-982bb757-54c4-4959-ace0-c25bff8740ad" acquired by "delete_volume" :: waited 0.043s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:16:54 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[5565d1b8-3c54-44f5-bad7-e3a2ff0ef73e]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:16:54 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-5c4ee55b-30ce-4990-b89c-15f14fd592e5 tempest-GroupsTest-2022448916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-982bb757-54c4-4959-ace0-c25bff8740ad {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:16:54 devstack sudo[93724]: pam_unix(sudo:session): session closed for user root Jul 31 12:16:55 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-22624308-20c4-410a-bca5-e44b913128e6 tempest-VolumesTransfersV357Test-172790153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2" returned: 0 in 0.804s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:16:55 devstack cinder-volume[89182]: DEBUG cinder.manager [None req-22624308-20c4-410a-bca5-e44b913128e6 tempest-VolumesTransfersV357Test-172790153 None] Notifying Schedulers of capabilities ... {{(pid=89182) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 12:16:55 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-22624308-20c4-410a-bca5-e44b913128e6 tempest-VolumesTransfersV357Test-172790153 None] Deleted volume successfully. Jul 31 12:16:55 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-22624308-20c4-410a-bca5-e44b913128e6 tempest-VolumesTransfersV357Test-172790153 None] Lock "cinder-e302bda9-a50d-4652-a4d0-a6a3126ed946-delete_volume" released by "delete_volume" :: held 2.809s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:16:55 devstack sudo[93729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-982bb757-54c4-4959-ace0-c25bff8740ad Jul 31 12:16:55 devstack sudo[93729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:16:55 devstack sudo[93729]: pam_unix(sudo:session): session closed for user root Jul 31 12:16:55 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-5c4ee55b-30ce-4990-b89c-15f14fd592e5 tempest-GroupsTest-2022448916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-982bb757-54c4-4959-ace0-c25bff8740ad" returned: 0 in 0.888s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:16:55 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-5c4ee55b-30ce-4990-b89c-15f14fd592e5 tempest-GroupsTest-2022448916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-982bb757-54c4-4959-ace0-c25bff8740ad {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:16:55 devstack sudo[93737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-982bb757-54c4-4959-ace0-c25bff8740ad Jul 31 12:16:55 devstack sudo[93737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:16:56 devstack sudo[93737]: pam_unix(sudo:session): session closed for user root Jul 31 12:16:56 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-5c4ee55b-30ce-4990-b89c-15f14fd592e5 tempest-GroupsTest-2022448916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-982bb757-54c4-4959-ace0-c25bff8740ad" returned: 0 in 0.722s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:16:56 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-5c4ee55b-30ce-4990-b89c-15f14fd592e5 tempest-GroupsTest-2022448916 None] Lock "cinder-quobyte-982bb757-54c4-4959-ace0-c25bff8740ad" released by "delete_volume" :: held 1.696s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:16:56 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-5c4ee55b-30ce-4990-b89c-15f14fd592e5 tempest-GroupsTest-2022448916 None] Acquiring lock "cinder-quobyte-aa0dfe82-7041-4bdf-8ba4-cb8715d13d04" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:16:56 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-5c4ee55b-30ce-4990-b89c-15f14fd592e5 tempest-GroupsTest-2022448916 None] Lock "cinder-quobyte-aa0dfe82-7041-4bdf-8ba4-cb8715d13d04" acquired by "delete_volume" :: waited 0.035s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:16:56 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1cb0d01-6464-4874-83fd-a69c7186669f]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:16:56 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-5c4ee55b-30ce-4990-b89c-15f14fd592e5 tempest-GroupsTest-2022448916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-aa0dfe82-7041-4bdf-8ba4-cb8715d13d04 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:16:56 devstack sudo[93740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-aa0dfe82-7041-4bdf-8ba4-cb8715d13d04 Jul 31 12:16:56 devstack sudo[93740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:16:57 devstack sudo[93740]: pam_unix(sudo:session): session closed for user root Jul 31 12:16:57 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-5c4ee55b-30ce-4990-b89c-15f14fd592e5 tempest-GroupsTest-2022448916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-aa0dfe82-7041-4bdf-8ba4-cb8715d13d04" returned: 0 in 0.675s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:16:57 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-5c4ee55b-30ce-4990-b89c-15f14fd592e5 tempest-GroupsTest-2022448916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-aa0dfe82-7041-4bdf-8ba4-cb8715d13d04 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:16:57 devstack sudo[93745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-aa0dfe82-7041-4bdf-8ba4-cb8715d13d04 Jul 31 12:16:57 devstack sudo[93745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:16:57 devstack sudo[93745]: pam_unix(sudo:session): session closed for user root Jul 31 12:16:57 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-5c4ee55b-30ce-4990-b89c-15f14fd592e5 tempest-GroupsTest-2022448916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-aa0dfe82-7041-4bdf-8ba4-cb8715d13d04" returned: 0 in 0.420s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:16:57 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-5c4ee55b-30ce-4990-b89c-15f14fd592e5 tempest-GroupsTest-2022448916 None] Lock "cinder-quobyte-aa0dfe82-7041-4bdf-8ba4-cb8715d13d04" released by "delete_volume" :: held 1.149s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:16:57 devstack cinder-volume[89182]: DEBUG cinder.quota [None req-5c4ee55b-30ce-4990-b89c-15f14fd592e5 tempest-GroupsTest-2022448916 None] Created reservations ['cc716daa-70be-491e-bc0c-98e66470c874'] {{(pid=89182) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 12:16:57 devstack cinder-volume[89182]: WARNING cinder.quota [None req-5c4ee55b-30ce-4990-b89c-15f14fd592e5 tempest-GroupsTest-2022448916 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-12166542 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-12166542, it is now deprecated. Please use the default quota class for default quota. Jul 31 12:16:57 devstack cinder-volume[89182]: WARNING cinder.quota [None req-5c4ee55b-30ce-4990-b89c-15f14fd592e5 tempest-GroupsTest-2022448916 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-12166542 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-12166542, it is now deprecated. Please use the default quota class for default quota. Jul 31 12:16:57 devstack cinder-volume[89182]: DEBUG cinder.quota [None req-5c4ee55b-30ce-4990-b89c-15f14fd592e5 tempest-GroupsTest-2022448916 None] Created reservations ['89059186-f79c-420c-9327-845ab29bcd2b', '63c8570c-d5f7-4b8c-8865-b83fbebabcb8', '402324a8-55d6-445d-970c-006218510bb5', '8828feba-4dba-4447-8d1a-56d84cd62d1c'] {{(pid=89182) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 12:16:58 devstack cinder-volume[89182]: DEBUG cinder.quota [None req-5c4ee55b-30ce-4990-b89c-15f14fd592e5 tempest-GroupsTest-2022448916 None] Created reservations ['4af6cdea-7419-4818-8927-a615eebc6034', '2de60e06-e86e-41a7-a805-66a65020139d', '6e3873bb-dc56-4c43-964e-a256c6d14244', '31392b0f-0f13-4dbb-a0df-a9b53989d9e9'] {{(pid=89182) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 12:16:58 devstack cinder-volume[89182]: INFO cinder.volume.manager [req-588a4f6c-3d55-4776-8e65-a2b06fc95c83 req-1f6ec46d-25d4-4554-a1f8-4fe4380c5e4d tempest-ServerActionsTestOtherA-721546481 None] Terminate volume connection completed successfully. Jul 31 12:16:58 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [req-588a4f6c-3d55-4776-8e65-a2b06fc95c83 req-1f6ec46d-25d4-4554-a1f8-4fe4380c5e4d tempest-ServerActionsTestOtherA-721546481 None] Deleting attachment 0f1f05fb-f457-4a8d-b6dd-8f36d9be0ad3. {{(pid=89182) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 31 12:16:58 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-5c4ee55b-30ce-4990-b89c-15f14fd592e5 tempest-GroupsTest-2022448916 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:16:58 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-5c4ee55b-30ce-4990-b89c-15f14fd592e5 tempest-GroupsTest-2022448916 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:16:58 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-5c4ee55b-30ce-4990-b89c-15f14fd592e5 tempest-GroupsTest-2022448916 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:16:58 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-5c4ee55b-30ce-4990-b89c-15f14fd592e5 tempest-GroupsTest-2022448916 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:16:58 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-5c4ee55b-30ce-4990-b89c-15f14fd592e5 tempest-GroupsTest-2022448916 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:16:58 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-5c4ee55b-30ce-4990-b89c-15f14fd592e5 tempest-GroupsTest-2022448916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:16:58 devstack sudo[93799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 Jul 31 12:16:58 devstack sudo[93799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:16:59 devstack sudo[93799]: pam_unix(sudo:session): session closed for user root Jul 31 12:16:59 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-5c4ee55b-30ce-4990-b89c-15f14fd592e5 tempest-GroupsTest-2022448916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2" returned: 0 in 0.546s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:16:59 devstack cinder-volume[89182]: DEBUG cinder.manager [None req-5c4ee55b-30ce-4990-b89c-15f14fd592e5 tempest-GroupsTest-2022448916 None] Notifying Schedulers of capabilities ... {{(pid=89182) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 12:16:59 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-5c4ee55b-30ce-4990-b89c-15f14fd592e5 tempest-GroupsTest-2022448916 None] Delete group completed successfully. Jul 31 12:17:01 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [req-588a4f6c-3d55-4776-8e65-a2b06fc95c83 req-3e2201a1-c2fd-47d6-930c-160e37150b09 tempest-ServerActionsTestOtherA-721546481 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:17:01 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [req-588a4f6c-3d55-4776-8e65-a2b06fc95c83 req-3e2201a1-c2fd-47d6-930c-160e37150b09 tempest-ServerActionsTestOtherA-721546481 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:17:01 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [req-588a4f6c-3d55-4776-8e65-a2b06fc95c83 req-3e2201a1-c2fd-47d6-930c-160e37150b09 tempest-ServerActionsTestOtherA-721546481 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:17:01 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [req-588a4f6c-3d55-4776-8e65-a2b06fc95c83 req-3e2201a1-c2fd-47d6-930c-160e37150b09 tempest-ServerActionsTestOtherA-721546481 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88', 'name': 'volume-885fab30-9c14-41a8-8e74-9847acb8523d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7563ac64-3142-4018-8f8b-27f8026c9f11', 'enforce_multipath': True} {{(pid=89182) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 31 12:17:01 devstack cinder-volume[89182]: INFO cinder.volume.manager [req-588a4f6c-3d55-4776-8e65-a2b06fc95c83 req-3e2201a1-c2fd-47d6-930c-160e37150b09 tempest-ServerActionsTestOtherA-721546481 None] attachment_update completed successfully. Jul 31 12:17:04 devstack cinder-volume[89182]: DEBUG cinder.volume.flows.manager.create_volume [None req-c96232f8-876e-41df-96d7-dd99e3afc2a3 tempest-VolumesCloneNegativeTest-827449904 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89182) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 12:17:04 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-c96232f8-876e-41df-96d7-dd99e3afc2a3 tempest-VolumesCloneNegativeTest-827449904 None] Flow 'volume_create_manager' (ea1a24d4-f16e-421a-a840-f68e2c771377) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:17:04 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-c96232f8-876e-41df-96d7-dd99e3afc2a3 tempest-VolumesCloneNegativeTest-827449904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2e3e539-f0e3-46ed-9592-d308a39a9d1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:17:04 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-c96232f8-876e-41df-96d7-dd99e3afc2a3 tempest-VolumesCloneNegativeTest-827449904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2e3e539-f0e3-46ed-9592-d308a39a9d1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:17:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1991448244',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=884de0fe-5d55-46df-b02c-5ef7081ceeff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a83a4af4c16543c08aad8a741f5bec16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:17:05Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:17:05Z,use_quota=True,user_id='1c7a3e0556554797b53348006535f730',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:17:04 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-c96232f8-876e-41df-96d7-dd99e3afc2a3 tempest-VolumesCloneNegativeTest-827449904 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f342fc84-7cc9-407e-9c85-02930eb688cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:17:04 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-c96232f8-876e-41df-96d7-dd99e3afc2a3 tempest-VolumesCloneNegativeTest-827449904 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f342fc84-7cc9-407e-9c85-02930eb688cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:17:04 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-c96232f8-876e-41df-96d7-dd99e3afc2a3 tempest-VolumesCloneNegativeTest-827449904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e37bbecf-ad99-4f71-9235-b5668199d47f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:17:04 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-c96232f8-876e-41df-96d7-dd99e3afc2a3 tempest-VolumesCloneNegativeTest-827449904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e37bbecf-ad99-4f71-9235-b5668199d47f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '884de0fe-5d55-46df-b02c-5ef7081ceeff', 'volume_name': 'volume-884de0fe-5d55-46df-b02c-5ef7081ceeff', 'volume_size': 2}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:17:04 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-c96232f8-876e-41df-96d7-dd99e3afc2a3 tempest-VolumesCloneNegativeTest-827449904 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbf0f768-4d62-4e87-918e-939a329d8dfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:17:04 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-c96232f8-876e-41df-96d7-dd99e3afc2a3 tempest-VolumesCloneNegativeTest-827449904 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbf0f768-4d62-4e87-918e-939a329d8dfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:17:04 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-c96232f8-876e-41df-96d7-dd99e3afc2a3 tempest-VolumesCloneNegativeTest-827449904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a073401-6852-420d-a72f-d76f8dc755b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:17:04 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-c96232f8-876e-41df-96d7-dd99e3afc2a3 tempest-VolumesCloneNegativeTest-827449904 None] Volume 884de0fe-5d55-46df-b02c-5ef7081ceeff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-884de0fe-5d55-46df-b02c-5ef7081ceeff', 'volume_size': 2} Jul 31 12:17:04 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-c96232f8-876e-41df-96d7-dd99e3afc2a3 tempest-VolumesCloneNegativeTest-827449904 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:17:04 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-c96232f8-876e-41df-96d7-dd99e3afc2a3 tempest-VolumesCloneNegativeTest-827449904 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:17:04 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-c96232f8-876e-41df-96d7-dd99e3afc2a3 tempest-VolumesCloneNegativeTest-827449904 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:17:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1991448244',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=884de0fe-5d55-46df-b02c-5ef7081ceeff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a83a4af4c16543c08aad8a741f5bec16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:17:05Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:17:05Z,use_quota=True,user_id='1c7a3e0556554797b53348006535f730',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)}" {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 12:17:04 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-c96232f8-876e-41df-96d7-dd99e3afc2a3 tempest-VolumesCloneNegativeTest-827449904 None] Creating volume 884de0fe-5d55-46df-b02c-5ef7081ceeff {{(pid=89182) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 12:17:04 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-c96232f8-876e-41df-96d7-dd99e3afc2a3 tempest-VolumesCloneNegativeTest-827449904 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:17:04 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-c96232f8-876e-41df-96d7-dd99e3afc2a3 tempest-VolumesCloneNegativeTest-827449904 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:17:04 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-c96232f8-876e-41df-96d7-dd99e3afc2a3 tempest-VolumesCloneNegativeTest-827449904 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:17:04 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-c96232f8-876e-41df-96d7-dd99e3afc2a3 tempest-VolumesCloneNegativeTest-827449904 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:17:04 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-c96232f8-876e-41df-96d7-dd99e3afc2a3 tempest-VolumesCloneNegativeTest-827449904 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:17:04 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-c96232f8-876e-41df-96d7-dd99e3afc2a3 tempest-VolumesCloneNegativeTest-827449904 None] Selected osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 as target Quobyte volume. {{(pid=89182) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 12:17:04 devstack cinder-volume[89182]: INFO cinder.volume.drivers.remotefs [None req-c96232f8-876e-41df-96d7-dd99e3afc2a3 tempest-VolumesCloneNegativeTest-827449904 None] casted to osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 Jul 31 12:17:04 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-c96232f8-876e-41df-96d7-dd99e3afc2a3 tempest-VolumesCloneNegativeTest-827449904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-884de0fe-5d55-46df-b02c-5ef7081ceeff 2147483648 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:17:04 devstack sudo[94270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-884de0fe-5d55-46df-b02c-5ef7081ceeff 2147483648 Jul 31 12:17:04 devstack sudo[94270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:17:05 devstack sudo[94270]: pam_unix(sudo:session): session closed for user root Jul 31 12:17:05 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-c96232f8-876e-41df-96d7-dd99e3afc2a3 tempest-VolumesCloneNegativeTest-827449904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-884de0fe-5d55-46df-b02c-5ef7081ceeff 2147483648" returned: 0 in 0.669s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:17:05 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-c96232f8-876e-41df-96d7-dd99e3afc2a3 tempest-VolumesCloneNegativeTest-827449904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-884de0fe-5d55-46df-b02c-5ef7081ceeff {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:17:05 devstack sudo[94280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-884de0fe-5d55-46df-b02c-5ef7081ceeff Jul 31 12:17:05 devstack sudo[94280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:17:05 devstack sudo[94280]: pam_unix(sudo:session): session closed for user root Jul 31 12:17:05 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-c96232f8-876e-41df-96d7-dd99e3afc2a3 tempest-VolumesCloneNegativeTest-827449904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-884de0fe-5d55-46df-b02c-5ef7081ceeff" returned: 0 in 0.302s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:17:05 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-c96232f8-876e-41df-96d7-dd99e3afc2a3 tempest-VolumesCloneNegativeTest-827449904 None] <== create_volume: return (1051ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'} {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 12:17:05 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-c96232f8-876e-41df-96d7-dd99e3afc2a3 tempest-VolumesCloneNegativeTest-827449904 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.054s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:17:05 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-c96232f8-876e-41df-96d7-dd99e3afc2a3 tempest-VolumesCloneNegativeTest-827449904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a073401-6852-420d-a72f-d76f8dc755b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-884de0fe-5d55-46df-b02c-5ef7081ceeff', 'volume_size': 2}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:17:05 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-c96232f8-876e-41df-96d7-dd99e3afc2a3 tempest-VolumesCloneNegativeTest-827449904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51d0329a-f013-4495-a977-1f791b4ac2b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:17:05 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-c96232f8-876e-41df-96d7-dd99e3afc2a3 tempest-VolumesCloneNegativeTest-827449904 None] Volume volume-884de0fe-5d55-46df-b02c-5ef7081ceeff (884de0fe-5d55-46df-b02c-5ef7081ceeff): created successfully Jul 31 12:17:05 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-c96232f8-876e-41df-96d7-dd99e3afc2a3 tempest-VolumesCloneNegativeTest-827449904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51d0329a-f013-4495-a977-1f791b4ac2b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:17:05 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-c96232f8-876e-41df-96d7-dd99e3afc2a3 tempest-VolumesCloneNegativeTest-827449904 None] Flow 'volume_create_manager' (ea1a24d4-f16e-421a-a840-f68e2c771377) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:17:05 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-c96232f8-876e-41df-96d7-dd99e3afc2a3 tempest-VolumesCloneNegativeTest-827449904 None] Created volume successfully. Jul 31 12:17:07 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-fbc8e385-fa96-4b58-a1e2-b5ca5c9d1d2a tempest-VolumesCloneNegativeTest-827449904 None] Acquiring lock "cinder-884de0fe-5d55-46df-b02c-5ef7081ceeff-delete_volume" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:17:07 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-fbc8e385-fa96-4b58-a1e2-b5ca5c9d1d2a tempest-VolumesCloneNegativeTest-827449904 None] Lock "cinder-884de0fe-5d55-46df-b02c-5ef7081ceeff-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:17:07 devstack cinder-volume[89182]: DEBUG dbcounter [-] [89182] Writing DB stats cinder:SELECT=117,cinder:UPDATE=117,cinder:INSERT=28,cinder:DELETE=8 {{(pid=89182) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 12:17:07 devstack cinder-volume[89182]: DEBUG dbcounter [-] [89182] Writing DB stats cinder:SELECT=125,cinder:UPDATE=117,cinder:INSERT=31,cinder:DELETE=4 {{(pid=89182) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 12:17:07 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-fbc8e385-fa96-4b58-a1e2-b5ca5c9d1d2a tempest-VolumesCloneNegativeTest-827449904 None] Acquiring lock "cinder-quobyte-884de0fe-5d55-46df-b02c-5ef7081ceeff" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:17:07 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-fbc8e385-fa96-4b58-a1e2-b5ca5c9d1d2a tempest-VolumesCloneNegativeTest-827449904 None] Lock "cinder-quobyte-884de0fe-5d55-46df-b02c-5ef7081ceeff" acquired by "delete_volume" :: waited 0.026s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:17:07 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6a9ee3e-df5f-4a78-af14-1192e9a1a2ac]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:17:07 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-fbc8e385-fa96-4b58-a1e2-b5ca5c9d1d2a tempest-VolumesCloneNegativeTest-827449904 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-884de0fe-5d55-46df-b02c-5ef7081ceeff {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:17:07 devstack cinder-volume[89182]: DEBUG cinder.volume.flows.manager.create_volume [None req-2db1ceb8-1e8c-48a5-bd51-3dca97c4df8f tempest-VolumesServicesTestJSON-1138319048 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89182) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 12:17:07 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-2db1ceb8-1e8c-48a5-bd51-3dca97c4df8f tempest-VolumesServicesTestJSON-1138319048 None] Flow 'volume_create_manager' (7d57a2a8-51c5-421c-8bf0-0d854670fbc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:17:07 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-2db1ceb8-1e8c-48a5-bd51-3dca97c4df8f tempest-VolumesServicesTestJSON-1138319048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3cea5bd4-1b94-45f1-b91d-0be8fa16de51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:17:07 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-2db1ceb8-1e8c-48a5-bd51-3dca97c4df8f tempest-VolumesServicesTestJSON-1138319048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3cea5bd4-1b94-45f1-b91d-0be8fa16de51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:17:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1395819140',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8021cb59-328b-499c-9c70-c4145596e2fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df3697f575de4c3cb55527311582af9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:17:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:17:07Z,use_quota=True,user_id='4630f68e169a4f9c940ef6fb7caa0db0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:17:07 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-2db1ceb8-1e8c-48a5-bd51-3dca97c4df8f tempest-VolumesServicesTestJSON-1138319048 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43a2a50e-38be-43fc-af03-fa9df6ea5b37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:17:07 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-2db1ceb8-1e8c-48a5-bd51-3dca97c4df8f tempest-VolumesServicesTestJSON-1138319048 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43a2a50e-38be-43fc-af03-fa9df6ea5b37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:17:07 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-2db1ceb8-1e8c-48a5-bd51-3dca97c4df8f tempest-VolumesServicesTestJSON-1138319048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (381e9dc6-75b9-4463-9e8f-06aea60cbc0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:17:07 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-2db1ceb8-1e8c-48a5-bd51-3dca97c4df8f tempest-VolumesServicesTestJSON-1138319048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (381e9dc6-75b9-4463-9e8f-06aea60cbc0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8021cb59-328b-499c-9c70-c4145596e2fd', 'volume_name': 'volume-8021cb59-328b-499c-9c70-c4145596e2fd', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:17:07 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-2db1ceb8-1e8c-48a5-bd51-3dca97c4df8f tempest-VolumesServicesTestJSON-1138319048 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (120a004b-834c-4f87-b9f2-10300f6f2db1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:17:07 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-2db1ceb8-1e8c-48a5-bd51-3dca97c4df8f tempest-VolumesServicesTestJSON-1138319048 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (120a004b-834c-4f87-b9f2-10300f6f2db1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:17:07 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-2db1ceb8-1e8c-48a5-bd51-3dca97c4df8f tempest-VolumesServicesTestJSON-1138319048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63e4a1dd-d89a-4f6e-b2bf-f6cfa2e739f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:17:07 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-2db1ceb8-1e8c-48a5-bd51-3dca97c4df8f tempest-VolumesServicesTestJSON-1138319048 None] Volume 8021cb59-328b-499c-9c70-c4145596e2fd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8021cb59-328b-499c-9c70-c4145596e2fd', 'volume_size': 1} Jul 31 12:17:07 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-2db1ceb8-1e8c-48a5-bd51-3dca97c4df8f tempest-VolumesServicesTestJSON-1138319048 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:17:07 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-2db1ceb8-1e8c-48a5-bd51-3dca97c4df8f tempest-VolumesServicesTestJSON-1138319048 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:17:07 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-2db1ceb8-1e8c-48a5-bd51-3dca97c4df8f tempest-VolumesServicesTestJSON-1138319048 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:17:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1395819140',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8021cb59-328b-499c-9c70-c4145596e2fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df3697f575de4c3cb55527311582af9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:17:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:17:07Z,use_quota=True,user_id='4630f68e169a4f9c940ef6fb7caa0db0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)}" {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 12:17:07 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-2db1ceb8-1e8c-48a5-bd51-3dca97c4df8f tempest-VolumesServicesTestJSON-1138319048 None] Creating volume 8021cb59-328b-499c-9c70-c4145596e2fd {{(pid=89182) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 12:17:07 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-2db1ceb8-1e8c-48a5-bd51-3dca97c4df8f tempest-VolumesServicesTestJSON-1138319048 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:17:07 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-2db1ceb8-1e8c-48a5-bd51-3dca97c4df8f tempest-VolumesServicesTestJSON-1138319048 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:17:07 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-2db1ceb8-1e8c-48a5-bd51-3dca97c4df8f tempest-VolumesServicesTestJSON-1138319048 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:17:07 devstack sudo[94287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-884de0fe-5d55-46df-b02c-5ef7081ceeff Jul 31 12:17:07 devstack sudo[94287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:17:07 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-2db1ceb8-1e8c-48a5-bd51-3dca97c4df8f tempest-VolumesServicesTestJSON-1138319048 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:17:07 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-2db1ceb8-1e8c-48a5-bd51-3dca97c4df8f tempest-VolumesServicesTestJSON-1138319048 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:17:07 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-2db1ceb8-1e8c-48a5-bd51-3dca97c4df8f tempest-VolumesServicesTestJSON-1138319048 None] Selected osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 as target Quobyte volume. {{(pid=89182) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 12:17:07 devstack cinder-volume[89182]: INFO cinder.volume.drivers.remotefs [None req-2db1ceb8-1e8c-48a5-bd51-3dca97c4df8f tempest-VolumesServicesTestJSON-1138319048 None] casted to osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 Jul 31 12:17:07 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-2db1ceb8-1e8c-48a5-bd51-3dca97c4df8f tempest-VolumesServicesTestJSON-1138319048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-8021cb59-328b-499c-9c70-c4145596e2fd 1073741824 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:17:07 devstack sudo[94289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-8021cb59-328b-499c-9c70-c4145596e2fd 1073741824 Jul 31 12:17:07 devstack sudo[94289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:17:07 devstack sudo[94287]: pam_unix(sudo:session): session closed for user root Jul 31 12:17:07 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-fbc8e385-fa96-4b58-a1e2-b5ca5c9d1d2a tempest-VolumesCloneNegativeTest-827449904 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-884de0fe-5d55-46df-b02c-5ef7081ceeff" returned: 0 in 0.510s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:17:07 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-fbc8e385-fa96-4b58-a1e2-b5ca5c9d1d2a tempest-VolumesCloneNegativeTest-827449904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-884de0fe-5d55-46df-b02c-5ef7081ceeff {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:17:07 devstack sudo[94297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-884de0fe-5d55-46df-b02c-5ef7081ceeff Jul 31 12:17:07 devstack sudo[94297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:17:08 devstack sudo[94289]: pam_unix(sudo:session): session closed for user root Jul 31 12:17:08 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-2db1ceb8-1e8c-48a5-bd51-3dca97c4df8f tempest-VolumesServicesTestJSON-1138319048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-8021cb59-328b-499c-9c70-c4145596e2fd 1073741824" returned: 0 in 0.609s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:17:08 devstack sudo[94297]: pam_unix(sudo:session): session closed for user root Jul 31 12:17:08 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-fbc8e385-fa96-4b58-a1e2-b5ca5c9d1d2a tempest-VolumesCloneNegativeTest-827449904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-884de0fe-5d55-46df-b02c-5ef7081ceeff" returned: 0 in 0.310s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:17:08 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-fbc8e385-fa96-4b58-a1e2-b5ca5c9d1d2a tempest-VolumesCloneNegativeTest-827449904 None] Lock "cinder-quobyte-884de0fe-5d55-46df-b02c-5ef7081ceeff" released by "delete_volume" :: held 0.888s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:17:08 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-2db1ceb8-1e8c-48a5-bd51-3dca97c4df8f tempest-VolumesServicesTestJSON-1138319048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-8021cb59-328b-499c-9c70-c4145596e2fd {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:17:08 devstack cinder-volume[89182]: DEBUG cinder.quota [None req-fbc8e385-fa96-4b58-a1e2-b5ca5c9d1d2a tempest-VolumesCloneNegativeTest-827449904 None] Created reservations ['dd604436-0905-48b4-bd78-81974c259f11', 'db4f793e-c0b1-48a0-bde2-0ee49e1245f6', '704853a5-9d02-446e-a91f-b28d4cbe9d47', 'f5d70084-b31d-4cf5-b0ea-2c5db21242a3'] {{(pid=89182) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 12:17:08 devstack sudo[94301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-8021cb59-328b-499c-9c70-c4145596e2fd Jul 31 12:17:08 devstack sudo[94301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:17:08 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-fbc8e385-fa96-4b58-a1e2-b5ca5c9d1d2a tempest-VolumesCloneNegativeTest-827449904 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:17:08 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-fbc8e385-fa96-4b58-a1e2-b5ca5c9d1d2a tempest-VolumesCloneNegativeTest-827449904 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:17:08 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-fbc8e385-fa96-4b58-a1e2-b5ca5c9d1d2a tempest-VolumesCloneNegativeTest-827449904 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:17:08 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-fbc8e385-fa96-4b58-a1e2-b5ca5c9d1d2a tempest-VolumesCloneNegativeTest-827449904 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:17:08 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-fbc8e385-fa96-4b58-a1e2-b5ca5c9d1d2a tempest-VolumesCloneNegativeTest-827449904 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:17:08 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-fbc8e385-fa96-4b58-a1e2-b5ca5c9d1d2a tempest-VolumesCloneNegativeTest-827449904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:17:08 devstack sudo[94303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 Jul 31 12:17:08 devstack sudo[94303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:17:08 devstack sudo[94301]: pam_unix(sudo:session): session closed for user root Jul 31 12:17:08 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-2db1ceb8-1e8c-48a5-bd51-3dca97c4df8f tempest-VolumesServicesTestJSON-1138319048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-8021cb59-328b-499c-9c70-c4145596e2fd" returned: 0 in 0.447s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:17:08 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-2db1ceb8-1e8c-48a5-bd51-3dca97c4df8f tempest-VolumesServicesTestJSON-1138319048 None] <== create_volume: return (1161ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'} {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 12:17:08 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-2db1ceb8-1e8c-48a5-bd51-3dca97c4df8f tempest-VolumesServicesTestJSON-1138319048 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.164s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:17:08 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-2db1ceb8-1e8c-48a5-bd51-3dca97c4df8f tempest-VolumesServicesTestJSON-1138319048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63e4a1dd-d89a-4f6e-b2bf-f6cfa2e739f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8021cb59-328b-499c-9c70-c4145596e2fd', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:17:08 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-2db1ceb8-1e8c-48a5-bd51-3dca97c4df8f tempest-VolumesServicesTestJSON-1138319048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c116947-1b40-4b72-9b0f-2a9f88f79c3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:17:08 devstack sudo[94303]: pam_unix(sudo:session): session closed for user root Jul 31 12:17:08 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-fbc8e385-fa96-4b58-a1e2-b5ca5c9d1d2a tempest-VolumesCloneNegativeTest-827449904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2" returned: 0 in 0.310s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:17:08 devstack cinder-volume[89182]: DEBUG cinder.manager [None req-fbc8e385-fa96-4b58-a1e2-b5ca5c9d1d2a tempest-VolumesCloneNegativeTest-827449904 None] Notifying Schedulers of capabilities ... {{(pid=89182) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 12:17:08 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-fbc8e385-fa96-4b58-a1e2-b5ca5c9d1d2a tempest-VolumesCloneNegativeTest-827449904 None] Deleted volume successfully. Jul 31 12:17:08 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-2db1ceb8-1e8c-48a5-bd51-3dca97c4df8f tempest-VolumesServicesTestJSON-1138319048 None] Volume volume-8021cb59-328b-499c-9c70-c4145596e2fd (8021cb59-328b-499c-9c70-c4145596e2fd): created successfully Jul 31 12:17:08 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-2db1ceb8-1e8c-48a5-bd51-3dca97c4df8f tempest-VolumesServicesTestJSON-1138319048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c116947-1b40-4b72-9b0f-2a9f88f79c3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:17:08 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-2db1ceb8-1e8c-48a5-bd51-3dca97c4df8f tempest-VolumesServicesTestJSON-1138319048 None] Flow 'volume_create_manager' (7d57a2a8-51c5-421c-8bf0-0d854670fbc2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:17:08 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-2db1ceb8-1e8c-48a5-bd51-3dca97c4df8f tempest-VolumesServicesTestJSON-1138319048 None] Created volume successfully. Jul 31 12:17:08 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-fbc8e385-fa96-4b58-a1e2-b5ca5c9d1d2a tempest-VolumesCloneNegativeTest-827449904 None] Lock "cinder-884de0fe-5d55-46df-b02c-5ef7081ceeff-delete_volume" released by "delete_volume" :: held 1.582s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:17:09 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-2ee33dd2-c262-4cb2-bd0b-60c4900bf88d tempest-VolumesServicesTestJSON-1138319048 None] Acquiring lock "cinder-8021cb59-328b-499c-9c70-c4145596e2fd-delete_volume" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:17:09 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-2ee33dd2-c262-4cb2-bd0b-60c4900bf88d tempest-VolumesServicesTestJSON-1138319048 None] Lock "cinder-8021cb59-328b-499c-9c70-c4145596e2fd-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:17:09 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-2ee33dd2-c262-4cb2-bd0b-60c4900bf88d tempest-VolumesServicesTestJSON-1138319048 None] Acquiring lock "cinder-quobyte-8021cb59-328b-499c-9c70-c4145596e2fd" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:17:09 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-2ee33dd2-c262-4cb2-bd0b-60c4900bf88d tempest-VolumesServicesTestJSON-1138319048 None] Lock "cinder-quobyte-8021cb59-328b-499c-9c70-c4145596e2fd" acquired by "delete_volume" :: waited 0.045s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:17:09 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf41bb28-4eba-46f0-8103-5d58c9089620]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:17:09 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-2ee33dd2-c262-4cb2-bd0b-60c4900bf88d tempest-VolumesServicesTestJSON-1138319048 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-8021cb59-328b-499c-9c70-c4145596e2fd {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:17:10 devstack sudo[94308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-8021cb59-328b-499c-9c70-c4145596e2fd Jul 31 12:17:10 devstack sudo[94308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:17:10 devstack sudo[94308]: pam_unix(sudo:session): session closed for user root Jul 31 12:17:10 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-2ee33dd2-c262-4cb2-bd0b-60c4900bf88d tempest-VolumesServicesTestJSON-1138319048 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-8021cb59-328b-499c-9c70-c4145596e2fd" returned: 0 in 0.520s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:17:10 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-2ee33dd2-c262-4cb2-bd0b-60c4900bf88d tempest-VolumesServicesTestJSON-1138319048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-8021cb59-328b-499c-9c70-c4145596e2fd {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:17:10 devstack sudo[94313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-8021cb59-328b-499c-9c70-c4145596e2fd Jul 31 12:17:10 devstack sudo[94313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:17:10 devstack sudo[94313]: pam_unix(sudo:session): session closed for user root Jul 31 12:17:10 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-2ee33dd2-c262-4cb2-bd0b-60c4900bf88d tempest-VolumesServicesTestJSON-1138319048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-8021cb59-328b-499c-9c70-c4145596e2fd" returned: 0 in 0.303s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:17:10 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-2ee33dd2-c262-4cb2-bd0b-60c4900bf88d tempest-VolumesServicesTestJSON-1138319048 None] Lock "cinder-quobyte-8021cb59-328b-499c-9c70-c4145596e2fd" released by "delete_volume" :: held 0.890s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:17:10 devstack cinder-volume[89182]: DEBUG cinder.quota [None req-2ee33dd2-c262-4cb2-bd0b-60c4900bf88d tempest-VolumesServicesTestJSON-1138319048 None] Created reservations ['9f96de3f-a773-45e5-8983-6f5e727107e5', '82c25543-32dd-400b-b93e-ac592fd5dd9d', '43009b8b-780a-4356-a258-c27d24ee59a5', '5ef6c540-23a4-4837-9d89-6d5eaca2f5fe'] {{(pid=89182) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 12:17:10 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-2ee33dd2-c262-4cb2-bd0b-60c4900bf88d tempest-VolumesServicesTestJSON-1138319048 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:17:10 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-2ee33dd2-c262-4cb2-bd0b-60c4900bf88d tempest-VolumesServicesTestJSON-1138319048 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:17:10 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-2ee33dd2-c262-4cb2-bd0b-60c4900bf88d tempest-VolumesServicesTestJSON-1138319048 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:17:10 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-2ee33dd2-c262-4cb2-bd0b-60c4900bf88d tempest-VolumesServicesTestJSON-1138319048 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:17:10 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-2ee33dd2-c262-4cb2-bd0b-60c4900bf88d tempest-VolumesServicesTestJSON-1138319048 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:17:10 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-2ee33dd2-c262-4cb2-bd0b-60c4900bf88d tempest-VolumesServicesTestJSON-1138319048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:17:10 devstack sudo[94316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 Jul 31 12:17:10 devstack sudo[94316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:17:11 devstack sudo[94316]: pam_unix(sudo:session): session closed for user root Jul 31 12:17:11 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-2ee33dd2-c262-4cb2-bd0b-60c4900bf88d tempest-VolumesServicesTestJSON-1138319048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2" returned: 0 in 0.290s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:17:11 devstack cinder-volume[89182]: DEBUG cinder.manager [None req-2ee33dd2-c262-4cb2-bd0b-60c4900bf88d tempest-VolumesServicesTestJSON-1138319048 None] Notifying Schedulers of capabilities ... {{(pid=89182) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 12:17:11 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-2ee33dd2-c262-4cb2-bd0b-60c4900bf88d tempest-VolumesServicesTestJSON-1138319048 None] Deleted volume successfully. Jul 31 12:17:11 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-2ee33dd2-c262-4cb2-bd0b-60c4900bf88d tempest-VolumesServicesTestJSON-1138319048 None] Lock "cinder-8021cb59-328b-499c-9c70-c4145596e2fd-delete_volume" released by "delete_volume" :: held 1.573s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:17:13 devstack cinder-volume[89182]: DEBUG cinder.volume.flows.manager.create_volume [None req-8bb21e33-57e7-403e-bd90-985889791978 tempest-VolumesGetTest-1167943284 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89182) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 12:17:13 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-8bb21e33-57e7-403e-bd90-985889791978 tempest-VolumesGetTest-1167943284 None] Flow 'volume_create_manager' (ad985444-8eb2-4cfe-b676-b6430e114b39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:17:13 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-8bb21e33-57e7-403e-bd90-985889791978 tempest-VolumesGetTest-1167943284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49d267a6-427b-4703-b1d2-9c731b86c7af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:17:13 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-8bb21e33-57e7-403e-bd90-985889791978 tempest-VolumesGetTest-1167943284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49d267a6-427b-4703-b1d2-9c731b86c7af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:17:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2091589348',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7e914f8-f211-466d-9d2b-e8ff0f15e9bf,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='3bfd8f27aa9442a384d65adca3b284dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:17:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:17:14Z,use_quota=True,user_id='219264511ea247d78c4075409a489eff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:17:13 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-8bb21e33-57e7-403e-bd90-985889791978 tempest-VolumesGetTest-1167943284 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (059802b0-40c4-4137-a956-5fd2ce44e000) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:17:13 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-8bb21e33-57e7-403e-bd90-985889791978 tempest-VolumesGetTest-1167943284 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (059802b0-40c4-4137-a956-5fd2ce44e000) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:17:13 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-8bb21e33-57e7-403e-bd90-985889791978 tempest-VolumesGetTest-1167943284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87a8e0ad-b038-4357-b713-0fea02eff5ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:17:13 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-8bb21e33-57e7-403e-bd90-985889791978 tempest-VolumesGetTest-1167943284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87a8e0ad-b038-4357-b713-0fea02eff5ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd7e914f8-f211-466d-9d2b-e8ff0f15e9bf', 'volume_name': 'volume-d7e914f8-f211-466d-9d2b-e8ff0f15e9bf', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:17:13 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-8bb21e33-57e7-403e-bd90-985889791978 tempest-VolumesGetTest-1167943284 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6bcbebf3-2e73-4675-95e4-b627020e17ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:17:13 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-8bb21e33-57e7-403e-bd90-985889791978 tempest-VolumesGetTest-1167943284 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6bcbebf3-2e73-4675-95e4-b627020e17ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:17:13 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-8bb21e33-57e7-403e-bd90-985889791978 tempest-VolumesGetTest-1167943284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3718438-be0f-4e47-8945-d187201e1008) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:17:13 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-8bb21e33-57e7-403e-bd90-985889791978 tempest-VolumesGetTest-1167943284 None] Volume d7e914f8-f211-466d-9d2b-e8ff0f15e9bf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d7e914f8-f211-466d-9d2b-e8ff0f15e9bf', 'volume_size': 1} Jul 31 12:17:13 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-8bb21e33-57e7-403e-bd90-985889791978 tempest-VolumesGetTest-1167943284 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:17:13 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-8bb21e33-57e7-403e-bd90-985889791978 tempest-VolumesGetTest-1167943284 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:17:13 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-8bb21e33-57e7-403e-bd90-985889791978 tempest-VolumesGetTest-1167943284 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:17:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2091589348',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7e914f8-f211-466d-9d2b-e8ff0f15e9bf,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='3bfd8f27aa9442a384d65adca3b284dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:17:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:17:14Z,use_quota=True,user_id='219264511ea247d78c4075409a489eff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)}" {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 12:17:13 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-8bb21e33-57e7-403e-bd90-985889791978 tempest-VolumesGetTest-1167943284 None] Creating volume d7e914f8-f211-466d-9d2b-e8ff0f15e9bf {{(pid=89182) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 12:17:13 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-8bb21e33-57e7-403e-bd90-985889791978 tempest-VolumesGetTest-1167943284 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:17:13 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-8bb21e33-57e7-403e-bd90-985889791978 tempest-VolumesGetTest-1167943284 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:17:13 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-8bb21e33-57e7-403e-bd90-985889791978 tempest-VolumesGetTest-1167943284 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:17:13 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-8bb21e33-57e7-403e-bd90-985889791978 tempest-VolumesGetTest-1167943284 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:17:13 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-8bb21e33-57e7-403e-bd90-985889791978 tempest-VolumesGetTest-1167943284 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:17:13 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-8bb21e33-57e7-403e-bd90-985889791978 tempest-VolumesGetTest-1167943284 None] Selected osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 as target Quobyte volume. {{(pid=89182) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 12:17:13 devstack cinder-volume[89182]: INFO cinder.volume.drivers.remotefs [None req-8bb21e33-57e7-403e-bd90-985889791978 tempest-VolumesGetTest-1167943284 None] casted to osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 Jul 31 12:17:13 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-8bb21e33-57e7-403e-bd90-985889791978 tempest-VolumesGetTest-1167943284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-d7e914f8-f211-466d-9d2b-e8ff0f15e9bf 1073741824 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:17:13 devstack sudo[94319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-d7e914f8-f211-466d-9d2b-e8ff0f15e9bf 1073741824 Jul 31 12:17:13 devstack sudo[94319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:17:14 devstack sudo[94319]: pam_unix(sudo:session): session closed for user root Jul 31 12:17:14 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-8bb21e33-57e7-403e-bd90-985889791978 tempest-VolumesGetTest-1167943284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-d7e914f8-f211-466d-9d2b-e8ff0f15e9bf 1073741824" returned: 0 in 0.568s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:17:14 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-8bb21e33-57e7-403e-bd90-985889791978 tempest-VolumesGetTest-1167943284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-d7e914f8-f211-466d-9d2b-e8ff0f15e9bf {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:17:14 devstack sudo[94327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-d7e914f8-f211-466d-9d2b-e8ff0f15e9bf Jul 31 12:17:14 devstack sudo[94327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:17:14 devstack sudo[94327]: pam_unix(sudo:session): session closed for user root Jul 31 12:17:14 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-8bb21e33-57e7-403e-bd90-985889791978 tempest-VolumesGetTest-1167943284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-d7e914f8-f211-466d-9d2b-e8ff0f15e9bf" returned: 0 in 0.344s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:17:14 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-8bb21e33-57e7-403e-bd90-985889791978 tempest-VolumesGetTest-1167943284 None] <== create_volume: return (993ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'} {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 12:17:14 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-8bb21e33-57e7-403e-bd90-985889791978 tempest-VolumesGetTest-1167943284 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.000s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:17:14 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-8bb21e33-57e7-403e-bd90-985889791978 tempest-VolumesGetTest-1167943284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3718438-be0f-4e47-8945-d187201e1008) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d7e914f8-f211-466d-9d2b-e8ff0f15e9bf', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:17:14 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-8bb21e33-57e7-403e-bd90-985889791978 tempest-VolumesGetTest-1167943284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (503ed801-4939-4e9f-8877-163164e78e10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:17:14 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-8bb21e33-57e7-403e-bd90-985889791978 tempest-VolumesGetTest-1167943284 None] Volume volume-d7e914f8-f211-466d-9d2b-e8ff0f15e9bf (d7e914f8-f211-466d-9d2b-e8ff0f15e9bf): created successfully Jul 31 12:17:14 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-8bb21e33-57e7-403e-bd90-985889791978 tempest-VolumesGetTest-1167943284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (503ed801-4939-4e9f-8877-163164e78e10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:17:14 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-8bb21e33-57e7-403e-bd90-985889791978 tempest-VolumesGetTest-1167943284 None] Flow 'volume_create_manager' (ad985444-8eb2-4cfe-b676-b6430e114b39) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:17:14 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-8bb21e33-57e7-403e-bd90-985889791978 tempest-VolumesGetTest-1167943284 None] Created volume successfully. Jul 31 12:17:15 devstack cinder-volume[89182]: DEBUG cinder.volume.flows.manager.create_volume [None req-87ede53d-c62b-4467-9259-30072b08b7c3 tempest-AttachVolumeShelveTestJSON-322663064 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89182) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 12:17:15 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-87ede53d-c62b-4467-9259-30072b08b7c3 tempest-AttachVolumeShelveTestJSON-322663064 None] Flow 'volume_create_manager' (1f16eaea-da60-4c3f-8113-f781a92db6f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:17:15 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-87ede53d-c62b-4467-9259-30072b08b7c3 tempest-AttachVolumeShelveTestJSON-322663064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3555cade-902e-41dd-9380-199d52deb975) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:17:15 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-87ede53d-c62b-4467-9259-30072b08b7c3 tempest-AttachVolumeShelveTestJSON-322663064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3555cade-902e-41dd-9380-199d52deb975) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:17:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-388072475',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ecf99134-2b69-4867-afcd-35e29656682e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a2f7d760f4849b1ad05bbeae04a9ccf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:17:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:17:15Z,use_quota=True,user_id='f652cdf8a3414980984380828724398f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:17:15 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-87ede53d-c62b-4467-9259-30072b08b7c3 tempest-AttachVolumeShelveTestJSON-322663064 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54057942-d889-4d63-8d3c-072d1d5c3e10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:17:15 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-87ede53d-c62b-4467-9259-30072b08b7c3 tempest-AttachVolumeShelveTestJSON-322663064 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54057942-d889-4d63-8d3c-072d1d5c3e10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:17:15 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-87ede53d-c62b-4467-9259-30072b08b7c3 tempest-AttachVolumeShelveTestJSON-322663064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94f9a763-de24-4a3c-bc9b-0697a409f769) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:17:15 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-87ede53d-c62b-4467-9259-30072b08b7c3 tempest-AttachVolumeShelveTestJSON-322663064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94f9a763-de24-4a3c-bc9b-0697a409f769) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ecf99134-2b69-4867-afcd-35e29656682e', 'volume_name': 'volume-ecf99134-2b69-4867-afcd-35e29656682e', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:17:15 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-87ede53d-c62b-4467-9259-30072b08b7c3 tempest-AttachVolumeShelveTestJSON-322663064 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91baa2bf-5cc1-4308-afd0-d3e556798206) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:17:15 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-87ede53d-c62b-4467-9259-30072b08b7c3 tempest-AttachVolumeShelveTestJSON-322663064 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91baa2bf-5cc1-4308-afd0-d3e556798206) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:17:15 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-87ede53d-c62b-4467-9259-30072b08b7c3 tempest-AttachVolumeShelveTestJSON-322663064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1204ed88-683c-4b3a-a536-a2be515a141b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:17:15 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-87ede53d-c62b-4467-9259-30072b08b7c3 tempest-AttachVolumeShelveTestJSON-322663064 None] Volume ecf99134-2b69-4867-afcd-35e29656682e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ecf99134-2b69-4867-afcd-35e29656682e', 'volume_size': 1} Jul 31 12:17:15 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-87ede53d-c62b-4467-9259-30072b08b7c3 tempest-AttachVolumeShelveTestJSON-322663064 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:17:15 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-87ede53d-c62b-4467-9259-30072b08b7c3 tempest-AttachVolumeShelveTestJSON-322663064 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:17:15 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-87ede53d-c62b-4467-9259-30072b08b7c3 tempest-AttachVolumeShelveTestJSON-322663064 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:17:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-388072475',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ecf99134-2b69-4867-afcd-35e29656682e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a2f7d760f4849b1ad05bbeae04a9ccf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:17:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:17:15Z,use_quota=True,user_id='f652cdf8a3414980984380828724398f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)}" {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 12:17:15 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-87ede53d-c62b-4467-9259-30072b08b7c3 tempest-AttachVolumeShelveTestJSON-322663064 None] Creating volume ecf99134-2b69-4867-afcd-35e29656682e {{(pid=89182) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 12:17:15 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-87ede53d-c62b-4467-9259-30072b08b7c3 tempest-AttachVolumeShelveTestJSON-322663064 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:17:15 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-87ede53d-c62b-4467-9259-30072b08b7c3 tempest-AttachVolumeShelveTestJSON-322663064 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:17:15 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-87ede53d-c62b-4467-9259-30072b08b7c3 tempest-AttachVolumeShelveTestJSON-322663064 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:17:15 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-87ede53d-c62b-4467-9259-30072b08b7c3 tempest-AttachVolumeShelveTestJSON-322663064 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:17:15 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-87ede53d-c62b-4467-9259-30072b08b7c3 tempest-AttachVolumeShelveTestJSON-322663064 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:17:15 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-87ede53d-c62b-4467-9259-30072b08b7c3 tempest-AttachVolumeShelveTestJSON-322663064 None] Selected osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 as target Quobyte volume. {{(pid=89182) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 12:17:15 devstack cinder-volume[89182]: INFO cinder.volume.drivers.remotefs [None req-87ede53d-c62b-4467-9259-30072b08b7c3 tempest-AttachVolumeShelveTestJSON-322663064 None] casted to osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 Jul 31 12:17:15 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-87ede53d-c62b-4467-9259-30072b08b7c3 tempest-AttachVolumeShelveTestJSON-322663064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-ecf99134-2b69-4867-afcd-35e29656682e 1073741824 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:17:15 devstack sudo[94330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-ecf99134-2b69-4867-afcd-35e29656682e 1073741824 Jul 31 12:17:15 devstack sudo[94330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:17:15 devstack sudo[94330]: pam_unix(sudo:session): session closed for user root Jul 31 12:17:15 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-87ede53d-c62b-4467-9259-30072b08b7c3 tempest-AttachVolumeShelveTestJSON-322663064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-ecf99134-2b69-4867-afcd-35e29656682e 1073741824" returned: 0 in 0.546s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:17:15 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-87ede53d-c62b-4467-9259-30072b08b7c3 tempest-AttachVolumeShelveTestJSON-322663064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-ecf99134-2b69-4867-afcd-35e29656682e {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:17:15 devstack sudo[94337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-ecf99134-2b69-4867-afcd-35e29656682e Jul 31 12:17:15 devstack sudo[94337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:17:16 devstack sudo[94337]: pam_unix(sudo:session): session closed for user root Jul 31 12:17:16 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-87ede53d-c62b-4467-9259-30072b08b7c3 tempest-AttachVolumeShelveTestJSON-322663064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-ecf99134-2b69-4867-afcd-35e29656682e" returned: 0 in 0.352s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:17:16 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-87ede53d-c62b-4467-9259-30072b08b7c3 tempest-AttachVolumeShelveTestJSON-322663064 None] <== create_volume: return (964ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'} {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 12:17:16 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-87ede53d-c62b-4467-9259-30072b08b7c3 tempest-AttachVolumeShelveTestJSON-322663064 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.966s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:17:16 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-87ede53d-c62b-4467-9259-30072b08b7c3 tempest-AttachVolumeShelveTestJSON-322663064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1204ed88-683c-4b3a-a536-a2be515a141b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ecf99134-2b69-4867-afcd-35e29656682e', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:17:16 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-87ede53d-c62b-4467-9259-30072b08b7c3 tempest-AttachVolumeShelveTestJSON-322663064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0998e80-62e8-4222-89c0-c82fe75f1f64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:17:16 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-87ede53d-c62b-4467-9259-30072b08b7c3 tempest-AttachVolumeShelveTestJSON-322663064 None] Volume volume-ecf99134-2b69-4867-afcd-35e29656682e (ecf99134-2b69-4867-afcd-35e29656682e): created successfully Jul 31 12:17:16 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-87ede53d-c62b-4467-9259-30072b08b7c3 tempest-AttachVolumeShelveTestJSON-322663064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0998e80-62e8-4222-89c0-c82fe75f1f64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:17:16 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-87ede53d-c62b-4467-9259-30072b08b7c3 tempest-AttachVolumeShelveTestJSON-322663064 None] Flow 'volume_create_manager' (1f16eaea-da60-4c3f-8113-f781a92db6f4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:17:16 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-87ede53d-c62b-4467-9259-30072b08b7c3 tempest-AttachVolumeShelveTestJSON-322663064 None] Created volume successfully. Jul 31 12:17:16 devstack cinder-volume[89182]: DEBUG cinder.volume.flows.manager.create_volume [None req-3be469d7-cc92-4836-9fbf-c9b9ae30ef1c tempest-VolumesGetTest-1167943284 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89182) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 12:17:16 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-3be469d7-cc92-4836-9fbf-c9b9ae30ef1c tempest-VolumesGetTest-1167943284 None] Flow 'volume_create_manager' (eca111d6-92ee-42ab-89e6-2197120d0409) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:17:16 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-3be469d7-cc92-4836-9fbf-c9b9ae30ef1c tempest-VolumesGetTest-1167943284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77a731bf-9423-4456-a9c5-255ec1023f67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:17:16 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-3be469d7-cc92-4836-9fbf-c9b9ae30ef1c tempest-VolumesGetTest-1167943284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77a731bf-9423-4456-a9c5-255ec1023f67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:17:16Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1743997305',display_name='tempest-VolumesGetTest-Volume-765209058',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f4adff0-1888-4e01-bb65-dee556e5f7f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3bfd8f27aa9442a384d65adca3b284dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:17:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:17:17Z,use_quota=True,user_id='219264511ea247d78c4075409a489eff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:17:16 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-3be469d7-cc92-4836-9fbf-c9b9ae30ef1c tempest-VolumesGetTest-1167943284 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efbc7724-805c-417f-824d-7cc624f766ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:17:16 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-3be469d7-cc92-4836-9fbf-c9b9ae30ef1c tempest-VolumesGetTest-1167943284 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efbc7724-805c-417f-824d-7cc624f766ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:17:16 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-3be469d7-cc92-4836-9fbf-c9b9ae30ef1c tempest-VolumesGetTest-1167943284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d21c37ff-0cd5-4969-a035-32601fb562a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:17:16 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-3be469d7-cc92-4836-9fbf-c9b9ae30ef1c tempest-VolumesGetTest-1167943284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d21c37ff-0cd5-4969-a035-32601fb562a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3f4adff0-1888-4e01-bb65-dee556e5f7f6', 'volume_name': 'volume-3f4adff0-1888-4e01-bb65-dee556e5f7f6', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:17:16 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-3be469d7-cc92-4836-9fbf-c9b9ae30ef1c tempest-VolumesGetTest-1167943284 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba5e5acc-486d-4d96-b763-f2d96ef6fce5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:17:16 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-3be469d7-cc92-4836-9fbf-c9b9ae30ef1c tempest-VolumesGetTest-1167943284 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba5e5acc-486d-4d96-b763-f2d96ef6fce5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:17:16 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-3be469d7-cc92-4836-9fbf-c9b9ae30ef1c tempest-VolumesGetTest-1167943284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc66b5dd-78d7-42c2-b137-c8b5afbc9da2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:17:16 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-3be469d7-cc92-4836-9fbf-c9b9ae30ef1c tempest-VolumesGetTest-1167943284 None] Volume 3f4adff0-1888-4e01-bb65-dee556e5f7f6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3f4adff0-1888-4e01-bb65-dee556e5f7f6', 'volume_size': 1} Jul 31 12:17:16 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-3be469d7-cc92-4836-9fbf-c9b9ae30ef1c tempest-VolumesGetTest-1167943284 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:17:16 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-3be469d7-cc92-4836-9fbf-c9b9ae30ef1c tempest-VolumesGetTest-1167943284 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:17:16 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-3be469d7-cc92-4836-9fbf-c9b9ae30ef1c tempest-VolumesGetTest-1167943284 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:17:16Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1743997305',display_name='tempest-VolumesGetTest-Volume-765209058',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f4adff0-1888-4e01-bb65-dee556e5f7f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3bfd8f27aa9442a384d65adca3b284dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:17:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:17:17Z,use_quota=True,user_id='219264511ea247d78c4075409a489eff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)}" {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 12:17:16 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-3be469d7-cc92-4836-9fbf-c9b9ae30ef1c tempest-VolumesGetTest-1167943284 None] Creating volume 3f4adff0-1888-4e01-bb65-dee556e5f7f6 {{(pid=89182) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 12:17:16 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-3be469d7-cc92-4836-9fbf-c9b9ae30ef1c tempest-VolumesGetTest-1167943284 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:17:16 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-3be469d7-cc92-4836-9fbf-c9b9ae30ef1c tempest-VolumesGetTest-1167943284 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:17:16 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-3be469d7-cc92-4836-9fbf-c9b9ae30ef1c tempest-VolumesGetTest-1167943284 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:17:16 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-3be469d7-cc92-4836-9fbf-c9b9ae30ef1c tempest-VolumesGetTest-1167943284 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:17:16 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-3be469d7-cc92-4836-9fbf-c9b9ae30ef1c tempest-VolumesGetTest-1167943284 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:17:16 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-3be469d7-cc92-4836-9fbf-c9b9ae30ef1c tempest-VolumesGetTest-1167943284 None] Selected osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 as target Quobyte volume. {{(pid=89182) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 12:17:16 devstack cinder-volume[89182]: INFO cinder.volume.drivers.remotefs [None req-3be469d7-cc92-4836-9fbf-c9b9ae30ef1c tempest-VolumesGetTest-1167943284 None] casted to osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 Jul 31 12:17:16 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-3be469d7-cc92-4836-9fbf-c9b9ae30ef1c tempest-VolumesGetTest-1167943284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-3f4adff0-1888-4e01-bb65-dee556e5f7f6 1073741824 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:17:16 devstack sudo[94340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-3f4adff0-1888-4e01-bb65-dee556e5f7f6 1073741824 Jul 31 12:17:16 devstack sudo[94340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:17:17 devstack sudo[94340]: pam_unix(sudo:session): session closed for user root Jul 31 12:17:17 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-3be469d7-cc92-4836-9fbf-c9b9ae30ef1c tempest-VolumesGetTest-1167943284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-3f4adff0-1888-4e01-bb65-dee556e5f7f6 1073741824" returned: 0 in 0.636s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:17:17 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-3be469d7-cc92-4836-9fbf-c9b9ae30ef1c tempest-VolumesGetTest-1167943284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-3f4adff0-1888-4e01-bb65-dee556e5f7f6 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:17:17 devstack sudo[94352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-3f4adff0-1888-4e01-bb65-dee556e5f7f6 Jul 31 12:17:17 devstack sudo[94352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:17:17 devstack sudo[94352]: pam_unix(sudo:session): session closed for user root Jul 31 12:17:17 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-3be469d7-cc92-4836-9fbf-c9b9ae30ef1c tempest-VolumesGetTest-1167943284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-3f4adff0-1888-4e01-bb65-dee556e5f7f6" returned: 0 in 0.346s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:17:17 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-3be469d7-cc92-4836-9fbf-c9b9ae30ef1c tempest-VolumesGetTest-1167943284 None] <== create_volume: return (1043ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'} {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 12:17:17 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-3be469d7-cc92-4836-9fbf-c9b9ae30ef1c tempest-VolumesGetTest-1167943284 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.045s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:17:17 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-3be469d7-cc92-4836-9fbf-c9b9ae30ef1c tempest-VolumesGetTest-1167943284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc66b5dd-78d7-42c2-b137-c8b5afbc9da2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f4adff0-1888-4e01-bb65-dee556e5f7f6', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:17:18 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-3be469d7-cc92-4836-9fbf-c9b9ae30ef1c tempest-VolumesGetTest-1167943284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e934c53f-7ccb-4543-88ba-d9a7581d8a19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:17:18 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-3be469d7-cc92-4836-9fbf-c9b9ae30ef1c tempest-VolumesGetTest-1167943284 None] Volume volume-3f4adff0-1888-4e01-bb65-dee556e5f7f6 (3f4adff0-1888-4e01-bb65-dee556e5f7f6): created successfully Jul 31 12:17:18 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-3be469d7-cc92-4836-9fbf-c9b9ae30ef1c tempest-VolumesGetTest-1167943284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e934c53f-7ccb-4543-88ba-d9a7581d8a19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:17:18 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-3be469d7-cc92-4836-9fbf-c9b9ae30ef1c tempest-VolumesGetTest-1167943284 None] Flow 'volume_create_manager' (eca111d6-92ee-42ab-89e6-2197120d0409) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:17:18 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-3be469d7-cc92-4836-9fbf-c9b9ae30ef1c tempest-VolumesGetTest-1167943284 None] Created volume successfully. Jul 31 12:17:19 devstack cinder-volume[89182]: DEBUG cinder.volume.flows.manager.create_volume [None req-fe533f48-9e36-4bc6-845b-ef2ff36707ea tempest-VolumeSnapshotQuotasNegativeTestJSON-7213724 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89182) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 12:17:19 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-fe533f48-9e36-4bc6-845b-ef2ff36707ea tempest-VolumeSnapshotQuotasNegativeTestJSON-7213724 None] Flow 'volume_create_manager' (c8e43061-013f-4b27-948f-c2a97d8db558) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:17:19 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-fe533f48-9e36-4bc6-845b-ef2ff36707ea tempest-VolumeSnapshotQuotasNegativeTestJSON-7213724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52095989-200b-4012-aef8-b0c700a2a098) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:17:19 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-fe533f48-9e36-4bc6-845b-ef2ff36707ea tempest-VolumeSnapshotQuotasNegativeTestJSON-7213724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52095989-200b-4012-aef8-b0c700a2a098) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:17:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1567872566',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=908bb66f-bb4f-4201-9397-ca1dc297e80e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cad8cbba2b9e46cfb7d2a9bdf534b98d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:17:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:17:19Z,use_quota=True,user_id='ec329462f38d4a568591105e496bfc83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:17:19 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-fe533f48-9e36-4bc6-845b-ef2ff36707ea tempest-VolumeSnapshotQuotasNegativeTestJSON-7213724 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fdcd618c-5205-4246-9b8d-39c98ce85959) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:17:19 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-fe533f48-9e36-4bc6-845b-ef2ff36707ea tempest-VolumeSnapshotQuotasNegativeTestJSON-7213724 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fdcd618c-5205-4246-9b8d-39c98ce85959) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:17:19 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-fe533f48-9e36-4bc6-845b-ef2ff36707ea tempest-VolumeSnapshotQuotasNegativeTestJSON-7213724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a091d095-dbc5-4c60-9e45-3d7ab536a207) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:17:19 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-fe533f48-9e36-4bc6-845b-ef2ff36707ea tempest-VolumeSnapshotQuotasNegativeTestJSON-7213724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a091d095-dbc5-4c60-9e45-3d7ab536a207) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '908bb66f-bb4f-4201-9397-ca1dc297e80e', 'volume_name': 'volume-908bb66f-bb4f-4201-9397-ca1dc297e80e', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:17:19 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-fe533f48-9e36-4bc6-845b-ef2ff36707ea tempest-VolumeSnapshotQuotasNegativeTestJSON-7213724 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6c47f15-3601-4b42-97ab-1f5d16f3b539) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:17:19 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-fe533f48-9e36-4bc6-845b-ef2ff36707ea tempest-VolumeSnapshotQuotasNegativeTestJSON-7213724 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6c47f15-3601-4b42-97ab-1f5d16f3b539) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:17:19 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-fe533f48-9e36-4bc6-845b-ef2ff36707ea tempest-VolumeSnapshotQuotasNegativeTestJSON-7213724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf760c0c-546a-4ef8-9ef3-37514f147e5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:17:19 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-fe533f48-9e36-4bc6-845b-ef2ff36707ea tempest-VolumeSnapshotQuotasNegativeTestJSON-7213724 None] Volume 908bb66f-bb4f-4201-9397-ca1dc297e80e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-908bb66f-bb4f-4201-9397-ca1dc297e80e', 'volume_size': 1} Jul 31 12:17:19 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-fe533f48-9e36-4bc6-845b-ef2ff36707ea tempest-VolumeSnapshotQuotasNegativeTestJSON-7213724 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:17:19 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-fe533f48-9e36-4bc6-845b-ef2ff36707ea tempest-VolumeSnapshotQuotasNegativeTestJSON-7213724 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:17:19 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-fe533f48-9e36-4bc6-845b-ef2ff36707ea tempest-VolumeSnapshotQuotasNegativeTestJSON-7213724 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:17:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1567872566',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=908bb66f-bb4f-4201-9397-ca1dc297e80e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cad8cbba2b9e46cfb7d2a9bdf534b98d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:17:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:17:19Z,use_quota=True,user_id='ec329462f38d4a568591105e496bfc83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)}" {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 12:17:19 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-fe533f48-9e36-4bc6-845b-ef2ff36707ea tempest-VolumeSnapshotQuotasNegativeTestJSON-7213724 None] Creating volume 908bb66f-bb4f-4201-9397-ca1dc297e80e {{(pid=89182) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 12:17:19 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-fe533f48-9e36-4bc6-845b-ef2ff36707ea tempest-VolumeSnapshotQuotasNegativeTestJSON-7213724 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:17:19 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-fe533f48-9e36-4bc6-845b-ef2ff36707ea tempest-VolumeSnapshotQuotasNegativeTestJSON-7213724 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:17:19 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-fe533f48-9e36-4bc6-845b-ef2ff36707ea tempest-VolumeSnapshotQuotasNegativeTestJSON-7213724 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:17:19 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-fe533f48-9e36-4bc6-845b-ef2ff36707ea tempest-VolumeSnapshotQuotasNegativeTestJSON-7213724 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:17:19 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-fe533f48-9e36-4bc6-845b-ef2ff36707ea tempest-VolumeSnapshotQuotasNegativeTestJSON-7213724 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:17:19 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-fe533f48-9e36-4bc6-845b-ef2ff36707ea tempest-VolumeSnapshotQuotasNegativeTestJSON-7213724 None] Selected osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 as target Quobyte volume. {{(pid=89182) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 12:17:19 devstack cinder-volume[89182]: INFO cinder.volume.drivers.remotefs [None req-fe533f48-9e36-4bc6-845b-ef2ff36707ea tempest-VolumeSnapshotQuotasNegativeTestJSON-7213724 None] casted to osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 Jul 31 12:17:19 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-fe533f48-9e36-4bc6-845b-ef2ff36707ea tempest-VolumeSnapshotQuotasNegativeTestJSON-7213724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-908bb66f-bb4f-4201-9397-ca1dc297e80e 1073741824 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:17:19 devstack sudo[94361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-908bb66f-bb4f-4201-9397-ca1dc297e80e 1073741824 Jul 31 12:17:19 devstack sudo[94361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:17:19 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-4df1feb3-067d-4f9b-959b-0b29a7089035 tempest-VolumesGetTest-1167943284 None] Acquiring lock "cinder-3f4adff0-1888-4e01-bb65-dee556e5f7f6-delete_volume" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:17:19 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-4df1feb3-067d-4f9b-959b-0b29a7089035 tempest-VolumesGetTest-1167943284 None] Lock "cinder-3f4adff0-1888-4e01-bb65-dee556e5f7f6-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:17:19 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-4df1feb3-067d-4f9b-959b-0b29a7089035 tempest-VolumesGetTest-1167943284 None] Acquiring lock "cinder-quobyte-3f4adff0-1888-4e01-bb65-dee556e5f7f6" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:17:19 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-4df1feb3-067d-4f9b-959b-0b29a7089035 tempest-VolumesGetTest-1167943284 None] Lock "cinder-quobyte-3f4adff0-1888-4e01-bb65-dee556e5f7f6" acquired by "delete_volume" :: waited 0.046s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:17:19 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[6482a1f0-4824-4eab-89a3-6dab2871df8e]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:17:19 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-4df1feb3-067d-4f9b-959b-0b29a7089035 tempest-VolumesGetTest-1167943284 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-3f4adff0-1888-4e01-bb65-dee556e5f7f6 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:17:19 devstack sudo[94368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-3f4adff0-1888-4e01-bb65-dee556e5f7f6 Jul 31 12:17:19 devstack sudo[94368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:17:19 devstack sudo[94361]: pam_unix(sudo:session): session closed for user root Jul 31 12:17:19 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-fe533f48-9e36-4bc6-845b-ef2ff36707ea tempest-VolumeSnapshotQuotasNegativeTestJSON-7213724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-908bb66f-bb4f-4201-9397-ca1dc297e80e 1073741824" returned: 0 in 0.745s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:17:20 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-fe533f48-9e36-4bc6-845b-ef2ff36707ea tempest-VolumeSnapshotQuotasNegativeTestJSON-7213724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-908bb66f-bb4f-4201-9397-ca1dc297e80e {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:17:20 devstack sudo[94390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-908bb66f-bb4f-4201-9397-ca1dc297e80e Jul 31 12:17:20 devstack sudo[94390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:17:20 devstack sudo[94368]: pam_unix(sudo:session): session closed for user root Jul 31 12:17:20 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-4df1feb3-067d-4f9b-959b-0b29a7089035 tempest-VolumesGetTest-1167943284 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-3f4adff0-1888-4e01-bb65-dee556e5f7f6" returned: 0 in 0.713s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:17:20 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-4df1feb3-067d-4f9b-959b-0b29a7089035 tempest-VolumesGetTest-1167943284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-3f4adff0-1888-4e01-bb65-dee556e5f7f6 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:17:20 devstack sudo[94399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-3f4adff0-1888-4e01-bb65-dee556e5f7f6 Jul 31 12:17:20 devstack sudo[94399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:17:20 devstack sudo[94390]: pam_unix(sudo:session): session closed for user root Jul 31 12:17:20 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-fe533f48-9e36-4bc6-845b-ef2ff36707ea tempest-VolumeSnapshotQuotasNegativeTestJSON-7213724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-908bb66f-bb4f-4201-9397-ca1dc297e80e" returned: 0 in 0.469s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:17:20 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-fe533f48-9e36-4bc6-845b-ef2ff36707ea tempest-VolumeSnapshotQuotasNegativeTestJSON-7213724 None] <== create_volume: return (1319ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'} {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 12:17:20 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-fe533f48-9e36-4bc6-845b-ef2ff36707ea tempest-VolumeSnapshotQuotasNegativeTestJSON-7213724 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.322s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:17:20 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-fe533f48-9e36-4bc6-845b-ef2ff36707ea tempest-VolumeSnapshotQuotasNegativeTestJSON-7213724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf760c0c-546a-4ef8-9ef3-37514f147e5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-908bb66f-bb4f-4201-9397-ca1dc297e80e', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:17:20 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-fe533f48-9e36-4bc6-845b-ef2ff36707ea tempest-VolumeSnapshotQuotasNegativeTestJSON-7213724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7665c7a-de2a-4f77-92f3-bfc0d85d78ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:17:20 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-fe533f48-9e36-4bc6-845b-ef2ff36707ea tempest-VolumeSnapshotQuotasNegativeTestJSON-7213724 None] Volume volume-908bb66f-bb4f-4201-9397-ca1dc297e80e (908bb66f-bb4f-4201-9397-ca1dc297e80e): created successfully Jul 31 12:17:20 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-fe533f48-9e36-4bc6-845b-ef2ff36707ea tempest-VolumeSnapshotQuotasNegativeTestJSON-7213724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7665c7a-de2a-4f77-92f3-bfc0d85d78ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:17:20 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-fe533f48-9e36-4bc6-845b-ef2ff36707ea tempest-VolumeSnapshotQuotasNegativeTestJSON-7213724 None] Flow 'volume_create_manager' (c8e43061-013f-4b27-948f-c2a97d8db558) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:17:20 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-fe533f48-9e36-4bc6-845b-ef2ff36707ea tempest-VolumeSnapshotQuotasNegativeTestJSON-7213724 None] Created volume successfully. Jul 31 12:17:20 devstack sudo[94399]: pam_unix(sudo:session): session closed for user root Jul 31 12:17:20 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-4df1feb3-067d-4f9b-959b-0b29a7089035 tempest-VolumesGetTest-1167943284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-3f4adff0-1888-4e01-bb65-dee556e5f7f6" returned: 0 in 0.503s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:17:20 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-4df1feb3-067d-4f9b-959b-0b29a7089035 tempest-VolumesGetTest-1167943284 None] Lock "cinder-quobyte-3f4adff0-1888-4e01-bb65-dee556e5f7f6" released by "delete_volume" :: held 1.301s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:17:20 devstack cinder-volume[89182]: DEBUG cinder.quota [None req-4df1feb3-067d-4f9b-959b-0b29a7089035 tempest-VolumesGetTest-1167943284 None] Created reservations ['74b16bf0-b50c-4cfb-b57c-7e65eca993fe', '05bc0902-0dec-412b-aba4-cfff36127d9a', '84ec94f7-dd0c-4196-b9d1-af2331a159cc', 'c5f8d8d8-e8f0-4cdb-b4e7-3a7a99735dda'] {{(pid=89182) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 12:17:20 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-4df1feb3-067d-4f9b-959b-0b29a7089035 tempest-VolumesGetTest-1167943284 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:17:20 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-4df1feb3-067d-4f9b-959b-0b29a7089035 tempest-VolumesGetTest-1167943284 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:17:20 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-4df1feb3-067d-4f9b-959b-0b29a7089035 tempest-VolumesGetTest-1167943284 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:17:20 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-4df1feb3-067d-4f9b-959b-0b29a7089035 tempest-VolumesGetTest-1167943284 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:17:20 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-4df1feb3-067d-4f9b-959b-0b29a7089035 tempest-VolumesGetTest-1167943284 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:17:20 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-4df1feb3-067d-4f9b-959b-0b29a7089035 tempest-VolumesGetTest-1167943284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:17:20 devstack sudo[94409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 Jul 31 12:17:20 devstack sudo[94409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:17:21 devstack sudo[94409]: pam_unix(sudo:session): session closed for user root Jul 31 12:17:21 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-4df1feb3-067d-4f9b-959b-0b29a7089035 tempest-VolumesGetTest-1167943284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2" returned: 0 in 0.353s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:17:21 devstack cinder-volume[89182]: DEBUG cinder.manager [None req-4df1feb3-067d-4f9b-959b-0b29a7089035 tempest-VolumesGetTest-1167943284 None] Notifying Schedulers of capabilities ... {{(pid=89182) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 12:17:21 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-4df1feb3-067d-4f9b-959b-0b29a7089035 tempest-VolumesGetTest-1167943284 None] Deleted volume successfully. Jul 31 12:17:21 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-4df1feb3-067d-4f9b-959b-0b29a7089035 tempest-VolumesGetTest-1167943284 None] Lock "cinder-3f4adff0-1888-4e01-bb65-dee556e5f7f6-delete_volume" released by "delete_volume" :: held 2.067s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:17:21 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-3aed8264-95a1-47e9-9bd2-46f196d9c0f1 tempest-VolumeSnapshotQuotasNegativeTestJSON-7213724 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:17:21 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-3aed8264-95a1-47e9-9bd2-46f196d9c0f1 tempest-VolumeSnapshotQuotasNegativeTestJSON-7213724 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:17:21 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-3aed8264-95a1-47e9-9bd2-46f196d9c0f1 tempest-VolumeSnapshotQuotasNegativeTestJSON-7213724 None] Creating offline snapshot a44531bb-b216-4d0d-8cc9-2c76cb881925 of volume 908bb66f-bb4f-4201-9397-ca1dc297e80e {{(pid=89182) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 31 12:17:21 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[97dd238a-29f4-4ae5-bf63-da8c17090473]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:17:21 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-3aed8264-95a1-47e9-9bd2-46f196d9c0f1 tempest-VolumeSnapshotQuotasNegativeTestJSON-7213724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-908bb66f-bb4f-4201-9397-ca1dc297e80e {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:17:21 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-abfcbfca-12e4-4c16-be98-eae2d53290d0 tempest-VolumesGetTest-1167943284 None] Acquiring lock "cinder-d7e914f8-f211-466d-9d2b-e8ff0f15e9bf-delete_volume" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:17:21 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-abfcbfca-12e4-4c16-be98-eae2d53290d0 tempest-VolumesGetTest-1167943284 None] Lock "cinder-d7e914f8-f211-466d-9d2b-e8ff0f15e9bf-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:17:21 devstack sudo[94412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-908bb66f-bb4f-4201-9397-ca1dc297e80e Jul 31 12:17:21 devstack sudo[94412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:17:21 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-abfcbfca-12e4-4c16-be98-eae2d53290d0 tempest-VolumesGetTest-1167943284 None] Acquiring lock "cinder-quobyte-d7e914f8-f211-466d-9d2b-e8ff0f15e9bf" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:17:21 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-abfcbfca-12e4-4c16-be98-eae2d53290d0 tempest-VolumesGetTest-1167943284 None] Lock "cinder-quobyte-d7e914f8-f211-466d-9d2b-e8ff0f15e9bf" acquired by "delete_volume" :: waited 0.022s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:17:21 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf97b72f-99ca-46bd-be9a-1f51a1db51be]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:17:21 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-abfcbfca-12e4-4c16-be98-eae2d53290d0 tempest-VolumesGetTest-1167943284 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-d7e914f8-f211-466d-9d2b-e8ff0f15e9bf {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:17:21 devstack cinder-volume[89182]: DEBUG oslo_service.periodic_task [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89182) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 31 12:17:21 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:17:21 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:17:21 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:17:21 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:17:21 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:17:21 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:17:21 devstack sudo[94440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 Jul 31 12:17:21 devstack sudo[94440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:17:22 devstack sudo[94439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-d7e914f8-f211-466d-9d2b-e8ff0f15e9bf Jul 31 12:17:22 devstack sudo[94439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:17:22 devstack sudo[94412]: pam_unix(sudo:session): session closed for user root Jul 31 12:17:22 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-3aed8264-95a1-47e9-9bd2-46f196d9c0f1 tempest-VolumeSnapshotQuotasNegativeTestJSON-7213724 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-908bb66f-bb4f-4201-9397-ca1dc297e80e" returned: 0 in 0.569s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:17:22 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-3aed8264-95a1-47e9-9bd2-46f196d9c0f1 tempest-VolumeSnapshotQuotasNegativeTestJSON-7213724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-908bb66f-bb4f-4201-9397-ca1dc297e80e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-908bb66f-bb4f-4201-9397-ca1dc297e80e.a44531bb-b216-4d0d-8cc9-2c76cb881925 1G {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:17:22 devstack sudo[94447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-908bb66f-bb4f-4201-9397-ca1dc297e80e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-908bb66f-bb4f-4201-9397-ca1dc297e80e.a44531bb-b216-4d0d-8cc9-2c76cb881925 1G Jul 31 12:17:22 devstack sudo[94447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:17:22 devstack sudo[94440]: pam_unix(sudo:session): session closed for user root Jul 31 12:17:22 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2" returned: 0 in 0.336s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:17:22 devstack cinder-volume[89182]: DEBUG cinder.manager [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] Notifying Schedulers of capabilities ... {{(pid=89182) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 12:17:22 devstack cinder-volume[89182]: DEBUG oslo_service.periodic_task [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] Running periodic task VolumeManager._thread_info {{(pid=89182) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 31 12:17:22 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] thread count: 28 {{(pid=89182) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 31 12:17:22 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] thread info: [<_MainThread(MainThread, started 136154603720832)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=89182) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 31 12:17:22 devstack sudo[94439]: pam_unix(sudo:session): session closed for user root Jul 31 12:17:22 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-abfcbfca-12e4-4c16-be98-eae2d53290d0 tempest-VolumesGetTest-1167943284 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-d7e914f8-f211-466d-9d2b-e8ff0f15e9bf" returned: 0 in 0.572s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:17:22 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-abfcbfca-12e4-4c16-be98-eae2d53290d0 tempest-VolumesGetTest-1167943284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-d7e914f8-f211-466d-9d2b-e8ff0f15e9bf {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:17:22 devstack sudo[94467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-d7e914f8-f211-466d-9d2b-e8ff0f15e9bf Jul 31 12:17:22 devstack sudo[94467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:17:22 devstack sudo[94447]: pam_unix(sudo:session): session closed for user root Jul 31 12:17:22 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-3aed8264-95a1-47e9-9bd2-46f196d9c0f1 tempest-VolumeSnapshotQuotasNegativeTestJSON-7213724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-908bb66f-bb4f-4201-9397-ca1dc297e80e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-908bb66f-bb4f-4201-9397-ca1dc297e80e.a44531bb-b216-4d0d-8cc9-2c76cb881925 1G" returned: 0 in 0.513s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:17:22 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-3aed8264-95a1-47e9-9bd2-46f196d9c0f1 tempest-VolumeSnapshotQuotasNegativeTestJSON-7213724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-908bb66f-bb4f-4201-9397-ca1dc297e80e -F qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-908bb66f-bb4f-4201-9397-ca1dc297e80e.a44531bb-b216-4d0d-8cc9-2c76cb881925 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:17:22 devstack sudo[94469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-908bb66f-bb4f-4201-9397-ca1dc297e80e -F qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-908bb66f-bb4f-4201-9397-ca1dc297e80e.a44531bb-b216-4d0d-8cc9-2c76cb881925 Jul 31 12:17:22 devstack sudo[94469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:17:22 devstack sudo[94467]: pam_unix(sudo:session): session closed for user root Jul 31 12:17:22 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-abfcbfca-12e4-4c16-be98-eae2d53290d0 tempest-VolumesGetTest-1167943284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-d7e914f8-f211-466d-9d2b-e8ff0f15e9bf" returned: 0 in 0.327s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:17:22 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-abfcbfca-12e4-4c16-be98-eae2d53290d0 tempest-VolumesGetTest-1167943284 None] Lock "cinder-quobyte-d7e914f8-f211-466d-9d2b-e8ff0f15e9bf" released by "delete_volume" :: held 0.971s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:17:22 devstack cinder-volume[89182]: DEBUG cinder.quota [None req-abfcbfca-12e4-4c16-be98-eae2d53290d0 tempest-VolumesGetTest-1167943284 None] Created reservations ['d18cf00e-090c-41ab-9cfc-6105c1c4af46', 'f6a0531a-50b4-4a95-8eee-4e5bb216471a', 'adc806d2-9122-4079-bcd7-1a2f5214d2c3', '963ab84d-ae01-4e7f-b62f-f3a440ae0a95'] {{(pid=89182) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 12:17:22 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-abfcbfca-12e4-4c16-be98-eae2d53290d0 tempest-VolumesGetTest-1167943284 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:17:22 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-abfcbfca-12e4-4c16-be98-eae2d53290d0 tempest-VolumesGetTest-1167943284 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:17:22 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-abfcbfca-12e4-4c16-be98-eae2d53290d0 tempest-VolumesGetTest-1167943284 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:17:22 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-abfcbfca-12e4-4c16-be98-eae2d53290d0 tempest-VolumesGetTest-1167943284 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:17:22 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-abfcbfca-12e4-4c16-be98-eae2d53290d0 tempest-VolumesGetTest-1167943284 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:17:22 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-abfcbfca-12e4-4c16-be98-eae2d53290d0 tempest-VolumesGetTest-1167943284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:17:23 devstack sudo[94469]: pam_unix(sudo:session): session closed for user root Jul 31 12:17:23 devstack sudo[94476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 Jul 31 12:17:23 devstack sudo[94476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:17:23 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-3aed8264-95a1-47e9-9bd2-46f196d9c0f1 tempest-VolumeSnapshotQuotasNegativeTestJSON-7213724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-908bb66f-bb4f-4201-9397-ca1dc297e80e -F qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-908bb66f-bb4f-4201-9397-ca1dc297e80e.a44531bb-b216-4d0d-8cc9-2c76cb881925" returned: 0 in 0.352s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:17:23 devstack cinder-volume[89182]: WARNING cinder.volume.drivers.remotefs [None req-3aed8264-95a1-47e9-9bd2-46f196d9c0f1 tempest-VolumeSnapshotQuotasNegativeTestJSON-7213724 None] /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-908bb66f-bb4f-4201-9397-ca1dc297e80e.a44531bb-b216-4d0d-8cc9-2c76cb881925 is being set with open permissions: ugo+rw Jul 31 12:17:23 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-3aed8264-95a1-47e9-9bd2-46f196d9c0f1 tempest-VolumeSnapshotQuotasNegativeTestJSON-7213724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-908bb66f-bb4f-4201-9397-ca1dc297e80e.a44531bb-b216-4d0d-8cc9-2c76cb881925 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:17:23 devstack sudo[94478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-908bb66f-bb4f-4201-9397-ca1dc297e80e.a44531bb-b216-4d0d-8cc9-2c76cb881925 Jul 31 12:17:23 devstack sudo[94478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:17:23 devstack sudo[94476]: pam_unix(sudo:session): session closed for user root Jul 31 12:17:23 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-abfcbfca-12e4-4c16-be98-eae2d53290d0 tempest-VolumesGetTest-1167943284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2" returned: 0 in 0.283s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:17:23 devstack cinder-volume[89182]: DEBUG cinder.manager [None req-abfcbfca-12e4-4c16-be98-eae2d53290d0 tempest-VolumesGetTest-1167943284 None] Notifying Schedulers of capabilities ... {{(pid=89182) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 12:17:23 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-abfcbfca-12e4-4c16-be98-eae2d53290d0 tempest-VolumesGetTest-1167943284 None] Deleted volume successfully. Jul 31 12:17:23 devstack sudo[94478]: pam_unix(sudo:session): session closed for user root Jul 31 12:17:23 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-3aed8264-95a1-47e9-9bd2-46f196d9c0f1 tempest-VolumeSnapshotQuotasNegativeTestJSON-7213724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-908bb66f-bb4f-4201-9397-ca1dc297e80e.a44531bb-b216-4d0d-8cc9-2c76cb881925" returned: 0 in 0.290s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:17:23 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-abfcbfca-12e4-4c16-be98-eae2d53290d0 tempest-VolumesGetTest-1167943284 None] Lock "cinder-d7e914f8-f211-466d-9d2b-e8ff0f15e9bf-delete_volume" released by "delete_volume" :: held 1.598s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:17:23 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-3aed8264-95a1-47e9-9bd2-46f196d9c0f1 tempest-VolumeSnapshotQuotasNegativeTestJSON-7213724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-908bb66f-bb4f-4201-9397-ca1dc297e80e.info {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:17:23 devstack sudo[94482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-908bb66f-bb4f-4201-9397-ca1dc297e80e.info Jul 31 12:17:23 devstack sudo[94482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:17:23 devstack sudo[94482]: pam_unix(sudo:session): session closed for user root Jul 31 12:17:23 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-3aed8264-95a1-47e9-9bd2-46f196d9c0f1 tempest-VolumeSnapshotQuotasNegativeTestJSON-7213724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-908bb66f-bb4f-4201-9397-ca1dc297e80e.info" returned: 0 in 0.326s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:17:23 devstack cinder-volume[89182]: WARNING cinder.volume.drivers.remotefs [None req-3aed8264-95a1-47e9-9bd2-46f196d9c0f1 tempest-VolumeSnapshotQuotasNegativeTestJSON-7213724 None] /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-908bb66f-bb4f-4201-9397-ca1dc297e80e.info is being set with open permissions: ugo+rw Jul 31 12:17:23 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-3aed8264-95a1-47e9-9bd2-46f196d9c0f1 tempest-VolumeSnapshotQuotasNegativeTestJSON-7213724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-908bb66f-bb4f-4201-9397-ca1dc297e80e.info {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:17:23 devstack sudo[94485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-908bb66f-bb4f-4201-9397-ca1dc297e80e.info Jul 31 12:17:23 devstack sudo[94485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:17:23 devstack sudo[94485]: pam_unix(sudo:session): session closed for user root Jul 31 12:17:23 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-3aed8264-95a1-47e9-9bd2-46f196d9c0f1 tempest-VolumeSnapshotQuotasNegativeTestJSON-7213724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-908bb66f-bb4f-4201-9397-ca1dc297e80e.info" returned: 0 in 0.279s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:17:23 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-3aed8264-95a1-47e9-9bd2-46f196d9c0f1 tempest-VolumeSnapshotQuotasNegativeTestJSON-7213724 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.447s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:17:23 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-3aed8264-95a1-47e9-9bd2-46f196d9c0f1 tempest-VolumeSnapshotQuotasNegativeTestJSON-7213724 None] Create snapshot completed successfully Jul 31 12:17:24 devstack cinder-volume[89182]: DEBUG cinder.volume.flows.manager.create_volume [None req-293ae633-9290-42bb-8f43-370b98343b7d tempest-VolumesGetTest-1167943284 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89182) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 12:17:24 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-293ae633-9290-42bb-8f43-370b98343b7d tempest-VolumesGetTest-1167943284 None] Flow 'volume_create_manager' (ae622a3a-f1d0-48a3-a5b3-179de53f0dd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:17:24 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-293ae633-9290-42bb-8f43-370b98343b7d tempest-VolumesGetTest-1167943284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f67f064b-cfb2-468d-a244-e4923cb8345c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:17:24 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-293ae633-9290-42bb-8f43-370b98343b7d tempest-VolumesGetTest-1167943284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f67f064b-cfb2-468d-a244-e4923cb8345c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:17:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-545430451',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d2b1c55-3e3b-4398-94e6-2b2de531bdc9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3bfd8f27aa9442a384d65adca3b284dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:17:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:17:24Z,use_quota=True,user_id='219264511ea247d78c4075409a489eff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:17:24 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-293ae633-9290-42bb-8f43-370b98343b7d tempest-VolumesGetTest-1167943284 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2266e0d0-bc36-4240-ab40-703a95299c10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:17:24 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-293ae633-9290-42bb-8f43-370b98343b7d tempest-VolumesGetTest-1167943284 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2266e0d0-bc36-4240-ab40-703a95299c10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:17:24 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-293ae633-9290-42bb-8f43-370b98343b7d tempest-VolumesGetTest-1167943284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d110345d-1033-4b44-b7e8-6b1513127bad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:17:24 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-293ae633-9290-42bb-8f43-370b98343b7d tempest-VolumesGetTest-1167943284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d110345d-1033-4b44-b7e8-6b1513127bad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4d2b1c55-3e3b-4398-94e6-2b2de531bdc9', 'volume_name': 'volume-4d2b1c55-3e3b-4398-94e6-2b2de531bdc9', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:17:24 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-293ae633-9290-42bb-8f43-370b98343b7d tempest-VolumesGetTest-1167943284 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (100e5837-ef96-43ee-b77a-966216077358) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:17:24 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-293ae633-9290-42bb-8f43-370b98343b7d tempest-VolumesGetTest-1167943284 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (100e5837-ef96-43ee-b77a-966216077358) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:17:24 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-293ae633-9290-42bb-8f43-370b98343b7d tempest-VolumesGetTest-1167943284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d29d55b-be04-4a8e-bc68-0b1b0dafe0f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:17:24 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-293ae633-9290-42bb-8f43-370b98343b7d tempest-VolumesGetTest-1167943284 None] Volume 4d2b1c55-3e3b-4398-94e6-2b2de531bdc9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4d2b1c55-3e3b-4398-94e6-2b2de531bdc9', 'volume_size': 1} Jul 31 12:17:24 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-293ae633-9290-42bb-8f43-370b98343b7d tempest-VolumesGetTest-1167943284 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:17:24 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-293ae633-9290-42bb-8f43-370b98343b7d tempest-VolumesGetTest-1167943284 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:17:24 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-293ae633-9290-42bb-8f43-370b98343b7d tempest-VolumesGetTest-1167943284 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:17:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-545430451',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d2b1c55-3e3b-4398-94e6-2b2de531bdc9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3bfd8f27aa9442a384d65adca3b284dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:17:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:17:24Z,use_quota=True,user_id='219264511ea247d78c4075409a489eff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)}" {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 12:17:24 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-293ae633-9290-42bb-8f43-370b98343b7d tempest-VolumesGetTest-1167943284 None] Creating volume 4d2b1c55-3e3b-4398-94e6-2b2de531bdc9 {{(pid=89182) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 12:17:24 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-293ae633-9290-42bb-8f43-370b98343b7d tempest-VolumesGetTest-1167943284 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:17:24 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-293ae633-9290-42bb-8f43-370b98343b7d tempest-VolumesGetTest-1167943284 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:17:24 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-293ae633-9290-42bb-8f43-370b98343b7d tempest-VolumesGetTest-1167943284 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:17:24 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-293ae633-9290-42bb-8f43-370b98343b7d tempest-VolumesGetTest-1167943284 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:17:24 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-293ae633-9290-42bb-8f43-370b98343b7d tempest-VolumesGetTest-1167943284 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:17:24 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-293ae633-9290-42bb-8f43-370b98343b7d tempest-VolumesGetTest-1167943284 None] Selected osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 as target Quobyte volume. {{(pid=89182) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 12:17:24 devstack cinder-volume[89182]: INFO cinder.volume.drivers.remotefs [None req-293ae633-9290-42bb-8f43-370b98343b7d tempest-VolumesGetTest-1167943284 None] casted to osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 Jul 31 12:17:24 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-293ae633-9290-42bb-8f43-370b98343b7d tempest-VolumesGetTest-1167943284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-4d2b1c55-3e3b-4398-94e6-2b2de531bdc9 1073741824 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:17:24 devstack sudo[94489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-4d2b1c55-3e3b-4398-94e6-2b2de531bdc9 1073741824 Jul 31 12:17:24 devstack sudo[94489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:17:25 devstack sudo[94489]: pam_unix(sudo:session): session closed for user root Jul 31 12:17:25 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-293ae633-9290-42bb-8f43-370b98343b7d tempest-VolumesGetTest-1167943284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-4d2b1c55-3e3b-4398-94e6-2b2de531bdc9 1073741824" returned: 0 in 0.460s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:17:25 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-293ae633-9290-42bb-8f43-370b98343b7d tempest-VolumesGetTest-1167943284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-4d2b1c55-3e3b-4398-94e6-2b2de531bdc9 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:17:25 devstack sudo[94495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-4d2b1c55-3e3b-4398-94e6-2b2de531bdc9 Jul 31 12:17:25 devstack sudo[94495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:17:25 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-5b3e4d01-8d78-475b-955d-851acf2d2cf2 tempest-VolumeSnapshotQuotasNegativeTestJSON-7213724 None] Acquiring lock "cinder-a44531bb-b216-4d0d-8cc9-2c76cb881925-delete_snapshot" by "delete_snapshot" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:17:25 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-5b3e4d01-8d78-475b-955d-851acf2d2cf2 tempest-VolumeSnapshotQuotasNegativeTestJSON-7213724 None] Lock "cinder-a44531bb-b216-4d0d-8cc9-2c76cb881925-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:17:25 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-5b3e4d01-8d78-475b-955d-851acf2d2cf2 tempest-VolumeSnapshotQuotasNegativeTestJSON-7213724 None] Acquiring lock "cinder-quobyte-908bb66f-bb4f-4201-9397-ca1dc297e80e" by "delete_snapshot" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:17:25 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-5b3e4d01-8d78-475b-955d-851acf2d2cf2 tempest-VolumeSnapshotQuotasNegativeTestJSON-7213724 None] Lock "cinder-quobyte-908bb66f-bb4f-4201-9397-ca1dc297e80e" acquired by "delete_snapshot" :: waited 0.021s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:17:25 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-5b3e4d01-8d78-475b-955d-851acf2d2cf2 tempest-VolumeSnapshotQuotasNegativeTestJSON-7213724 None] Acquiring lock "cinder-quobyte-a44531bb-b216-4d0d-8cc9-2c76cb881925" by "_delete_snapshot" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:17:25 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-5b3e4d01-8d78-475b-955d-851acf2d2cf2 tempest-VolumeSnapshotQuotasNegativeTestJSON-7213724 None] Lock "cinder-quobyte-a44531bb-b216-4d0d-8cc9-2c76cb881925" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:17:25 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-5b3e4d01-8d78-475b-955d-851acf2d2cf2 tempest-VolumeSnapshotQuotasNegativeTestJSON-7213724 None] Deleting offline snapshot a44531bb-b216-4d0d-8cc9-2c76cb881925 of volume 908bb66f-bb4f-4201-9397-ca1dc297e80e {{(pid=89182) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 31 12:17:25 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-5b3e4d01-8d78-475b-955d-851acf2d2cf2 tempest-VolumeSnapshotQuotasNegativeTestJSON-7213724 None] snapshot_file for this snap is: volume-908bb66f-bb4f-4201-9397-ca1dc297e80e.a44531bb-b216-4d0d-8cc9-2c76cb881925 {{(pid=89182) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 31 12:17:25 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a4054b9-4e99-4b18-80b5-a24dad17aa69]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:17:25 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-5b3e4d01-8d78-475b-955d-851acf2d2cf2 tempest-VolumeSnapshotQuotasNegativeTestJSON-7213724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-908bb66f-bb4f-4201-9397-ca1dc297e80e.a44531bb-b216-4d0d-8cc9-2c76cb881925 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:17:25 devstack sudo[94495]: pam_unix(sudo:session): session closed for user root Jul 31 12:17:25 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-293ae633-9290-42bb-8f43-370b98343b7d tempest-VolumesGetTest-1167943284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-4d2b1c55-3e3b-4398-94e6-2b2de531bdc9" returned: 0 in 0.295s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:17:25 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-293ae633-9290-42bb-8f43-370b98343b7d tempest-VolumesGetTest-1167943284 None] <== create_volume: return (807ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'} {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 12:17:25 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-293ae633-9290-42bb-8f43-370b98343b7d tempest-VolumesGetTest-1167943284 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.810s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:17:25 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-293ae633-9290-42bb-8f43-370b98343b7d tempest-VolumesGetTest-1167943284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d29d55b-be04-4a8e-bc68-0b1b0dafe0f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4d2b1c55-3e3b-4398-94e6-2b2de531bdc9', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:17:25 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-293ae633-9290-42bb-8f43-370b98343b7d tempest-VolumesGetTest-1167943284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4071d15-5e36-46ff-978b-fcc98187827a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:17:25 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-293ae633-9290-42bb-8f43-370b98343b7d tempest-VolumesGetTest-1167943284 None] Volume volume-4d2b1c55-3e3b-4398-94e6-2b2de531bdc9 (4d2b1c55-3e3b-4398-94e6-2b2de531bdc9): created successfully Jul 31 12:17:25 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-293ae633-9290-42bb-8f43-370b98343b7d tempest-VolumesGetTest-1167943284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4071d15-5e36-46ff-978b-fcc98187827a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:17:25 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-293ae633-9290-42bb-8f43-370b98343b7d tempest-VolumesGetTest-1167943284 None] Flow 'volume_create_manager' (ae622a3a-f1d0-48a3-a5b3-179de53f0dd0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:17:25 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-293ae633-9290-42bb-8f43-370b98343b7d tempest-VolumesGetTest-1167943284 None] Created volume successfully. Jul 31 12:17:25 devstack sudo[94497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-908bb66f-bb4f-4201-9397-ca1dc297e80e.a44531bb-b216-4d0d-8cc9-2c76cb881925 Jul 31 12:17:25 devstack sudo[94497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:17:25 devstack sudo[94497]: pam_unix(sudo:session): session closed for user root Jul 31 12:17:25 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-5b3e4d01-8d78-475b-955d-851acf2d2cf2 tempest-VolumeSnapshotQuotasNegativeTestJSON-7213724 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-908bb66f-bb4f-4201-9397-ca1dc297e80e.a44531bb-b216-4d0d-8cc9-2c76cb881925" returned: 0 in 0.505s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:17:25 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-5b3e4d01-8d78-475b-955d-851acf2d2cf2 tempest-VolumeSnapshotQuotasNegativeTestJSON-7213724 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-908bb66f-bb4f-4201-9397-ca1dc297e80e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89182) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 12:17:25 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[3104a0b0-4371-4d44-ae12-8773602156a4]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:17:25 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-5b3e4d01-8d78-475b-955d-851acf2d2cf2 tempest-VolumeSnapshotQuotasNegativeTestJSON-7213724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-908bb66f-bb4f-4201-9397-ca1dc297e80e {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:17:26 devstack sudo[94521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-908bb66f-bb4f-4201-9397-ca1dc297e80e Jul 31 12:17:26 devstack sudo[94521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:17:26 devstack sudo[94521]: pam_unix(sudo:session): session closed for user root Jul 31 12:17:26 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-5b3e4d01-8d78-475b-955d-851acf2d2cf2 tempest-VolumeSnapshotQuotasNegativeTestJSON-7213724 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-908bb66f-bb4f-4201-9397-ca1dc297e80e" returned: 0 in 0.407s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:17:26 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-5b3e4d01-8d78-475b-955d-851acf2d2cf2 tempest-VolumeSnapshotQuotasNegativeTestJSON-7213724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-908bb66f-bb4f-4201-9397-ca1dc297e80e.a44531bb-b216-4d0d-8cc9-2c76cb881925 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:17:26 devstack sudo[94530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-908bb66f-bb4f-4201-9397-ca1dc297e80e.a44531bb-b216-4d0d-8cc9-2c76cb881925 Jul 31 12:17:26 devstack sudo[94530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:17:26 devstack sudo[94530]: pam_unix(sudo:session): session closed for user root Jul 31 12:17:26 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-5b3e4d01-8d78-475b-955d-851acf2d2cf2 tempest-VolumeSnapshotQuotasNegativeTestJSON-7213724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-908bb66f-bb4f-4201-9397-ca1dc297e80e.a44531bb-b216-4d0d-8cc9-2c76cb881925" returned: 0 in 0.330s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:17:26 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-5b3e4d01-8d78-475b-955d-851acf2d2cf2 tempest-VolumeSnapshotQuotasNegativeTestJSON-7213724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-908bb66f-bb4f-4201-9397-ca1dc297e80e.a44531bb-b216-4d0d-8cc9-2c76cb881925 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:17:26 devstack sudo[94535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-908bb66f-bb4f-4201-9397-ca1dc297e80e.a44531bb-b216-4d0d-8cc9-2c76cb881925 Jul 31 12:17:26 devstack sudo[94535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:17:26 devstack sudo[94535]: pam_unix(sudo:session): session closed for user root Jul 31 12:17:26 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-5b3e4d01-8d78-475b-955d-851acf2d2cf2 tempest-VolumeSnapshotQuotasNegativeTestJSON-7213724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-908bb66f-bb4f-4201-9397-ca1dc297e80e.a44531bb-b216-4d0d-8cc9-2c76cb881925" returned: 0 in 0.246s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:17:26 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-5b3e4d01-8d78-475b-955d-851acf2d2cf2 tempest-VolumeSnapshotQuotasNegativeTestJSON-7213724 None] Lock "cinder-quobyte-a44531bb-b216-4d0d-8cc9-2c76cb881925" released by "_delete_snapshot" :: held 1.646s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:17:26 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-5b3e4d01-8d78-475b-955d-851acf2d2cf2 tempest-VolumeSnapshotQuotasNegativeTestJSON-7213724 None] Lock "cinder-quobyte-908bb66f-bb4f-4201-9397-ca1dc297e80e" released by "delete_snapshot" :: held 1.671s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:17:27 devstack cinder-volume[89182]: DEBUG cinder.quota [None req-5b3e4d01-8d78-475b-955d-851acf2d2cf2 tempest-VolumeSnapshotQuotasNegativeTestJSON-7213724 None] Created reservations ['78e35cd7-69f1-415a-a2d8-989be40db385', '58985d7a-d6ea-4951-8443-22717d0c8d79', '58d06837-7b69-4dd7-9ff8-834b6f734cf1', 'f892bde4-5af4-429b-91c8-9be11ae12737'] {{(pid=89182) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 12:17:27 devstack cinder-volume[89182]: DEBUG cinder.volume.flows.manager.create_volume [None req-2b72c222-d00d-427c-9f95-a38182ccc69c tempest-VolumesGetTest-1167943284 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89182) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 12:17:27 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-2b72c222-d00d-427c-9f95-a38182ccc69c tempest-VolumesGetTest-1167943284 None] Flow 'volume_create_manager' (0508d8f1-b1f6-412b-9a4f-7cbcd09de231) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:17:27 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-2b72c222-d00d-427c-9f95-a38182ccc69c tempest-VolumesGetTest-1167943284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a2ad1e5-58d1-4b4d-b6dd-3594cc0a551f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:17:27 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-2b72c222-d00d-427c-9f95-a38182ccc69c tempest-VolumesGetTest-1167943284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a2ad1e5-58d1-4b4d-b6dd-3594cc0a551f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:17:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1033064342',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f4ddd47-3ed6-422c-991f-b0f6ea5a08f9,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='3bfd8f27aa9442a384d65adca3b284dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:17:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=4d2b1c55-3e3b-4398-94e6-2b2de531bdc9,status='creating',terminated_at=None,updated_at=2026-07-31T10:17:27Z,use_quota=True,user_id='219264511ea247d78c4075409a489eff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:17:27 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-2b72c222-d00d-427c-9f95-a38182ccc69c tempest-VolumesGetTest-1167943284 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20c1cc7f-bc0c-4d3b-8569-c639faf4c759) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:17:27 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-2b72c222-d00d-427c-9f95-a38182ccc69c tempest-VolumesGetTest-1167943284 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20c1cc7f-bc0c-4d3b-8569-c639faf4c759) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:17:27 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-2b72c222-d00d-427c-9f95-a38182ccc69c tempest-VolumesGetTest-1167943284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e69cddfc-3a43-4393-95c7-ff0407e81514) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:17:27 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-5b3e4d01-8d78-475b-955d-851acf2d2cf2 tempest-VolumeSnapshotQuotasNegativeTestJSON-7213724 None] Delete snapshot completed successfully. Jul 31 12:17:27 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-2b72c222-d00d-427c-9f95-a38182ccc69c tempest-VolumesGetTest-1167943284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e69cddfc-3a43-4393-95c7-ff0407e81514) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '0f4ddd47-3ed6-422c-991f-b0f6ea5a08f9', 'volume_name': 'volume-0f4ddd47-3ed6-422c-991f-b0f6ea5a08f9', 'volume_size': 1, 'source_volid': '4d2b1c55-3e3b-4398-94e6-2b2de531bdc9', 'source_volstatus': 'available'}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:17:27 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-2b72c222-d00d-427c-9f95-a38182ccc69c tempest-VolumesGetTest-1167943284 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a3e78c5-c31d-4fa5-9c46-8b9193c9a6e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:17:27 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-2b72c222-d00d-427c-9f95-a38182ccc69c tempest-VolumesGetTest-1167943284 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a3e78c5-c31d-4fa5-9c46-8b9193c9a6e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:17:27 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-2b72c222-d00d-427c-9f95-a38182ccc69c tempest-VolumesGetTest-1167943284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec861280-b607-4913-8239-57550be22896) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:17:27 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-2b72c222-d00d-427c-9f95-a38182ccc69c tempest-VolumesGetTest-1167943284 None] Volume 0f4ddd47-3ed6-422c-991f-b0f6ea5a08f9: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-0f4ddd47-3ed6-422c-991f-b0f6ea5a08f9', 'volume_size': 1, 'source_volid': '4d2b1c55-3e3b-4398-94e6-2b2de531bdc9', 'source_volstatus': 'available'} Jul 31 12:17:27 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-5b3e4d01-8d78-475b-955d-851acf2d2cf2 tempest-VolumeSnapshotQuotasNegativeTestJSON-7213724 None] Lock "cinder-a44531bb-b216-4d0d-8cc9-2c76cb881925-delete_snapshot" released by "delete_snapshot" :: held 1.960s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:17:27 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-2b72c222-d00d-427c-9f95-a38182ccc69c tempest-VolumesGetTest-1167943284 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:17:27 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-2b72c222-d00d-427c-9f95-a38182ccc69c tempest-VolumesGetTest-1167943284 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.000s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:17:27 devstack cinder-volume[89182]: INFO cinder.volume.drivers.remotefs [None req-2b72c222-d00d-427c-9f95-a38182ccc69c tempest-VolumesGetTest-1167943284 None] Cloning volume 4d2b1c55-3e3b-4398-94e6-2b2de531bdc9 to volume 0f4ddd47-3ed6-422c-991f-b0f6ea5a08f9 Jul 31 12:17:27 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-2b72c222-d00d-427c-9f95-a38182ccc69c tempest-VolumesGetTest-1167943284 None] Creating offline snapshot 2db9f98a-a8f5-47e1-be72-f3a2fb4078ac of volume 4d2b1c55-3e3b-4398-94e6-2b2de531bdc9 {{(pid=89182) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 31 12:17:27 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[a58f6a50-1139-44e1-9b8d-6dda228ab04d]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:17:27 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-2b72c222-d00d-427c-9f95-a38182ccc69c tempest-VolumesGetTest-1167943284 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-4d2b1c55-3e3b-4398-94e6-2b2de531bdc9 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:17:27 devstack sudo[94538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-4d2b1c55-3e3b-4398-94e6-2b2de531bdc9 Jul 31 12:17:27 devstack sudo[94538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:17:27 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-9b77bee5-a3f0-418b-a8da-20a6cfa24d40 tempest-VolumeSnapshotQuotasNegativeTestJSON-7213724 None] Acquiring lock "cinder-908bb66f-bb4f-4201-9397-ca1dc297e80e-delete_volume" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:17:27 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-9b77bee5-a3f0-418b-a8da-20a6cfa24d40 tempest-VolumeSnapshotQuotasNegativeTestJSON-7213724 None] Lock "cinder-908bb66f-bb4f-4201-9397-ca1dc297e80e-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:17:27 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-9b77bee5-a3f0-418b-a8da-20a6cfa24d40 tempest-VolumeSnapshotQuotasNegativeTestJSON-7213724 None] Acquiring lock "cinder-quobyte-908bb66f-bb4f-4201-9397-ca1dc297e80e" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:17:27 devstack sudo[94538]: pam_unix(sudo:session): session closed for user root Jul 31 12:17:27 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-2b72c222-d00d-427c-9f95-a38182ccc69c tempest-VolumesGetTest-1167943284 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-4d2b1c55-3e3b-4398-94e6-2b2de531bdc9" returned: 0 in 0.429s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:17:27 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-2b72c222-d00d-427c-9f95-a38182ccc69c tempest-VolumesGetTest-1167943284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-4d2b1c55-3e3b-4398-94e6-2b2de531bdc9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-4d2b1c55-3e3b-4398-94e6-2b2de531bdc9.2db9f98a-a8f5-47e1-be72-f3a2fb4078ac 1G {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:17:27 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-9b77bee5-a3f0-418b-a8da-20a6cfa24d40 tempest-VolumeSnapshotQuotasNegativeTestJSON-7213724 None] Lock "cinder-quobyte-908bb66f-bb4f-4201-9397-ca1dc297e80e" acquired by "delete_volume" :: waited 0.034s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:17:27 devstack sudo[94577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-4d2b1c55-3e3b-4398-94e6-2b2de531bdc9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-4d2b1c55-3e3b-4398-94e6-2b2de531bdc9.2db9f98a-a8f5-47e1-be72-f3a2fb4078ac 1G Jul 31 12:17:27 devstack sudo[94577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:17:27 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[8943c7d2-756a-471a-9ffc-3eea223fa8e8]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:17:27 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-9b77bee5-a3f0-418b-a8da-20a6cfa24d40 tempest-VolumeSnapshotQuotasNegativeTestJSON-7213724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-908bb66f-bb4f-4201-9397-ca1dc297e80e {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:17:27 devstack sudo[94581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-908bb66f-bb4f-4201-9397-ca1dc297e80e Jul 31 12:17:27 devstack sudo[94581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:17:28 devstack sudo[94581]: pam_unix(sudo:session): session closed for user root Jul 31 12:17:28 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-9b77bee5-a3f0-418b-a8da-20a6cfa24d40 tempest-VolumeSnapshotQuotasNegativeTestJSON-7213724 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-908bb66f-bb4f-4201-9397-ca1dc297e80e" returned: 0 in 0.471s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:17:28 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-9b77bee5-a3f0-418b-a8da-20a6cfa24d40 tempest-VolumeSnapshotQuotasNegativeTestJSON-7213724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-908bb66f-bb4f-4201-9397-ca1dc297e80e {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:17:28 devstack sudo[94577]: pam_unix(sudo:session): session closed for user root Jul 31 12:17:28 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-2b72c222-d00d-427c-9f95-a38182ccc69c tempest-VolumesGetTest-1167943284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-4d2b1c55-3e3b-4398-94e6-2b2de531bdc9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-4d2b1c55-3e3b-4398-94e6-2b2de531bdc9.2db9f98a-a8f5-47e1-be72-f3a2fb4078ac 1G" returned: 0 in 0.560s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:17:28 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-2b72c222-d00d-427c-9f95-a38182ccc69c tempest-VolumesGetTest-1167943284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4d2b1c55-3e3b-4398-94e6-2b2de531bdc9 -F qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-4d2b1c55-3e3b-4398-94e6-2b2de531bdc9.2db9f98a-a8f5-47e1-be72-f3a2fb4078ac {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:17:28 devstack sudo[94590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-908bb66f-bb4f-4201-9397-ca1dc297e80e Jul 31 12:17:28 devstack sudo[94590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:17:28 devstack sudo[94591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4d2b1c55-3e3b-4398-94e6-2b2de531bdc9 -F qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-4d2b1c55-3e3b-4398-94e6-2b2de531bdc9.2db9f98a-a8f5-47e1-be72-f3a2fb4078ac Jul 31 12:17:28 devstack sudo[94591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:17:28 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [req-b4797fdc-c7d1-4c83-ae5b-bbced978c483 req-423f6ebf-d953-4c6d-b3ac-6aff75fedf06 tempest-AttachVolumeShelveTestJSON-322663064 None] No connector for attachment d34374d1-e75d-44e8-9314-1fa099477af4; skipping storage backend terminate_connection call. {{(pid=89182) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Jul 31 12:17:28 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [req-b4797fdc-c7d1-4c83-ae5b-bbced978c483 req-423f6ebf-d953-4c6d-b3ac-6aff75fedf06 tempest-AttachVolumeShelveTestJSON-322663064 None] Deleting attachment d34374d1-e75d-44e8-9314-1fa099477af4. {{(pid=89182) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 31 12:17:28 devstack sudo[94590]: pam_unix(sudo:session): session closed for user root Jul 31 12:17:28 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-9b77bee5-a3f0-418b-a8da-20a6cfa24d40 tempest-VolumeSnapshotQuotasNegativeTestJSON-7213724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-908bb66f-bb4f-4201-9397-ca1dc297e80e" returned: 0 in 0.320s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:17:28 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-9b77bee5-a3f0-418b-a8da-20a6cfa24d40 tempest-VolumeSnapshotQuotasNegativeTestJSON-7213724 None] Lock "cinder-quobyte-908bb66f-bb4f-4201-9397-ca1dc297e80e" released by "delete_volume" :: held 0.874s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:17:28 devstack sudo[94591]: pam_unix(sudo:session): session closed for user root Jul 31 12:17:28 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-2b72c222-d00d-427c-9f95-a38182ccc69c tempest-VolumesGetTest-1167943284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4d2b1c55-3e3b-4398-94e6-2b2de531bdc9 -F qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-4d2b1c55-3e3b-4398-94e6-2b2de531bdc9.2db9f98a-a8f5-47e1-be72-f3a2fb4078ac" returned: 0 in 0.344s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:17:28 devstack cinder-volume[89182]: WARNING cinder.volume.drivers.remotefs [None req-2b72c222-d00d-427c-9f95-a38182ccc69c tempest-VolumesGetTest-1167943284 None] /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-4d2b1c55-3e3b-4398-94e6-2b2de531bdc9.2db9f98a-a8f5-47e1-be72-f3a2fb4078ac is being set with open permissions: ugo+rw Jul 31 12:17:28 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-2b72c222-d00d-427c-9f95-a38182ccc69c tempest-VolumesGetTest-1167943284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-4d2b1c55-3e3b-4398-94e6-2b2de531bdc9.2db9f98a-a8f5-47e1-be72-f3a2fb4078ac {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:17:28 devstack sudo[94598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-4d2b1c55-3e3b-4398-94e6-2b2de531bdc9.2db9f98a-a8f5-47e1-be72-f3a2fb4078ac Jul 31 12:17:28 devstack sudo[94598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:17:28 devstack cinder-volume[89182]: DEBUG cinder.quota [None req-9b77bee5-a3f0-418b-a8da-20a6cfa24d40 tempest-VolumeSnapshotQuotasNegativeTestJSON-7213724 None] Created reservations ['5d5f8530-e11c-424a-880f-f570ad132d33', '1eb0a31b-695f-4793-b59b-42cad836d1af', '7a53310d-414b-47fd-902b-19293614c3f8', '90b9af60-8fe5-4a98-8dca-58048f8d0351'] {{(pid=89182) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 12:17:28 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-9b77bee5-a3f0-418b-a8da-20a6cfa24d40 tempest-VolumeSnapshotQuotasNegativeTestJSON-7213724 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:17:28 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-9b77bee5-a3f0-418b-a8da-20a6cfa24d40 tempest-VolumeSnapshotQuotasNegativeTestJSON-7213724 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:17:28 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-9b77bee5-a3f0-418b-a8da-20a6cfa24d40 tempest-VolumeSnapshotQuotasNegativeTestJSON-7213724 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:17:28 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-9b77bee5-a3f0-418b-a8da-20a6cfa24d40 tempest-VolumeSnapshotQuotasNegativeTestJSON-7213724 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:17:28 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-9b77bee5-a3f0-418b-a8da-20a6cfa24d40 tempest-VolumeSnapshotQuotasNegativeTestJSON-7213724 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:17:28 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-9b77bee5-a3f0-418b-a8da-20a6cfa24d40 tempest-VolumeSnapshotQuotasNegativeTestJSON-7213724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:17:28 devstack sudo[94600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 Jul 31 12:17:28 devstack sudo[94600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:17:28 devstack sudo[94598]: pam_unix(sudo:session): session closed for user root Jul 31 12:17:28 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-2b72c222-d00d-427c-9f95-a38182ccc69c tempest-VolumesGetTest-1167943284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-4d2b1c55-3e3b-4398-94e6-2b2de531bdc9.2db9f98a-a8f5-47e1-be72-f3a2fb4078ac" returned: 0 in 0.276s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:17:28 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-2b72c222-d00d-427c-9f95-a38182ccc69c tempest-VolumesGetTest-1167943284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-4d2b1c55-3e3b-4398-94e6-2b2de531bdc9.info {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:17:28 devstack sudo[94603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-4d2b1c55-3e3b-4398-94e6-2b2de531bdc9.info Jul 31 12:17:28 devstack sudo[94603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:17:29 devstack sudo[94600]: pam_unix(sudo:session): session closed for user root Jul 31 12:17:29 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-9b77bee5-a3f0-418b-a8da-20a6cfa24d40 tempest-VolumeSnapshotQuotasNegativeTestJSON-7213724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2" returned: 0 in 0.481s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:17:29 devstack cinder-volume[89182]: DEBUG cinder.manager [None req-9b77bee5-a3f0-418b-a8da-20a6cfa24d40 tempest-VolumeSnapshotQuotasNegativeTestJSON-7213724 None] Notifying Schedulers of capabilities ... {{(pid=89182) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 12:17:29 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-9b77bee5-a3f0-418b-a8da-20a6cfa24d40 tempest-VolumeSnapshotQuotasNegativeTestJSON-7213724 None] Deleted volume successfully. Jul 31 12:17:29 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-9b77bee5-a3f0-418b-a8da-20a6cfa24d40 tempest-VolumeSnapshotQuotasNegativeTestJSON-7213724 None] Lock "cinder-908bb66f-bb4f-4201-9397-ca1dc297e80e-delete_volume" released by "delete_volume" :: held 1.653s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:17:29 devstack sudo[94603]: pam_unix(sudo:session): session closed for user root Jul 31 12:17:29 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-2b72c222-d00d-427c-9f95-a38182ccc69c tempest-VolumesGetTest-1167943284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-4d2b1c55-3e3b-4398-94e6-2b2de531bdc9.info" returned: 0 in 0.549s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:17:29 devstack cinder-volume[89182]: WARNING cinder.volume.drivers.remotefs [None req-2b72c222-d00d-427c-9f95-a38182ccc69c tempest-VolumesGetTest-1167943284 None] /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-4d2b1c55-3e3b-4398-94e6-2b2de531bdc9.info is being set with open permissions: ugo+rw Jul 31 12:17:29 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-2b72c222-d00d-427c-9f95-a38182ccc69c tempest-VolumesGetTest-1167943284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-4d2b1c55-3e3b-4398-94e6-2b2de531bdc9.info {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:17:29 devstack sudo[94608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-4d2b1c55-3e3b-4398-94e6-2b2de531bdc9.info Jul 31 12:17:29 devstack sudo[94608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:17:29 devstack sudo[94608]: pam_unix(sudo:session): session closed for user root Jul 31 12:17:29 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-2b72c222-d00d-427c-9f95-a38182ccc69c tempest-VolumesGetTest-1167943284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-4d2b1c55-3e3b-4398-94e6-2b2de531bdc9.info" returned: 0 in 0.274s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:17:29 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-2b72c222-d00d-427c-9f95-a38182ccc69c tempest-VolumesGetTest-1167943284 None] Acquiring lock "cinder-quobyte-0f4ddd47-3ed6-422c-991f-b0f6ea5a08f9" by "_copy_volume_from_snapshot" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:17:29 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-2b72c222-d00d-427c-9f95-a38182ccc69c tempest-VolumesGetTest-1167943284 None] Lock "cinder-quobyte-0f4ddd47-3ed6-422c-991f-b0f6ea5a08f9" acquired by "_copy_volume_from_snapshot" :: waited 0.028s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:17:29 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-2b72c222-d00d-427c-9f95-a38182ccc69c tempest-VolumesGetTest-1167943284 None] snapshot: 2db9f98a-a8f5-47e1-be72-f3a2fb4078ac, volume: 0f4ddd47-3ed6-422c-991f-b0f6ea5a08f9, {{(pid=89182) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Jul 31 12:17:29 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-2b72c222-d00d-427c-9f95-a38182ccc69c tempest-VolumesGetTest-1167943284 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:17:29 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-2b72c222-d00d-427c-9f95-a38182ccc69c tempest-VolumesGetTest-1167943284 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:17:29 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-2b72c222-d00d-427c-9f95-a38182ccc69c tempest-VolumesGetTest-1167943284 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:17:29 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-2b72c222-d00d-427c-9f95-a38182ccc69c tempest-VolumesGetTest-1167943284 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:17:29 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-2b72c222-d00d-427c-9f95-a38182ccc69c tempest-VolumesGetTest-1167943284 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:17:29 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[424858e0-4e58-4722-9e86-311fea9df835]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:17:29 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-2b72c222-d00d-427c-9f95-a38182ccc69c tempest-VolumesGetTest-1167943284 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-4d2b1c55-3e3b-4398-94e6-2b2de531bdc9.2db9f98a-a8f5-47e1-be72-f3a2fb4078ac {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:17:29 devstack sudo[94611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-4d2b1c55-3e3b-4398-94e6-2b2de531bdc9.2db9f98a-a8f5-47e1-be72-f3a2fb4078ac Jul 31 12:17:29 devstack sudo[94611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:17:30 devstack sudo[94611]: pam_unix(sudo:session): session closed for user root Jul 31 12:17:30 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-2b72c222-d00d-427c-9f95-a38182ccc69c tempest-VolumesGetTest-1167943284 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-4d2b1c55-3e3b-4398-94e6-2b2de531bdc9.2db9f98a-a8f5-47e1-be72-f3a2fb4078ac" returned: 0 in 0.433s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:17:30 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-2b72c222-d00d-427c-9f95-a38182ccc69c tempest-VolumesGetTest-1167943284 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4d2b1c55-3e3b-4398-94e6-2b2de531bdc9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89182) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 12:17:30 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[1eeb89f7-082e-41c2-99a6-28b28d5c92fb]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:17:30 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-2b72c222-d00d-427c-9f95-a38182ccc69c tempest-VolumesGetTest-1167943284 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-4d2b1c55-3e3b-4398-94e6-2b2de531bdc9 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:17:30 devstack sudo[94625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-4d2b1c55-3e3b-4398-94e6-2b2de531bdc9 Jul 31 12:17:30 devstack sudo[94625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:17:30 devstack sudo[94625]: pam_unix(sudo:session): session closed for user root Jul 31 12:17:30 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-2b72c222-d00d-427c-9f95-a38182ccc69c tempest-VolumesGetTest-1167943284 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-4d2b1c55-3e3b-4398-94e6-2b2de531bdc9" returned: 0 in 0.544s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:17:30 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-2b72c222-d00d-427c-9f95-a38182ccc69c tempest-VolumesGetTest-1167943284 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-4d2b1c55-3e3b-4398-94e6-2b2de531bdc9 {{(pid=89182) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Jul 31 12:17:30 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-2b72c222-d00d-427c-9f95-a38182ccc69c tempest-VolumesGetTest-1167943284 None] Creating direct copy from snapshot {{(pid=89182) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Jul 31 12:17:30 devstack cinder-volume[89182]: DEBUG cinder.utils [None req-2b72c222-d00d-427c-9f95-a38182ccc69c tempest-VolumesGetTest-1167943284 None] Path /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0f4ddd47-3ed6-422c-991f-b0f6ea5a08f9 not found in is_blk_device check {{(pid=89182) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 31 12:17:30 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-2b72c222-d00d-427c-9f95-a38182ccc69c tempest-VolumesGetTest-1167943284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-4d2b1c55-3e3b-4398-94e6-2b2de531bdc9 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0f4ddd47-3ed6-422c-991f-b0f6ea5a08f9 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:17:30 devstack sudo[94632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-4d2b1c55-3e3b-4398-94e6-2b2de531bdc9 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0f4ddd47-3ed6-422c-991f-b0f6ea5a08f9 Jul 31 12:17:30 devstack sudo[94632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:17:36 devstack sudo[94632]: pam_unix(sudo:session): session closed for user root Jul 31 12:17:36 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-2b72c222-d00d-427c-9f95-a38182ccc69c tempest-VolumesGetTest-1167943284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-4d2b1c55-3e3b-4398-94e6-2b2de531bdc9 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0f4ddd47-3ed6-422c-991f-b0f6ea5a08f9" returned: 0 in 6.034s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:17:36 devstack cinder-volume[89182]: DEBUG cinder.image.image_utils [None req-2b72c222-d00d-427c-9f95-a38182ccc69c tempest-VolumesGetTest-1167943284 None] Image conversion details: src /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-4d2b1c55-3e3b-4398-94e6-2b2de531bdc9, size 1024.00 MB, duration 6.04 sec, destination /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0f4ddd47-3ed6-422c-991f-b0f6ea5a08f9 {{(pid=89182) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 31 12:17:36 devstack cinder-volume[89182]: INFO cinder.image.image_utils [None req-2b72c222-d00d-427c-9f95-a38182ccc69c tempest-VolumesGetTest-1167943284 None] Converted 1024.00 MB image at 169.66 MB/s Jul 31 12:17:36 devstack cinder-volume[89182]: WARNING cinder.volume.drivers.remotefs [None req-2b72c222-d00d-427c-9f95-a38182ccc69c tempest-VolumesGetTest-1167943284 None] /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0f4ddd47-3ed6-422c-991f-b0f6ea5a08f9 is being set with open permissions: ugo+rw Jul 31 12:17:36 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-2b72c222-d00d-427c-9f95-a38182ccc69c tempest-VolumesGetTest-1167943284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0f4ddd47-3ed6-422c-991f-b0f6ea5a08f9 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:17:36 devstack sudo[94698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0f4ddd47-3ed6-422c-991f-b0f6ea5a08f9 Jul 31 12:17:36 devstack sudo[94698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:17:37 devstack sudo[94698]: pam_unix(sudo:session): session closed for user root Jul 31 12:17:37 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-2b72c222-d00d-427c-9f95-a38182ccc69c tempest-VolumesGetTest-1167943284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0f4ddd47-3ed6-422c-991f-b0f6ea5a08f9" returned: 0 in 0.425s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:17:37 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-2b72c222-d00d-427c-9f95-a38182ccc69c tempest-VolumesGetTest-1167943284 None] Lock "cinder-quobyte-0f4ddd47-3ed6-422c-991f-b0f6ea5a08f9" released by "_copy_volume_from_snapshot" :: held 7.538s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:17:37 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-2b72c222-d00d-427c-9f95-a38182ccc69c tempest-VolumesGetTest-1167943284 None] Acquiring lock "cinder-quobyte-2db9f98a-a8f5-47e1-be72-f3a2fb4078ac" by "_delete_snapshot" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:17:37 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-2b72c222-d00d-427c-9f95-a38182ccc69c tempest-VolumesGetTest-1167943284 None] Lock "cinder-quobyte-2db9f98a-a8f5-47e1-be72-f3a2fb4078ac" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:17:37 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-2b72c222-d00d-427c-9f95-a38182ccc69c tempest-VolumesGetTest-1167943284 None] Deleting offline snapshot 2db9f98a-a8f5-47e1-be72-f3a2fb4078ac of volume 4d2b1c55-3e3b-4398-94e6-2b2de531bdc9 {{(pid=89182) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 31 12:17:37 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-2b72c222-d00d-427c-9f95-a38182ccc69c tempest-VolumesGetTest-1167943284 None] snapshot_file for this snap is: volume-4d2b1c55-3e3b-4398-94e6-2b2de531bdc9.2db9f98a-a8f5-47e1-be72-f3a2fb4078ac {{(pid=89182) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 31 12:17:37 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b56fa84-8bbe-4f1a-9d79-609f9aba61e3]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:17:37 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-2b72c222-d00d-427c-9f95-a38182ccc69c tempest-VolumesGetTest-1167943284 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-4d2b1c55-3e3b-4398-94e6-2b2de531bdc9.2db9f98a-a8f5-47e1-be72-f3a2fb4078ac {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:17:37 devstack sudo[94703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-4d2b1c55-3e3b-4398-94e6-2b2de531bdc9.2db9f98a-a8f5-47e1-be72-f3a2fb4078ac Jul 31 12:17:37 devstack sudo[94703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:17:37 devstack cinder-volume[89182]: INFO cinder.volume.manager [req-8dfd986f-bcde-4f77-b0a8-aa3be13baf89 req-6e046f36-5d54-4ed2-8f41-c93252d4208d tempest-ServerActionsTestOtherA-721546481 None] Terminate volume connection completed successfully. Jul 31 12:17:37 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [req-8dfd986f-bcde-4f77-b0a8-aa3be13baf89 req-6e046f36-5d54-4ed2-8f41-c93252d4208d tempest-ServerActionsTestOtherA-721546481 None] Deleting attachment 7563ac64-3142-4018-8f8b-27f8026c9f11. {{(pid=89182) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 31 12:17:38 devstack sudo[94703]: pam_unix(sudo:session): session closed for user root Jul 31 12:17:38 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-2b72c222-d00d-427c-9f95-a38182ccc69c tempest-VolumesGetTest-1167943284 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-4d2b1c55-3e3b-4398-94e6-2b2de531bdc9.2db9f98a-a8f5-47e1-be72-f3a2fb4078ac" returned: 0 in 0.660s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:17:38 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-2b72c222-d00d-427c-9f95-a38182ccc69c tempest-VolumesGetTest-1167943284 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4d2b1c55-3e3b-4398-94e6-2b2de531bdc9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89182) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 12:17:38 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[302e7e34-89b5-4f98-9138-ecc929577145]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:17:38 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-2b72c222-d00d-427c-9f95-a38182ccc69c tempest-VolumesGetTest-1167943284 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-4d2b1c55-3e3b-4398-94e6-2b2de531bdc9 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:17:38 devstack cinder-volume[89182]: DEBUG cinder.coordination [req-8dfd986f-bcde-4f77-b0a8-aa3be13baf89 req-838ec213-cdd4-4a85-b767-8a6b655cf7d0 tempest-ServerActionsTestOtherA-721546481 None] Acquiring lock "cinder-885fab30-9c14-41a8-8e74-9847acb8523d-delete_volume" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:17:38 devstack cinder-volume[89182]: DEBUG cinder.coordination [req-8dfd986f-bcde-4f77-b0a8-aa3be13baf89 req-838ec213-cdd4-4a85-b767-8a6b655cf7d0 tempest-ServerActionsTestOtherA-721546481 None] Lock "cinder-885fab30-9c14-41a8-8e74-9847acb8523d-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:17:38 devstack cinder-volume[89182]: DEBUG cinder.coordination [req-8dfd986f-bcde-4f77-b0a8-aa3be13baf89 req-838ec213-cdd4-4a85-b767-8a6b655cf7d0 tempest-ServerActionsTestOtherA-721546481 None] Acquiring lock "cinder-quobyte-885fab30-9c14-41a8-8e74-9847acb8523d" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:17:38 devstack cinder-volume[89182]: DEBUG cinder.coordination [req-8dfd986f-bcde-4f77-b0a8-aa3be13baf89 req-838ec213-cdd4-4a85-b767-8a6b655cf7d0 tempest-ServerActionsTestOtherA-721546481 None] Lock "cinder-quobyte-885fab30-9c14-41a8-8e74-9847acb8523d" acquired by "delete_volume" :: waited 0.019s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:17:38 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[23e512ab-a3b9-4acf-9815-c9f6cab93fda]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:17:38 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [req-8dfd986f-bcde-4f77-b0a8-aa3be13baf89 req-838ec213-cdd4-4a85-b767-8a6b655cf7d0 tempest-ServerActionsTestOtherA-721546481 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-885fab30-9c14-41a8-8e74-9847acb8523d {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:17:38 devstack sudo[94711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-4d2b1c55-3e3b-4398-94e6-2b2de531bdc9 Jul 31 12:17:38 devstack sudo[94711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:17:38 devstack sudo[94712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-885fab30-9c14-41a8-8e74-9847acb8523d Jul 31 12:17:38 devstack sudo[94712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:17:39 devstack sudo[94712]: pam_unix(sudo:session): session closed for user root Jul 31 12:17:39 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [req-8dfd986f-bcde-4f77-b0a8-aa3be13baf89 req-838ec213-cdd4-4a85-b767-8a6b655cf7d0 tempest-ServerActionsTestOtherA-721546481 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-885fab30-9c14-41a8-8e74-9847acb8523d" returned: 0 in 0.715s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:17:39 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [req-8dfd986f-bcde-4f77-b0a8-aa3be13baf89 req-838ec213-cdd4-4a85-b767-8a6b655cf7d0 tempest-ServerActionsTestOtherA-721546481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-885fab30-9c14-41a8-8e74-9847acb8523d {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:17:39 devstack sudo[94721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-885fab30-9c14-41a8-8e74-9847acb8523d Jul 31 12:17:39 devstack sudo[94721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:17:39 devstack sudo[94711]: pam_unix(sudo:session): session closed for user root Jul 31 12:17:39 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-2b72c222-d00d-427c-9f95-a38182ccc69c tempest-VolumesGetTest-1167943284 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-4d2b1c55-3e3b-4398-94e6-2b2de531bdc9" returned: 0 in 0.991s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:17:39 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-2b72c222-d00d-427c-9f95-a38182ccc69c tempest-VolumesGetTest-1167943284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-4d2b1c55-3e3b-4398-94e6-2b2de531bdc9.2db9f98a-a8f5-47e1-be72-f3a2fb4078ac {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:17:39 devstack sudo[94723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-4d2b1c55-3e3b-4398-94e6-2b2de531bdc9.2db9f98a-a8f5-47e1-be72-f3a2fb4078ac Jul 31 12:17:39 devstack sudo[94723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:17:39 devstack sudo[94721]: pam_unix(sudo:session): session closed for user root Jul 31 12:17:39 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [req-8dfd986f-bcde-4f77-b0a8-aa3be13baf89 req-838ec213-cdd4-4a85-b767-8a6b655cf7d0 tempest-ServerActionsTestOtherA-721546481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-885fab30-9c14-41a8-8e74-9847acb8523d" returned: 0 in 0.436s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:17:39 devstack cinder-volume[89182]: DEBUG cinder.coordination [req-8dfd986f-bcde-4f77-b0a8-aa3be13baf89 req-838ec213-cdd4-4a85-b767-8a6b655cf7d0 tempest-ServerActionsTestOtherA-721546481 None] Lock "cinder-quobyte-885fab30-9c14-41a8-8e74-9847acb8523d" released by "delete_volume" :: held 1.220s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:17:39 devstack cinder-volume[89182]: DEBUG cinder.quota [req-8dfd986f-bcde-4f77-b0a8-aa3be13baf89 req-838ec213-cdd4-4a85-b767-8a6b655cf7d0 tempest-ServerActionsTestOtherA-721546481 None] Created reservations ['54b47f65-fa5c-4bdf-83ed-3d23e2a777fa', '31d9e7e9-f3c2-4ca6-b334-3b4da6032bd8', '9f14f5f0-e000-4357-a580-cf577ff549d6', '07ed54fc-b89e-488d-9658-1cfce75c1e3b'] {{(pid=89182) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 12:17:39 devstack sudo[94723]: pam_unix(sudo:session): session closed for user root Jul 31 12:17:39 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-2b72c222-d00d-427c-9f95-a38182ccc69c tempest-VolumesGetTest-1167943284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-4d2b1c55-3e3b-4398-94e6-2b2de531bdc9.2db9f98a-a8f5-47e1-be72-f3a2fb4078ac" returned: 0 in 0.502s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:17:39 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-2b72c222-d00d-427c-9f95-a38182ccc69c tempest-VolumesGetTest-1167943284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-4d2b1c55-3e3b-4398-94e6-2b2de531bdc9.2db9f98a-a8f5-47e1-be72-f3a2fb4078ac {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:17:39 devstack sudo[94729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-4d2b1c55-3e3b-4398-94e6-2b2de531bdc9.2db9f98a-a8f5-47e1-be72-f3a2fb4078ac Jul 31 12:17:39 devstack sudo[94729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:17:39 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [req-8dfd986f-bcde-4f77-b0a8-aa3be13baf89 req-838ec213-cdd4-4a85-b767-8a6b655cf7d0 tempest-ServerActionsTestOtherA-721546481 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:17:39 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [req-8dfd986f-bcde-4f77-b0a8-aa3be13baf89 req-838ec213-cdd4-4a85-b767-8a6b655cf7d0 tempest-ServerActionsTestOtherA-721546481 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:17:39 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [req-8dfd986f-bcde-4f77-b0a8-aa3be13baf89 req-838ec213-cdd4-4a85-b767-8a6b655cf7d0 tempest-ServerActionsTestOtherA-721546481 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:17:39 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [req-8dfd986f-bcde-4f77-b0a8-aa3be13baf89 req-838ec213-cdd4-4a85-b767-8a6b655cf7d0 tempest-ServerActionsTestOtherA-721546481 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:17:39 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [req-8dfd986f-bcde-4f77-b0a8-aa3be13baf89 req-838ec213-cdd4-4a85-b767-8a6b655cf7d0 tempest-ServerActionsTestOtherA-721546481 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:17:39 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [req-8dfd986f-bcde-4f77-b0a8-aa3be13baf89 req-838ec213-cdd4-4a85-b767-8a6b655cf7d0 tempest-ServerActionsTestOtherA-721546481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:17:39 devstack sudo[94731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 Jul 31 12:17:39 devstack sudo[94731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:17:39 devstack sudo[94729]: pam_unix(sudo:session): session closed for user root Jul 31 12:17:39 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-2b72c222-d00d-427c-9f95-a38182ccc69c tempest-VolumesGetTest-1167943284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-4d2b1c55-3e3b-4398-94e6-2b2de531bdc9.2db9f98a-a8f5-47e1-be72-f3a2fb4078ac" returned: 0 in 0.304s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:17:39 devstack sudo[94731]: pam_unix(sudo:session): session closed for user root Jul 31 12:17:39 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [req-8dfd986f-bcde-4f77-b0a8-aa3be13baf89 req-838ec213-cdd4-4a85-b767-8a6b655cf7d0 tempest-ServerActionsTestOtherA-721546481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2" returned: 0 in 0.295s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:17:39 devstack cinder-volume[89182]: DEBUG cinder.manager [req-8dfd986f-bcde-4f77-b0a8-aa3be13baf89 req-838ec213-cdd4-4a85-b767-8a6b655cf7d0 tempest-ServerActionsTestOtherA-721546481 None] Notifying Schedulers of capabilities ... {{(pid=89182) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 12:17:39 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-2b72c222-d00d-427c-9f95-a38182ccc69c tempest-VolumesGetTest-1167943284 None] Lock "cinder-quobyte-2db9f98a-a8f5-47e1-be72-f3a2fb4078ac" released by "_delete_snapshot" :: held 2.600s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:17:39 devstack cinder-volume[89182]: INFO cinder.volume.manager [req-8dfd986f-bcde-4f77-b0a8-aa3be13baf89 req-838ec213-cdd4-4a85-b767-8a6b655cf7d0 tempest-ServerActionsTestOtherA-721546481 None] Deleted volume successfully. Jul 31 12:17:40 devstack cinder-volume[89182]: DEBUG cinder.coordination [req-8dfd986f-bcde-4f77-b0a8-aa3be13baf89 req-838ec213-cdd4-4a85-b767-8a6b655cf7d0 tempest-ServerActionsTestOtherA-721546481 None] Lock "cinder-885fab30-9c14-41a8-8e74-9847acb8523d-delete_volume" released by "delete_volume" :: held 1.833s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:17:40 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-2b72c222-d00d-427c-9f95-a38182ccc69c tempest-VolumesGetTest-1167943284 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 12.867s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:17:40 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-2b72c222-d00d-427c-9f95-a38182ccc69c tempest-VolumesGetTest-1167943284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec861280-b607-4913-8239-57550be22896) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0f4ddd47-3ed6-422c-991f-b0f6ea5a08f9', 'volume_size': 1, 'source_volid': '4d2b1c55-3e3b-4398-94e6-2b2de531bdc9', 'source_volstatus': 'available'}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:17:40 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-2b72c222-d00d-427c-9f95-a38182ccc69c tempest-VolumesGetTest-1167943284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1858a5ec-16ae-4b05-afe0-401a09c548d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:17:40 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-2b72c222-d00d-427c-9f95-a38182ccc69c tempest-VolumesGetTest-1167943284 None] Volume volume-0f4ddd47-3ed6-422c-991f-b0f6ea5a08f9 (0f4ddd47-3ed6-422c-991f-b0f6ea5a08f9): created successfully Jul 31 12:17:40 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-2b72c222-d00d-427c-9f95-a38182ccc69c tempest-VolumesGetTest-1167943284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1858a5ec-16ae-4b05-afe0-401a09c548d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:17:40 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-2b72c222-d00d-427c-9f95-a38182ccc69c tempest-VolumesGetTest-1167943284 None] Flow 'volume_create_manager' (0508d8f1-b1f6-412b-9a4f-7cbcd09de231) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:17:40 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-2b72c222-d00d-427c-9f95-a38182ccc69c tempest-VolumesGetTest-1167943284 None] Created volume successfully. Jul 31 12:17:40 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-8e1bf1e3-d6cb-4d9a-b7a5-4c097087c474 tempest-ServerActionsTestOtherA-721546481 None] Acquiring lock "cinder-58e3eb03-8b43-4942-8387-27ac4293420c-delete_volume" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:17:40 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-8e1bf1e3-d6cb-4d9a-b7a5-4c097087c474 tempest-ServerActionsTestOtherA-721546481 None] Lock "cinder-58e3eb03-8b43-4942-8387-27ac4293420c-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:17:40 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-8e1bf1e3-d6cb-4d9a-b7a5-4c097087c474 tempest-ServerActionsTestOtherA-721546481 None] Acquiring lock "cinder-quobyte-58e3eb03-8b43-4942-8387-27ac4293420c" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:17:40 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-8e1bf1e3-d6cb-4d9a-b7a5-4c097087c474 tempest-ServerActionsTestOtherA-721546481 None] Lock "cinder-quobyte-58e3eb03-8b43-4942-8387-27ac4293420c" acquired by "delete_volume" :: waited 0.017s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:17:40 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[f74c01f5-6b51-4962-b13f-93726d5d0877]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:17:40 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-8e1bf1e3-d6cb-4d9a-b7a5-4c097087c474 tempest-ServerActionsTestOtherA-721546481 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-58e3eb03-8b43-4942-8387-27ac4293420c {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:17:40 devstack sudo[94747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-58e3eb03-8b43-4942-8387-27ac4293420c Jul 31 12:17:40 devstack sudo[94747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:17:41 devstack sudo[94747]: pam_unix(sudo:session): session closed for user root Jul 31 12:17:41 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-8e1bf1e3-d6cb-4d9a-b7a5-4c097087c474 tempest-ServerActionsTestOtherA-721546481 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-58e3eb03-8b43-4942-8387-27ac4293420c" returned: 0 in 0.455s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:17:41 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-8e1bf1e3-d6cb-4d9a-b7a5-4c097087c474 tempest-ServerActionsTestOtherA-721546481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-58e3eb03-8b43-4942-8387-27ac4293420c {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:17:41 devstack sudo[94764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-58e3eb03-8b43-4942-8387-27ac4293420c Jul 31 12:17:41 devstack sudo[94764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:17:41 devstack sudo[94764]: pam_unix(sudo:session): session closed for user root Jul 31 12:17:41 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-8e1bf1e3-d6cb-4d9a-b7a5-4c097087c474 tempest-ServerActionsTestOtherA-721546481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-58e3eb03-8b43-4942-8387-27ac4293420c" returned: 0 in 0.416s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:17:41 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-8e1bf1e3-d6cb-4d9a-b7a5-4c097087c474 tempest-ServerActionsTestOtherA-721546481 None] Lock "cinder-quobyte-58e3eb03-8b43-4942-8387-27ac4293420c" released by "delete_volume" :: held 0.931s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:17:41 devstack cinder-volume[89182]: DEBUG cinder.volume.flows.manager.create_volume [None req-a75b3e76-90c7-44f3-92ec-c49851c4d964 tempest-VolumesGetTest-1167943284 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89182) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 12:17:41 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-a75b3e76-90c7-44f3-92ec-c49851c4d964 tempest-VolumesGetTest-1167943284 None] Flow 'volume_create_manager' (cd911145-c65e-4848-9efe-238ad3d0ae8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:17:41 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-a75b3e76-90c7-44f3-92ec-c49851c4d964 tempest-VolumesGetTest-1167943284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95d8e418-98b7-4758-b893-1641826372c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:17:41 devstack cinder-volume[89182]: DEBUG cinder.quota [None req-8e1bf1e3-d6cb-4d9a-b7a5-4c097087c474 tempest-ServerActionsTestOtherA-721546481 None] Created reservations ['398e2e7b-0534-41ec-a725-c98373dd3bb2', '3e5f2bd1-6de1-4c2e-8a5e-3e6d8434841d', '45d7249e-3d1c-4e60-a4f7-3f8613c08f0f', '71078bbd-9771-4fac-a7e9-2aef97f02743'] {{(pid=89182) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 12:17:41 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-a75b3e76-90c7-44f3-92ec-c49851c4d964 tempest-VolumesGetTest-1167943284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95d8e418-98b7-4758-b893-1641826372c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:17:41Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-137468620',display_name='tempest-VolumesGetTest-Volume-1391753158',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9d4dbca-c60c-47e0-a18d-f9af3d32f110,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3bfd8f27aa9442a384d65adca3b284dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:17:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:17:42Z,use_quota=True,user_id='219264511ea247d78c4075409a489eff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:17:41 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-a75b3e76-90c7-44f3-92ec-c49851c4d964 tempest-VolumesGetTest-1167943284 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e5b43de-28df-43e9-8b53-d7611f928806) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:17:41 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-a75b3e76-90c7-44f3-92ec-c49851c4d964 tempest-VolumesGetTest-1167943284 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e5b43de-28df-43e9-8b53-d7611f928806) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:17:41 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-a75b3e76-90c7-44f3-92ec-c49851c4d964 tempest-VolumesGetTest-1167943284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b93a2cb-4932-4906-bca9-6e42ce38d36b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:17:41 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-a75b3e76-90c7-44f3-92ec-c49851c4d964 tempest-VolumesGetTest-1167943284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b93a2cb-4932-4906-bca9-6e42ce38d36b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e9d4dbca-c60c-47e0-a18d-f9af3d32f110', 'volume_name': 'volume-e9d4dbca-c60c-47e0-a18d-f9af3d32f110', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:17:41 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-a75b3e76-90c7-44f3-92ec-c49851c4d964 tempest-VolumesGetTest-1167943284 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97f68d8c-c5bd-4603-a90e-1c99c8f3e806) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:17:41 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-a75b3e76-90c7-44f3-92ec-c49851c4d964 tempest-VolumesGetTest-1167943284 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97f68d8c-c5bd-4603-a90e-1c99c8f3e806) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:17:41 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-a75b3e76-90c7-44f3-92ec-c49851c4d964 tempest-VolumesGetTest-1167943284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41ed595e-8413-4cee-bb5b-85bf63f7b535) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:17:41 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-a75b3e76-90c7-44f3-92ec-c49851c4d964 tempest-VolumesGetTest-1167943284 None] Volume e9d4dbca-c60c-47e0-a18d-f9af3d32f110: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e9d4dbca-c60c-47e0-a18d-f9af3d32f110', 'volume_size': 1} Jul 31 12:17:41 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-a75b3e76-90c7-44f3-92ec-c49851c4d964 tempest-VolumesGetTest-1167943284 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:17:41 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-a75b3e76-90c7-44f3-92ec-c49851c4d964 tempest-VolumesGetTest-1167943284 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:17:41 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-a75b3e76-90c7-44f3-92ec-c49851c4d964 tempest-VolumesGetTest-1167943284 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:17:41Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-137468620',display_name='tempest-VolumesGetTest-Volume-1391753158',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9d4dbca-c60c-47e0-a18d-f9af3d32f110,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3bfd8f27aa9442a384d65adca3b284dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:17:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:17:42Z,use_quota=True,user_id='219264511ea247d78c4075409a489eff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)}" {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 12:17:41 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-a75b3e76-90c7-44f3-92ec-c49851c4d964 tempest-VolumesGetTest-1167943284 None] Creating volume e9d4dbca-c60c-47e0-a18d-f9af3d32f110 {{(pid=89182) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 12:17:41 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-a75b3e76-90c7-44f3-92ec-c49851c4d964 tempest-VolumesGetTest-1167943284 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:17:41 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-a75b3e76-90c7-44f3-92ec-c49851c4d964 tempest-VolumesGetTest-1167943284 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:17:41 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-a75b3e76-90c7-44f3-92ec-c49851c4d964 tempest-VolumesGetTest-1167943284 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:17:41 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-a75b3e76-90c7-44f3-92ec-c49851c4d964 tempest-VolumesGetTest-1167943284 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:17:41 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-a75b3e76-90c7-44f3-92ec-c49851c4d964 tempest-VolumesGetTest-1167943284 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:17:41 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-a75b3e76-90c7-44f3-92ec-c49851c4d964 tempest-VolumesGetTest-1167943284 None] Selected osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 as target Quobyte volume. {{(pid=89182) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 12:17:41 devstack cinder-volume[89182]: INFO cinder.volume.drivers.remotefs [None req-a75b3e76-90c7-44f3-92ec-c49851c4d964 tempest-VolumesGetTest-1167943284 None] casted to osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 Jul 31 12:17:41 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-a75b3e76-90c7-44f3-92ec-c49851c4d964 tempest-VolumesGetTest-1167943284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e9d4dbca-c60c-47e0-a18d-f9af3d32f110 1073741824 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:17:41 devstack sudo[94775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e9d4dbca-c60c-47e0-a18d-f9af3d32f110 1073741824 Jul 31 12:17:41 devstack sudo[94775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:17:41 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-8e1bf1e3-d6cb-4d9a-b7a5-4c097087c474 tempest-ServerActionsTestOtherA-721546481 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:17:41 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-8e1bf1e3-d6cb-4d9a-b7a5-4c097087c474 tempest-ServerActionsTestOtherA-721546481 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:17:41 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-8e1bf1e3-d6cb-4d9a-b7a5-4c097087c474 tempest-ServerActionsTestOtherA-721546481 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:17:41 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-8e1bf1e3-d6cb-4d9a-b7a5-4c097087c474 tempest-ServerActionsTestOtherA-721546481 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:17:41 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-8e1bf1e3-d6cb-4d9a-b7a5-4c097087c474 tempest-ServerActionsTestOtherA-721546481 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:17:41 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-8e1bf1e3-d6cb-4d9a-b7a5-4c097087c474 tempest-ServerActionsTestOtherA-721546481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:17:41 devstack sudo[94777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 Jul 31 12:17:41 devstack sudo[94777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:17:42 devstack sudo[94777]: pam_unix(sudo:session): session closed for user root Jul 31 12:17:42 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-8e1bf1e3-d6cb-4d9a-b7a5-4c097087c474 tempest-ServerActionsTestOtherA-721546481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2" returned: 0 in 0.305s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:17:42 devstack cinder-volume[89182]: DEBUG cinder.manager [None req-8e1bf1e3-d6cb-4d9a-b7a5-4c097087c474 tempest-ServerActionsTestOtherA-721546481 None] Notifying Schedulers of capabilities ... {{(pid=89182) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 12:17:42 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-8e1bf1e3-d6cb-4d9a-b7a5-4c097087c474 tempest-ServerActionsTestOtherA-721546481 None] Deleted volume successfully. Jul 31 12:17:42 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-8e1bf1e3-d6cb-4d9a-b7a5-4c097087c474 tempest-ServerActionsTestOtherA-721546481 None] Lock "cinder-58e3eb03-8b43-4942-8387-27ac4293420c-delete_volume" released by "delete_volume" :: held 1.788s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:17:42 devstack sudo[94775]: pam_unix(sudo:session): session closed for user root Jul 31 12:17:42 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-a75b3e76-90c7-44f3-92ec-c49851c4d964 tempest-VolumesGetTest-1167943284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e9d4dbca-c60c-47e0-a18d-f9af3d32f110 1073741824" returned: 0 in 0.616s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:17:42 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-a75b3e76-90c7-44f3-92ec-c49851c4d964 tempest-VolumesGetTest-1167943284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e9d4dbca-c60c-47e0-a18d-f9af3d32f110 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:17:42 devstack sudo[94784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e9d4dbca-c60c-47e0-a18d-f9af3d32f110 Jul 31 12:17:42 devstack sudo[94784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:17:42 devstack sudo[94784]: pam_unix(sudo:session): session closed for user root Jul 31 12:17:42 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-a75b3e76-90c7-44f3-92ec-c49851c4d964 tempest-VolumesGetTest-1167943284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e9d4dbca-c60c-47e0-a18d-f9af3d32f110" returned: 0 in 0.290s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:17:42 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-a75b3e76-90c7-44f3-92ec-c49851c4d964 tempest-VolumesGetTest-1167943284 None] <== create_volume: return (965ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'} {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 12:17:42 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-a75b3e76-90c7-44f3-92ec-c49851c4d964 tempest-VolumesGetTest-1167943284 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.968s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:17:42 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-a75b3e76-90c7-44f3-92ec-c49851c4d964 tempest-VolumesGetTest-1167943284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41ed595e-8413-4cee-bb5b-85bf63f7b535) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e9d4dbca-c60c-47e0-a18d-f9af3d32f110', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:17:42 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-a75b3e76-90c7-44f3-92ec-c49851c4d964 tempest-VolumesGetTest-1167943284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51f93114-66b8-45a7-a942-e4654e73291d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:17:42 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-a75b3e76-90c7-44f3-92ec-c49851c4d964 tempest-VolumesGetTest-1167943284 None] Volume volume-e9d4dbca-c60c-47e0-a18d-f9af3d32f110 (e9d4dbca-c60c-47e0-a18d-f9af3d32f110): created successfully Jul 31 12:17:42 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-a75b3e76-90c7-44f3-92ec-c49851c4d964 tempest-VolumesGetTest-1167943284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51f93114-66b8-45a7-a942-e4654e73291d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:17:42 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-a75b3e76-90c7-44f3-92ec-c49851c4d964 tempest-VolumesGetTest-1167943284 None] Flow 'volume_create_manager' (cd911145-c65e-4848-9efe-238ad3d0ae8b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:17:42 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-a75b3e76-90c7-44f3-92ec-c49851c4d964 tempest-VolumesGetTest-1167943284 None] Created volume successfully. Jul 31 12:17:44 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-c5975368-4cb2-4c53-9ffa-181ff6907a79 tempest-VolumesGetTest-1167943284 None] Acquiring lock "cinder-e9d4dbca-c60c-47e0-a18d-f9af3d32f110-delete_volume" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:17:44 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-c5975368-4cb2-4c53-9ffa-181ff6907a79 tempest-VolumesGetTest-1167943284 None] Lock "cinder-e9d4dbca-c60c-47e0-a18d-f9af3d32f110-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:17:44 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-c5975368-4cb2-4c53-9ffa-181ff6907a79 tempest-VolumesGetTest-1167943284 None] Acquiring lock "cinder-quobyte-e9d4dbca-c60c-47e0-a18d-f9af3d32f110" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:17:44 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-c5975368-4cb2-4c53-9ffa-181ff6907a79 tempest-VolumesGetTest-1167943284 None] Lock "cinder-quobyte-e9d4dbca-c60c-47e0-a18d-f9af3d32f110" acquired by "delete_volume" :: waited 0.022s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:17:44 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[8120aa07-7f99-4672-8b1f-68a1b762be8e]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:17:44 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-c5975368-4cb2-4c53-9ffa-181ff6907a79 tempest-VolumesGetTest-1167943284 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e9d4dbca-c60c-47e0-a18d-f9af3d32f110 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:17:44 devstack sudo[94856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e9d4dbca-c60c-47e0-a18d-f9af3d32f110 Jul 31 12:17:44 devstack sudo[94856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:17:44 devstack sudo[94856]: pam_unix(sudo:session): session closed for user root Jul 31 12:17:44 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-c5975368-4cb2-4c53-9ffa-181ff6907a79 tempest-VolumesGetTest-1167943284 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e9d4dbca-c60c-47e0-a18d-f9af3d32f110" returned: 0 in 0.707s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:17:44 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-c5975368-4cb2-4c53-9ffa-181ff6907a79 tempest-VolumesGetTest-1167943284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e9d4dbca-c60c-47e0-a18d-f9af3d32f110 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:17:44 devstack sudo[94886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e9d4dbca-c60c-47e0-a18d-f9af3d32f110 Jul 31 12:17:44 devstack sudo[94886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:17:45 devstack sudo[94886]: pam_unix(sudo:session): session closed for user root Jul 31 12:17:45 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-c5975368-4cb2-4c53-9ffa-181ff6907a79 tempest-VolumesGetTest-1167943284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e9d4dbca-c60c-47e0-a18d-f9af3d32f110" returned: 0 in 0.470s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:17:45 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-c5975368-4cb2-4c53-9ffa-181ff6907a79 tempest-VolumesGetTest-1167943284 None] Lock "cinder-quobyte-e9d4dbca-c60c-47e0-a18d-f9af3d32f110" released by "delete_volume" :: held 1.290s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:17:45 devstack cinder-volume[89182]: DEBUG cinder.quota [None req-c5975368-4cb2-4c53-9ffa-181ff6907a79 tempest-VolumesGetTest-1167943284 None] Created reservations ['0a5e4966-b34f-4377-a995-fb5640cef848', '30899851-91bc-46bb-b14d-f7e28eb056ba', '26243d16-377c-4a26-acf3-4089198b089c', '1fcd44be-113f-4ca4-b89a-5737c494ccb3'] {{(pid=89182) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 12:17:45 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-c5975368-4cb2-4c53-9ffa-181ff6907a79 tempest-VolumesGetTest-1167943284 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:17:45 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-c5975368-4cb2-4c53-9ffa-181ff6907a79 tempest-VolumesGetTest-1167943284 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:17:45 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-c5975368-4cb2-4c53-9ffa-181ff6907a79 tempest-VolumesGetTest-1167943284 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:17:45 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-c5975368-4cb2-4c53-9ffa-181ff6907a79 tempest-VolumesGetTest-1167943284 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:17:45 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-c5975368-4cb2-4c53-9ffa-181ff6907a79 tempest-VolumesGetTest-1167943284 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:17:45 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-c5975368-4cb2-4c53-9ffa-181ff6907a79 tempest-VolumesGetTest-1167943284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:17:45 devstack sudo[94903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 Jul 31 12:17:45 devstack sudo[94903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:17:46 devstack sudo[94903]: pam_unix(sudo:session): session closed for user root Jul 31 12:17:46 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-c5975368-4cb2-4c53-9ffa-181ff6907a79 tempest-VolumesGetTest-1167943284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2" returned: 0 in 0.403s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:17:46 devstack cinder-volume[89182]: DEBUG cinder.manager [None req-c5975368-4cb2-4c53-9ffa-181ff6907a79 tempest-VolumesGetTest-1167943284 None] Notifying Schedulers of capabilities ... {{(pid=89182) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 12:17:46 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-c5975368-4cb2-4c53-9ffa-181ff6907a79 tempest-VolumesGetTest-1167943284 None] Deleted volume successfully. Jul 31 12:17:46 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-c5975368-4cb2-4c53-9ffa-181ff6907a79 tempest-VolumesGetTest-1167943284 None] Lock "cinder-e9d4dbca-c60c-47e0-a18d-f9af3d32f110-delete_volume" released by "delete_volume" :: held 2.002s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:17:46 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-854f31ec-6348-40c7-96f4-68a92f98a1c1 tempest-VolumesGetTest-1167943284 None] Acquiring lock "cinder-0f4ddd47-3ed6-422c-991f-b0f6ea5a08f9-delete_volume" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:17:46 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-854f31ec-6348-40c7-96f4-68a92f98a1c1 tempest-VolumesGetTest-1167943284 None] Lock "cinder-0f4ddd47-3ed6-422c-991f-b0f6ea5a08f9-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:17:46 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-854f31ec-6348-40c7-96f4-68a92f98a1c1 tempest-VolumesGetTest-1167943284 None] Acquiring lock "cinder-quobyte-0f4ddd47-3ed6-422c-991f-b0f6ea5a08f9" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:17:46 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-854f31ec-6348-40c7-96f4-68a92f98a1c1 tempest-VolumesGetTest-1167943284 None] Lock "cinder-quobyte-0f4ddd47-3ed6-422c-991f-b0f6ea5a08f9" acquired by "delete_volume" :: waited 0.028s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:17:46 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbf1f05e-dbc2-45e3-90fe-4c0f83321454]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:17:46 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-854f31ec-6348-40c7-96f4-68a92f98a1c1 tempest-VolumesGetTest-1167943284 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0f4ddd47-3ed6-422c-991f-b0f6ea5a08f9 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:17:47 devstack sudo[94911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0f4ddd47-3ed6-422c-991f-b0f6ea5a08f9 Jul 31 12:17:47 devstack sudo[94911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:17:47 devstack sudo[94911]: pam_unix(sudo:session): session closed for user root Jul 31 12:17:47 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-854f31ec-6348-40c7-96f4-68a92f98a1c1 tempest-VolumesGetTest-1167943284 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0f4ddd47-3ed6-422c-991f-b0f6ea5a08f9" returned: 0 in 0.878s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:17:47 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-854f31ec-6348-40c7-96f4-68a92f98a1c1 tempest-VolumesGetTest-1167943284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0f4ddd47-3ed6-422c-991f-b0f6ea5a08f9 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:17:47 devstack sudo[94923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0f4ddd47-3ed6-422c-991f-b0f6ea5a08f9 Jul 31 12:17:47 devstack sudo[94923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:17:48 devstack sudo[94923]: pam_unix(sudo:session): session closed for user root Jul 31 12:17:48 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-854f31ec-6348-40c7-96f4-68a92f98a1c1 tempest-VolumesGetTest-1167943284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0f4ddd47-3ed6-422c-991f-b0f6ea5a08f9" returned: 0 in 0.359s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:17:48 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-854f31ec-6348-40c7-96f4-68a92f98a1c1 tempest-VolumesGetTest-1167943284 None] Lock "cinder-quobyte-0f4ddd47-3ed6-422c-991f-b0f6ea5a08f9" released by "delete_volume" :: held 1.297s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:17:48 devstack cinder-volume[89182]: DEBUG cinder.quota [None req-854f31ec-6348-40c7-96f4-68a92f98a1c1 tempest-VolumesGetTest-1167943284 None] Created reservations ['a55ef525-e7f3-42bd-9282-2f89d72c40bf', 'e0da4f09-8409-4db5-9af2-0a1fd2534e14', '8b2eeb57-bb1f-4e6a-be33-a26e51f95c6d', '7dacbf10-479c-49c9-9fce-47724e7ee97e'] {{(pid=89182) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 12:17:48 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-854f31ec-6348-40c7-96f4-68a92f98a1c1 tempest-VolumesGetTest-1167943284 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:17:48 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-854f31ec-6348-40c7-96f4-68a92f98a1c1 tempest-VolumesGetTest-1167943284 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:17:48 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-854f31ec-6348-40c7-96f4-68a92f98a1c1 tempest-VolumesGetTest-1167943284 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:17:48 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-854f31ec-6348-40c7-96f4-68a92f98a1c1 tempest-VolumesGetTest-1167943284 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:17:48 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-854f31ec-6348-40c7-96f4-68a92f98a1c1 tempest-VolumesGetTest-1167943284 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:17:48 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-854f31ec-6348-40c7-96f4-68a92f98a1c1 tempest-VolumesGetTest-1167943284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:17:48 devstack sudo[94926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 Jul 31 12:17:48 devstack sudo[94926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:17:48 devstack sudo[94926]: pam_unix(sudo:session): session closed for user root Jul 31 12:17:48 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-854f31ec-6348-40c7-96f4-68a92f98a1c1 tempest-VolumesGetTest-1167943284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2" returned: 0 in 0.468s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:17:48 devstack cinder-volume[89182]: DEBUG cinder.manager [None req-854f31ec-6348-40c7-96f4-68a92f98a1c1 tempest-VolumesGetTest-1167943284 None] Notifying Schedulers of capabilities ... {{(pid=89182) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 12:17:48 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-854f31ec-6348-40c7-96f4-68a92f98a1c1 tempest-VolumesGetTest-1167943284 None] Deleted volume successfully. Jul 31 12:17:48 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-854f31ec-6348-40c7-96f4-68a92f98a1c1 tempest-VolumesGetTest-1167943284 None] Lock "cinder-0f4ddd47-3ed6-422c-991f-b0f6ea5a08f9-delete_volume" released by "delete_volume" :: held 2.172s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:17:49 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-a558e6df-052a-466a-af9b-4285b528284a tempest-VolumesGetTest-1167943284 None] Acquiring lock "cinder-4d2b1c55-3e3b-4398-94e6-2b2de531bdc9-delete_volume" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:17:49 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-a558e6df-052a-466a-af9b-4285b528284a tempest-VolumesGetTest-1167943284 None] Lock "cinder-4d2b1c55-3e3b-4398-94e6-2b2de531bdc9-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:17:49 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-a558e6df-052a-466a-af9b-4285b528284a tempest-VolumesGetTest-1167943284 None] Acquiring lock "cinder-quobyte-4d2b1c55-3e3b-4398-94e6-2b2de531bdc9" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:17:49 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-a558e6df-052a-466a-af9b-4285b528284a tempest-VolumesGetTest-1167943284 None] Lock "cinder-quobyte-4d2b1c55-3e3b-4398-94e6-2b2de531bdc9" acquired by "delete_volume" :: waited 0.022s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:17:49 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc1794e0-e7d1-49de-82ce-5053243b6cf0]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:17:49 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-a558e6df-052a-466a-af9b-4285b528284a tempest-VolumesGetTest-1167943284 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-4d2b1c55-3e3b-4398-94e6-2b2de531bdc9 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:17:49 devstack sudo[94929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-4d2b1c55-3e3b-4398-94e6-2b2de531bdc9 Jul 31 12:17:49 devstack sudo[94929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:17:50 devstack sudo[94929]: pam_unix(sudo:session): session closed for user root Jul 31 12:17:50 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-a558e6df-052a-466a-af9b-4285b528284a tempest-VolumesGetTest-1167943284 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-4d2b1c55-3e3b-4398-94e6-2b2de531bdc9" returned: 0 in 0.564s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:17:50 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-a558e6df-052a-466a-af9b-4285b528284a tempest-VolumesGetTest-1167943284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-4d2b1c55-3e3b-4398-94e6-2b2de531bdc9 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:17:50 devstack sudo[94934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-4d2b1c55-3e3b-4398-94e6-2b2de531bdc9 Jul 31 12:17:50 devstack sudo[94934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:17:50 devstack sudo[94934]: pam_unix(sudo:session): session closed for user root Jul 31 12:17:50 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-a558e6df-052a-466a-af9b-4285b528284a tempest-VolumesGetTest-1167943284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-4d2b1c55-3e3b-4398-94e6-2b2de531bdc9" returned: 0 in 0.338s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:17:50 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-a558e6df-052a-466a-af9b-4285b528284a tempest-VolumesGetTest-1167943284 None] Lock "cinder-quobyte-4d2b1c55-3e3b-4398-94e6-2b2de531bdc9" released by "delete_volume" :: held 1.086s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:17:50 devstack cinder-volume[89182]: DEBUG cinder.quota [None req-a558e6df-052a-466a-af9b-4285b528284a tempest-VolumesGetTest-1167943284 None] Created reservations ['620d2f0e-b990-49ef-a86c-7c78a5afa781', 'ccc2bffc-e60b-420d-8f08-6e69d22ba77d', '6331966e-ada4-43a9-b673-401ad2b7d593', 'be3b95bf-6cf4-4ec4-a67d-df5d1c2a29be'] {{(pid=89182) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 12:17:50 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-a558e6df-052a-466a-af9b-4285b528284a tempest-VolumesGetTest-1167943284 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:17:50 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-a558e6df-052a-466a-af9b-4285b528284a tempest-VolumesGetTest-1167943284 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:17:50 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-a558e6df-052a-466a-af9b-4285b528284a tempest-VolumesGetTest-1167943284 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:17:50 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-a558e6df-052a-466a-af9b-4285b528284a tempest-VolumesGetTest-1167943284 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:17:50 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-a558e6df-052a-466a-af9b-4285b528284a tempest-VolumesGetTest-1167943284 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:17:50 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-a558e6df-052a-466a-af9b-4285b528284a tempest-VolumesGetTest-1167943284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:17:50 devstack sudo[94938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 Jul 31 12:17:50 devstack sudo[94938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:17:50 devstack sudo[94938]: pam_unix(sudo:session): session closed for user root Jul 31 12:17:50 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-a558e6df-052a-466a-af9b-4285b528284a tempest-VolumesGetTest-1167943284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2" returned: 0 in 0.352s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:17:50 devstack cinder-volume[89182]: DEBUG cinder.manager [None req-a558e6df-052a-466a-af9b-4285b528284a tempest-VolumesGetTest-1167943284 None] Notifying Schedulers of capabilities ... {{(pid=89182) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 12:17:50 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-a558e6df-052a-466a-af9b-4285b528284a tempest-VolumesGetTest-1167943284 None] Deleted volume successfully. Jul 31 12:17:51 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-a558e6df-052a-466a-af9b-4285b528284a tempest-VolumesGetTest-1167943284 None] Lock "cinder-4d2b1c55-3e3b-4398-94e6-2b2de531bdc9-delete_volume" released by "delete_volume" :: held 1.748s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:17:52 devstack cinder-volume[89182]: DEBUG cinder.volume.flows.manager.create_volume [None req-64264d57-9dda-4292-874d-b07835f86d3d tempest-VolumesGetTest-1167943284 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89182) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 12:17:52 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-64264d57-9dda-4292-874d-b07835f86d3d tempest-VolumesGetTest-1167943284 None] Flow 'volume_create_manager' (dc5d05e3-de67-4166-a161-a5a7d0a63230) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:17:52 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-64264d57-9dda-4292-874d-b07835f86d3d tempest-VolumesGetTest-1167943284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff6389c9-b382-4874-bfb4-23a96b71e270) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:17:52 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-64264d57-9dda-4292-874d-b07835f86d3d tempest-VolumesGetTest-1167943284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff6389c9-b382-4874-bfb4-23a96b71e270) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:17:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1291585154',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea82cb3e-708d-4c57-baf5-e2899d07b9c7,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='3bfd8f27aa9442a384d65adca3b284dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:17:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:17:53Z,use_quota=True,user_id='219264511ea247d78c4075409a489eff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:17:52 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-64264d57-9dda-4292-874d-b07835f86d3d tempest-VolumesGetTest-1167943284 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (657597de-67ed-4a00-9d08-47a62be87fd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:17:52 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-64264d57-9dda-4292-874d-b07835f86d3d tempest-VolumesGetTest-1167943284 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (657597de-67ed-4a00-9d08-47a62be87fd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:17:52 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-64264d57-9dda-4292-874d-b07835f86d3d tempest-VolumesGetTest-1167943284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db2e6b00-906b-4c79-9c3d-224faef7c135) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:17:52 devstack cinder-volume[89182]: DEBUG cinder.image.glance [None req-64264d57-9dda-4292-874d-b07835f86d3d tempest-VolumesGetTest-1167943284 None] Creating Keystone auth plugin from conf {{(pid=89182) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 31 12:17:53 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-64264d57-9dda-4292-874d-b07835f86d3d tempest-VolumesGetTest-1167943284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db2e6b00-906b-4c79-9c3d-224faef7c135) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'ea82cb3e-708d-4c57-baf5-e2899d07b9c7', 'volume_name': 'volume-ea82cb3e-708d-4c57-baf5-e2899d07b9c7', 'volume_size': 1, 'image_id': '4cbd0fd2-77a8-43ca-bc93-b0249d6daea0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4cbd0fd2-77a8-43ca-bc93-b0249d6daea0', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3f77cb0dad9a46948c9357c65b22aef5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4cbd0fd2-77a8-43ca-bc93-b0249d6daea0', 'created_at': datetime.datetime(2026, 7, 31, 10, 8, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 31, 10, 8, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4cbd0fd2-77a8-43ca-bc93-b0249d6daea0/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:17:53 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-64264d57-9dda-4292-874d-b07835f86d3d tempest-VolumesGetTest-1167943284 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c368b408-b80b-4326-9b3d-feb03dd86bc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:17:53 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-64264d57-9dda-4292-874d-b07835f86d3d tempest-VolumesGetTest-1167943284 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c368b408-b80b-4326-9b3d-feb03dd86bc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:17:53 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-64264d57-9dda-4292-874d-b07835f86d3d tempest-VolumesGetTest-1167943284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d068d22-7d6f-46b5-9fe5-9e868984aa36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:17:53 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-64264d57-9dda-4292-874d-b07835f86d3d tempest-VolumesGetTest-1167943284 None] Volume ea82cb3e-708d-4c57-baf5-e2899d07b9c7: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-ea82cb3e-708d-4c57-baf5-e2899d07b9c7', 'volume_size': 1, 'image_id': '4cbd0fd2-77a8-43ca-bc93-b0249d6daea0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4cbd0fd2-77a8-43ca-bc93-b0249d6daea0', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3f77cb0dad9a46948c9357c65b22aef5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4cbd0fd2-77a8-43ca-bc93-b0249d6daea0', 'created_at': datetime.datetime(2026, 7, 31, 10, 8, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 31, 10, 8, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4cbd0fd2-77a8-43ca-bc93-b0249d6daea0/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 31 12:17:53 devstack cinder-volume[89182]: DEBUG cinder.volume.flows.manager.create_volume [None req-64264d57-9dda-4292-874d-b07835f86d3d tempest-VolumesGetTest-1167943284 None] Trying to clone ea82cb3e-708d-4c57-baf5-e2899d07b9c7 from image 4cbd0fd2-77a8-43ca-bc93-b0249d6daea0 at location (None, [{'url': 'file:///opt/stack/data/glance/images/4cbd0fd2-77a8-43ca-bc93-b0249d6daea0', 'metadata': {}}]). {{(pid=89182) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 31 12:17:53 devstack cinder-volume[89182]: DEBUG cinder.image.image_utils [None req-64264d57-9dda-4292-874d-b07835f86d3d tempest-VolumesGetTest-1167943284 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_4cbd0fd2-77a8-43ca-bc93-b0249d6daea0_tezf3ez5devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=89182) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 31 12:17:53 devstack cinder-volume[89182]: INFO cinder.image.image_utils [None req-64264d57-9dda-4292-874d-b07835f86d3d tempest-VolumesGetTest-1167943284 None] Image download 20.69 MB at 20.69 MB/s Jul 31 12:17:53 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[2baf4f2e-b66d-4dd3-aad0-0b24638752f5]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:17:53 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-64264d57-9dda-4292-874d-b07835f86d3d tempest-VolumesGetTest-1167943284 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4cbd0fd2-77a8-43ca-bc93-b0249d6daea0_tezf3ez5devstack@QuobyteHD {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:17:53 devstack cinder-volume[89182]: DEBUG cinder.volume.flows.manager.create_volume [None req-7753d2e6-de54-4c67-9cd1-f2c3890591cd tempest-VolumesImageMetadata-729283616 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89182) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 12:17:53 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-7753d2e6-de54-4c67-9cd1-f2c3890591cd tempest-VolumesImageMetadata-729283616 None] Flow 'volume_create_manager' (9f4d29b9-4754-4b7f-9e7b-d43b1a59350c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:17:53 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-7753d2e6-de54-4c67-9cd1-f2c3890591cd tempest-VolumesImageMetadata-729283616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d22cb210-0cd4-4c65-8810-08fabfcab48d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:17:53 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-7753d2e6-de54-4c67-9cd1-f2c3890591cd tempest-VolumesImageMetadata-729283616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d22cb210-0cd4-4c65-8810-08fabfcab48d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:17:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-849282757',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a91a426-c787-405d-a9fc-c6bff4d9bc59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0218ddc89fec44899297fd60199a068e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:17:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:17:54Z,use_quota=True,user_id='91c5b250a11148c281cfc333807344cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:17:53 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-7753d2e6-de54-4c67-9cd1-f2c3890591cd tempest-VolumesImageMetadata-729283616 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69f149bb-7c9d-4c2c-b4f5-48c92ebc5619) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:17:53 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-7753d2e6-de54-4c67-9cd1-f2c3890591cd tempest-VolumesImageMetadata-729283616 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69f149bb-7c9d-4c2c-b4f5-48c92ebc5619) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:17:53 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-7753d2e6-de54-4c67-9cd1-f2c3890591cd tempest-VolumesImageMetadata-729283616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c286ab62-54b8-4d88-af6f-eea5f5b62879) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:17:53 devstack cinder-volume[89182]: DEBUG cinder.image.glance [None req-7753d2e6-de54-4c67-9cd1-f2c3890591cd tempest-VolumesImageMetadata-729283616 None] Creating Keystone auth plugin from conf {{(pid=89182) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 31 12:17:53 devstack sudo[94943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4cbd0fd2-77a8-43ca-bc93-b0249d6daea0_tezf3ez5devstack@QuobyteHD Jul 31 12:17:53 devstack sudo[94943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:17:54 devstack sudo[94943]: pam_unix(sudo:session): session closed for user root Jul 31 12:17:54 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-64264d57-9dda-4292-874d-b07835f86d3d tempest-VolumesGetTest-1167943284 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4cbd0fd2-77a8-43ca-bc93-b0249d6daea0_tezf3ez5devstack@QuobyteHD" returned: 0 in 0.430s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:17:54 devstack cinder-volume[89182]: DEBUG cinder.image.image_utils [None req-64264d57-9dda-4292-874d-b07835f86d3d tempest-VolumesGetTest-1167943284 None] Temporary image 4cbd0fd2-77a8-43ca-bc93-b0249d6daea0 is fetched for user 219264511ea247d78c4075409a489eff. {{(pid=89182) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 31 12:17:54 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[12cc4192-a883-4bef-9795-37a61bbfa705]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:17:54 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-64264d57-9dda-4292-874d-b07835f86d3d tempest-VolumesGetTest-1167943284 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4cbd0fd2-77a8-43ca-bc93-b0249d6daea0_tezf3ez5devstack@QuobyteHD {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:17:54 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-7753d2e6-de54-4c67-9cd1-f2c3890591cd tempest-VolumesImageMetadata-729283616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c286ab62-54b8-4d88-af6f-eea5f5b62879) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '2a91a426-c787-405d-a9fc-c6bff4d9bc59', 'volume_name': 'volume-2a91a426-c787-405d-a9fc-c6bff4d9bc59', 'volume_size': 1, 'image_id': '4cbd0fd2-77a8-43ca-bc93-b0249d6daea0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4cbd0fd2-77a8-43ca-bc93-b0249d6daea0', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3f77cb0dad9a46948c9357c65b22aef5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4cbd0fd2-77a8-43ca-bc93-b0249d6daea0', 'created_at': datetime.datetime(2026, 7, 31, 10, 8, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 31, 10, 8, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4cbd0fd2-77a8-43ca-bc93-b0249d6daea0/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:17:54 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-7753d2e6-de54-4c67-9cd1-f2c3890591cd tempest-VolumesImageMetadata-729283616 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9286dc5-4711-4fd3-a72e-0222e5c93302) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:17:54 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-7753d2e6-de54-4c67-9cd1-f2c3890591cd tempest-VolumesImageMetadata-729283616 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9286dc5-4711-4fd3-a72e-0222e5c93302) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:17:54 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-7753d2e6-de54-4c67-9cd1-f2c3890591cd tempest-VolumesImageMetadata-729283616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2a1dc43-0f95-4a6f-93c5-d4c2958e629c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:17:54 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-7753d2e6-de54-4c67-9cd1-f2c3890591cd tempest-VolumesImageMetadata-729283616 None] Volume 2a91a426-c787-405d-a9fc-c6bff4d9bc59: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-2a91a426-c787-405d-a9fc-c6bff4d9bc59', 'volume_size': 1, 'image_id': '4cbd0fd2-77a8-43ca-bc93-b0249d6daea0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4cbd0fd2-77a8-43ca-bc93-b0249d6daea0', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3f77cb0dad9a46948c9357c65b22aef5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4cbd0fd2-77a8-43ca-bc93-b0249d6daea0', 'created_at': datetime.datetime(2026, 7, 31, 10, 8, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 31, 10, 8, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4cbd0fd2-77a8-43ca-bc93-b0249d6daea0/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 31 12:17:54 devstack cinder-volume[89182]: DEBUG cinder.volume.flows.manager.create_volume [None req-7753d2e6-de54-4c67-9cd1-f2c3890591cd tempest-VolumesImageMetadata-729283616 None] Trying to clone 2a91a426-c787-405d-a9fc-c6bff4d9bc59 from image 4cbd0fd2-77a8-43ca-bc93-b0249d6daea0 at location (None, [{'url': 'file:///opt/stack/data/glance/images/4cbd0fd2-77a8-43ca-bc93-b0249d6daea0', 'metadata': {}}]). {{(pid=89182) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 31 12:17:54 devstack sudo[94948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4cbd0fd2-77a8-43ca-bc93-b0249d6daea0_tezf3ez5devstack@QuobyteHD Jul 31 12:17:54 devstack sudo[94948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:17:54 devstack sudo[94948]: pam_unix(sudo:session): session closed for user root Jul 31 12:17:54 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-64264d57-9dda-4292-874d-b07835f86d3d tempest-VolumesGetTest-1167943284 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4cbd0fd2-77a8-43ca-bc93-b0249d6daea0_tezf3ez5devstack@QuobyteHD" returned: 0 in 0.429s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:17:54 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-64264d57-9dda-4292-874d-b07835f86d3d tempest-VolumesGetTest-1167943284 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:17:54 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-64264d57-9dda-4292-874d-b07835f86d3d tempest-VolumesGetTest-1167943284 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:17:54 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-64264d57-9dda-4292-874d-b07835f86d3d tempest-VolumesGetTest-1167943284 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:17:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1291585154',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea82cb3e-708d-4c57-baf5-e2899d07b9c7,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='3bfd8f27aa9442a384d65adca3b284dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:17:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:17:53Z,use_quota=True,user_id='219264511ea247d78c4075409a489eff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)}" {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 12:17:54 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-64264d57-9dda-4292-874d-b07835f86d3d tempest-VolumesGetTest-1167943284 None] Creating volume ea82cb3e-708d-4c57-baf5-e2899d07b9c7 {{(pid=89182) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 12:17:54 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-64264d57-9dda-4292-874d-b07835f86d3d tempest-VolumesGetTest-1167943284 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:17:54 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-64264d57-9dda-4292-874d-b07835f86d3d tempest-VolumesGetTest-1167943284 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:17:54 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-64264d57-9dda-4292-874d-b07835f86d3d tempest-VolumesGetTest-1167943284 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:17:54 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-64264d57-9dda-4292-874d-b07835f86d3d tempest-VolumesGetTest-1167943284 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:17:54 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-64264d57-9dda-4292-874d-b07835f86d3d tempest-VolumesGetTest-1167943284 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:17:54 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-64264d57-9dda-4292-874d-b07835f86d3d tempest-VolumesGetTest-1167943284 None] Selected osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 as target Quobyte volume. {{(pid=89182) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 12:17:54 devstack cinder-volume[89182]: INFO cinder.volume.drivers.remotefs [None req-64264d57-9dda-4292-874d-b07835f86d3d tempest-VolumesGetTest-1167943284 None] casted to osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 Jul 31 12:17:54 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-64264d57-9dda-4292-874d-b07835f86d3d tempest-VolumesGetTest-1167943284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-ea82cb3e-708d-4c57-baf5-e2899d07b9c7 1073741824 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:17:54 devstack sudo[94954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-ea82cb3e-708d-4c57-baf5-e2899d07b9c7 1073741824 Jul 31 12:17:54 devstack sudo[94954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:17:55 devstack cinder-volume[89182]: DEBUG cinder.image.image_utils [None req-7753d2e6-de54-4c67-9cd1-f2c3890591cd tempest-VolumesImageMetadata-729283616 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_4cbd0fd2-77a8-43ca-bc93-b0249d6daea0_876rt5nudevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=89182) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 31 12:17:55 devstack cinder-volume[89182]: INFO cinder.image.image_utils [None req-7753d2e6-de54-4c67-9cd1-f2c3890591cd tempest-VolumesImageMetadata-729283616 None] Image download 20.69 MB at 20.69 MB/s Jul 31 12:17:55 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7b69335-aa78-4981-a304-a6495b96caff]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:17:55 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-7753d2e6-de54-4c67-9cd1-f2c3890591cd tempest-VolumesImageMetadata-729283616 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4cbd0fd2-77a8-43ca-bc93-b0249d6daea0_876rt5nudevstack@QuobyteHD {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:17:55 devstack sudo[94957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4cbd0fd2-77a8-43ca-bc93-b0249d6daea0_876rt5nudevstack@QuobyteHD Jul 31 12:17:55 devstack sudo[94957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:17:55 devstack sudo[94954]: pam_unix(sudo:session): session closed for user root Jul 31 12:17:55 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-64264d57-9dda-4292-874d-b07835f86d3d tempest-VolumesGetTest-1167943284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-ea82cb3e-708d-4c57-baf5-e2899d07b9c7 1073741824" returned: 0 in 0.593s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:17:55 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-64264d57-9dda-4292-874d-b07835f86d3d tempest-VolumesGetTest-1167943284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-ea82cb3e-708d-4c57-baf5-e2899d07b9c7 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:17:55 devstack sudo[94967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-ea82cb3e-708d-4c57-baf5-e2899d07b9c7 Jul 31 12:17:55 devstack sudo[94967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:17:55 devstack sudo[94957]: pam_unix(sudo:session): session closed for user root Jul 31 12:17:55 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-7753d2e6-de54-4c67-9cd1-f2c3890591cd tempest-VolumesImageMetadata-729283616 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4cbd0fd2-77a8-43ca-bc93-b0249d6daea0_876rt5nudevstack@QuobyteHD" returned: 0 in 0.385s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:17:55 devstack cinder-volume[89182]: DEBUG cinder.image.image_utils [None req-7753d2e6-de54-4c67-9cd1-f2c3890591cd tempest-VolumesImageMetadata-729283616 None] Temporary image 4cbd0fd2-77a8-43ca-bc93-b0249d6daea0 is fetched for user 91c5b250a11148c281cfc333807344cf. {{(pid=89182) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 31 12:17:55 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2f0b136-a767-4f81-ae55-d35e8a56a5cd]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:17:55 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-7753d2e6-de54-4c67-9cd1-f2c3890591cd tempest-VolumesImageMetadata-729283616 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4cbd0fd2-77a8-43ca-bc93-b0249d6daea0_876rt5nudevstack@QuobyteHD {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:17:55 devstack sudo[94969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4cbd0fd2-77a8-43ca-bc93-b0249d6daea0_876rt5nudevstack@QuobyteHD Jul 31 12:17:55 devstack sudo[94969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:17:55 devstack sudo[94967]: pam_unix(sudo:session): session closed for user root Jul 31 12:17:55 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-64264d57-9dda-4292-874d-b07835f86d3d tempest-VolumesGetTest-1167943284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-ea82cb3e-708d-4c57-baf5-e2899d07b9c7" returned: 0 in 0.380s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:17:55 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-64264d57-9dda-4292-874d-b07835f86d3d tempest-VolumesGetTest-1167943284 None] <== create_volume: return (1037ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'} {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 12:17:55 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-64264d57-9dda-4292-874d-b07835f86d3d tempest-VolumesGetTest-1167943284 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.041s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:17:55 devstack cinder-volume[89182]: DEBUG cinder.volume.volume_utils [None req-64264d57-9dda-4292-874d-b07835f86d3d tempest-VolumesGetTest-1167943284 None] Attempting download of 4cbd0fd2-77a8-43ca-bc93-b0249d6daea0 ((None, [{'url': 'file:///opt/stack/data/glance/images/4cbd0fd2-77a8-43ca-bc93-b0249d6daea0', 'metadata': {}}])) to volume ea82cb3e-708d-4c57-baf5-e2899d07b9c7. {{(pid=89182) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 31 12:17:55 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[52ba802f-12e7-4820-9819-b8ecf5abbdbd]: (4, 'raw') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:17:55 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-64264d57-9dda-4292-874d-b07835f86d3d tempest-VolumesGetTest-1167943284 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4cbd0fd2-77a8-43ca-bc93-b0249d6daea0_g9ge0w5l {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:17:56 devstack sudo[94969]: pam_unix(sudo:session): session closed for user root Jul 31 12:17:56 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-7753d2e6-de54-4c67-9cd1-f2c3890591cd tempest-VolumesImageMetadata-729283616 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4cbd0fd2-77a8-43ca-bc93-b0249d6daea0_876rt5nudevstack@QuobyteHD" returned: 0 in 0.372s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:17:56 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-7753d2e6-de54-4c67-9cd1-f2c3890591cd tempest-VolumesImageMetadata-729283616 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:17:56 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-7753d2e6-de54-4c67-9cd1-f2c3890591cd tempest-VolumesImageMetadata-729283616 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:17:56 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-7753d2e6-de54-4c67-9cd1-f2c3890591cd tempest-VolumesImageMetadata-729283616 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:17:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-849282757',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a91a426-c787-405d-a9fc-c6bff4d9bc59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0218ddc89fec44899297fd60199a068e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:17:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:17:54Z,use_quota=True,user_id='91c5b250a11148c281cfc333807344cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)}" {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 12:17:56 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-7753d2e6-de54-4c67-9cd1-f2c3890591cd tempest-VolumesImageMetadata-729283616 None] Creating volume 2a91a426-c787-405d-a9fc-c6bff4d9bc59 {{(pid=89182) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 12:17:56 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-7753d2e6-de54-4c67-9cd1-f2c3890591cd tempest-VolumesImageMetadata-729283616 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:17:56 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-7753d2e6-de54-4c67-9cd1-f2c3890591cd tempest-VolumesImageMetadata-729283616 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:17:56 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-7753d2e6-de54-4c67-9cd1-f2c3890591cd tempest-VolumesImageMetadata-729283616 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:17:56 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-7753d2e6-de54-4c67-9cd1-f2c3890591cd tempest-VolumesImageMetadata-729283616 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:17:56 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-7753d2e6-de54-4c67-9cd1-f2c3890591cd tempest-VolumesImageMetadata-729283616 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:17:56 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-7753d2e6-de54-4c67-9cd1-f2c3890591cd tempest-VolumesImageMetadata-729283616 None] Selected osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 as target Quobyte volume. {{(pid=89182) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 12:17:56 devstack cinder-volume[89182]: INFO cinder.volume.drivers.remotefs [None req-7753d2e6-de54-4c67-9cd1-f2c3890591cd tempest-VolumesImageMetadata-729283616 None] casted to osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 Jul 31 12:17:56 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-7753d2e6-de54-4c67-9cd1-f2c3890591cd tempest-VolumesImageMetadata-729283616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-2a91a426-c787-405d-a9fc-c6bff4d9bc59 1073741824 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:17:56 devstack sudo[94973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4cbd0fd2-77a8-43ca-bc93-b0249d6daea0_g9ge0w5l Jul 31 12:17:56 devstack sudo[94977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-2a91a426-c787-405d-a9fc-c6bff4d9bc59 1073741824 Jul 31 12:17:56 devstack sudo[94973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:17:56 devstack sudo[94977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:17:56 devstack sudo[94973]: pam_unix(sudo:session): session closed for user root Jul 31 12:17:56 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-64264d57-9dda-4292-874d-b07835f86d3d tempest-VolumesGetTest-1167943284 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4cbd0fd2-77a8-43ca-bc93-b0249d6daea0_g9ge0w5l" returned: 0 in 0.426s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:17:56 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-64264d57-9dda-4292-874d-b07835f86d3d tempest-VolumesGetTest-1167943284 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4cbd0fd2-77a8-43ca-bc93-b0249d6daea0_g9ge0w5l {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:17:56 devstack sudo[94985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4cbd0fd2-77a8-43ca-bc93-b0249d6daea0_g9ge0w5l Jul 31 12:17:56 devstack sudo[94985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:17:56 devstack sudo[94977]: pam_unix(sudo:session): session closed for user root Jul 31 12:17:56 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-7753d2e6-de54-4c67-9cd1-f2c3890591cd tempest-VolumesImageMetadata-729283616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-2a91a426-c787-405d-a9fc-c6bff4d9bc59 1073741824" returned: 0 in 0.534s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:17:56 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-7753d2e6-de54-4c67-9cd1-f2c3890591cd tempest-VolumesImageMetadata-729283616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-2a91a426-c787-405d-a9fc-c6bff4d9bc59 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:17:56 devstack sudo[94988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-2a91a426-c787-405d-a9fc-c6bff4d9bc59 Jul 31 12:17:56 devstack sudo[94988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:17:56 devstack sudo[94985]: pam_unix(sudo:session): session closed for user root Jul 31 12:17:56 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-64264d57-9dda-4292-874d-b07835f86d3d tempest-VolumesGetTest-1167943284 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4cbd0fd2-77a8-43ca-bc93-b0249d6daea0_g9ge0w5l" returned: 1 in 0.551s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:17:56 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-64264d57-9dda-4292-874d-b07835f86d3d tempest-VolumesGetTest-1167943284 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4cbd0fd2-77a8-43ca-bc93-b0249d6daea0_g9ge0w5l' failed. Not Retrying. {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 31 12:17:56 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[8513248b-40a3-430f-9375-da8b50f3161b]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:17:56 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-64264d57-9dda-4292-874d-b07835f86d3d tempest-VolumesGetTest-1167943284 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4cbd0fd2-77a8-43ca-bc93-b0249d6daea0_tezf3ez5devstack@QuobyteHD {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:17:57 devstack sudo[94992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4cbd0fd2-77a8-43ca-bc93-b0249d6daea0_tezf3ez5devstack@QuobyteHD Jul 31 12:17:57 devstack sudo[94992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:17:57 devstack sudo[94988]: pam_unix(sudo:session): session closed for user root Jul 31 12:17:57 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-7753d2e6-de54-4c67-9cd1-f2c3890591cd tempest-VolumesImageMetadata-729283616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-2a91a426-c787-405d-a9fc-c6bff4d9bc59" returned: 0 in 0.466s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:17:57 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-7753d2e6-de54-4c67-9cd1-f2c3890591cd tempest-VolumesImageMetadata-729283616 None] <== create_volume: return (1045ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'} {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 12:17:57 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-7753d2e6-de54-4c67-9cd1-f2c3890591cd tempest-VolumesImageMetadata-729283616 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.049s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:17:57 devstack cinder-volume[89182]: DEBUG cinder.volume.volume_utils [None req-7753d2e6-de54-4c67-9cd1-f2c3890591cd tempest-VolumesImageMetadata-729283616 None] Attempting download of 4cbd0fd2-77a8-43ca-bc93-b0249d6daea0 ((None, [{'url': 'file:///opt/stack/data/glance/images/4cbd0fd2-77a8-43ca-bc93-b0249d6daea0', 'metadata': {}}])) to volume 2a91a426-c787-405d-a9fc-c6bff4d9bc59. {{(pid=89182) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 31 12:17:57 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f832d27-6858-4f0d-b4d0-e12008cd07be]: (4, 'raw') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:17:57 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-7753d2e6-de54-4c67-9cd1-f2c3890591cd tempest-VolumesImageMetadata-729283616 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4cbd0fd2-77a8-43ca-bc93-b0249d6daea0_1d9tt04f {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:17:57 devstack sudo[94992]: pam_unix(sudo:session): session closed for user root Jul 31 12:17:57 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-64264d57-9dda-4292-874d-b07835f86d3d tempest-VolumesGetTest-1167943284 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4cbd0fd2-77a8-43ca-bc93-b0249d6daea0_tezf3ez5devstack@QuobyteHD" returned: 0 in 0.379s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:17:57 devstack cinder-volume[89182]: DEBUG cinder.image.image_utils [None req-64264d57-9dda-4292-874d-b07835f86d3d tempest-VolumesGetTest-1167943284 None] 4cbd0fd2-77a8-43ca-bc93-b0249d6daea0 was qcow2, converting to qcow2 {{(pid=89182) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 31 12:17:57 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-64264d57-9dda-4292-874d-b07835f86d3d tempest-VolumesGetTest-1167943284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4cbd0fd2-77a8-43ca-bc93-b0249d6daea0_tezf3ez5devstack@QuobyteHD /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-ea82cb3e-708d-4c57-baf5-e2899d07b9c7 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:17:57 devstack sudo[95000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4cbd0fd2-77a8-43ca-bc93-b0249d6daea0_tezf3ez5devstack@QuobyteHD /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-ea82cb3e-708d-4c57-baf5-e2899d07b9c7 Jul 31 12:17:57 devstack sudo[95000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:17:57 devstack sudo[94995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4cbd0fd2-77a8-43ca-bc93-b0249d6daea0_1d9tt04f Jul 31 12:17:57 devstack sudo[94995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:17:57 devstack sudo[94995]: pam_unix(sudo:session): session closed for user root Jul 31 12:17:57 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-7753d2e6-de54-4c67-9cd1-f2c3890591cd tempest-VolumesImageMetadata-729283616 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4cbd0fd2-77a8-43ca-bc93-b0249d6daea0_1d9tt04f" returned: 0 in 0.475s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:17:57 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-7753d2e6-de54-4c67-9cd1-f2c3890591cd tempest-VolumesImageMetadata-729283616 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4cbd0fd2-77a8-43ca-bc93-b0249d6daea0_1d9tt04f {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:17:57 devstack sudo[95009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4cbd0fd2-77a8-43ca-bc93-b0249d6daea0_1d9tt04f Jul 31 12:17:57 devstack sudo[95009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:17:58 devstack sudo[95009]: pam_unix(sudo:session): session closed for user root Jul 31 12:17:58 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-7753d2e6-de54-4c67-9cd1-f2c3890591cd tempest-VolumesImageMetadata-729283616 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4cbd0fd2-77a8-43ca-bc93-b0249d6daea0_1d9tt04f" returned: 1 in 0.440s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:17:58 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-7753d2e6-de54-4c67-9cd1-f2c3890591cd tempest-VolumesImageMetadata-729283616 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4cbd0fd2-77a8-43ca-bc93-b0249d6daea0_1d9tt04f' failed. Not Retrying. {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 31 12:17:58 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[dad9af49-f9a5-4846-aabd-e01e0691f557]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:17:58 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-7753d2e6-de54-4c67-9cd1-f2c3890591cd tempest-VolumesImageMetadata-729283616 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4cbd0fd2-77a8-43ca-bc93-b0249d6daea0_876rt5nudevstack@QuobyteHD {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:17:58 devstack sudo[95014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4cbd0fd2-77a8-43ca-bc93-b0249d6daea0_876rt5nudevstack@QuobyteHD Jul 31 12:17:58 devstack sudo[95014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:17:58 devstack sudo[95014]: pam_unix(sudo:session): session closed for user root Jul 31 12:17:58 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-7753d2e6-de54-4c67-9cd1-f2c3890591cd tempest-VolumesImageMetadata-729283616 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4cbd0fd2-77a8-43ca-bc93-b0249d6daea0_876rt5nudevstack@QuobyteHD" returned: 0 in 0.416s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:17:58 devstack cinder-volume[89182]: DEBUG cinder.image.image_utils [None req-7753d2e6-de54-4c67-9cd1-f2c3890591cd tempest-VolumesImageMetadata-729283616 None] 4cbd0fd2-77a8-43ca-bc93-b0249d6daea0 was qcow2, converting to qcow2 {{(pid=89182) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 31 12:17:58 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-7753d2e6-de54-4c67-9cd1-f2c3890591cd tempest-VolumesImageMetadata-729283616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4cbd0fd2-77a8-43ca-bc93-b0249d6daea0_876rt5nudevstack@QuobyteHD /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-2a91a426-c787-405d-a9fc-c6bff4d9bc59 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:17:58 devstack sudo[95019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4cbd0fd2-77a8-43ca-bc93-b0249d6daea0_876rt5nudevstack@QuobyteHD /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-2a91a426-c787-405d-a9fc-c6bff4d9bc59 Jul 31 12:17:58 devstack sudo[95019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:17:59 devstack sudo[95000]: pam_unix(sudo:session): session closed for user root Jul 31 12:17:59 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-64264d57-9dda-4292-874d-b07835f86d3d tempest-VolumesGetTest-1167943284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4cbd0fd2-77a8-43ca-bc93-b0249d6daea0_tezf3ez5devstack@QuobyteHD /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-ea82cb3e-708d-4c57-baf5-e2899d07b9c7" returned: 0 in 2.377s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:17:59 devstack cinder-volume[89182]: DEBUG cinder.image.image_utils [None req-64264d57-9dda-4292-874d-b07835f86d3d tempest-VolumesGetTest-1167943284 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_4cbd0fd2-77a8-43ca-bc93-b0249d6daea0_tezf3ez5devstack@QuobyteHD, size 112.00 MB, duration 2.38 sec, destination /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-ea82cb3e-708d-4c57-baf5-e2899d07b9c7 {{(pid=89182) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 31 12:17:59 devstack cinder-volume[89182]: INFO cinder.image.image_utils [None req-64264d57-9dda-4292-874d-b07835f86d3d tempest-VolumesGetTest-1167943284 None] Converted 112.00 MB image at 47.09 MB/s Jul 31 12:17:59 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-64264d57-9dda-4292-874d-b07835f86d3d tempest-VolumesGetTest-1167943284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-ea82cb3e-708d-4c57-baf5-e2899d07b9c7 1G {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:17:59 devstack sudo[95028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-ea82cb3e-708d-4c57-baf5-e2899d07b9c7 1G Jul 31 12:17:59 devstack sudo[95028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:18:00 devstack sudo[95028]: pam_unix(sudo:session): session closed for user root Jul 31 12:18:00 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-64264d57-9dda-4292-874d-b07835f86d3d tempest-VolumesGetTest-1167943284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-ea82cb3e-708d-4c57-baf5-e2899d07b9c7 1G" returned: 0 in 0.371s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:18:00 devstack cinder-volume[89182]: DEBUG cinder.volume.volume_utils [None req-64264d57-9dda-4292-874d-b07835f86d3d tempest-VolumesGetTest-1167943284 None] Downloaded image 4cbd0fd2-77a8-43ca-bc93-b0249d6daea0 ((None, [{'url': 'file:///opt/stack/data/glance/images/4cbd0fd2-77a8-43ca-bc93-b0249d6daea0', 'metadata': {}}])) to volume ea82cb3e-708d-4c57-baf5-e2899d07b9c7 successfully. {{(pid=89182) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 31 12:18:00 devstack cinder-volume[89182]: DEBUG cinder.image.image_utils [None req-64264d57-9dda-4292-874d-b07835f86d3d tempest-VolumesGetTest-1167943284 None] Temporary image 4cbd0fd2-77a8-43ca-bc93-b0249d6daea0 for user 219264511ea247d78c4075409a489eff is deleted. {{(pid=89182) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 31 12:18:00 devstack cinder-volume[89182]: DEBUG cinder.volume.volume_utils [None req-64264d57-9dda-4292-874d-b07835f86d3d tempest-VolumesGetTest-1167943284 None] Marking volume ea82cb3e-708d-4c57-baf5-e2899d07b9c7 as bootable. {{(pid=89182) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 31 12:18:00 devstack cinder-volume[89182]: DEBUG cinder.volume.flows.manager.create_volume [None req-64264d57-9dda-4292-874d-b07835f86d3d tempest-VolumesGetTest-1167943284 None] Copying metadata from image 4cbd0fd2-77a8-43ca-bc93-b0249d6daea0 to ea82cb3e-708d-4c57-baf5-e2899d07b9c7. {{(pid=89182) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 31 12:18:00 devstack cinder-volume[89182]: DEBUG cinder.volume.flows.manager.create_volume [None req-64264d57-9dda-4292-874d-b07835f86d3d tempest-VolumesGetTest-1167943284 None] Creating volume glance metadata for volume ea82cb3e-708d-4c57-baf5-e2899d07b9c7 backed by image 4cbd0fd2-77a8-43ca-bc93-b0249d6daea0 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '4cbd0fd2-77a8-43ca-bc93-b0249d6daea0', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=89182) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 31 12:18:00 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-64264d57-9dda-4292-874d-b07835f86d3d tempest-VolumesGetTest-1167943284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d068d22-7d6f-46b5-9fe5-9e868984aa36) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ea82cb3e-708d-4c57-baf5-e2899d07b9c7', 'volume_size': 1, 'image_id': '4cbd0fd2-77a8-43ca-bc93-b0249d6daea0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4cbd0fd2-77a8-43ca-bc93-b0249d6daea0', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3f77cb0dad9a46948c9357c65b22aef5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4cbd0fd2-77a8-43ca-bc93-b0249d6daea0', 'created_at': datetime.datetime(2026, 7, 31, 10, 8, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 31, 10, 8, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4cbd0fd2-77a8-43ca-bc93-b0249d6daea0/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:18:00 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-64264d57-9dda-4292-874d-b07835f86d3d tempest-VolumesGetTest-1167943284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ffbd1be-ca2a-4375-b449-d828a0f3a505) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:18:00 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-64264d57-9dda-4292-874d-b07835f86d3d tempest-VolumesGetTest-1167943284 None] Volume volume-ea82cb3e-708d-4c57-baf5-e2899d07b9c7 (ea82cb3e-708d-4c57-baf5-e2899d07b9c7): created successfully Jul 31 12:18:00 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-64264d57-9dda-4292-874d-b07835f86d3d tempest-VolumesGetTest-1167943284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ffbd1be-ca2a-4375-b449-d828a0f3a505) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:18:00 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-64264d57-9dda-4292-874d-b07835f86d3d tempest-VolumesGetTest-1167943284 None] Flow 'volume_create_manager' (dc5d05e3-de67-4166-a161-a5a7d0a63230) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:18:00 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-64264d57-9dda-4292-874d-b07835f86d3d tempest-VolumesGetTest-1167943284 None] Created volume successfully. Jul 31 12:18:00 devstack sudo[95019]: pam_unix(sudo:session): session closed for user root Jul 31 12:18:00 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-7753d2e6-de54-4c67-9cd1-f2c3890591cd tempest-VolumesImageMetadata-729283616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4cbd0fd2-77a8-43ca-bc93-b0249d6daea0_876rt5nudevstack@QuobyteHD /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-2a91a426-c787-405d-a9fc-c6bff4d9bc59" returned: 0 in 2.285s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:18:00 devstack cinder-volume[89182]: DEBUG cinder.image.image_utils [None req-7753d2e6-de54-4c67-9cd1-f2c3890591cd tempest-VolumesImageMetadata-729283616 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_4cbd0fd2-77a8-43ca-bc93-b0249d6daea0_876rt5nudevstack@QuobyteHD, size 112.00 MB, duration 2.29 sec, destination /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-2a91a426-c787-405d-a9fc-c6bff4d9bc59 {{(pid=89182) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 31 12:18:00 devstack cinder-volume[89182]: INFO cinder.image.image_utils [None req-7753d2e6-de54-4c67-9cd1-f2c3890591cd tempest-VolumesImageMetadata-729283616 None] Converted 112.00 MB image at 49.00 MB/s Jul 31 12:18:00 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-7753d2e6-de54-4c67-9cd1-f2c3890591cd tempest-VolumesImageMetadata-729283616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-2a91a426-c787-405d-a9fc-c6bff4d9bc59 1G {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:18:00 devstack sudo[95035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-2a91a426-c787-405d-a9fc-c6bff4d9bc59 1G Jul 31 12:18:00 devstack sudo[95035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:18:01 devstack sudo[95035]: pam_unix(sudo:session): session closed for user root Jul 31 12:18:01 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-7753d2e6-de54-4c67-9cd1-f2c3890591cd tempest-VolumesImageMetadata-729283616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-2a91a426-c787-405d-a9fc-c6bff4d9bc59 1G" returned: 0 in 0.349s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:18:01 devstack cinder-volume[89182]: DEBUG cinder.volume.volume_utils [None req-7753d2e6-de54-4c67-9cd1-f2c3890591cd tempest-VolumesImageMetadata-729283616 None] Downloaded image 4cbd0fd2-77a8-43ca-bc93-b0249d6daea0 ((None, [{'url': 'file:///opt/stack/data/glance/images/4cbd0fd2-77a8-43ca-bc93-b0249d6daea0', 'metadata': {}}])) to volume 2a91a426-c787-405d-a9fc-c6bff4d9bc59 successfully. {{(pid=89182) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 31 12:18:01 devstack cinder-volume[89182]: DEBUG cinder.image.image_utils [None req-7753d2e6-de54-4c67-9cd1-f2c3890591cd tempest-VolumesImageMetadata-729283616 None] Temporary image 4cbd0fd2-77a8-43ca-bc93-b0249d6daea0 for user 91c5b250a11148c281cfc333807344cf is deleted. {{(pid=89182) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 31 12:18:01 devstack cinder-volume[89182]: DEBUG cinder.volume.volume_utils [None req-7753d2e6-de54-4c67-9cd1-f2c3890591cd tempest-VolumesImageMetadata-729283616 None] Marking volume 2a91a426-c787-405d-a9fc-c6bff4d9bc59 as bootable. {{(pid=89182) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 31 12:18:01 devstack cinder-volume[89182]: DEBUG cinder.volume.flows.manager.create_volume [None req-7753d2e6-de54-4c67-9cd1-f2c3890591cd tempest-VolumesImageMetadata-729283616 None] Copying metadata from image 4cbd0fd2-77a8-43ca-bc93-b0249d6daea0 to 2a91a426-c787-405d-a9fc-c6bff4d9bc59. {{(pid=89182) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 31 12:18:01 devstack cinder-volume[89182]: DEBUG cinder.volume.flows.manager.create_volume [None req-7753d2e6-de54-4c67-9cd1-f2c3890591cd tempest-VolumesImageMetadata-729283616 None] Creating volume glance metadata for volume 2a91a426-c787-405d-a9fc-c6bff4d9bc59 backed by image 4cbd0fd2-77a8-43ca-bc93-b0249d6daea0 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '4cbd0fd2-77a8-43ca-bc93-b0249d6daea0', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=89182) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 31 12:18:01 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-7753d2e6-de54-4c67-9cd1-f2c3890591cd tempest-VolumesImageMetadata-729283616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2a1dc43-0f95-4a6f-93c5-d4c2958e629c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2a91a426-c787-405d-a9fc-c6bff4d9bc59', 'volume_size': 1, 'image_id': '4cbd0fd2-77a8-43ca-bc93-b0249d6daea0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4cbd0fd2-77a8-43ca-bc93-b0249d6daea0', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3f77cb0dad9a46948c9357c65b22aef5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4cbd0fd2-77a8-43ca-bc93-b0249d6daea0', 'created_at': datetime.datetime(2026, 7, 31, 10, 8, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 31, 10, 8, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4cbd0fd2-77a8-43ca-bc93-b0249d6daea0/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:18:01 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-7753d2e6-de54-4c67-9cd1-f2c3890591cd tempest-VolumesImageMetadata-729283616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7999458-a17c-416b-9e3c-999e479f5905) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:18:01 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-7753d2e6-de54-4c67-9cd1-f2c3890591cd tempest-VolumesImageMetadata-729283616 None] Volume volume-2a91a426-c787-405d-a9fc-c6bff4d9bc59 (2a91a426-c787-405d-a9fc-c6bff4d9bc59): created successfully Jul 31 12:18:01 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-7753d2e6-de54-4c67-9cd1-f2c3890591cd tempest-VolumesImageMetadata-729283616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7999458-a17c-416b-9e3c-999e479f5905) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:18:01 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-7753d2e6-de54-4c67-9cd1-f2c3890591cd tempest-VolumesImageMetadata-729283616 None] Flow 'volume_create_manager' (9f4d29b9-4754-4b7f-9e7b-d43b1a59350c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:18:01 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-7753d2e6-de54-4c67-9cd1-f2c3890591cd tempest-VolumesImageMetadata-729283616 None] Created volume successfully. Jul 31 12:18:02 devstack cinder-volume[89182]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca6818b9-f23a-4b53-b293-a940b30227ab tempest-VolumesGetTest-1167943284 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89182) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 12:18:02 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-ca6818b9-f23a-4b53-b293-a940b30227ab tempest-VolumesGetTest-1167943284 None] Flow 'volume_create_manager' (8b756c7c-7636-412f-ad65-15e6099b0b5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:18:02 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-ca6818b9-f23a-4b53-b293-a940b30227ab tempest-VolumesGetTest-1167943284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bea6cdc1-9b0c-40bf-bdd5-046996e96f05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:18:02 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-ca6818b9-f23a-4b53-b293-a940b30227ab tempest-VolumesGetTest-1167943284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bea6cdc1-9b0c-40bf-bdd5-046996e96f05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:18:02Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1852280717',display_name='tempest-VolumesGetTest-Volume-830985805',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d00c536-869f-4677-89ae-2ec3166cf793,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3bfd8f27aa9442a384d65adca3b284dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:18:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:18:02Z,use_quota=True,user_id='219264511ea247d78c4075409a489eff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:18:02 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-ca6818b9-f23a-4b53-b293-a940b30227ab tempest-VolumesGetTest-1167943284 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb195071-a7cd-4381-a87d-0dab8519cf34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:18:02 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-ca6818b9-f23a-4b53-b293-a940b30227ab tempest-VolumesGetTest-1167943284 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb195071-a7cd-4381-a87d-0dab8519cf34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:18:02 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-ca6818b9-f23a-4b53-b293-a940b30227ab tempest-VolumesGetTest-1167943284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68f5d5b4-078f-40b5-befa-5a1d89ceace4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:18:02 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-ca6818b9-f23a-4b53-b293-a940b30227ab tempest-VolumesGetTest-1167943284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68f5d5b4-078f-40b5-befa-5a1d89ceace4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7d00c536-869f-4677-89ae-2ec3166cf793', 'volume_name': 'volume-7d00c536-869f-4677-89ae-2ec3166cf793', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:18:02 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-ca6818b9-f23a-4b53-b293-a940b30227ab tempest-VolumesGetTest-1167943284 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (baef740c-7e51-415c-a6b6-c44c50f000d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:18:02 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-ca6818b9-f23a-4b53-b293-a940b30227ab tempest-VolumesGetTest-1167943284 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (baef740c-7e51-415c-a6b6-c44c50f000d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:18:02 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-ca6818b9-f23a-4b53-b293-a940b30227ab tempest-VolumesGetTest-1167943284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ac73cba-0ce1-4d9d-85b5-bb28543420c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:18:02 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-ca6818b9-f23a-4b53-b293-a940b30227ab tempest-VolumesGetTest-1167943284 None] Volume 7d00c536-869f-4677-89ae-2ec3166cf793: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7d00c536-869f-4677-89ae-2ec3166cf793', 'volume_size': 1} Jul 31 12:18:02 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-ca6818b9-f23a-4b53-b293-a940b30227ab tempest-VolumesGetTest-1167943284 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:18:02 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-ca6818b9-f23a-4b53-b293-a940b30227ab tempest-VolumesGetTest-1167943284 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:18:02 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-ca6818b9-f23a-4b53-b293-a940b30227ab tempest-VolumesGetTest-1167943284 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:18:02Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1852280717',display_name='tempest-VolumesGetTest-Volume-830985805',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d00c536-869f-4677-89ae-2ec3166cf793,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3bfd8f27aa9442a384d65adca3b284dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:18:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:18:02Z,use_quota=True,user_id='219264511ea247d78c4075409a489eff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)}" {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 12:18:02 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-ca6818b9-f23a-4b53-b293-a940b30227ab tempest-VolumesGetTest-1167943284 None] Creating volume 7d00c536-869f-4677-89ae-2ec3166cf793 {{(pid=89182) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 12:18:02 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-ca6818b9-f23a-4b53-b293-a940b30227ab tempest-VolumesGetTest-1167943284 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:18:02 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-ca6818b9-f23a-4b53-b293-a940b30227ab tempest-VolumesGetTest-1167943284 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:18:02 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-ca6818b9-f23a-4b53-b293-a940b30227ab tempest-VolumesGetTest-1167943284 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:18:02 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-ca6818b9-f23a-4b53-b293-a940b30227ab tempest-VolumesGetTest-1167943284 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:18:02 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-ca6818b9-f23a-4b53-b293-a940b30227ab tempest-VolumesGetTest-1167943284 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:18:02 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-ca6818b9-f23a-4b53-b293-a940b30227ab tempest-VolumesGetTest-1167943284 None] Selected osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 as target Quobyte volume. {{(pid=89182) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 12:18:02 devstack cinder-volume[89182]: INFO cinder.volume.drivers.remotefs [None req-ca6818b9-f23a-4b53-b293-a940b30227ab tempest-VolumesGetTest-1167943284 None] casted to osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 Jul 31 12:18:02 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-ca6818b9-f23a-4b53-b293-a940b30227ab tempest-VolumesGetTest-1167943284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-7d00c536-869f-4677-89ae-2ec3166cf793 1073741824 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:18:02 devstack sudo[95040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-7d00c536-869f-4677-89ae-2ec3166cf793 1073741824 Jul 31 12:18:02 devstack sudo[95040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:18:02 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-39a2e4cc-7c69-46ca-aa51-5869d53439db tempest-VolumesImageMetadata-729283616 None] Acquiring lock "cinder-2a91a426-c787-405d-a9fc-c6bff4d9bc59-delete_volume" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:18:02 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-39a2e4cc-7c69-46ca-aa51-5869d53439db tempest-VolumesImageMetadata-729283616 None] Lock "cinder-2a91a426-c787-405d-a9fc-c6bff4d9bc59-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:18:02 devstack sudo[95040]: pam_unix(sudo:session): session closed for user root Jul 31 12:18:02 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-ca6818b9-f23a-4b53-b293-a940b30227ab tempest-VolumesGetTest-1167943284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-7d00c536-869f-4677-89ae-2ec3166cf793 1073741824" returned: 0 in 0.587s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:18:02 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-39a2e4cc-7c69-46ca-aa51-5869d53439db tempest-VolumesImageMetadata-729283616 None] Acquiring lock "cinder-quobyte-2a91a426-c787-405d-a9fc-c6bff4d9bc59" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:18:02 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-39a2e4cc-7c69-46ca-aa51-5869d53439db tempest-VolumesImageMetadata-729283616 None] Lock "cinder-quobyte-2a91a426-c787-405d-a9fc-c6bff4d9bc59" acquired by "delete_volume" :: waited 0.029s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:18:02 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[d02e4960-41c7-46cd-8439-ef104a3a3f02]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:18:02 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-39a2e4cc-7c69-46ca-aa51-5869d53439db tempest-VolumesImageMetadata-729283616 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-2a91a426-c787-405d-a9fc-c6bff4d9bc59 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:18:03 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-ca6818b9-f23a-4b53-b293-a940b30227ab tempest-VolumesGetTest-1167943284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-7d00c536-869f-4677-89ae-2ec3166cf793 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:18:03 devstack sudo[95048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-7d00c536-869f-4677-89ae-2ec3166cf793 Jul 31 12:18:03 devstack sudo[95048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:18:03 devstack sudo[95047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-2a91a426-c787-405d-a9fc-c6bff4d9bc59 Jul 31 12:18:03 devstack sudo[95047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:18:03 devstack sudo[95048]: pam_unix(sudo:session): session closed for user root Jul 31 12:18:03 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-ca6818b9-f23a-4b53-b293-a940b30227ab tempest-VolumesGetTest-1167943284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-7d00c536-869f-4677-89ae-2ec3166cf793" returned: 0 in 0.362s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:18:03 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-ca6818b9-f23a-4b53-b293-a940b30227ab tempest-VolumesGetTest-1167943284 None] <== create_volume: return (1111ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'} {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 12:18:03 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-ca6818b9-f23a-4b53-b293-a940b30227ab tempest-VolumesGetTest-1167943284 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.114s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:18:03 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-ca6818b9-f23a-4b53-b293-a940b30227ab tempest-VolumesGetTest-1167943284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ac73cba-0ce1-4d9d-85b5-bb28543420c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7d00c536-869f-4677-89ae-2ec3166cf793', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:18:03 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-ca6818b9-f23a-4b53-b293-a940b30227ab tempest-VolumesGetTest-1167943284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b20937bd-9c5c-45cf-bcdc-47ff4f078c08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:18:03 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-ca6818b9-f23a-4b53-b293-a940b30227ab tempest-VolumesGetTest-1167943284 None] Volume volume-7d00c536-869f-4677-89ae-2ec3166cf793 (7d00c536-869f-4677-89ae-2ec3166cf793): created successfully Jul 31 12:18:03 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-ca6818b9-f23a-4b53-b293-a940b30227ab tempest-VolumesGetTest-1167943284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b20937bd-9c5c-45cf-bcdc-47ff4f078c08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:18:03 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-ca6818b9-f23a-4b53-b293-a940b30227ab tempest-VolumesGetTest-1167943284 None] Flow 'volume_create_manager' (8b756c7c-7636-412f-ad65-15e6099b0b5b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:18:03 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-ca6818b9-f23a-4b53-b293-a940b30227ab tempest-VolumesGetTest-1167943284 None] Created volume successfully. Jul 31 12:18:03 devstack sudo[95047]: pam_unix(sudo:session): session closed for user root Jul 31 12:18:03 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-39a2e4cc-7c69-46ca-aa51-5869d53439db tempest-VolumesImageMetadata-729283616 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-2a91a426-c787-405d-a9fc-c6bff4d9bc59" returned: 0 in 0.565s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:18:03 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-39a2e4cc-7c69-46ca-aa51-5869d53439db tempest-VolumesImageMetadata-729283616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-2a91a426-c787-405d-a9fc-c6bff4d9bc59 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:18:03 devstack sudo[95055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-2a91a426-c787-405d-a9fc-c6bff4d9bc59 Jul 31 12:18:03 devstack sudo[95055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:18:03 devstack sudo[95055]: pam_unix(sudo:session): session closed for user root Jul 31 12:18:03 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-39a2e4cc-7c69-46ca-aa51-5869d53439db tempest-VolumesImageMetadata-729283616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-2a91a426-c787-405d-a9fc-c6bff4d9bc59" returned: 0 in 0.315s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:18:03 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-39a2e4cc-7c69-46ca-aa51-5869d53439db tempest-VolumesImageMetadata-729283616 None] Lock "cinder-quobyte-2a91a426-c787-405d-a9fc-c6bff4d9bc59" released by "delete_volume" :: held 0.930s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:18:03 devstack cinder-volume[89182]: DEBUG cinder.quota [None req-39a2e4cc-7c69-46ca-aa51-5869d53439db tempest-VolumesImageMetadata-729283616 None] Created reservations ['045aa0ed-547b-4b6d-9946-51ccc0307ffb', '20d6ffe4-f427-4ab0-a52c-9d44a45677e6', '83dbff58-e7ef-4a7a-8622-9273248b4793', 'c403f084-1fc5-4063-ba05-973bc783cf89'] {{(pid=89182) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 12:18:04 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-39a2e4cc-7c69-46ca-aa51-5869d53439db tempest-VolumesImageMetadata-729283616 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:18:04 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-39a2e4cc-7c69-46ca-aa51-5869d53439db tempest-VolumesImageMetadata-729283616 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:18:04 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-39a2e4cc-7c69-46ca-aa51-5869d53439db tempest-VolumesImageMetadata-729283616 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:18:04 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-39a2e4cc-7c69-46ca-aa51-5869d53439db tempest-VolumesImageMetadata-729283616 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:18:04 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-39a2e4cc-7c69-46ca-aa51-5869d53439db tempest-VolumesImageMetadata-729283616 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:18:04 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-39a2e4cc-7c69-46ca-aa51-5869d53439db tempest-VolumesImageMetadata-729283616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:18:04 devstack sudo[95058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 Jul 31 12:18:04 devstack sudo[95058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:18:04 devstack sudo[95058]: pam_unix(sudo:session): session closed for user root Jul 31 12:18:04 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-39a2e4cc-7c69-46ca-aa51-5869d53439db tempest-VolumesImageMetadata-729283616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2" returned: 0 in 0.343s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:18:04 devstack cinder-volume[89182]: DEBUG cinder.manager [None req-39a2e4cc-7c69-46ca-aa51-5869d53439db tempest-VolumesImageMetadata-729283616 None] Notifying Schedulers of capabilities ... {{(pid=89182) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 12:18:04 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-39a2e4cc-7c69-46ca-aa51-5869d53439db tempest-VolumesImageMetadata-729283616 None] Deleted volume successfully. Jul 31 12:18:04 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-39a2e4cc-7c69-46ca-aa51-5869d53439db tempest-VolumesImageMetadata-729283616 None] Lock "cinder-2a91a426-c787-405d-a9fc-c6bff4d9bc59-delete_volume" released by "delete_volume" :: held 1.625s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:18:04 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-35e63fe2-17ba-4153-bddf-ec2cb12907df tempest-VolumesGetTest-1167943284 None] Acquiring lock "cinder-7d00c536-869f-4677-89ae-2ec3166cf793-delete_volume" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:18:04 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-35e63fe2-17ba-4153-bddf-ec2cb12907df tempest-VolumesGetTest-1167943284 None] Lock "cinder-7d00c536-869f-4677-89ae-2ec3166cf793-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:18:04 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-35e63fe2-17ba-4153-bddf-ec2cb12907df tempest-VolumesGetTest-1167943284 None] Acquiring lock "cinder-quobyte-7d00c536-869f-4677-89ae-2ec3166cf793" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:18:04 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-35e63fe2-17ba-4153-bddf-ec2cb12907df tempest-VolumesGetTest-1167943284 None] Lock "cinder-quobyte-7d00c536-869f-4677-89ae-2ec3166cf793" acquired by "delete_volume" :: waited 0.017s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:18:04 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[2244b893-3bdc-43c8-9adc-559806b3a2dc]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:18:04 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-35e63fe2-17ba-4153-bddf-ec2cb12907df tempest-VolumesGetTest-1167943284 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-7d00c536-869f-4677-89ae-2ec3166cf793 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:18:04 devstack sudo[95061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-7d00c536-869f-4677-89ae-2ec3166cf793 Jul 31 12:18:04 devstack sudo[95061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:18:05 devstack sudo[95061]: pam_unix(sudo:session): session closed for user root Jul 31 12:18:05 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-35e63fe2-17ba-4153-bddf-ec2cb12907df tempest-VolumesGetTest-1167943284 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-7d00c536-869f-4677-89ae-2ec3166cf793" returned: 0 in 0.472s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:18:05 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-35e63fe2-17ba-4153-bddf-ec2cb12907df tempest-VolumesGetTest-1167943284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-7d00c536-869f-4677-89ae-2ec3166cf793 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:18:05 devstack sudo[95066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-7d00c536-869f-4677-89ae-2ec3166cf793 Jul 31 12:18:05 devstack sudo[95066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:18:05 devstack sudo[95066]: pam_unix(sudo:session): session closed for user root Jul 31 12:18:05 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-35e63fe2-17ba-4153-bddf-ec2cb12907df tempest-VolumesGetTest-1167943284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-7d00c536-869f-4677-89ae-2ec3166cf793" returned: 0 in 0.321s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:18:05 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-35e63fe2-17ba-4153-bddf-ec2cb12907df tempest-VolumesGetTest-1167943284 None] Lock "cinder-quobyte-7d00c536-869f-4677-89ae-2ec3166cf793" released by "delete_volume" :: held 0.867s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:18:05 devstack cinder-volume[89182]: DEBUG cinder.quota [None req-35e63fe2-17ba-4153-bddf-ec2cb12907df tempest-VolumesGetTest-1167943284 None] Created reservations ['117b16cb-e63b-496f-a09e-5d35d1680cc9', 'd5834f2b-1c5e-478d-af7a-e53e087a3791', 'dbb3c897-5ea8-4c8e-b4dc-e00ac96af07d', 'b0fc1024-4596-4e86-bc1d-953e31ac859c'] {{(pid=89182) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 12:18:05 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-35e63fe2-17ba-4153-bddf-ec2cb12907df tempest-VolumesGetTest-1167943284 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:18:05 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-35e63fe2-17ba-4153-bddf-ec2cb12907df tempest-VolumesGetTest-1167943284 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:18:05 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-35e63fe2-17ba-4153-bddf-ec2cb12907df tempest-VolumesGetTest-1167943284 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:18:05 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-35e63fe2-17ba-4153-bddf-ec2cb12907df tempest-VolumesGetTest-1167943284 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:18:05 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-35e63fe2-17ba-4153-bddf-ec2cb12907df tempest-VolumesGetTest-1167943284 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:18:05 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-35e63fe2-17ba-4153-bddf-ec2cb12907df tempest-VolumesGetTest-1167943284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:18:05 devstack sudo[95072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 Jul 31 12:18:05 devstack sudo[95072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:18:06 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-23d82560-381a-417d-8fc8-7ab3ccf33cca tempest-VolumesGetTest-1167943284 None] Acquiring lock "cinder-ea82cb3e-708d-4c57-baf5-e2899d07b9c7-delete_volume" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:18:06 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-23d82560-381a-417d-8fc8-7ab3ccf33cca tempest-VolumesGetTest-1167943284 None] Lock "cinder-ea82cb3e-708d-4c57-baf5-e2899d07b9c7-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:18:06 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-23d82560-381a-417d-8fc8-7ab3ccf33cca tempest-VolumesGetTest-1167943284 None] Acquiring lock "cinder-quobyte-ea82cb3e-708d-4c57-baf5-e2899d07b9c7" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:18:06 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-23d82560-381a-417d-8fc8-7ab3ccf33cca tempest-VolumesGetTest-1167943284 None] Lock "cinder-quobyte-ea82cb3e-708d-4c57-baf5-e2899d07b9c7" acquired by "delete_volume" :: waited 0.042s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:18:06 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[40cbd412-b551-4aaf-b8ed-ae82b5b7ce1d]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:18:06 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-23d82560-381a-417d-8fc8-7ab3ccf33cca tempest-VolumesGetTest-1167943284 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-ea82cb3e-708d-4c57-baf5-e2899d07b9c7 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:18:06 devstack sudo[95072]: pam_unix(sudo:session): session closed for user root Jul 31 12:18:06 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-35e63fe2-17ba-4153-bddf-ec2cb12907df tempest-VolumesGetTest-1167943284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2" returned: 0 in 0.482s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:18:06 devstack cinder-volume[89182]: DEBUG cinder.manager [None req-35e63fe2-17ba-4153-bddf-ec2cb12907df tempest-VolumesGetTest-1167943284 None] Notifying Schedulers of capabilities ... {{(pid=89182) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 12:18:06 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-35e63fe2-17ba-4153-bddf-ec2cb12907df tempest-VolumesGetTest-1167943284 None] Deleted volume successfully. Jul 31 12:18:06 devstack sudo[95075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-ea82cb3e-708d-4c57-baf5-e2899d07b9c7 Jul 31 12:18:06 devstack sudo[95075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:18:06 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-35e63fe2-17ba-4153-bddf-ec2cb12907df tempest-VolumesGetTest-1167943284 None] Lock "cinder-7d00c536-869f-4677-89ae-2ec3166cf793-delete_volume" released by "delete_volume" :: held 1.683s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:18:06 devstack sudo[95075]: pam_unix(sudo:session): session closed for user root Jul 31 12:18:06 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-23d82560-381a-417d-8fc8-7ab3ccf33cca tempest-VolumesGetTest-1167943284 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-ea82cb3e-708d-4c57-baf5-e2899d07b9c7" returned: 0 in 0.735s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:18:06 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-23d82560-381a-417d-8fc8-7ab3ccf33cca tempest-VolumesGetTest-1167943284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-ea82cb3e-708d-4c57-baf5-e2899d07b9c7 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:18:07 devstack sudo[95081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-ea82cb3e-708d-4c57-baf5-e2899d07b9c7 Jul 31 12:18:07 devstack sudo[95081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:18:07 devstack sudo[95081]: pam_unix(sudo:session): session closed for user root Jul 31 12:18:07 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-23d82560-381a-417d-8fc8-7ab3ccf33cca tempest-VolumesGetTest-1167943284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-ea82cb3e-708d-4c57-baf5-e2899d07b9c7" returned: 0 in 0.556s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:18:07 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-23d82560-381a-417d-8fc8-7ab3ccf33cca tempest-VolumesGetTest-1167943284 None] Lock "cinder-quobyte-ea82cb3e-708d-4c57-baf5-e2899d07b9c7" released by "delete_volume" :: held 1.368s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:18:07 devstack cinder-volume[89182]: DEBUG dbcounter [-] [89182] Writing DB stats cinder:SELECT=115,cinder:UPDATE=140,cinder:INSERT=46,cinder:DELETE=9 {{(pid=89182) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 12:18:07 devstack cinder-volume[89182]: DEBUG dbcounter [-] [89182] Writing DB stats cinder:SELECT=111,cinder:UPDATE=142,cinder:INSERT=46,cinder:DELETE=15 {{(pid=89182) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 12:18:07 devstack cinder-volume[89182]: DEBUG cinder.quota [None req-23d82560-381a-417d-8fc8-7ab3ccf33cca tempest-VolumesGetTest-1167943284 None] Created reservations ['09206e88-782d-4bb8-8bf1-8026b532c854', '75974bff-04b1-42d4-8941-478a6c7dc14c', '7117745c-9834-47a0-94ca-9c5a55bc0ec6', '96387675-d69d-4f47-9ac4-a6b170c708ab'] {{(pid=89182) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 12:18:07 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-23d82560-381a-417d-8fc8-7ab3ccf33cca tempest-VolumesGetTest-1167943284 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:18:07 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-23d82560-381a-417d-8fc8-7ab3ccf33cca tempest-VolumesGetTest-1167943284 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:18:07 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-23d82560-381a-417d-8fc8-7ab3ccf33cca tempest-VolumesGetTest-1167943284 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:18:07 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-23d82560-381a-417d-8fc8-7ab3ccf33cca tempest-VolumesGetTest-1167943284 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:18:07 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-23d82560-381a-417d-8fc8-7ab3ccf33cca tempest-VolumesGetTest-1167943284 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:18:07 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-23d82560-381a-417d-8fc8-7ab3ccf33cca tempest-VolumesGetTest-1167943284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:18:07 devstack sudo[95086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 Jul 31 12:18:07 devstack sudo[95086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:18:08 devstack sudo[95086]: pam_unix(sudo:session): session closed for user root Jul 31 12:18:08 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-23d82560-381a-417d-8fc8-7ab3ccf33cca tempest-VolumesGetTest-1167943284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2" returned: 0 in 0.398s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:18:08 devstack cinder-volume[89182]: DEBUG cinder.manager [None req-23d82560-381a-417d-8fc8-7ab3ccf33cca tempest-VolumesGetTest-1167943284 None] Notifying Schedulers of capabilities ... {{(pid=89182) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 12:18:08 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-23d82560-381a-417d-8fc8-7ab3ccf33cca tempest-VolumesGetTest-1167943284 None] Deleted volume successfully. Jul 31 12:18:08 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-23d82560-381a-417d-8fc8-7ab3ccf33cca tempest-VolumesGetTest-1167943284 None] Lock "cinder-ea82cb3e-708d-4c57-baf5-e2899d07b9c7-delete_volume" released by "delete_volume" :: held 2.187s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:18:08 devstack cinder-volume[89182]: DEBUG cinder.volume.flows.manager.create_volume [None req-3551ffda-f1be-4bcf-884d-5f6c17db6c6d tempest-SnapshotMetadataTestJSON-194710577 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89182) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 12:18:08 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-3551ffda-f1be-4bcf-884d-5f6c17db6c6d tempest-SnapshotMetadataTestJSON-194710577 None] Flow 'volume_create_manager' (7145757f-22d0-4dbc-83ca-81f35e5798fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:18:08 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-3551ffda-f1be-4bcf-884d-5f6c17db6c6d tempest-SnapshotMetadataTestJSON-194710577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b129e31-f3f3-452e-b53b-828786bf209e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:18:09 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-3551ffda-f1be-4bcf-884d-5f6c17db6c6d tempest-SnapshotMetadataTestJSON-194710577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b129e31-f3f3-452e-b53b-828786bf209e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:18:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-2010480068',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be3b0228-1da9-4967-aa9a-fb9b9216565d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be379e5fa709420596ff56efbc1d357b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:18:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:18:09Z,use_quota=True,user_id='bf29864e09f64737aba7932b713bad3b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:18:09 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-3551ffda-f1be-4bcf-884d-5f6c17db6c6d tempest-SnapshotMetadataTestJSON-194710577 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0226636b-d3fa-4e3e-9dee-d759686690a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:18:09 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-3551ffda-f1be-4bcf-884d-5f6c17db6c6d tempest-SnapshotMetadataTestJSON-194710577 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0226636b-d3fa-4e3e-9dee-d759686690a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:18:09 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-3551ffda-f1be-4bcf-884d-5f6c17db6c6d tempest-SnapshotMetadataTestJSON-194710577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11754b7e-8618-46d9-92a9-0922d9a60c0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:18:09 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-3551ffda-f1be-4bcf-884d-5f6c17db6c6d tempest-SnapshotMetadataTestJSON-194710577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11754b7e-8618-46d9-92a9-0922d9a60c0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'be3b0228-1da9-4967-aa9a-fb9b9216565d', 'volume_name': 'volume-be3b0228-1da9-4967-aa9a-fb9b9216565d', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:18:09 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-3551ffda-f1be-4bcf-884d-5f6c17db6c6d tempest-SnapshotMetadataTestJSON-194710577 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db231aaf-3fc3-49de-8eee-d36b57a727b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:18:09 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-3551ffda-f1be-4bcf-884d-5f6c17db6c6d tempest-SnapshotMetadataTestJSON-194710577 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db231aaf-3fc3-49de-8eee-d36b57a727b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:18:09 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-3551ffda-f1be-4bcf-884d-5f6c17db6c6d tempest-SnapshotMetadataTestJSON-194710577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (250ffa12-90f5-4377-8790-0a22d49948ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:18:09 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-3551ffda-f1be-4bcf-884d-5f6c17db6c6d tempest-SnapshotMetadataTestJSON-194710577 None] Volume be3b0228-1da9-4967-aa9a-fb9b9216565d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-be3b0228-1da9-4967-aa9a-fb9b9216565d', 'volume_size': 1} Jul 31 12:18:09 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-3551ffda-f1be-4bcf-884d-5f6c17db6c6d tempest-SnapshotMetadataTestJSON-194710577 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:18:09 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-3551ffda-f1be-4bcf-884d-5f6c17db6c6d tempest-SnapshotMetadataTestJSON-194710577 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:18:09 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-3551ffda-f1be-4bcf-884d-5f6c17db6c6d tempest-SnapshotMetadataTestJSON-194710577 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:18:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-2010480068',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be3b0228-1da9-4967-aa9a-fb9b9216565d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be379e5fa709420596ff56efbc1d357b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:18:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:18:09Z,use_quota=True,user_id='bf29864e09f64737aba7932b713bad3b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)}" {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 12:18:09 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-3551ffda-f1be-4bcf-884d-5f6c17db6c6d tempest-SnapshotMetadataTestJSON-194710577 None] Creating volume be3b0228-1da9-4967-aa9a-fb9b9216565d {{(pid=89182) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 12:18:09 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-3551ffda-f1be-4bcf-884d-5f6c17db6c6d tempest-SnapshotMetadataTestJSON-194710577 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:18:09 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-3551ffda-f1be-4bcf-884d-5f6c17db6c6d tempest-SnapshotMetadataTestJSON-194710577 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:18:09 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-3551ffda-f1be-4bcf-884d-5f6c17db6c6d tempest-SnapshotMetadataTestJSON-194710577 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:18:09 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-3551ffda-f1be-4bcf-884d-5f6c17db6c6d tempest-SnapshotMetadataTestJSON-194710577 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:18:09 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-3551ffda-f1be-4bcf-884d-5f6c17db6c6d tempest-SnapshotMetadataTestJSON-194710577 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:18:09 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-3551ffda-f1be-4bcf-884d-5f6c17db6c6d tempest-SnapshotMetadataTestJSON-194710577 None] Selected osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 as target Quobyte volume. {{(pid=89182) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 12:18:09 devstack cinder-volume[89182]: INFO cinder.volume.drivers.remotefs [None req-3551ffda-f1be-4bcf-884d-5f6c17db6c6d tempest-SnapshotMetadataTestJSON-194710577 None] casted to osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 Jul 31 12:18:09 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-3551ffda-f1be-4bcf-884d-5f6c17db6c6d tempest-SnapshotMetadataTestJSON-194710577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-be3b0228-1da9-4967-aa9a-fb9b9216565d 1073741824 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:18:09 devstack sudo[95114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-be3b0228-1da9-4967-aa9a-fb9b9216565d 1073741824 Jul 31 12:18:09 devstack sudo[95114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:18:09 devstack sudo[95114]: pam_unix(sudo:session): session closed for user root Jul 31 12:18:09 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-3551ffda-f1be-4bcf-884d-5f6c17db6c6d tempest-SnapshotMetadataTestJSON-194710577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-be3b0228-1da9-4967-aa9a-fb9b9216565d 1073741824" returned: 0 in 0.676s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:18:09 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-3551ffda-f1be-4bcf-884d-5f6c17db6c6d tempest-SnapshotMetadataTestJSON-194710577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-be3b0228-1da9-4967-aa9a-fb9b9216565d {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:18:09 devstack sudo[95122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-be3b0228-1da9-4967-aa9a-fb9b9216565d Jul 31 12:18:09 devstack sudo[95122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:18:10 devstack sudo[95122]: pam_unix(sudo:session): session closed for user root Jul 31 12:18:10 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-3551ffda-f1be-4bcf-884d-5f6c17db6c6d tempest-SnapshotMetadataTestJSON-194710577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-be3b0228-1da9-4967-aa9a-fb9b9216565d" returned: 0 in 0.309s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:18:10 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-3551ffda-f1be-4bcf-884d-5f6c17db6c6d tempest-SnapshotMetadataTestJSON-194710577 None] <== create_volume: return (1048ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'} {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 12:18:10 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-3551ffda-f1be-4bcf-884d-5f6c17db6c6d tempest-SnapshotMetadataTestJSON-194710577 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.051s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:18:10 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-3551ffda-f1be-4bcf-884d-5f6c17db6c6d tempest-SnapshotMetadataTestJSON-194710577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (250ffa12-90f5-4377-8790-0a22d49948ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-be3b0228-1da9-4967-aa9a-fb9b9216565d', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:18:10 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-3551ffda-f1be-4bcf-884d-5f6c17db6c6d tempest-SnapshotMetadataTestJSON-194710577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52ea3301-8bac-4e7f-b967-604e93436443) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:18:10 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-3551ffda-f1be-4bcf-884d-5f6c17db6c6d tempest-SnapshotMetadataTestJSON-194710577 None] Volume volume-be3b0228-1da9-4967-aa9a-fb9b9216565d (be3b0228-1da9-4967-aa9a-fb9b9216565d): created successfully Jul 31 12:18:10 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-3551ffda-f1be-4bcf-884d-5f6c17db6c6d tempest-SnapshotMetadataTestJSON-194710577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52ea3301-8bac-4e7f-b967-604e93436443) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:18:10 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-3551ffda-f1be-4bcf-884d-5f6c17db6c6d tempest-SnapshotMetadataTestJSON-194710577 None] Flow 'volume_create_manager' (7145757f-22d0-4dbc-83ca-81f35e5798fd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:18:10 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-3551ffda-f1be-4bcf-884d-5f6c17db6c6d tempest-SnapshotMetadataTestJSON-194710577 None] Created volume successfully. Jul 31 12:18:11 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-b1541d51-70b5-4d46-baf5-9349c9e07c62 tempest-SnapshotMetadataTestJSON-194710577 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:18:11 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-b1541d51-70b5-4d46-baf5-9349c9e07c62 tempest-SnapshotMetadataTestJSON-194710577 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:18:11 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-b1541d51-70b5-4d46-baf5-9349c9e07c62 tempest-SnapshotMetadataTestJSON-194710577 None] Creating offline snapshot 2c4aa48c-37c5-48a2-8872-cb9c48f28869 of volume be3b0228-1da9-4967-aa9a-fb9b9216565d {{(pid=89182) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 31 12:18:11 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[29198f06-7c51-4a2f-a84b-8ec5e77f1abf]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:18:11 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-b1541d51-70b5-4d46-baf5-9349c9e07c62 tempest-SnapshotMetadataTestJSON-194710577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-be3b0228-1da9-4967-aa9a-fb9b9216565d {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:18:11 devstack sudo[95132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-be3b0228-1da9-4967-aa9a-fb9b9216565d Jul 31 12:18:11 devstack sudo[95132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:18:11 devstack sudo[95132]: pam_unix(sudo:session): session closed for user root Jul 31 12:18:11 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-b1541d51-70b5-4d46-baf5-9349c9e07c62 tempest-SnapshotMetadataTestJSON-194710577 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-be3b0228-1da9-4967-aa9a-fb9b9216565d" returned: 0 in 0.608s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:18:11 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-b1541d51-70b5-4d46-baf5-9349c9e07c62 tempest-SnapshotMetadataTestJSON-194710577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-be3b0228-1da9-4967-aa9a-fb9b9216565d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-be3b0228-1da9-4967-aa9a-fb9b9216565d.2c4aa48c-37c5-48a2-8872-cb9c48f28869 1G {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:18:12 devstack sudo[95138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-be3b0228-1da9-4967-aa9a-fb9b9216565d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-be3b0228-1da9-4967-aa9a-fb9b9216565d.2c4aa48c-37c5-48a2-8872-cb9c48f28869 1G Jul 31 12:18:12 devstack sudo[95138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:18:12 devstack sudo[95138]: pam_unix(sudo:session): session closed for user root Jul 31 12:18:12 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-b1541d51-70b5-4d46-baf5-9349c9e07c62 tempest-SnapshotMetadataTestJSON-194710577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-be3b0228-1da9-4967-aa9a-fb9b9216565d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-be3b0228-1da9-4967-aa9a-fb9b9216565d.2c4aa48c-37c5-48a2-8872-cb9c48f28869 1G" returned: 0 in 0.754s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:18:12 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-b1541d51-70b5-4d46-baf5-9349c9e07c62 tempest-SnapshotMetadataTestJSON-194710577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-be3b0228-1da9-4967-aa9a-fb9b9216565d -F qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-be3b0228-1da9-4967-aa9a-fb9b9216565d.2c4aa48c-37c5-48a2-8872-cb9c48f28869 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:18:12 devstack sudo[95148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-be3b0228-1da9-4967-aa9a-fb9b9216565d -F qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-be3b0228-1da9-4967-aa9a-fb9b9216565d.2c4aa48c-37c5-48a2-8872-cb9c48f28869 Jul 31 12:18:12 devstack sudo[95148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:18:13 devstack sudo[95148]: pam_unix(sudo:session): session closed for user root Jul 31 12:18:13 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-b1541d51-70b5-4d46-baf5-9349c9e07c62 tempest-SnapshotMetadataTestJSON-194710577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-be3b0228-1da9-4967-aa9a-fb9b9216565d -F qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-be3b0228-1da9-4967-aa9a-fb9b9216565d.2c4aa48c-37c5-48a2-8872-cb9c48f28869" returned: 0 in 0.550s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:18:13 devstack cinder-volume[89182]: WARNING cinder.volume.drivers.remotefs [None req-b1541d51-70b5-4d46-baf5-9349c9e07c62 tempest-SnapshotMetadataTestJSON-194710577 None] /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-be3b0228-1da9-4967-aa9a-fb9b9216565d.2c4aa48c-37c5-48a2-8872-cb9c48f28869 is being set with open permissions: ugo+rw Jul 31 12:18:13 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-b1541d51-70b5-4d46-baf5-9349c9e07c62 tempest-SnapshotMetadataTestJSON-194710577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-be3b0228-1da9-4967-aa9a-fb9b9216565d.2c4aa48c-37c5-48a2-8872-cb9c48f28869 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:18:13 devstack sudo[95153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-be3b0228-1da9-4967-aa9a-fb9b9216565d.2c4aa48c-37c5-48a2-8872-cb9c48f28869 Jul 31 12:18:13 devstack sudo[95153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:18:13 devstack sudo[95153]: pam_unix(sudo:session): session closed for user root Jul 31 12:18:13 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-b1541d51-70b5-4d46-baf5-9349c9e07c62 tempest-SnapshotMetadataTestJSON-194710577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-be3b0228-1da9-4967-aa9a-fb9b9216565d.2c4aa48c-37c5-48a2-8872-cb9c48f28869" returned: 0 in 0.472s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:18:13 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-b1541d51-70b5-4d46-baf5-9349c9e07c62 tempest-SnapshotMetadataTestJSON-194710577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-be3b0228-1da9-4967-aa9a-fb9b9216565d.info {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:18:13 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-399674df-3043-4bf4-bda7-3b192f0f6560 tempest-AttachVolumeShelveTestJSON-322663064 None] Acquiring lock "cinder-ecf99134-2b69-4867-afcd-35e29656682e-delete_volume" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:18:13 devstack sudo[95162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-be3b0228-1da9-4967-aa9a-fb9b9216565d.info Jul 31 12:18:13 devstack sudo[95162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:18:13 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-399674df-3043-4bf4-bda7-3b192f0f6560 tempest-AttachVolumeShelveTestJSON-322663064 None] Lock "cinder-ecf99134-2b69-4867-afcd-35e29656682e-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:18:13 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-399674df-3043-4bf4-bda7-3b192f0f6560 tempest-AttachVolumeShelveTestJSON-322663064 None] Acquiring lock "cinder-quobyte-ecf99134-2b69-4867-afcd-35e29656682e" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:18:14 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-399674df-3043-4bf4-bda7-3b192f0f6560 tempest-AttachVolumeShelveTestJSON-322663064 None] Lock "cinder-quobyte-ecf99134-2b69-4867-afcd-35e29656682e" acquired by "delete_volume" :: waited 0.039s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:18:14 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cd743a0-0500-4b1c-9319-32a0fc06b70c]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:18:14 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-399674df-3043-4bf4-bda7-3b192f0f6560 tempest-AttachVolumeShelveTestJSON-322663064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-ecf99134-2b69-4867-afcd-35e29656682e {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:18:14 devstack sudo[95162]: pam_unix(sudo:session): session closed for user root Jul 31 12:18:14 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-b1541d51-70b5-4d46-baf5-9349c9e07c62 tempest-SnapshotMetadataTestJSON-194710577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-be3b0228-1da9-4967-aa9a-fb9b9216565d.info" returned: 0 in 0.408s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:18:14 devstack cinder-volume[89182]: WARNING cinder.volume.drivers.remotefs [None req-b1541d51-70b5-4d46-baf5-9349c9e07c62 tempest-SnapshotMetadataTestJSON-194710577 None] /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-be3b0228-1da9-4967-aa9a-fb9b9216565d.info is being set with open permissions: ugo+rw Jul 31 12:18:14 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-b1541d51-70b5-4d46-baf5-9349c9e07c62 tempest-SnapshotMetadataTestJSON-194710577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-be3b0228-1da9-4967-aa9a-fb9b9216565d.info {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:18:14 devstack sudo[95172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-ecf99134-2b69-4867-afcd-35e29656682e Jul 31 12:18:14 devstack sudo[95172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:18:14 devstack sudo[95176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-be3b0228-1da9-4967-aa9a-fb9b9216565d.info Jul 31 12:18:14 devstack sudo[95176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:18:14 devstack sudo[95176]: pam_unix(sudo:session): session closed for user root Jul 31 12:18:14 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-b1541d51-70b5-4d46-baf5-9349c9e07c62 tempest-SnapshotMetadataTestJSON-194710577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-be3b0228-1da9-4967-aa9a-fb9b9216565d.info" returned: 0 in 0.300s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:18:14 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-b1541d51-70b5-4d46-baf5-9349c9e07c62 tempest-SnapshotMetadataTestJSON-194710577 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.285s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:18:14 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-b1541d51-70b5-4d46-baf5-9349c9e07c62 tempest-SnapshotMetadataTestJSON-194710577 None] Create snapshot completed successfully Jul 31 12:18:14 devstack sudo[95172]: pam_unix(sudo:session): session closed for user root Jul 31 12:18:14 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-399674df-3043-4bf4-bda7-3b192f0f6560 tempest-AttachVolumeShelveTestJSON-322663064 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-ecf99134-2b69-4867-afcd-35e29656682e" returned: 0 in 0.752s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:18:14 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-399674df-3043-4bf4-bda7-3b192f0f6560 tempest-AttachVolumeShelveTestJSON-322663064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-ecf99134-2b69-4867-afcd-35e29656682e {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:18:14 devstack sudo[95186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-ecf99134-2b69-4867-afcd-35e29656682e Jul 31 12:18:14 devstack sudo[95186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:18:15 devstack sudo[95186]: pam_unix(sudo:session): session closed for user root Jul 31 12:18:15 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-399674df-3043-4bf4-bda7-3b192f0f6560 tempest-AttachVolumeShelveTestJSON-322663064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-ecf99134-2b69-4867-afcd-35e29656682e" returned: 0 in 0.392s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:18:15 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-399674df-3043-4bf4-bda7-3b192f0f6560 tempest-AttachVolumeShelveTestJSON-322663064 None] Lock "cinder-quobyte-ecf99134-2b69-4867-afcd-35e29656682e" released by "delete_volume" :: held 1.238s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:18:15 devstack cinder-volume[89182]: DEBUG cinder.quota [None req-399674df-3043-4bf4-bda7-3b192f0f6560 tempest-AttachVolumeShelveTestJSON-322663064 None] Created reservations ['dc34f149-2493-42b6-b8dc-cf6b830edfbb', 'b2935661-9b7b-4121-bcba-13001814cea5', '6e890c2f-46a8-4c44-873d-194f345e4e0f', '589e85d2-1e18-4139-827a-080de18e3dbf'] {{(pid=89182) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 12:18:15 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-399674df-3043-4bf4-bda7-3b192f0f6560 tempest-AttachVolumeShelveTestJSON-322663064 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:18:15 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-399674df-3043-4bf4-bda7-3b192f0f6560 tempest-AttachVolumeShelveTestJSON-322663064 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:18:15 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-399674df-3043-4bf4-bda7-3b192f0f6560 tempest-AttachVolumeShelveTestJSON-322663064 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:18:15 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-399674df-3043-4bf4-bda7-3b192f0f6560 tempest-AttachVolumeShelveTestJSON-322663064 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:18:15 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-399674df-3043-4bf4-bda7-3b192f0f6560 tempest-AttachVolumeShelveTestJSON-322663064 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.038s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:18:15 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-399674df-3043-4bf4-bda7-3b192f0f6560 tempest-AttachVolumeShelveTestJSON-322663064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:18:15 devstack sudo[95200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 Jul 31 12:18:15 devstack sudo[95200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:18:15 devstack sudo[95200]: pam_unix(sudo:session): session closed for user root Jul 31 12:18:15 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-399674df-3043-4bf4-bda7-3b192f0f6560 tempest-AttachVolumeShelveTestJSON-322663064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2" returned: 0 in 0.439s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:18:15 devstack cinder-volume[89182]: DEBUG cinder.manager [None req-399674df-3043-4bf4-bda7-3b192f0f6560 tempest-AttachVolumeShelveTestJSON-322663064 None] Notifying Schedulers of capabilities ... {{(pid=89182) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 12:18:15 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-399674df-3043-4bf4-bda7-3b192f0f6560 tempest-AttachVolumeShelveTestJSON-322663064 None] Deleted volume successfully. Jul 31 12:18:16 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-399674df-3043-4bf4-bda7-3b192f0f6560 tempest-AttachVolumeShelveTestJSON-322663064 None] Lock "cinder-ecf99134-2b69-4867-afcd-35e29656682e-delete_volume" released by "delete_volume" :: held 2.099s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:18:16 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-83cd9377-c7f9-4656-9c42-90f78f8e0025 tempest-SnapshotMetadataTestJSON-194710577 None] Acquiring lock "cinder-2c4aa48c-37c5-48a2-8872-cb9c48f28869-delete_snapshot" by "delete_snapshot" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:18:16 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-83cd9377-c7f9-4656-9c42-90f78f8e0025 tempest-SnapshotMetadataTestJSON-194710577 None] Lock "cinder-2c4aa48c-37c5-48a2-8872-cb9c48f28869-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:18:16 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-83cd9377-c7f9-4656-9c42-90f78f8e0025 tempest-SnapshotMetadataTestJSON-194710577 None] Acquiring lock "cinder-quobyte-be3b0228-1da9-4967-aa9a-fb9b9216565d" by "delete_snapshot" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:18:16 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-83cd9377-c7f9-4656-9c42-90f78f8e0025 tempest-SnapshotMetadataTestJSON-194710577 None] Lock "cinder-quobyte-be3b0228-1da9-4967-aa9a-fb9b9216565d" acquired by "delete_snapshot" :: waited 0.026s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:18:16 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-83cd9377-c7f9-4656-9c42-90f78f8e0025 tempest-SnapshotMetadataTestJSON-194710577 None] Acquiring lock "cinder-quobyte-2c4aa48c-37c5-48a2-8872-cb9c48f28869" by "_delete_snapshot" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:18:16 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-83cd9377-c7f9-4656-9c42-90f78f8e0025 tempest-SnapshotMetadataTestJSON-194710577 None] Lock "cinder-quobyte-2c4aa48c-37c5-48a2-8872-cb9c48f28869" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:18:16 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-83cd9377-c7f9-4656-9c42-90f78f8e0025 tempest-SnapshotMetadataTestJSON-194710577 None] Deleting offline snapshot 2c4aa48c-37c5-48a2-8872-cb9c48f28869 of volume be3b0228-1da9-4967-aa9a-fb9b9216565d {{(pid=89182) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 31 12:18:16 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-83cd9377-c7f9-4656-9c42-90f78f8e0025 tempest-SnapshotMetadataTestJSON-194710577 None] snapshot_file for this snap is: volume-be3b0228-1da9-4967-aa9a-fb9b9216565d.2c4aa48c-37c5-48a2-8872-cb9c48f28869 {{(pid=89182) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 31 12:18:16 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[73b2e87b-ee60-4f14-be3b-ab690429f170]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:18:16 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-83cd9377-c7f9-4656-9c42-90f78f8e0025 tempest-SnapshotMetadataTestJSON-194710577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-be3b0228-1da9-4967-aa9a-fb9b9216565d.2c4aa48c-37c5-48a2-8872-cb9c48f28869 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:18:17 devstack sudo[95209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-be3b0228-1da9-4967-aa9a-fb9b9216565d.2c4aa48c-37c5-48a2-8872-cb9c48f28869 Jul 31 12:18:17 devstack sudo[95209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:18:17 devstack sudo[95209]: pam_unix(sudo:session): session closed for user root Jul 31 12:18:17 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-83cd9377-c7f9-4656-9c42-90f78f8e0025 tempest-SnapshotMetadataTestJSON-194710577 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-be3b0228-1da9-4967-aa9a-fb9b9216565d.2c4aa48c-37c5-48a2-8872-cb9c48f28869" returned: 0 in 0.519s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:18:17 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-83cd9377-c7f9-4656-9c42-90f78f8e0025 tempest-SnapshotMetadataTestJSON-194710577 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-be3b0228-1da9-4967-aa9a-fb9b9216565d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89182) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 12:18:17 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[fece76a7-3a06-4e4d-9243-01cd1edfe405]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:18:17 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-83cd9377-c7f9-4656-9c42-90f78f8e0025 tempest-SnapshotMetadataTestJSON-194710577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-be3b0228-1da9-4967-aa9a-fb9b9216565d {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:18:17 devstack cinder-volume[89182]: DEBUG cinder.volume.flows.manager.create_volume [None req-c8bd925d-94b5-4e64-bd79-e62c53ca055a tempest-VolumesListTestJSON-588829472 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89182) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 12:18:17 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-c8bd925d-94b5-4e64-bd79-e62c53ca055a tempest-VolumesListTestJSON-588829472 None] Flow 'volume_create_manager' (ad59c13c-e70d-4a4d-b885-2c78dcad6f65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:18:17 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-c8bd925d-94b5-4e64-bd79-e62c53ca055a tempest-VolumesListTestJSON-588829472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98d8f9ee-6fd4-4dd1-b045-24224ddf54eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:18:17 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-c8bd925d-94b5-4e64-bd79-e62c53ca055a tempest-VolumesListTestJSON-588829472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98d8f9ee-6fd4-4dd1-b045-24224ddf54eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:18:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2026279343',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf7f9371-5334-4e93-86a2-f1e61197ebfc,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3d2487d642e94c50ad3d54a5e21107a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:18:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:18:17Z,use_quota=True,user_id='583ca0cc01da420cb742480a6b48ed81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:18:17 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-c8bd925d-94b5-4e64-bd79-e62c53ca055a tempest-VolumesListTestJSON-588829472 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efb99ce3-38c3-4ba6-9b43-8d06780f4b54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:18:17 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-c8bd925d-94b5-4e64-bd79-e62c53ca055a tempest-VolumesListTestJSON-588829472 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efb99ce3-38c3-4ba6-9b43-8d06780f4b54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:18:17 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-c8bd925d-94b5-4e64-bd79-e62c53ca055a tempest-VolumesListTestJSON-588829472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (421cbd86-4672-43e2-827e-8861b2b4fc53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:18:17 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-c8bd925d-94b5-4e64-bd79-e62c53ca055a tempest-VolumesListTestJSON-588829472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (421cbd86-4672-43e2-827e-8861b2b4fc53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bf7f9371-5334-4e93-86a2-f1e61197ebfc', 'volume_name': 'volume-bf7f9371-5334-4e93-86a2-f1e61197ebfc', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:18:17 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-c8bd925d-94b5-4e64-bd79-e62c53ca055a tempest-VolumesListTestJSON-588829472 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06c765e5-4b76-4cf6-acaf-9240b4b07dbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:18:17 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-c8bd925d-94b5-4e64-bd79-e62c53ca055a tempest-VolumesListTestJSON-588829472 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06c765e5-4b76-4cf6-acaf-9240b4b07dbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:18:17 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-c8bd925d-94b5-4e64-bd79-e62c53ca055a tempest-VolumesListTestJSON-588829472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18b74c1e-43ba-43e2-9e9e-5816a916ca4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:18:17 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-c8bd925d-94b5-4e64-bd79-e62c53ca055a tempest-VolumesListTestJSON-588829472 None] Volume bf7f9371-5334-4e93-86a2-f1e61197ebfc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bf7f9371-5334-4e93-86a2-f1e61197ebfc', 'volume_size': 1} Jul 31 12:18:17 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-c8bd925d-94b5-4e64-bd79-e62c53ca055a tempest-VolumesListTestJSON-588829472 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:18:17 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-c8bd925d-94b5-4e64-bd79-e62c53ca055a tempest-VolumesListTestJSON-588829472 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:18:17 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-c8bd925d-94b5-4e64-bd79-e62c53ca055a tempest-VolumesListTestJSON-588829472 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:18:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2026279343',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf7f9371-5334-4e93-86a2-f1e61197ebfc,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3d2487d642e94c50ad3d54a5e21107a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:18:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:18:17Z,use_quota=True,user_id='583ca0cc01da420cb742480a6b48ed81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)}" {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 12:18:17 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-c8bd925d-94b5-4e64-bd79-e62c53ca055a tempest-VolumesListTestJSON-588829472 None] Creating volume bf7f9371-5334-4e93-86a2-f1e61197ebfc {{(pid=89182) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 12:18:17 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-c8bd925d-94b5-4e64-bd79-e62c53ca055a tempest-VolumesListTestJSON-588829472 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:18:17 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-c8bd925d-94b5-4e64-bd79-e62c53ca055a tempest-VolumesListTestJSON-588829472 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:18:17 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-c8bd925d-94b5-4e64-bd79-e62c53ca055a tempest-VolumesListTestJSON-588829472 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:18:17 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-c8bd925d-94b5-4e64-bd79-e62c53ca055a tempest-VolumesListTestJSON-588829472 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:18:17 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-c8bd925d-94b5-4e64-bd79-e62c53ca055a tempest-VolumesListTestJSON-588829472 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:18:17 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-c8bd925d-94b5-4e64-bd79-e62c53ca055a tempest-VolumesListTestJSON-588829472 None] Selected osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 as target Quobyte volume. {{(pid=89182) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 12:18:17 devstack cinder-volume[89182]: INFO cinder.volume.drivers.remotefs [None req-c8bd925d-94b5-4e64-bd79-e62c53ca055a tempest-VolumesListTestJSON-588829472 None] casted to osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 Jul 31 12:18:17 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-c8bd925d-94b5-4e64-bd79-e62c53ca055a tempest-VolumesListTestJSON-588829472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-bf7f9371-5334-4e93-86a2-f1e61197ebfc 1073741824 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:18:17 devstack sudo[95214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-be3b0228-1da9-4967-aa9a-fb9b9216565d Jul 31 12:18:17 devstack sudo[95214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:18:17 devstack sudo[95216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-bf7f9371-5334-4e93-86a2-f1e61197ebfc 1073741824 Jul 31 12:18:17 devstack sudo[95216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:18:17 devstack sudo[95214]: pam_unix(sudo:session): session closed for user root Jul 31 12:18:17 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-83cd9377-c7f9-4656-9c42-90f78f8e0025 tempest-SnapshotMetadataTestJSON-194710577 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-be3b0228-1da9-4967-aa9a-fb9b9216565d" returned: 0 in 0.463s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:18:17 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-83cd9377-c7f9-4656-9c42-90f78f8e0025 tempest-SnapshotMetadataTestJSON-194710577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-be3b0228-1da9-4967-aa9a-fb9b9216565d.2c4aa48c-37c5-48a2-8872-cb9c48f28869 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:18:17 devstack sudo[95227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-be3b0228-1da9-4967-aa9a-fb9b9216565d.2c4aa48c-37c5-48a2-8872-cb9c48f28869 Jul 31 12:18:17 devstack sudo[95227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:18:18 devstack sudo[95216]: pam_unix(sudo:session): session closed for user root Jul 31 12:18:18 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-c8bd925d-94b5-4e64-bd79-e62c53ca055a tempest-VolumesListTestJSON-588829472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-bf7f9371-5334-4e93-86a2-f1e61197ebfc 1073741824" returned: 0 in 0.603s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:18:18 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-c8bd925d-94b5-4e64-bd79-e62c53ca055a tempest-VolumesListTestJSON-588829472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-bf7f9371-5334-4e93-86a2-f1e61197ebfc {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:18:18 devstack sudo[95232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-bf7f9371-5334-4e93-86a2-f1e61197ebfc Jul 31 12:18:18 devstack sudo[95232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:18:18 devstack sudo[95227]: pam_unix(sudo:session): session closed for user root Jul 31 12:18:18 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-83cd9377-c7f9-4656-9c42-90f78f8e0025 tempest-SnapshotMetadataTestJSON-194710577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-be3b0228-1da9-4967-aa9a-fb9b9216565d.2c4aa48c-37c5-48a2-8872-cb9c48f28869" returned: 0 in 0.544s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:18:18 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-83cd9377-c7f9-4656-9c42-90f78f8e0025 tempest-SnapshotMetadataTestJSON-194710577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-be3b0228-1da9-4967-aa9a-fb9b9216565d.2c4aa48c-37c5-48a2-8872-cb9c48f28869 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:18:18 devstack sudo[95235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-be3b0228-1da9-4967-aa9a-fb9b9216565d.2c4aa48c-37c5-48a2-8872-cb9c48f28869 Jul 31 12:18:18 devstack sudo[95235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:18:18 devstack sudo[95232]: pam_unix(sudo:session): session closed for user root Jul 31 12:18:18 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-c8bd925d-94b5-4e64-bd79-e62c53ca055a tempest-VolumesListTestJSON-588829472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-bf7f9371-5334-4e93-86a2-f1e61197ebfc" returned: 0 in 0.337s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:18:18 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-c8bd925d-94b5-4e64-bd79-e62c53ca055a tempest-VolumesListTestJSON-588829472 None] <== create_volume: return (1003ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'} {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 12:18:18 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-c8bd925d-94b5-4e64-bd79-e62c53ca055a tempest-VolumesListTestJSON-588829472 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.006s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:18:18 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-c8bd925d-94b5-4e64-bd79-e62c53ca055a tempest-VolumesListTestJSON-588829472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18b74c1e-43ba-43e2-9e9e-5816a916ca4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bf7f9371-5334-4e93-86a2-f1e61197ebfc', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:18:18 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-c8bd925d-94b5-4e64-bd79-e62c53ca055a tempest-VolumesListTestJSON-588829472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd1a0ab7-fd13-4e37-a808-8000c07909d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:18:18 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-c8bd925d-94b5-4e64-bd79-e62c53ca055a tempest-VolumesListTestJSON-588829472 None] Volume volume-bf7f9371-5334-4e93-86a2-f1e61197ebfc (bf7f9371-5334-4e93-86a2-f1e61197ebfc): created successfully Jul 31 12:18:18 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-c8bd925d-94b5-4e64-bd79-e62c53ca055a tempest-VolumesListTestJSON-588829472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd1a0ab7-fd13-4e37-a808-8000c07909d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:18:18 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-c8bd925d-94b5-4e64-bd79-e62c53ca055a tempest-VolumesListTestJSON-588829472 None] Flow 'volume_create_manager' (ad59c13c-e70d-4a4d-b885-2c78dcad6f65) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:18:18 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-c8bd925d-94b5-4e64-bd79-e62c53ca055a tempest-VolumesListTestJSON-588829472 None] Created volume successfully. Jul 31 12:18:18 devstack sudo[95235]: pam_unix(sudo:session): session closed for user root Jul 31 12:18:18 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-83cd9377-c7f9-4656-9c42-90f78f8e0025 tempest-SnapshotMetadataTestJSON-194710577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-be3b0228-1da9-4967-aa9a-fb9b9216565d.2c4aa48c-37c5-48a2-8872-cb9c48f28869" returned: 0 in 0.310s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:18:18 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-83cd9377-c7f9-4656-9c42-90f78f8e0025 tempest-SnapshotMetadataTestJSON-194710577 None] Lock "cinder-quobyte-2c4aa48c-37c5-48a2-8872-cb9c48f28869" released by "_delete_snapshot" :: held 1.980s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:18:18 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-83cd9377-c7f9-4656-9c42-90f78f8e0025 tempest-SnapshotMetadataTestJSON-194710577 None] Lock "cinder-quobyte-be3b0228-1da9-4967-aa9a-fb9b9216565d" released by "delete_snapshot" :: held 2.025s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:18:18 devstack cinder-volume[89182]: DEBUG cinder.quota [None req-83cd9377-c7f9-4656-9c42-90f78f8e0025 tempest-SnapshotMetadataTestJSON-194710577 None] Created reservations ['fa6ea961-c323-4937-850a-1e596939108f', '52f51517-fcc8-49ae-965f-61f0ae322b7d', '460094ad-d81c-41b8-bc69-7d243edd095d', 'e01db8b2-e6e1-4152-980a-0d7c83866168'] {{(pid=89182) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 12:18:19 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-83cd9377-c7f9-4656-9c42-90f78f8e0025 tempest-SnapshotMetadataTestJSON-194710577 None] Delete snapshot completed successfully. Jul 31 12:18:19 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-83cd9377-c7f9-4656-9c42-90f78f8e0025 tempest-SnapshotMetadataTestJSON-194710577 None] Lock "cinder-2c4aa48c-37c5-48a2-8872-cb9c48f28869-delete_snapshot" released by "delete_snapshot" :: held 2.250s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:18:20 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-b9c58898-7053-49da-8dc3-0f8667d24fe0 tempest-SnapshotMetadataTestJSON-194710577 None] Acquiring lock "cinder-be3b0228-1da9-4967-aa9a-fb9b9216565d-delete_volume" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:18:20 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-b9c58898-7053-49da-8dc3-0f8667d24fe0 tempest-SnapshotMetadataTestJSON-194710577 None] Lock "cinder-be3b0228-1da9-4967-aa9a-fb9b9216565d-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:18:20 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-b9c58898-7053-49da-8dc3-0f8667d24fe0 tempest-SnapshotMetadataTestJSON-194710577 None] Acquiring lock "cinder-quobyte-be3b0228-1da9-4967-aa9a-fb9b9216565d" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:18:20 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-b9c58898-7053-49da-8dc3-0f8667d24fe0 tempest-SnapshotMetadataTestJSON-194710577 None] Lock "cinder-quobyte-be3b0228-1da9-4967-aa9a-fb9b9216565d" acquired by "delete_volume" :: waited 0.039s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:18:20 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9369f86-61c2-454e-9b47-7a6bbb1c0086]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:18:20 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-b9c58898-7053-49da-8dc3-0f8667d24fe0 tempest-SnapshotMetadataTestJSON-194710577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-be3b0228-1da9-4967-aa9a-fb9b9216565d {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:18:20 devstack cinder-volume[89182]: DEBUG cinder.volume.flows.manager.create_volume [None req-47495709-5426-46d5-82d2-049d0410be7e tempest-VolumesListTestJSON-588829472 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89182) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 12:18:20 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-47495709-5426-46d5-82d2-049d0410be7e tempest-VolumesListTestJSON-588829472 None] Flow 'volume_create_manager' (840978dc-5560-4292-bf20-790c07619173) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:18:20 devstack sudo[95284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-be3b0228-1da9-4967-aa9a-fb9b9216565d Jul 31 12:18:20 devstack sudo[95284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:18:20 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-47495709-5426-46d5-82d2-049d0410be7e tempest-VolumesListTestJSON-588829472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (adc63ac9-f55d-4f54-8674-4dfdb72d913b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:18:20 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-47495709-5426-46d5-82d2-049d0410be7e tempest-VolumesListTestJSON-588829472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (adc63ac9-f55d-4f54-8674-4dfdb72d913b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:18:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2042197238',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2ef5a61-34e3-4adb-b1b7-d776103aa215,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3d2487d642e94c50ad3d54a5e21107a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:18:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:18:21Z,use_quota=True,user_id='583ca0cc01da420cb742480a6b48ed81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:18:20 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-47495709-5426-46d5-82d2-049d0410be7e tempest-VolumesListTestJSON-588829472 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ccd3bb7a-8d9c-4ccc-888b-574df90a2e08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:18:20 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-47495709-5426-46d5-82d2-049d0410be7e tempest-VolumesListTestJSON-588829472 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ccd3bb7a-8d9c-4ccc-888b-574df90a2e08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:18:20 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-47495709-5426-46d5-82d2-049d0410be7e tempest-VolumesListTestJSON-588829472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (550860ba-6960-4020-9a6e-7b681662f23a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:18:20 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-47495709-5426-46d5-82d2-049d0410be7e tempest-VolumesListTestJSON-588829472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (550860ba-6960-4020-9a6e-7b681662f23a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f2ef5a61-34e3-4adb-b1b7-d776103aa215', 'volume_name': 'volume-f2ef5a61-34e3-4adb-b1b7-d776103aa215', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:18:20 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-47495709-5426-46d5-82d2-049d0410be7e tempest-VolumesListTestJSON-588829472 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eac3b011-760b-4b98-8bad-45020fe75ff9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:18:20 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-47495709-5426-46d5-82d2-049d0410be7e tempest-VolumesListTestJSON-588829472 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eac3b011-760b-4b98-8bad-45020fe75ff9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:18:20 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-47495709-5426-46d5-82d2-049d0410be7e tempest-VolumesListTestJSON-588829472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea6d01cb-42eb-4986-9ccb-4f753f1260cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:18:20 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-47495709-5426-46d5-82d2-049d0410be7e tempest-VolumesListTestJSON-588829472 None] Volume f2ef5a61-34e3-4adb-b1b7-d776103aa215: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f2ef5a61-34e3-4adb-b1b7-d776103aa215', 'volume_size': 1} Jul 31 12:18:20 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-47495709-5426-46d5-82d2-049d0410be7e tempest-VolumesListTestJSON-588829472 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:18:20 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-47495709-5426-46d5-82d2-049d0410be7e tempest-VolumesListTestJSON-588829472 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:18:20 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-47495709-5426-46d5-82d2-049d0410be7e tempest-VolumesListTestJSON-588829472 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:18:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2042197238',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2ef5a61-34e3-4adb-b1b7-d776103aa215,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3d2487d642e94c50ad3d54a5e21107a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:18:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:18:21Z,use_quota=True,user_id='583ca0cc01da420cb742480a6b48ed81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)}" {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 12:18:20 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-47495709-5426-46d5-82d2-049d0410be7e tempest-VolumesListTestJSON-588829472 None] Creating volume f2ef5a61-34e3-4adb-b1b7-d776103aa215 {{(pid=89182) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 12:18:20 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-47495709-5426-46d5-82d2-049d0410be7e tempest-VolumesListTestJSON-588829472 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:18:20 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-47495709-5426-46d5-82d2-049d0410be7e tempest-VolumesListTestJSON-588829472 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:18:20 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-47495709-5426-46d5-82d2-049d0410be7e tempest-VolumesListTestJSON-588829472 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:18:20 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-47495709-5426-46d5-82d2-049d0410be7e tempest-VolumesListTestJSON-588829472 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:18:20 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-47495709-5426-46d5-82d2-049d0410be7e tempest-VolumesListTestJSON-588829472 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:18:20 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-47495709-5426-46d5-82d2-049d0410be7e tempest-VolumesListTestJSON-588829472 None] Selected osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 as target Quobyte volume. {{(pid=89182) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 12:18:20 devstack cinder-volume[89182]: INFO cinder.volume.drivers.remotefs [None req-47495709-5426-46d5-82d2-049d0410be7e tempest-VolumesListTestJSON-588829472 None] casted to osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 Jul 31 12:18:20 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-47495709-5426-46d5-82d2-049d0410be7e tempest-VolumesListTestJSON-588829472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-f2ef5a61-34e3-4adb-b1b7-d776103aa215 1073741824 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:18:21 devstack sudo[95295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-f2ef5a61-34e3-4adb-b1b7-d776103aa215 1073741824 Jul 31 12:18:21 devstack sudo[95295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:18:21 devstack sudo[95284]: pam_unix(sudo:session): session closed for user root Jul 31 12:18:21 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-b9c58898-7053-49da-8dc3-0f8667d24fe0 tempest-SnapshotMetadataTestJSON-194710577 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-be3b0228-1da9-4967-aa9a-fb9b9216565d" returned: 0 in 0.514s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:18:21 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-b9c58898-7053-49da-8dc3-0f8667d24fe0 tempest-SnapshotMetadataTestJSON-194710577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-be3b0228-1da9-4967-aa9a-fb9b9216565d {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:18:21 devstack sudo[95308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-be3b0228-1da9-4967-aa9a-fb9b9216565d Jul 31 12:18:21 devstack sudo[95308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:18:21 devstack sudo[95308]: pam_unix(sudo:session): session closed for user root Jul 31 12:18:21 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-b9c58898-7053-49da-8dc3-0f8667d24fe0 tempest-SnapshotMetadataTestJSON-194710577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-be3b0228-1da9-4967-aa9a-fb9b9216565d" returned: 0 in 0.538s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:18:21 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-b9c58898-7053-49da-8dc3-0f8667d24fe0 tempest-SnapshotMetadataTestJSON-194710577 None] Lock "cinder-quobyte-be3b0228-1da9-4967-aa9a-fb9b9216565d" released by "delete_volume" :: held 1.215s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:18:21 devstack cinder-volume[89182]: DEBUG oslo_service.periodic_task [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89182) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 31 12:18:21 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:18:21 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:18:21 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:18:21 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:18:21 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:18:21 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:18:21 devstack sudo[95331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 Jul 31 12:18:21 devstack sudo[95331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:18:22 devstack cinder-volume[89182]: DEBUG cinder.quota [None req-b9c58898-7053-49da-8dc3-0f8667d24fe0 tempest-SnapshotMetadataTestJSON-194710577 None] Created reservations ['124eb19d-084b-4094-a4a8-f2b2e33da0d6', 'd05d89f6-f7db-4b12-8ef8-90eda95d56d0', 'af49f039-826a-4929-a3a6-138a701a4635', '6d81a8b6-15b6-4607-bf36-a4ffa986f629'] {{(pid=89182) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 12:18:22 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-b9c58898-7053-49da-8dc3-0f8667d24fe0 tempest-SnapshotMetadataTestJSON-194710577 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:18:22 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-b9c58898-7053-49da-8dc3-0f8667d24fe0 tempest-SnapshotMetadataTestJSON-194710577 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:18:22 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-b9c58898-7053-49da-8dc3-0f8667d24fe0 tempest-SnapshotMetadataTestJSON-194710577 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:18:22 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-b9c58898-7053-49da-8dc3-0f8667d24fe0 tempest-SnapshotMetadataTestJSON-194710577 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:18:22 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-b9c58898-7053-49da-8dc3-0f8667d24fe0 tempest-SnapshotMetadataTestJSON-194710577 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:18:22 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-b9c58898-7053-49da-8dc3-0f8667d24fe0 tempest-SnapshotMetadataTestJSON-194710577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:18:22 devstack sudo[95295]: pam_unix(sudo:session): session closed for user root Jul 31 12:18:22 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-47495709-5426-46d5-82d2-049d0410be7e tempest-VolumesListTestJSON-588829472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-f2ef5a61-34e3-4adb-b1b7-d776103aa215 1073741824" returned: 0 in 1.290s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:18:22 devstack sudo[95342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 Jul 31 12:18:22 devstack sudo[95342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:18:22 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-47495709-5426-46d5-82d2-049d0410be7e tempest-VolumesListTestJSON-588829472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-f2ef5a61-34e3-4adb-b1b7-d776103aa215 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:18:22 devstack sudo[95349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-f2ef5a61-34e3-4adb-b1b7-d776103aa215 Jul 31 12:18:22 devstack sudo[95349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:18:22 devstack sudo[95331]: pam_unix(sudo:session): session closed for user root Jul 31 12:18:22 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2" returned: 0 in 0.521s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:18:22 devstack cinder-volume[89182]: DEBUG cinder.manager [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] Notifying Schedulers of capabilities ... {{(pid=89182) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 12:18:22 devstack cinder-volume[89182]: DEBUG oslo_service.periodic_task [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] Running periodic task VolumeManager._thread_info {{(pid=89182) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 31 12:18:22 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] thread count: 28 {{(pid=89182) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 31 12:18:22 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] thread info: [<_MainThread(MainThread, started 136154603720832)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=89182) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 31 12:18:22 devstack sudo[95342]: pam_unix(sudo:session): session closed for user root Jul 31 12:18:22 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-b9c58898-7053-49da-8dc3-0f8667d24fe0 tempest-SnapshotMetadataTestJSON-194710577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2" returned: 0 in 0.398s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:18:22 devstack cinder-volume[89182]: DEBUG cinder.manager [None req-b9c58898-7053-49da-8dc3-0f8667d24fe0 tempest-SnapshotMetadataTestJSON-194710577 None] Notifying Schedulers of capabilities ... {{(pid=89182) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 12:18:22 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-b9c58898-7053-49da-8dc3-0f8667d24fe0 tempest-SnapshotMetadataTestJSON-194710577 None] Deleted volume successfully. Jul 31 12:18:22 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-b9c58898-7053-49da-8dc3-0f8667d24fe0 tempest-SnapshotMetadataTestJSON-194710577 None] Lock "cinder-be3b0228-1da9-4967-aa9a-fb9b9216565d-delete_volume" released by "delete_volume" :: held 2.410s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:18:22 devstack sudo[95349]: pam_unix(sudo:session): session closed for user root Jul 31 12:18:23 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-47495709-5426-46d5-82d2-049d0410be7e tempest-VolumesListTestJSON-588829472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-f2ef5a61-34e3-4adb-b1b7-d776103aa215" returned: 0 in 0.644s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:18:23 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-47495709-5426-46d5-82d2-049d0410be7e tempest-VolumesListTestJSON-588829472 None] <== create_volume: return (2042ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'} {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 12:18:23 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-47495709-5426-46d5-82d2-049d0410be7e tempest-VolumesListTestJSON-588829472 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.049s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:18:23 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-47495709-5426-46d5-82d2-049d0410be7e tempest-VolumesListTestJSON-588829472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea6d01cb-42eb-4986-9ccb-4f753f1260cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f2ef5a61-34e3-4adb-b1b7-d776103aa215', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:18:23 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-47495709-5426-46d5-82d2-049d0410be7e tempest-VolumesListTestJSON-588829472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1c45208-9be3-442c-aeb6-19d327c28cb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:18:23 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-47495709-5426-46d5-82d2-049d0410be7e tempest-VolumesListTestJSON-588829472 None] Volume volume-f2ef5a61-34e3-4adb-b1b7-d776103aa215 (f2ef5a61-34e3-4adb-b1b7-d776103aa215): created successfully Jul 31 12:18:23 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-47495709-5426-46d5-82d2-049d0410be7e tempest-VolumesListTestJSON-588829472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1c45208-9be3-442c-aeb6-19d327c28cb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:18:23 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-47495709-5426-46d5-82d2-049d0410be7e tempest-VolumesListTestJSON-588829472 None] Flow 'volume_create_manager' (840978dc-5560-4292-bf20-790c07619173) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:18:23 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-47495709-5426-46d5-82d2-049d0410be7e tempest-VolumesListTestJSON-588829472 None] Created volume successfully. Jul 31 12:18:25 devstack cinder-volume[89182]: DEBUG cinder.volume.flows.manager.create_volume [None req-fde58321-b4b4-4850-a8d3-8c05529ea514 tempest-VolumesListTestJSON-588829472 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89182) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 12:18:25 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-fde58321-b4b4-4850-a8d3-8c05529ea514 tempest-VolumesListTestJSON-588829472 None] Flow 'volume_create_manager' (c93cb289-1914-41cf-8be6-04b3658b8fc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:18:25 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-fde58321-b4b4-4850-a8d3-8c05529ea514 tempest-VolumesListTestJSON-588829472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86b6967b-85c9-4ea1-88ff-acb9c99b636f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:18:25 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-fde58321-b4b4-4850-a8d3-8c05529ea514 tempest-VolumesListTestJSON-588829472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86b6967b-85c9-4ea1-88ff-acb9c99b636f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:18:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2119097010',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69fceb25-4032-4be6-b7b2-f6c88a47f737,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3d2487d642e94c50ad3d54a5e21107a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:18:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:18:25Z,use_quota=True,user_id='583ca0cc01da420cb742480a6b48ed81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:18:25 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-fde58321-b4b4-4850-a8d3-8c05529ea514 tempest-VolumesListTestJSON-588829472 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3debe4aa-90ba-4869-b310-66272201a5f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:18:25 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-fde58321-b4b4-4850-a8d3-8c05529ea514 tempest-VolumesListTestJSON-588829472 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3debe4aa-90ba-4869-b310-66272201a5f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:18:25 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-fde58321-b4b4-4850-a8d3-8c05529ea514 tempest-VolumesListTestJSON-588829472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a967b450-7526-4f86-98f1-f2bf8a725a83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:18:25 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-fde58321-b4b4-4850-a8d3-8c05529ea514 tempest-VolumesListTestJSON-588829472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a967b450-7526-4f86-98f1-f2bf8a725a83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '69fceb25-4032-4be6-b7b2-f6c88a47f737', 'volume_name': 'volume-69fceb25-4032-4be6-b7b2-f6c88a47f737', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:18:25 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-fde58321-b4b4-4850-a8d3-8c05529ea514 tempest-VolumesListTestJSON-588829472 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58491fbc-2ad9-4bc5-8b05-911061263750) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:18:25 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-fde58321-b4b4-4850-a8d3-8c05529ea514 tempest-VolumesListTestJSON-588829472 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58491fbc-2ad9-4bc5-8b05-911061263750) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:18:25 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-fde58321-b4b4-4850-a8d3-8c05529ea514 tempest-VolumesListTestJSON-588829472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55cece62-98e8-49d8-a6a0-04c52438ff4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:18:25 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-fde58321-b4b4-4850-a8d3-8c05529ea514 tempest-VolumesListTestJSON-588829472 None] Volume 69fceb25-4032-4be6-b7b2-f6c88a47f737: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-69fceb25-4032-4be6-b7b2-f6c88a47f737', 'volume_size': 1} Jul 31 12:18:25 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-fde58321-b4b4-4850-a8d3-8c05529ea514 tempest-VolumesListTestJSON-588829472 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:18:25 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-fde58321-b4b4-4850-a8d3-8c05529ea514 tempest-VolumesListTestJSON-588829472 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:18:25 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-fde58321-b4b4-4850-a8d3-8c05529ea514 tempest-VolumesListTestJSON-588829472 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:18:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2119097010',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69fceb25-4032-4be6-b7b2-f6c88a47f737,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3d2487d642e94c50ad3d54a5e21107a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:18:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:18:25Z,use_quota=True,user_id='583ca0cc01da420cb742480a6b48ed81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)}" {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 12:18:25 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-fde58321-b4b4-4850-a8d3-8c05529ea514 tempest-VolumesListTestJSON-588829472 None] Creating volume 69fceb25-4032-4be6-b7b2-f6c88a47f737 {{(pid=89182) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 12:18:25 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-fde58321-b4b4-4850-a8d3-8c05529ea514 tempest-VolumesListTestJSON-588829472 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:18:25 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-fde58321-b4b4-4850-a8d3-8c05529ea514 tempest-VolumesListTestJSON-588829472 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:18:25 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-fde58321-b4b4-4850-a8d3-8c05529ea514 tempest-VolumesListTestJSON-588829472 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:18:25 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-fde58321-b4b4-4850-a8d3-8c05529ea514 tempest-VolumesListTestJSON-588829472 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:18:25 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-fde58321-b4b4-4850-a8d3-8c05529ea514 tempest-VolumesListTestJSON-588829472 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:18:25 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-fde58321-b4b4-4850-a8d3-8c05529ea514 tempest-VolumesListTestJSON-588829472 None] Selected osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 as target Quobyte volume. {{(pid=89182) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 12:18:25 devstack cinder-volume[89182]: INFO cinder.volume.drivers.remotefs [None req-fde58321-b4b4-4850-a8d3-8c05529ea514 tempest-VolumesListTestJSON-588829472 None] casted to osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 Jul 31 12:18:25 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-fde58321-b4b4-4850-a8d3-8c05529ea514 tempest-VolumesListTestJSON-588829472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-69fceb25-4032-4be6-b7b2-f6c88a47f737 1073741824 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:18:26 devstack sudo[95425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-69fceb25-4032-4be6-b7b2-f6c88a47f737 1073741824 Jul 31 12:18:26 devstack sudo[95425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:18:26 devstack sudo[95425]: pam_unix(sudo:session): session closed for user root Jul 31 12:18:26 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-fde58321-b4b4-4850-a8d3-8c05529ea514 tempest-VolumesListTestJSON-588829472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-69fceb25-4032-4be6-b7b2-f6c88a47f737 1073741824" returned: 0 in 0.855s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:18:26 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-fde58321-b4b4-4850-a8d3-8c05529ea514 tempest-VolumesListTestJSON-588829472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-69fceb25-4032-4be6-b7b2-f6c88a47f737 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:18:26 devstack sudo[95430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-69fceb25-4032-4be6-b7b2-f6c88a47f737 Jul 31 12:18:26 devstack sudo[95430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:18:27 devstack sudo[95430]: pam_unix(sudo:session): session closed for user root Jul 31 12:18:27 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-fde58321-b4b4-4850-a8d3-8c05529ea514 tempest-VolumesListTestJSON-588829472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-69fceb25-4032-4be6-b7b2-f6c88a47f737" returned: 0 in 0.799s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:18:27 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-fde58321-b4b4-4850-a8d3-8c05529ea514 tempest-VolumesListTestJSON-588829472 None] <== create_volume: return (1754ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'} {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 12:18:27 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-fde58321-b4b4-4850-a8d3-8c05529ea514 tempest-VolumesListTestJSON-588829472 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.758s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:18:27 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-fde58321-b4b4-4850-a8d3-8c05529ea514 tempest-VolumesListTestJSON-588829472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55cece62-98e8-49d8-a6a0-04c52438ff4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-69fceb25-4032-4be6-b7b2-f6c88a47f737', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:18:27 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-fde58321-b4b4-4850-a8d3-8c05529ea514 tempest-VolumesListTestJSON-588829472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1a9822f-3c2e-4e7e-9c3b-a43e43cf3554) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:18:27 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-fde58321-b4b4-4850-a8d3-8c05529ea514 tempest-VolumesListTestJSON-588829472 None] Volume volume-69fceb25-4032-4be6-b7b2-f6c88a47f737 (69fceb25-4032-4be6-b7b2-f6c88a47f737): created successfully Jul 31 12:18:27 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-fde58321-b4b4-4850-a8d3-8c05529ea514 tempest-VolumesListTestJSON-588829472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1a9822f-3c2e-4e7e-9c3b-a43e43cf3554) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:18:27 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-fde58321-b4b4-4850-a8d3-8c05529ea514 tempest-VolumesListTestJSON-588829472 None] Flow 'volume_create_manager' (c93cb289-1914-41cf-8be6-04b3658b8fc0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:18:27 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-fde58321-b4b4-4850-a8d3-8c05529ea514 tempest-VolumesListTestJSON-588829472 None] Created volume successfully. Jul 31 12:18:33 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-8dbb917b-0570-4e8e-bdb8-664bbe5004c0 tempest-VolumesListTestJSON-588829472 None] Acquiring lock "cinder-69fceb25-4032-4be6-b7b2-f6c88a47f737-delete_volume" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:18:33 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-8dbb917b-0570-4e8e-bdb8-664bbe5004c0 tempest-VolumesListTestJSON-588829472 None] Lock "cinder-69fceb25-4032-4be6-b7b2-f6c88a47f737-delete_volume" acquired by "delete_volume" :: waited 0.077s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:18:33 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-8dbb917b-0570-4e8e-bdb8-664bbe5004c0 tempest-VolumesListTestJSON-588829472 None] Acquiring lock "cinder-quobyte-69fceb25-4032-4be6-b7b2-f6c88a47f737" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:18:33 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-8dbb917b-0570-4e8e-bdb8-664bbe5004c0 tempest-VolumesListTestJSON-588829472 None] Lock "cinder-quobyte-69fceb25-4032-4be6-b7b2-f6c88a47f737" acquired by "delete_volume" :: waited 0.051s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:18:33 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ace2636-bddc-4101-8036-70fc53bb72c9]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:18:33 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-8dbb917b-0570-4e8e-bdb8-664bbe5004c0 tempest-VolumesListTestJSON-588829472 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-69fceb25-4032-4be6-b7b2-f6c88a47f737 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:18:33 devstack sudo[95525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-69fceb25-4032-4be6-b7b2-f6c88a47f737 Jul 31 12:18:33 devstack sudo[95525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:18:33 devstack sudo[95525]: pam_unix(sudo:session): session closed for user root Jul 31 12:18:33 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-8dbb917b-0570-4e8e-bdb8-664bbe5004c0 tempest-VolumesListTestJSON-588829472 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-69fceb25-4032-4be6-b7b2-f6c88a47f737" returned: 0 in 0.663s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:18:33 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-8dbb917b-0570-4e8e-bdb8-664bbe5004c0 tempest-VolumesListTestJSON-588829472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-69fceb25-4032-4be6-b7b2-f6c88a47f737 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:18:34 devstack sudo[95530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-69fceb25-4032-4be6-b7b2-f6c88a47f737 Jul 31 12:18:34 devstack sudo[95530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:18:34 devstack sudo[95530]: pam_unix(sudo:session): session closed for user root Jul 31 12:18:34 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-8dbb917b-0570-4e8e-bdb8-664bbe5004c0 tempest-VolumesListTestJSON-588829472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-69fceb25-4032-4be6-b7b2-f6c88a47f737" returned: 0 in 0.835s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:18:34 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-8dbb917b-0570-4e8e-bdb8-664bbe5004c0 tempest-VolumesListTestJSON-588829472 None] Lock "cinder-quobyte-69fceb25-4032-4be6-b7b2-f6c88a47f737" released by "delete_volume" :: held 1.600s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:18:34 devstack cinder-volume[89182]: DEBUG cinder.quota [None req-8dbb917b-0570-4e8e-bdb8-664bbe5004c0 tempest-VolumesListTestJSON-588829472 None] Created reservations ['175468eb-4410-4970-8119-ae25152cf353', '9e12705c-170f-43ea-9072-21d8830dbb61', '88dc3745-0fad-424c-8d65-5dedf5541d13', '2aec7411-8c15-4de0-a74d-764336955a84'] {{(pid=89182) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 12:18:35 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-8dbb917b-0570-4e8e-bdb8-664bbe5004c0 tempest-VolumesListTestJSON-588829472 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:18:35 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-8dbb917b-0570-4e8e-bdb8-664bbe5004c0 tempest-VolumesListTestJSON-588829472 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:18:35 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-8dbb917b-0570-4e8e-bdb8-664bbe5004c0 tempest-VolumesListTestJSON-588829472 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:18:35 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-8dbb917b-0570-4e8e-bdb8-664bbe5004c0 tempest-VolumesListTestJSON-588829472 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:18:35 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-8dbb917b-0570-4e8e-bdb8-664bbe5004c0 tempest-VolumesListTestJSON-588829472 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:18:35 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-8dbb917b-0570-4e8e-bdb8-664bbe5004c0 tempest-VolumesListTestJSON-588829472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:18:35 devstack sudo[95534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 Jul 31 12:18:35 devstack sudo[95534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:18:35 devstack sudo[95534]: pam_unix(sudo:session): session closed for user root Jul 31 12:18:35 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-8dbb917b-0570-4e8e-bdb8-664bbe5004c0 tempest-VolumesListTestJSON-588829472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2" returned: 0 in 0.532s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:18:35 devstack cinder-volume[89182]: DEBUG cinder.manager [None req-8dbb917b-0570-4e8e-bdb8-664bbe5004c0 tempest-VolumesListTestJSON-588829472 None] Notifying Schedulers of capabilities ... {{(pid=89182) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 12:18:35 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-8dbb917b-0570-4e8e-bdb8-664bbe5004c0 tempest-VolumesListTestJSON-588829472 None] Deleted volume successfully. Jul 31 12:18:35 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-8dbb917b-0570-4e8e-bdb8-664bbe5004c0 tempest-VolumesListTestJSON-588829472 None] Lock "cinder-69fceb25-4032-4be6-b7b2-f6c88a47f737-delete_volume" released by "delete_volume" :: held 2.669s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:18:35 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-65f89457-fd35-4fb1-b73e-527d25739a71 tempest-VolumesListTestJSON-588829472 None] Acquiring lock "cinder-f2ef5a61-34e3-4adb-b1b7-d776103aa215-delete_volume" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:18:35 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-65f89457-fd35-4fb1-b73e-527d25739a71 tempest-VolumesListTestJSON-588829472 None] Lock "cinder-f2ef5a61-34e3-4adb-b1b7-d776103aa215-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:18:36 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-65f89457-fd35-4fb1-b73e-527d25739a71 tempest-VolumesListTestJSON-588829472 None] Acquiring lock "cinder-quobyte-f2ef5a61-34e3-4adb-b1b7-d776103aa215" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:18:36 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-65f89457-fd35-4fb1-b73e-527d25739a71 tempest-VolumesListTestJSON-588829472 None] Lock "cinder-quobyte-f2ef5a61-34e3-4adb-b1b7-d776103aa215" acquired by "delete_volume" :: waited 0.030s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:18:36 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[80551c39-a9da-4487-bf36-2711991b8961]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:18:36 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-65f89457-fd35-4fb1-b73e-527d25739a71 tempest-VolumesListTestJSON-588829472 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-f2ef5a61-34e3-4adb-b1b7-d776103aa215 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:18:36 devstack sudo[95538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-f2ef5a61-34e3-4adb-b1b7-d776103aa215 Jul 31 12:18:36 devstack sudo[95538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:18:36 devstack sudo[95538]: pam_unix(sudo:session): session closed for user root Jul 31 12:18:36 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-65f89457-fd35-4fb1-b73e-527d25739a71 tempest-VolumesListTestJSON-588829472 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-f2ef5a61-34e3-4adb-b1b7-d776103aa215" returned: 0 in 0.885s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:18:36 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-65f89457-fd35-4fb1-b73e-527d25739a71 tempest-VolumesListTestJSON-588829472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-f2ef5a61-34e3-4adb-b1b7-d776103aa215 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:18:37 devstack sudo[95543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-f2ef5a61-34e3-4adb-b1b7-d776103aa215 Jul 31 12:18:37 devstack sudo[95543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:18:37 devstack sudo[95543]: pam_unix(sudo:session): session closed for user root Jul 31 12:18:37 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-65f89457-fd35-4fb1-b73e-527d25739a71 tempest-VolumesListTestJSON-588829472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-f2ef5a61-34e3-4adb-b1b7-d776103aa215" returned: 0 in 0.715s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:18:37 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-65f89457-fd35-4fb1-b73e-527d25739a71 tempest-VolumesListTestJSON-588829472 None] Lock "cinder-quobyte-f2ef5a61-34e3-4adb-b1b7-d776103aa215" released by "delete_volume" :: held 1.703s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:18:37 devstack cinder-volume[89182]: DEBUG cinder.quota [None req-65f89457-fd35-4fb1-b73e-527d25739a71 tempest-VolumesListTestJSON-588829472 None] Created reservations ['06d0dc73-8460-4c3e-afa1-1f5ed91df4d8', '650ab04b-70ca-401e-a076-d1bc63ae3c61', '8a1ad1fc-c08a-4931-a3d0-b95ec99ce148', 'dd753a02-6357-4009-b796-16992e042739'] {{(pid=89182) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 12:18:38 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-65f89457-fd35-4fb1-b73e-527d25739a71 tempest-VolumesListTestJSON-588829472 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:18:38 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-65f89457-fd35-4fb1-b73e-527d25739a71 tempest-VolumesListTestJSON-588829472 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:18:38 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-65f89457-fd35-4fb1-b73e-527d25739a71 tempest-VolumesListTestJSON-588829472 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:18:38 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-65f89457-fd35-4fb1-b73e-527d25739a71 tempest-VolumesListTestJSON-588829472 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:18:38 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-65f89457-fd35-4fb1-b73e-527d25739a71 tempest-VolumesListTestJSON-588829472 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:18:38 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-65f89457-fd35-4fb1-b73e-527d25739a71 tempest-VolumesListTestJSON-588829472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:18:38 devstack sudo[95547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 Jul 31 12:18:38 devstack sudo[95547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:18:38 devstack sudo[95547]: pam_unix(sudo:session): session closed for user root Jul 31 12:18:38 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-65f89457-fd35-4fb1-b73e-527d25739a71 tempest-VolumesListTestJSON-588829472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2" returned: 0 in 0.517s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:18:38 devstack cinder-volume[89182]: DEBUG cinder.manager [None req-65f89457-fd35-4fb1-b73e-527d25739a71 tempest-VolumesListTestJSON-588829472 None] Notifying Schedulers of capabilities ... {{(pid=89182) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 12:18:38 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-65f89457-fd35-4fb1-b73e-527d25739a71 tempest-VolumesListTestJSON-588829472 None] Deleted volume successfully. Jul 31 12:18:38 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-65f89457-fd35-4fb1-b73e-527d25739a71 tempest-VolumesListTestJSON-588829472 None] Lock "cinder-f2ef5a61-34e3-4adb-b1b7-d776103aa215-delete_volume" released by "delete_volume" :: held 2.836s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:18:38 devstack cinder-volume[89182]: DEBUG cinder.volume.flows.manager.create_volume [None req-6bd2a3f3-587f-4d2a-94c1-dd5341e18ab2 tempest-ServerRescueNegativeTestJSON-1046577311 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89182) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 12:18:38 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-6bd2a3f3-587f-4d2a-94c1-dd5341e18ab2 tempest-ServerRescueNegativeTestJSON-1046577311 None] Flow 'volume_create_manager' (43dbe897-7a5f-4f4d-a3c3-bd505cb44021) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:18:38 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-6bd2a3f3-587f-4d2a-94c1-dd5341e18ab2 tempest-ServerRescueNegativeTestJSON-1046577311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3dae12a-b9e4-4bc4-b26a-5a2e5226c0ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:18:38 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-b5a3a45c-2ded-495f-9f11-0817fcb0f901 tempest-VolumesListTestJSON-588829472 None] Acquiring lock "cinder-bf7f9371-5334-4e93-86a2-f1e61197ebfc-delete_volume" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:18:39 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-6bd2a3f3-587f-4d2a-94c1-dd5341e18ab2 tempest-ServerRescueNegativeTestJSON-1046577311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3dae12a-b9e4-4bc4-b26a-5a2e5226c0ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:18:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1877482684',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36d51079-8c4c-4230-b7de-b5fc3eb5c036,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='098c677d479c4011a26e6e8fa2c93cbc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:18:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:18:39Z,use_quota=True,user_id='b5e3391537004972b1695d2efdec9dc8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:18:39 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-6bd2a3f3-587f-4d2a-94c1-dd5341e18ab2 tempest-ServerRescueNegativeTestJSON-1046577311 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20dff64d-8107-4c8f-a7d1-26e5026e673e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:18:39 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-6bd2a3f3-587f-4d2a-94c1-dd5341e18ab2 tempest-ServerRescueNegativeTestJSON-1046577311 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20dff64d-8107-4c8f-a7d1-26e5026e673e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:18:39 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-6bd2a3f3-587f-4d2a-94c1-dd5341e18ab2 tempest-ServerRescueNegativeTestJSON-1046577311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d80dc0ea-1f0c-4627-9427-28f4ddc6a967) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:18:39 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-6bd2a3f3-587f-4d2a-94c1-dd5341e18ab2 tempest-ServerRescueNegativeTestJSON-1046577311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d80dc0ea-1f0c-4627-9427-28f4ddc6a967) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '36d51079-8c4c-4230-b7de-b5fc3eb5c036', 'volume_name': 'volume-36d51079-8c4c-4230-b7de-b5fc3eb5c036', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:18:39 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-6bd2a3f3-587f-4d2a-94c1-dd5341e18ab2 tempest-ServerRescueNegativeTestJSON-1046577311 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a00af9f4-c401-4b73-a990-e9a091fd47c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:18:39 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-6bd2a3f3-587f-4d2a-94c1-dd5341e18ab2 tempest-ServerRescueNegativeTestJSON-1046577311 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a00af9f4-c401-4b73-a990-e9a091fd47c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:18:39 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-6bd2a3f3-587f-4d2a-94c1-dd5341e18ab2 tempest-ServerRescueNegativeTestJSON-1046577311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85d6493c-58e9-4b4f-b1ac-f5c91ad679da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:18:39 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-6bd2a3f3-587f-4d2a-94c1-dd5341e18ab2 tempest-ServerRescueNegativeTestJSON-1046577311 None] Volume 36d51079-8c4c-4230-b7de-b5fc3eb5c036: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-36d51079-8c4c-4230-b7de-b5fc3eb5c036', 'volume_size': 1} Jul 31 12:18:39 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-6bd2a3f3-587f-4d2a-94c1-dd5341e18ab2 tempest-ServerRescueNegativeTestJSON-1046577311 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:18:39 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-6bd2a3f3-587f-4d2a-94c1-dd5341e18ab2 tempest-ServerRescueNegativeTestJSON-1046577311 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:18:39 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-6bd2a3f3-587f-4d2a-94c1-dd5341e18ab2 tempest-ServerRescueNegativeTestJSON-1046577311 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:18:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1877482684',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36d51079-8c4c-4230-b7de-b5fc3eb5c036,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='098c677d479c4011a26e6e8fa2c93cbc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:18:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:18:39Z,use_quota=True,user_id='b5e3391537004972b1695d2efdec9dc8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)}" {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 12:18:39 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-6bd2a3f3-587f-4d2a-94c1-dd5341e18ab2 tempest-ServerRescueNegativeTestJSON-1046577311 None] Creating volume 36d51079-8c4c-4230-b7de-b5fc3eb5c036 {{(pid=89182) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 12:18:39 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-6bd2a3f3-587f-4d2a-94c1-dd5341e18ab2 tempest-ServerRescueNegativeTestJSON-1046577311 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:18:39 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-6bd2a3f3-587f-4d2a-94c1-dd5341e18ab2 tempest-ServerRescueNegativeTestJSON-1046577311 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:18:39 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-6bd2a3f3-587f-4d2a-94c1-dd5341e18ab2 tempest-ServerRescueNegativeTestJSON-1046577311 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:18:39 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-6bd2a3f3-587f-4d2a-94c1-dd5341e18ab2 tempest-ServerRescueNegativeTestJSON-1046577311 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:18:39 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-6bd2a3f3-587f-4d2a-94c1-dd5341e18ab2 tempest-ServerRescueNegativeTestJSON-1046577311 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:18:39 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-6bd2a3f3-587f-4d2a-94c1-dd5341e18ab2 tempest-ServerRescueNegativeTestJSON-1046577311 None] Selected osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 as target Quobyte volume. {{(pid=89182) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 12:18:39 devstack cinder-volume[89182]: INFO cinder.volume.drivers.remotefs [None req-6bd2a3f3-587f-4d2a-94c1-dd5341e18ab2 tempest-ServerRescueNegativeTestJSON-1046577311 None] casted to osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 Jul 31 12:18:39 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-6bd2a3f3-587f-4d2a-94c1-dd5341e18ab2 tempest-ServerRescueNegativeTestJSON-1046577311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-36d51079-8c4c-4230-b7de-b5fc3eb5c036 1073741824 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:18:39 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-b5a3a45c-2ded-495f-9f11-0817fcb0f901 tempest-VolumesListTestJSON-588829472 None] Lock "cinder-bf7f9371-5334-4e93-86a2-f1e61197ebfc-delete_volume" acquired by "delete_volume" :: waited 0.109s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:18:39 devstack cinder-volume[89182]: DEBUG cinder.volume.flows.manager.create_volume [None req-30bb1480-aad6-4142-8361-919e063294dd tempest-AbsoluteLimitsTests-570086898 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89182) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 12:18:39 devstack sudo[95550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-36d51079-8c4c-4230-b7de-b5fc3eb5c036 1073741824 Jul 31 12:18:39 devstack sudo[95550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:18:39 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-30bb1480-aad6-4142-8361-919e063294dd tempest-AbsoluteLimitsTests-570086898 None] Flow 'volume_create_manager' (4a81109e-c8ca-4e74-9a37-d1ee447542e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:18:39 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-30bb1480-aad6-4142-8361-919e063294dd tempest-AbsoluteLimitsTests-570086898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29ac8348-5372-4f1a-b4f8-c8db13bfd82b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:18:39 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-b5a3a45c-2ded-495f-9f11-0817fcb0f901 tempest-VolumesListTestJSON-588829472 None] Acquiring lock "cinder-quobyte-bf7f9371-5334-4e93-86a2-f1e61197ebfc" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:18:39 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-30bb1480-aad6-4142-8361-919e063294dd tempest-AbsoluteLimitsTests-570086898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29ac8348-5372-4f1a-b4f8-c8db13bfd82b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:18:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1771059255',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e0fb16d-98cf-484f-91c0-f8563bd1b342,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb32bcbda8034f0caf23b1bf2e7b0174',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:18:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:18:39Z,use_quota=True,user_id='78d1c1b8732a44ab8ede3b23140dc7bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:18:39 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-30bb1480-aad6-4142-8361-919e063294dd tempest-AbsoluteLimitsTests-570086898 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4466430f-814c-4297-adbb-784e93fb6d4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:18:39 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-30bb1480-aad6-4142-8361-919e063294dd tempest-AbsoluteLimitsTests-570086898 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4466430f-814c-4297-adbb-784e93fb6d4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:18:39 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-30bb1480-aad6-4142-8361-919e063294dd tempest-AbsoluteLimitsTests-570086898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b6a0099-e8c1-42d4-9672-f058a39de16d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:18:39 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-30bb1480-aad6-4142-8361-919e063294dd tempest-AbsoluteLimitsTests-570086898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b6a0099-e8c1-42d4-9672-f058a39de16d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7e0fb16d-98cf-484f-91c0-f8563bd1b342', 'volume_name': 'volume-7e0fb16d-98cf-484f-91c0-f8563bd1b342', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:18:39 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-30bb1480-aad6-4142-8361-919e063294dd tempest-AbsoluteLimitsTests-570086898 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37356507-7e87-484b-a6d0-8607002d5339) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:18:39 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-30bb1480-aad6-4142-8361-919e063294dd tempest-AbsoluteLimitsTests-570086898 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37356507-7e87-484b-a6d0-8607002d5339) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:18:39 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-30bb1480-aad6-4142-8361-919e063294dd tempest-AbsoluteLimitsTests-570086898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (555b61ba-ce43-4d91-9870-63de28f39082) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:18:39 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-30bb1480-aad6-4142-8361-919e063294dd tempest-AbsoluteLimitsTests-570086898 None] Volume 7e0fb16d-98cf-484f-91c0-f8563bd1b342: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7e0fb16d-98cf-484f-91c0-f8563bd1b342', 'volume_size': 1} Jul 31 12:18:39 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-30bb1480-aad6-4142-8361-919e063294dd tempest-AbsoluteLimitsTests-570086898 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:18:39 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-b5a3a45c-2ded-495f-9f11-0817fcb0f901 tempest-VolumesListTestJSON-588829472 None] Lock "cinder-quobyte-bf7f9371-5334-4e93-86a2-f1e61197ebfc" acquired by "delete_volume" :: waited 0.082s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:18:39 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2720ce4-c1db-4f61-bc1e-a039083c82b2]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:18:39 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-b5a3a45c-2ded-495f-9f11-0817fcb0f901 tempest-VolumesListTestJSON-588829472 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-bf7f9371-5334-4e93-86a2-f1e61197ebfc {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:18:39 devstack sudo[95552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-bf7f9371-5334-4e93-86a2-f1e61197ebfc Jul 31 12:18:39 devstack sudo[95552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:18:39 devstack sudo[95550]: pam_unix(sudo:session): session closed for user root Jul 31 12:18:39 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-6bd2a3f3-587f-4d2a-94c1-dd5341e18ab2 tempest-ServerRescueNegativeTestJSON-1046577311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-36d51079-8c4c-4230-b7de-b5fc3eb5c036 1073741824" returned: 0 in 0.898s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:18:40 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-6bd2a3f3-587f-4d2a-94c1-dd5341e18ab2 tempest-ServerRescueNegativeTestJSON-1046577311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-36d51079-8c4c-4230-b7de-b5fc3eb5c036 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:18:40 devstack sudo[95552]: pam_unix(sudo:session): session closed for user root Jul 31 12:18:40 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-b5a3a45c-2ded-495f-9f11-0817fcb0f901 tempest-VolumesListTestJSON-588829472 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-bf7f9371-5334-4e93-86a2-f1e61197ebfc" returned: 0 in 0.742s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:18:40 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-b5a3a45c-2ded-495f-9f11-0817fcb0f901 tempest-VolumesListTestJSON-588829472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-bf7f9371-5334-4e93-86a2-f1e61197ebfc {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:18:40 devstack sudo[95604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-36d51079-8c4c-4230-b7de-b5fc3eb5c036 Jul 31 12:18:40 devstack sudo[95604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:18:40 devstack sudo[95606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-bf7f9371-5334-4e93-86a2-f1e61197ebfc Jul 31 12:18:40 devstack sudo[95606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:18:40 devstack sudo[95604]: pam_unix(sudo:session): session closed for user root Jul 31 12:18:40 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-6bd2a3f3-587f-4d2a-94c1-dd5341e18ab2 tempest-ServerRescueNegativeTestJSON-1046577311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-36d51079-8c4c-4230-b7de-b5fc3eb5c036" returned: 0 in 0.484s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:18:40 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-6bd2a3f3-587f-4d2a-94c1-dd5341e18ab2 tempest-ServerRescueNegativeTestJSON-1046577311 None] <== create_volume: return (1484ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'} {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 12:18:40 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-6bd2a3f3-587f-4d2a-94c1-dd5341e18ab2 tempest-ServerRescueNegativeTestJSON-1046577311 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.486s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:18:40 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-30bb1480-aad6-4142-8361-919e063294dd tempest-AbsoluteLimitsTests-570086898 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.303s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:18:40 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-30bb1480-aad6-4142-8361-919e063294dd tempest-AbsoluteLimitsTests-570086898 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:18:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1771059255',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e0fb16d-98cf-484f-91c0-f8563bd1b342,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb32bcbda8034f0caf23b1bf2e7b0174',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:18:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:18:39Z,use_quota=True,user_id='78d1c1b8732a44ab8ede3b23140dc7bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)}" {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 12:18:40 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-30bb1480-aad6-4142-8361-919e063294dd tempest-AbsoluteLimitsTests-570086898 None] Creating volume 7e0fb16d-98cf-484f-91c0-f8563bd1b342 {{(pid=89182) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 12:18:40 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-30bb1480-aad6-4142-8361-919e063294dd tempest-AbsoluteLimitsTests-570086898 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:18:40 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-30bb1480-aad6-4142-8361-919e063294dd tempest-AbsoluteLimitsTests-570086898 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:18:40 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-30bb1480-aad6-4142-8361-919e063294dd tempest-AbsoluteLimitsTests-570086898 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:18:40 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-30bb1480-aad6-4142-8361-919e063294dd tempest-AbsoluteLimitsTests-570086898 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:18:40 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-30bb1480-aad6-4142-8361-919e063294dd tempest-AbsoluteLimitsTests-570086898 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:18:40 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-30bb1480-aad6-4142-8361-919e063294dd tempest-AbsoluteLimitsTests-570086898 None] Selected osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 as target Quobyte volume. {{(pid=89182) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 12:18:40 devstack cinder-volume[89182]: INFO cinder.volume.drivers.remotefs [None req-30bb1480-aad6-4142-8361-919e063294dd tempest-AbsoluteLimitsTests-570086898 None] casted to osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 Jul 31 12:18:40 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-30bb1480-aad6-4142-8361-919e063294dd tempest-AbsoluteLimitsTests-570086898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-7e0fb16d-98cf-484f-91c0-f8563bd1b342 1073741824 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:18:40 devstack sudo[95606]: pam_unix(sudo:session): session closed for user root Jul 31 12:18:40 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-b5a3a45c-2ded-495f-9f11-0817fcb0f901 tempest-VolumesListTestJSON-588829472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-bf7f9371-5334-4e93-86a2-f1e61197ebfc" returned: 0 in 0.501s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:18:40 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-6bd2a3f3-587f-4d2a-94c1-dd5341e18ab2 tempest-ServerRescueNegativeTestJSON-1046577311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85d6493c-58e9-4b4f-b1ac-f5c91ad679da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-36d51079-8c4c-4230-b7de-b5fc3eb5c036', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:18:40 devstack sudo[95610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-7e0fb16d-98cf-484f-91c0-f8563bd1b342 1073741824 Jul 31 12:18:40 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-6bd2a3f3-587f-4d2a-94c1-dd5341e18ab2 tempest-ServerRescueNegativeTestJSON-1046577311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (693bb1d7-a866-4255-9acc-e4c801fe7a1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:18:40 devstack sudo[95610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:18:40 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-b5a3a45c-2ded-495f-9f11-0817fcb0f901 tempest-VolumesListTestJSON-588829472 None] Lock "cinder-quobyte-bf7f9371-5334-4e93-86a2-f1e61197ebfc" released by "delete_volume" :: held 1.412s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:18:40 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-6bd2a3f3-587f-4d2a-94c1-dd5341e18ab2 tempest-ServerRescueNegativeTestJSON-1046577311 None] Volume volume-36d51079-8c4c-4230-b7de-b5fc3eb5c036 (36d51079-8c4c-4230-b7de-b5fc3eb5c036): created successfully Jul 31 12:18:40 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-6bd2a3f3-587f-4d2a-94c1-dd5341e18ab2 tempest-ServerRescueNegativeTestJSON-1046577311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (693bb1d7-a866-4255-9acc-e4c801fe7a1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:18:40 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-6bd2a3f3-587f-4d2a-94c1-dd5341e18ab2 tempest-ServerRescueNegativeTestJSON-1046577311 None] Flow 'volume_create_manager' (43dbe897-7a5f-4f4d-a3c3-bd505cb44021) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:18:40 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-6bd2a3f3-587f-4d2a-94c1-dd5341e18ab2 tempest-ServerRescueNegativeTestJSON-1046577311 None] Created volume successfully. Jul 31 12:18:41 devstack cinder-volume[89182]: DEBUG cinder.quota [None req-b5a3a45c-2ded-495f-9f11-0817fcb0f901 tempest-VolumesListTestJSON-588829472 None] Created reservations ['b6ff877c-6c6d-4323-8d78-47b4db5bf4e5', '901f9402-5364-4223-9e6b-5fcb961a1908', 'd6d6628c-618a-41a1-bd72-f4449dd28cc8', 'e41a1003-191e-441b-baaf-c6fbd7b27cfa'] {{(pid=89182) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 12:18:41 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-b5a3a45c-2ded-495f-9f11-0817fcb0f901 tempest-VolumesListTestJSON-588829472 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:18:41 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-b5a3a45c-2ded-495f-9f11-0817fcb0f901 tempest-VolumesListTestJSON-588829472 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:18:41 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-b5a3a45c-2ded-495f-9f11-0817fcb0f901 tempest-VolumesListTestJSON-588829472 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:18:41 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-b5a3a45c-2ded-495f-9f11-0817fcb0f901 tempest-VolumesListTestJSON-588829472 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:18:41 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-b5a3a45c-2ded-495f-9f11-0817fcb0f901 tempest-VolumesListTestJSON-588829472 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:18:41 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-b5a3a45c-2ded-495f-9f11-0817fcb0f901 tempest-VolumesListTestJSON-588829472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:18:41 devstack sudo[95615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 Jul 31 12:18:41 devstack sudo[95615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:18:41 devstack sudo[95615]: pam_unix(sudo:session): session closed for user root Jul 31 12:18:41 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-b5a3a45c-2ded-495f-9f11-0817fcb0f901 tempest-VolumesListTestJSON-588829472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2" returned: 0 in 0.495s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:18:41 devstack cinder-volume[89182]: DEBUG cinder.manager [None req-b5a3a45c-2ded-495f-9f11-0817fcb0f901 tempest-VolumesListTestJSON-588829472 None] Notifying Schedulers of capabilities ... {{(pid=89182) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 12:18:41 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-b5a3a45c-2ded-495f-9f11-0817fcb0f901 tempest-VolumesListTestJSON-588829472 None] Deleted volume successfully. Jul 31 12:18:41 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-b5a3a45c-2ded-495f-9f11-0817fcb0f901 tempest-VolumesListTestJSON-588829472 None] Lock "cinder-bf7f9371-5334-4e93-86a2-f1e61197ebfc-delete_volume" released by "delete_volume" :: held 2.701s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:18:41 devstack sudo[95610]: pam_unix(sudo:session): session closed for user root Jul 31 12:18:41 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-30bb1480-aad6-4142-8361-919e063294dd tempest-AbsoluteLimitsTests-570086898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-7e0fb16d-98cf-484f-91c0-f8563bd1b342 1073741824" returned: 0 in 1.267s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:18:41 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-30bb1480-aad6-4142-8361-919e063294dd tempest-AbsoluteLimitsTests-570086898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-7e0fb16d-98cf-484f-91c0-f8563bd1b342 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:18:41 devstack sudo[95619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-7e0fb16d-98cf-484f-91c0-f8563bd1b342 Jul 31 12:18:41 devstack sudo[95619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:18:42 devstack sudo[95619]: pam_unix(sudo:session): session closed for user root Jul 31 12:18:42 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-30bb1480-aad6-4142-8361-919e063294dd tempest-AbsoluteLimitsTests-570086898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-7e0fb16d-98cf-484f-91c0-f8563bd1b342" returned: 0 in 0.468s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:18:42 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-30bb1480-aad6-4142-8361-919e063294dd tempest-AbsoluteLimitsTests-570086898 None] <== create_volume: return (1837ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'} {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 12:18:42 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-30bb1480-aad6-4142-8361-919e063294dd tempest-AbsoluteLimitsTests-570086898 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.841s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:18:42 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-30bb1480-aad6-4142-8361-919e063294dd tempest-AbsoluteLimitsTests-570086898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (555b61ba-ce43-4d91-9870-63de28f39082) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7e0fb16d-98cf-484f-91c0-f8563bd1b342', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:18:42 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-30bb1480-aad6-4142-8361-919e063294dd tempest-AbsoluteLimitsTests-570086898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0b79dfc-2f97-4c9a-9879-f77144e20a29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:18:42 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-30bb1480-aad6-4142-8361-919e063294dd tempest-AbsoluteLimitsTests-570086898 None] Volume volume-7e0fb16d-98cf-484f-91c0-f8563bd1b342 (7e0fb16d-98cf-484f-91c0-f8563bd1b342): created successfully Jul 31 12:18:42 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-30bb1480-aad6-4142-8361-919e063294dd tempest-AbsoluteLimitsTests-570086898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0b79dfc-2f97-4c9a-9879-f77144e20a29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:18:42 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-30bb1480-aad6-4142-8361-919e063294dd tempest-AbsoluteLimitsTests-570086898 None] Flow 'volume_create_manager' (4a81109e-c8ca-4e74-9a37-d1ee447542e3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:18:42 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-30bb1480-aad6-4142-8361-919e063294dd tempest-AbsoluteLimitsTests-570086898 None] Created volume successfully. Jul 31 12:18:43 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-4fba5d20-9d17-4f02-b823-832a1905ca5b tempest-AbsoluteLimitsTests-570086898 None] Acquiring lock "cinder-7e0fb16d-98cf-484f-91c0-f8563bd1b342-delete_volume" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:18:43 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-4fba5d20-9d17-4f02-b823-832a1905ca5b tempest-AbsoluteLimitsTests-570086898 None] Lock "cinder-7e0fb16d-98cf-484f-91c0-f8563bd1b342-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:18:43 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-4fba5d20-9d17-4f02-b823-832a1905ca5b tempest-AbsoluteLimitsTests-570086898 None] Acquiring lock "cinder-quobyte-7e0fb16d-98cf-484f-91c0-f8563bd1b342" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:18:43 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-4fba5d20-9d17-4f02-b823-832a1905ca5b tempest-AbsoluteLimitsTests-570086898 None] Lock "cinder-quobyte-7e0fb16d-98cf-484f-91c0-f8563bd1b342" acquired by "delete_volume" :: waited 0.045s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:18:43 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[e098f689-9621-4181-ad95-c624eb0cf19b]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:18:43 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-4fba5d20-9d17-4f02-b823-832a1905ca5b tempest-AbsoluteLimitsTests-570086898 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-7e0fb16d-98cf-484f-91c0-f8563bd1b342 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:18:44 devstack sudo[95622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-7e0fb16d-98cf-484f-91c0-f8563bd1b342 Jul 31 12:18:44 devstack sudo[95622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:18:44 devstack sudo[95622]: pam_unix(sudo:session): session closed for user root Jul 31 12:18:44 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-4fba5d20-9d17-4f02-b823-832a1905ca5b tempest-AbsoluteLimitsTests-570086898 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-7e0fb16d-98cf-484f-91c0-f8563bd1b342" returned: 0 in 0.449s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:18:44 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-4fba5d20-9d17-4f02-b823-832a1905ca5b tempest-AbsoluteLimitsTests-570086898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-7e0fb16d-98cf-484f-91c0-f8563bd1b342 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:18:44 devstack sudo[95627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-7e0fb16d-98cf-484f-91c0-f8563bd1b342 Jul 31 12:18:44 devstack sudo[95627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:18:44 devstack sudo[95627]: pam_unix(sudo:session): session closed for user root Jul 31 12:18:44 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-4fba5d20-9d17-4f02-b823-832a1905ca5b tempest-AbsoluteLimitsTests-570086898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-7e0fb16d-98cf-484f-91c0-f8563bd1b342" returned: 0 in 0.322s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:18:44 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-4fba5d20-9d17-4f02-b823-832a1905ca5b tempest-AbsoluteLimitsTests-570086898 None] Lock "cinder-quobyte-7e0fb16d-98cf-484f-91c0-f8563bd1b342" released by "delete_volume" :: held 0.848s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:18:44 devstack cinder-volume[89182]: DEBUG cinder.quota [None req-4fba5d20-9d17-4f02-b823-832a1905ca5b tempest-AbsoluteLimitsTests-570086898 None] Created reservations ['5ea16c8f-f002-47ab-b6eb-019f009f8ad1', '3d9ebe45-4204-40ce-af03-63606df8ca42', '8f2f5b6e-609a-4f70-9811-e2dc610fe9db', '2218137c-8a1e-44a9-9b3a-a4b140483f39'] {{(pid=89182) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 12:18:44 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-4fba5d20-9d17-4f02-b823-832a1905ca5b tempest-AbsoluteLimitsTests-570086898 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:18:44 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-4fba5d20-9d17-4f02-b823-832a1905ca5b tempest-AbsoluteLimitsTests-570086898 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:18:44 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-4fba5d20-9d17-4f02-b823-832a1905ca5b tempest-AbsoluteLimitsTests-570086898 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:18:44 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-4fba5d20-9d17-4f02-b823-832a1905ca5b tempest-AbsoluteLimitsTests-570086898 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:18:44 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-4fba5d20-9d17-4f02-b823-832a1905ca5b tempest-AbsoluteLimitsTests-570086898 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:18:44 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-4fba5d20-9d17-4f02-b823-832a1905ca5b tempest-AbsoluteLimitsTests-570086898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:18:45 devstack sudo[95631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 Jul 31 12:18:45 devstack sudo[95631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:18:45 devstack sudo[95631]: pam_unix(sudo:session): session closed for user root Jul 31 12:18:45 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-4fba5d20-9d17-4f02-b823-832a1905ca5b tempest-AbsoluteLimitsTests-570086898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2" returned: 0 in 0.522s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:18:45 devstack cinder-volume[89182]: DEBUG cinder.manager [None req-4fba5d20-9d17-4f02-b823-832a1905ca5b tempest-AbsoluteLimitsTests-570086898 None] Notifying Schedulers of capabilities ... {{(pid=89182) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 12:18:45 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-4fba5d20-9d17-4f02-b823-832a1905ca5b tempest-AbsoluteLimitsTests-570086898 None] Deleted volume successfully. Jul 31 12:18:45 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-4fba5d20-9d17-4f02-b823-832a1905ca5b tempest-AbsoluteLimitsTests-570086898 None] Lock "cinder-7e0fb16d-98cf-484f-91c0-f8563bd1b342-delete_volume" released by "delete_volume" :: held 1.854s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:18:54 devstack cinder-volume[89182]: DEBUG cinder.volume.flows.manager.create_volume [None req-cba448ea-614f-47a0-82db-c86bc0eb1ab2 tempest-VolumesSnapshotListTestJSON-1847501116 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89182) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 12:18:54 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-cba448ea-614f-47a0-82db-c86bc0eb1ab2 tempest-VolumesSnapshotListTestJSON-1847501116 None] Flow 'volume_create_manager' (e4868221-9017-41db-a742-35e308ed60bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:18:54 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-cba448ea-614f-47a0-82db-c86bc0eb1ab2 tempest-VolumesSnapshotListTestJSON-1847501116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bda0b079-6a7e-49a3-8c22-45b90dbe096f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:18:54 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-cba448ea-614f-47a0-82db-c86bc0eb1ab2 tempest-VolumesSnapshotListTestJSON-1847501116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bda0b079-6a7e-49a3-8c22-45b90dbe096f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:18:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1762317291',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62ecccd7-9e16-4c9d-af3c-eaba24bb5169,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='173f90645e5f45a08118501096b389a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:18:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:18:54Z,use_quota=True,user_id='7df57ff55d1545f7a092bc96bb34ba46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:18:54 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-cba448ea-614f-47a0-82db-c86bc0eb1ab2 tempest-VolumesSnapshotListTestJSON-1847501116 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2964ab89-e33c-4c70-b512-88b8ab639099) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:18:54 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-cba448ea-614f-47a0-82db-c86bc0eb1ab2 tempest-VolumesSnapshotListTestJSON-1847501116 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2964ab89-e33c-4c70-b512-88b8ab639099) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:18:54 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-cba448ea-614f-47a0-82db-c86bc0eb1ab2 tempest-VolumesSnapshotListTestJSON-1847501116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aaea7192-7a87-4e14-bcf8-a527d75b7869) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:18:54 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-cba448ea-614f-47a0-82db-c86bc0eb1ab2 tempest-VolumesSnapshotListTestJSON-1847501116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aaea7192-7a87-4e14-bcf8-a527d75b7869) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '62ecccd7-9e16-4c9d-af3c-eaba24bb5169', 'volume_name': 'volume-62ecccd7-9e16-4c9d-af3c-eaba24bb5169', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:18:54 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-cba448ea-614f-47a0-82db-c86bc0eb1ab2 tempest-VolumesSnapshotListTestJSON-1847501116 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1bf84231-27bd-475d-bae2-acd5f54615f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:18:54 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-cba448ea-614f-47a0-82db-c86bc0eb1ab2 tempest-VolumesSnapshotListTestJSON-1847501116 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1bf84231-27bd-475d-bae2-acd5f54615f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:18:54 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-cba448ea-614f-47a0-82db-c86bc0eb1ab2 tempest-VolumesSnapshotListTestJSON-1847501116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed7cfb56-e078-4f5b-a8ff-f66a105a08ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:18:54 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-cba448ea-614f-47a0-82db-c86bc0eb1ab2 tempest-VolumesSnapshotListTestJSON-1847501116 None] Volume 62ecccd7-9e16-4c9d-af3c-eaba24bb5169: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-62ecccd7-9e16-4c9d-af3c-eaba24bb5169', 'volume_size': 1} Jul 31 12:18:54 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-cba448ea-614f-47a0-82db-c86bc0eb1ab2 tempest-VolumesSnapshotListTestJSON-1847501116 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:18:54 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-cba448ea-614f-47a0-82db-c86bc0eb1ab2 tempest-VolumesSnapshotListTestJSON-1847501116 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:18:54 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-cba448ea-614f-47a0-82db-c86bc0eb1ab2 tempest-VolumesSnapshotListTestJSON-1847501116 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:18:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1762317291',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62ecccd7-9e16-4c9d-af3c-eaba24bb5169,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='173f90645e5f45a08118501096b389a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:18:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:18:54Z,use_quota=True,user_id='7df57ff55d1545f7a092bc96bb34ba46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)}" {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 12:18:54 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-cba448ea-614f-47a0-82db-c86bc0eb1ab2 tempest-VolumesSnapshotListTestJSON-1847501116 None] Creating volume 62ecccd7-9e16-4c9d-af3c-eaba24bb5169 {{(pid=89182) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 12:18:54 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-cba448ea-614f-47a0-82db-c86bc0eb1ab2 tempest-VolumesSnapshotListTestJSON-1847501116 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:18:54 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-cba448ea-614f-47a0-82db-c86bc0eb1ab2 tempest-VolumesSnapshotListTestJSON-1847501116 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:18:54 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-cba448ea-614f-47a0-82db-c86bc0eb1ab2 tempest-VolumesSnapshotListTestJSON-1847501116 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:18:54 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-cba448ea-614f-47a0-82db-c86bc0eb1ab2 tempest-VolumesSnapshotListTestJSON-1847501116 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:18:54 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-cba448ea-614f-47a0-82db-c86bc0eb1ab2 tempest-VolumesSnapshotListTestJSON-1847501116 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:18:54 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-cba448ea-614f-47a0-82db-c86bc0eb1ab2 tempest-VolumesSnapshotListTestJSON-1847501116 None] Selected osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 as target Quobyte volume. {{(pid=89182) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 12:18:54 devstack cinder-volume[89182]: INFO cinder.volume.drivers.remotefs [None req-cba448ea-614f-47a0-82db-c86bc0eb1ab2 tempest-VolumesSnapshotListTestJSON-1847501116 None] casted to osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 Jul 31 12:18:54 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-cba448ea-614f-47a0-82db-c86bc0eb1ab2 tempest-VolumesSnapshotListTestJSON-1847501116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-62ecccd7-9e16-4c9d-af3c-eaba24bb5169 1073741824 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:18:54 devstack sudo[95720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-62ecccd7-9e16-4c9d-af3c-eaba24bb5169 1073741824 Jul 31 12:18:54 devstack sudo[95720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:18:55 devstack sudo[95720]: pam_unix(sudo:session): session closed for user root Jul 31 12:18:55 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-cba448ea-614f-47a0-82db-c86bc0eb1ab2 tempest-VolumesSnapshotListTestJSON-1847501116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-62ecccd7-9e16-4c9d-af3c-eaba24bb5169 1073741824" returned: 0 in 0.806s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:18:55 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-cba448ea-614f-47a0-82db-c86bc0eb1ab2 tempest-VolumesSnapshotListTestJSON-1847501116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-62ecccd7-9e16-4c9d-af3c-eaba24bb5169 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:18:55 devstack sudo[95726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-62ecccd7-9e16-4c9d-af3c-eaba24bb5169 Jul 31 12:18:55 devstack sudo[95726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:18:55 devstack sudo[95726]: pam_unix(sudo:session): session closed for user root Jul 31 12:18:55 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-cba448ea-614f-47a0-82db-c86bc0eb1ab2 tempest-VolumesSnapshotListTestJSON-1847501116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-62ecccd7-9e16-4c9d-af3c-eaba24bb5169" returned: 0 in 0.422s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:18:55 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-cba448ea-614f-47a0-82db-c86bc0eb1ab2 tempest-VolumesSnapshotListTestJSON-1847501116 None] <== create_volume: return (1302ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'} {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 12:18:55 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-cba448ea-614f-47a0-82db-c86bc0eb1ab2 tempest-VolumesSnapshotListTestJSON-1847501116 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.305s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:18:55 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-cba448ea-614f-47a0-82db-c86bc0eb1ab2 tempest-VolumesSnapshotListTestJSON-1847501116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed7cfb56-e078-4f5b-a8ff-f66a105a08ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-62ecccd7-9e16-4c9d-af3c-eaba24bb5169', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:18:55 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-cba448ea-614f-47a0-82db-c86bc0eb1ab2 tempest-VolumesSnapshotListTestJSON-1847501116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (321bb30c-1b5a-4003-966a-585d3ba38b1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:18:55 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-cba448ea-614f-47a0-82db-c86bc0eb1ab2 tempest-VolumesSnapshotListTestJSON-1847501116 None] Volume volume-62ecccd7-9e16-4c9d-af3c-eaba24bb5169 (62ecccd7-9e16-4c9d-af3c-eaba24bb5169): created successfully Jul 31 12:18:55 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-cba448ea-614f-47a0-82db-c86bc0eb1ab2 tempest-VolumesSnapshotListTestJSON-1847501116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (321bb30c-1b5a-4003-966a-585d3ba38b1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:18:55 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-cba448ea-614f-47a0-82db-c86bc0eb1ab2 tempest-VolumesSnapshotListTestJSON-1847501116 None] Flow 'volume_create_manager' (e4868221-9017-41db-a742-35e308ed60bd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:18:55 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-cba448ea-614f-47a0-82db-c86bc0eb1ab2 tempest-VolumesSnapshotListTestJSON-1847501116 None] Created volume successfully. Jul 31 12:18:56 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-f63b9a2a-eed0-4a8a-9579-799595edde50 tempest-VolumesSnapshotListTestJSON-1847501116 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:18:56 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-f63b9a2a-eed0-4a8a-9579-799595edde50 tempest-VolumesSnapshotListTestJSON-1847501116 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:18:56 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-f63b9a2a-eed0-4a8a-9579-799595edde50 tempest-VolumesSnapshotListTestJSON-1847501116 None] Creating offline snapshot 046be853-2f5f-4709-b73a-58edf86beb1d of volume 62ecccd7-9e16-4c9d-af3c-eaba24bb5169 {{(pid=89182) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 31 12:18:56 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[6011ba91-30ed-4ffd-96a7-9f740e82785b]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:18:56 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-f63b9a2a-eed0-4a8a-9579-799595edde50 tempest-VolumesSnapshotListTestJSON-1847501116 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-62ecccd7-9e16-4c9d-af3c-eaba24bb5169 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:18:57 devstack sudo[95740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-62ecccd7-9e16-4c9d-af3c-eaba24bb5169 Jul 31 12:18:57 devstack sudo[95740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:18:57 devstack sudo[95740]: pam_unix(sudo:session): session closed for user root Jul 31 12:18:57 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-f63b9a2a-eed0-4a8a-9579-799595edde50 tempest-VolumesSnapshotListTestJSON-1847501116 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-62ecccd7-9e16-4c9d-af3c-eaba24bb5169" returned: 0 in 0.755s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:18:57 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-f63b9a2a-eed0-4a8a-9579-799595edde50 tempest-VolumesSnapshotListTestJSON-1847501116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-62ecccd7-9e16-4c9d-af3c-eaba24bb5169,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-62ecccd7-9e16-4c9d-af3c-eaba24bb5169.046be853-2f5f-4709-b73a-58edf86beb1d 1G {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:18:57 devstack sudo[95761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-62ecccd7-9e16-4c9d-af3c-eaba24bb5169,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-62ecccd7-9e16-4c9d-af3c-eaba24bb5169.046be853-2f5f-4709-b73a-58edf86beb1d 1G Jul 31 12:18:57 devstack sudo[95761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:18:58 devstack sudo[95761]: pam_unix(sudo:session): session closed for user root Jul 31 12:18:58 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-f63b9a2a-eed0-4a8a-9579-799595edde50 tempest-VolumesSnapshotListTestJSON-1847501116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-62ecccd7-9e16-4c9d-af3c-eaba24bb5169,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-62ecccd7-9e16-4c9d-af3c-eaba24bb5169.046be853-2f5f-4709-b73a-58edf86beb1d 1G" returned: 0 in 0.919s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:18:58 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-f63b9a2a-eed0-4a8a-9579-799595edde50 tempest-VolumesSnapshotListTestJSON-1847501116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-62ecccd7-9e16-4c9d-af3c-eaba24bb5169 -F qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-62ecccd7-9e16-4c9d-af3c-eaba24bb5169.046be853-2f5f-4709-b73a-58edf86beb1d {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:18:58 devstack sudo[95789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-62ecccd7-9e16-4c9d-af3c-eaba24bb5169 -F qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-62ecccd7-9e16-4c9d-af3c-eaba24bb5169.046be853-2f5f-4709-b73a-58edf86beb1d Jul 31 12:18:58 devstack sudo[95789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:18:59 devstack sudo[95789]: pam_unix(sudo:session): session closed for user root Jul 31 12:18:59 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-f63b9a2a-eed0-4a8a-9579-799595edde50 tempest-VolumesSnapshotListTestJSON-1847501116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-62ecccd7-9e16-4c9d-af3c-eaba24bb5169 -F qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-62ecccd7-9e16-4c9d-af3c-eaba24bb5169.046be853-2f5f-4709-b73a-58edf86beb1d" returned: 0 in 0.549s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:18:59 devstack cinder-volume[89182]: WARNING cinder.volume.drivers.remotefs [None req-f63b9a2a-eed0-4a8a-9579-799595edde50 tempest-VolumesSnapshotListTestJSON-1847501116 None] /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-62ecccd7-9e16-4c9d-af3c-eaba24bb5169.046be853-2f5f-4709-b73a-58edf86beb1d is being set with open permissions: ugo+rw Jul 31 12:18:59 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-f63b9a2a-eed0-4a8a-9579-799595edde50 tempest-VolumesSnapshotListTestJSON-1847501116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-62ecccd7-9e16-4c9d-af3c-eaba24bb5169.046be853-2f5f-4709-b73a-58edf86beb1d {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:18:59 devstack sudo[95797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-62ecccd7-9e16-4c9d-af3c-eaba24bb5169.046be853-2f5f-4709-b73a-58edf86beb1d Jul 31 12:18:59 devstack sudo[95797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:18:59 devstack sudo[95797]: pam_unix(sudo:session): session closed for user root Jul 31 12:18:59 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-f63b9a2a-eed0-4a8a-9579-799595edde50 tempest-VolumesSnapshotListTestJSON-1847501116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-62ecccd7-9e16-4c9d-af3c-eaba24bb5169.046be853-2f5f-4709-b73a-58edf86beb1d" returned: 0 in 0.313s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:18:59 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-f63b9a2a-eed0-4a8a-9579-799595edde50 tempest-VolumesSnapshotListTestJSON-1847501116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-62ecccd7-9e16-4c9d-af3c-eaba24bb5169.info {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:18:59 devstack sudo[95803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-62ecccd7-9e16-4c9d-af3c-eaba24bb5169.info Jul 31 12:18:59 devstack sudo[95803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:19:00 devstack sudo[95803]: pam_unix(sudo:session): session closed for user root Jul 31 12:19:00 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-f63b9a2a-eed0-4a8a-9579-799595edde50 tempest-VolumesSnapshotListTestJSON-1847501116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-62ecccd7-9e16-4c9d-af3c-eaba24bb5169.info" returned: 0 in 0.727s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:19:00 devstack cinder-volume[89182]: WARNING cinder.volume.drivers.remotefs [None req-f63b9a2a-eed0-4a8a-9579-799595edde50 tempest-VolumesSnapshotListTestJSON-1847501116 None] /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-62ecccd7-9e16-4c9d-af3c-eaba24bb5169.info is being set with open permissions: ugo+rw Jul 31 12:19:00 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-f63b9a2a-eed0-4a8a-9579-799595edde50 tempest-VolumesSnapshotListTestJSON-1847501116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-62ecccd7-9e16-4c9d-af3c-eaba24bb5169.info {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:19:00 devstack sudo[95820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-62ecccd7-9e16-4c9d-af3c-eaba24bb5169.info Jul 31 12:19:00 devstack sudo[95820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:19:00 devstack sudo[95820]: pam_unix(sudo:session): session closed for user root Jul 31 12:19:00 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-f63b9a2a-eed0-4a8a-9579-799595edde50 tempest-VolumesSnapshotListTestJSON-1847501116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-62ecccd7-9e16-4c9d-af3c-eaba24bb5169.info" returned: 0 in 0.386s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:19:00 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-f63b9a2a-eed0-4a8a-9579-799595edde50 tempest-VolumesSnapshotListTestJSON-1847501116 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.840s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:19:00 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-f63b9a2a-eed0-4a8a-9579-799595edde50 tempest-VolumesSnapshotListTestJSON-1847501116 None] Create snapshot completed successfully Jul 31 12:19:01 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-904ee029-82d2-4a69-93c6-0278e3f4ca7b tempest-VolumesSnapshotListTestJSON-1847501116 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:19:01 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-904ee029-82d2-4a69-93c6-0278e3f4ca7b tempest-VolumesSnapshotListTestJSON-1847501116 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:19:01 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-904ee029-82d2-4a69-93c6-0278e3f4ca7b tempest-VolumesSnapshotListTestJSON-1847501116 None] Creating offline snapshot 57a8ee46-a318-492a-94ec-2233d55f5402 of volume 62ecccd7-9e16-4c9d-af3c-eaba24bb5169 {{(pid=89182) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 31 12:19:01 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd499a9d-993f-499e-8ba6-46d05048ceb9]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:19:01 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-904ee029-82d2-4a69-93c6-0278e3f4ca7b tempest-VolumesSnapshotListTestJSON-1847501116 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-62ecccd7-9e16-4c9d-af3c-eaba24bb5169.046be853-2f5f-4709-b73a-58edf86beb1d {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:19:01 devstack sudo[95826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-62ecccd7-9e16-4c9d-af3c-eaba24bb5169.046be853-2f5f-4709-b73a-58edf86beb1d Jul 31 12:19:01 devstack sudo[95826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:19:02 devstack sudo[95826]: pam_unix(sudo:session): session closed for user root Jul 31 12:19:02 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-904ee029-82d2-4a69-93c6-0278e3f4ca7b tempest-VolumesSnapshotListTestJSON-1847501116 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-62ecccd7-9e16-4c9d-af3c-eaba24bb5169.046be853-2f5f-4709-b73a-58edf86beb1d" returned: 0 in 0.580s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:19:02 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-904ee029-82d2-4a69-93c6-0278e3f4ca7b tempest-VolumesSnapshotListTestJSON-1847501116 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-62ecccd7-9e16-4c9d-af3c-eaba24bb5169(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89182) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 12:19:02 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-904ee029-82d2-4a69-93c6-0278e3f4ca7b tempest-VolumesSnapshotListTestJSON-1847501116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-62ecccd7-9e16-4c9d-af3c-eaba24bb5169.046be853-2f5f-4709-b73a-58edf86beb1d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-62ecccd7-9e16-4c9d-af3c-eaba24bb5169.57a8ee46-a318-492a-94ec-2233d55f5402 1G {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:19:02 devstack sudo[95832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-62ecccd7-9e16-4c9d-af3c-eaba24bb5169.046be853-2f5f-4709-b73a-58edf86beb1d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-62ecccd7-9e16-4c9d-af3c-eaba24bb5169.57a8ee46-a318-492a-94ec-2233d55f5402 1G Jul 31 12:19:02 devstack sudo[95832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:19:03 devstack sudo[95832]: pam_unix(sudo:session): session closed for user root Jul 31 12:19:03 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-904ee029-82d2-4a69-93c6-0278e3f4ca7b tempest-VolumesSnapshotListTestJSON-1847501116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-62ecccd7-9e16-4c9d-af3c-eaba24bb5169.046be853-2f5f-4709-b73a-58edf86beb1d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-62ecccd7-9e16-4c9d-af3c-eaba24bb5169.57a8ee46-a318-492a-94ec-2233d55f5402 1G" returned: 0 in 0.831s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:19:03 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-904ee029-82d2-4a69-93c6-0278e3f4ca7b tempest-VolumesSnapshotListTestJSON-1847501116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-62ecccd7-9e16-4c9d-af3c-eaba24bb5169.046be853-2f5f-4709-b73a-58edf86beb1d -F qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-62ecccd7-9e16-4c9d-af3c-eaba24bb5169.57a8ee46-a318-492a-94ec-2233d55f5402 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:19:03 devstack sudo[95839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-62ecccd7-9e16-4c9d-af3c-eaba24bb5169.046be853-2f5f-4709-b73a-58edf86beb1d -F qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-62ecccd7-9e16-4c9d-af3c-eaba24bb5169.57a8ee46-a318-492a-94ec-2233d55f5402 Jul 31 12:19:03 devstack sudo[95839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:19:03 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-04d4b181-42cc-4924-9450-623bc60bd6f6 tempest-ServerRescueNegativeTestJSON-1046577311 None] Acquiring lock "cinder-36d51079-8c4c-4230-b7de-b5fc3eb5c036-delete_volume" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:19:03 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-04d4b181-42cc-4924-9450-623bc60bd6f6 tempest-ServerRescueNegativeTestJSON-1046577311 None] Lock "cinder-36d51079-8c4c-4230-b7de-b5fc3eb5c036-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:19:03 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-04d4b181-42cc-4924-9450-623bc60bd6f6 tempest-ServerRescueNegativeTestJSON-1046577311 None] Acquiring lock "cinder-quobyte-36d51079-8c4c-4230-b7de-b5fc3eb5c036" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:19:03 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-04d4b181-42cc-4924-9450-623bc60bd6f6 tempest-ServerRescueNegativeTestJSON-1046577311 None] Lock "cinder-quobyte-36d51079-8c4c-4230-b7de-b5fc3eb5c036" acquired by "delete_volume" :: waited 0.034s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:19:03 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3d16fa2-8f5e-40cd-aa65-eb143912fbdb]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:19:03 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-04d4b181-42cc-4924-9450-623bc60bd6f6 tempest-ServerRescueNegativeTestJSON-1046577311 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-36d51079-8c4c-4230-b7de-b5fc3eb5c036 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:19:03 devstack sudo[95841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-36d51079-8c4c-4230-b7de-b5fc3eb5c036 Jul 31 12:19:03 devstack sudo[95841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:19:03 devstack sudo[95839]: pam_unix(sudo:session): session closed for user root Jul 31 12:19:03 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-904ee029-82d2-4a69-93c6-0278e3f4ca7b tempest-VolumesSnapshotListTestJSON-1847501116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-62ecccd7-9e16-4c9d-af3c-eaba24bb5169.046be853-2f5f-4709-b73a-58edf86beb1d -F qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-62ecccd7-9e16-4c9d-af3c-eaba24bb5169.57a8ee46-a318-492a-94ec-2233d55f5402" returned: 0 in 0.748s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:19:03 devstack cinder-volume[89182]: WARNING cinder.volume.drivers.remotefs [None req-904ee029-82d2-4a69-93c6-0278e3f4ca7b tempest-VolumesSnapshotListTestJSON-1847501116 None] /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-62ecccd7-9e16-4c9d-af3c-eaba24bb5169.57a8ee46-a318-492a-94ec-2233d55f5402 is being set with open permissions: ugo+rw Jul 31 12:19:03 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-904ee029-82d2-4a69-93c6-0278e3f4ca7b tempest-VolumesSnapshotListTestJSON-1847501116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-62ecccd7-9e16-4c9d-af3c-eaba24bb5169.57a8ee46-a318-492a-94ec-2233d55f5402 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:19:03 devstack sudo[95847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-62ecccd7-9e16-4c9d-af3c-eaba24bb5169.57a8ee46-a318-492a-94ec-2233d55f5402 Jul 31 12:19:03 devstack sudo[95847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:19:04 devstack sudo[95847]: pam_unix(sudo:session): session closed for user root Jul 31 12:19:04 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-904ee029-82d2-4a69-93c6-0278e3f4ca7b tempest-VolumesSnapshotListTestJSON-1847501116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-62ecccd7-9e16-4c9d-af3c-eaba24bb5169.57a8ee46-a318-492a-94ec-2233d55f5402" returned: 0 in 0.431s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:19:04 devstack sudo[95841]: pam_unix(sudo:session): session closed for user root Jul 31 12:19:04 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-904ee029-82d2-4a69-93c6-0278e3f4ca7b tempest-VolumesSnapshotListTestJSON-1847501116 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.847s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:19:04 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-04d4b181-42cc-4924-9450-623bc60bd6f6 tempest-ServerRescueNegativeTestJSON-1046577311 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-36d51079-8c4c-4230-b7de-b5fc3eb5c036" returned: 0 in 0.777s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:19:04 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-04d4b181-42cc-4924-9450-623bc60bd6f6 tempest-ServerRescueNegativeTestJSON-1046577311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-36d51079-8c4c-4230-b7de-b5fc3eb5c036 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:19:04 devstack sudo[95853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-36d51079-8c4c-4230-b7de-b5fc3eb5c036 Jul 31 12:19:04 devstack sudo[95853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:19:04 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-904ee029-82d2-4a69-93c6-0278e3f4ca7b tempest-VolumesSnapshotListTestJSON-1847501116 None] Create snapshot completed successfully Jul 31 12:19:04 devstack cinder-volume[89182]: DEBUG cinder.volume.flows.manager.create_volume [None req-b0a4bc51-90f5-476d-8018-dcb8f1f20cfd tempest-VolumesSnapshotTestJSON-1809567557 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89182) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 12:19:04 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-b0a4bc51-90f5-476d-8018-dcb8f1f20cfd tempest-VolumesSnapshotTestJSON-1809567557 None] Flow 'volume_create_manager' (db69738e-d98d-4b14-91eb-adb818c32d52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:19:04 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-b0a4bc51-90f5-476d-8018-dcb8f1f20cfd tempest-VolumesSnapshotTestJSON-1809567557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (705cefe0-ac25-4a13-aa01-0d39c4ba7081) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:19:04 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-b0a4bc51-90f5-476d-8018-dcb8f1f20cfd tempest-VolumesSnapshotTestJSON-1809567557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (705cefe0-ac25-4a13-aa01-0d39c4ba7081) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:19:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-749162584',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b24c8676-80e7-4ae1-bb0d-f648cf80bce8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='973c0b5551ab4879b114262098af54d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:19:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:19:05Z,use_quota=True,user_id='a4512f81d8c949f5ac15e6b3f39585c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:19:04 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-b0a4bc51-90f5-476d-8018-dcb8f1f20cfd tempest-VolumesSnapshotTestJSON-1809567557 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ddb3772a-8d91-4228-b1a4-9eecc1502a23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:19:04 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-b0a4bc51-90f5-476d-8018-dcb8f1f20cfd tempest-VolumesSnapshotTestJSON-1809567557 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ddb3772a-8d91-4228-b1a4-9eecc1502a23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:19:04 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-b0a4bc51-90f5-476d-8018-dcb8f1f20cfd tempest-VolumesSnapshotTestJSON-1809567557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9398ead-49fa-4136-8096-005d2dcc6547) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:19:04 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-b0a4bc51-90f5-476d-8018-dcb8f1f20cfd tempest-VolumesSnapshotTestJSON-1809567557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9398ead-49fa-4136-8096-005d2dcc6547) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b24c8676-80e7-4ae1-bb0d-f648cf80bce8', 'volume_name': 'volume-b24c8676-80e7-4ae1-bb0d-f648cf80bce8', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:19:04 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-b0a4bc51-90f5-476d-8018-dcb8f1f20cfd tempest-VolumesSnapshotTestJSON-1809567557 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1f4ffb7-8d63-4f18-9335-de7bf6d483d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:19:04 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-b0a4bc51-90f5-476d-8018-dcb8f1f20cfd tempest-VolumesSnapshotTestJSON-1809567557 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1f4ffb7-8d63-4f18-9335-de7bf6d483d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:19:04 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-b0a4bc51-90f5-476d-8018-dcb8f1f20cfd tempest-VolumesSnapshotTestJSON-1809567557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55cea2dd-97ab-44f7-97c1-6d11d77cf25e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:19:04 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-b0a4bc51-90f5-476d-8018-dcb8f1f20cfd tempest-VolumesSnapshotTestJSON-1809567557 None] Volume b24c8676-80e7-4ae1-bb0d-f648cf80bce8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b24c8676-80e7-4ae1-bb0d-f648cf80bce8', 'volume_size': 1} Jul 31 12:19:04 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-b0a4bc51-90f5-476d-8018-dcb8f1f20cfd tempest-VolumesSnapshotTestJSON-1809567557 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:19:04 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-b0a4bc51-90f5-476d-8018-dcb8f1f20cfd tempest-VolumesSnapshotTestJSON-1809567557 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:19:04 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-b0a4bc51-90f5-476d-8018-dcb8f1f20cfd tempest-VolumesSnapshotTestJSON-1809567557 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:19:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-749162584',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b24c8676-80e7-4ae1-bb0d-f648cf80bce8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='973c0b5551ab4879b114262098af54d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:19:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:19:05Z,use_quota=True,user_id='a4512f81d8c949f5ac15e6b3f39585c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)}" {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 12:19:04 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-b0a4bc51-90f5-476d-8018-dcb8f1f20cfd tempest-VolumesSnapshotTestJSON-1809567557 None] Creating volume b24c8676-80e7-4ae1-bb0d-f648cf80bce8 {{(pid=89182) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 12:19:04 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-b0a4bc51-90f5-476d-8018-dcb8f1f20cfd tempest-VolumesSnapshotTestJSON-1809567557 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:19:04 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-b0a4bc51-90f5-476d-8018-dcb8f1f20cfd tempest-VolumesSnapshotTestJSON-1809567557 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:19:04 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-b0a4bc51-90f5-476d-8018-dcb8f1f20cfd tempest-VolumesSnapshotTestJSON-1809567557 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:19:04 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-b0a4bc51-90f5-476d-8018-dcb8f1f20cfd tempest-VolumesSnapshotTestJSON-1809567557 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:19:04 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-b0a4bc51-90f5-476d-8018-dcb8f1f20cfd tempest-VolumesSnapshotTestJSON-1809567557 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:19:04 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-b0a4bc51-90f5-476d-8018-dcb8f1f20cfd tempest-VolumesSnapshotTestJSON-1809567557 None] Selected osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 as target Quobyte volume. {{(pid=89182) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 12:19:04 devstack cinder-volume[89182]: INFO cinder.volume.drivers.remotefs [None req-b0a4bc51-90f5-476d-8018-dcb8f1f20cfd tempest-VolumesSnapshotTestJSON-1809567557 None] casted to osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 Jul 31 12:19:04 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-b0a4bc51-90f5-476d-8018-dcb8f1f20cfd tempest-VolumesSnapshotTestJSON-1809567557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-b24c8676-80e7-4ae1-bb0d-f648cf80bce8 1073741824 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:19:04 devstack sudo[95853]: pam_unix(sudo:session): session closed for user root Jul 31 12:19:04 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-04d4b181-42cc-4924-9450-623bc60bd6f6 tempest-ServerRescueNegativeTestJSON-1046577311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-36d51079-8c4c-4230-b7de-b5fc3eb5c036" returned: 0 in 0.594s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:19:05 devstack sudo[95856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-b24c8676-80e7-4ae1-bb0d-f648cf80bce8 1073741824 Jul 31 12:19:05 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-04d4b181-42cc-4924-9450-623bc60bd6f6 tempest-ServerRescueNegativeTestJSON-1046577311 None] Lock "cinder-quobyte-36d51079-8c4c-4230-b7de-b5fc3eb5c036" released by "delete_volume" :: held 1.478s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:19:05 devstack sudo[95856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:19:05 devstack cinder-volume[89182]: DEBUG cinder.quota [None req-04d4b181-42cc-4924-9450-623bc60bd6f6 tempest-ServerRescueNegativeTestJSON-1046577311 None] Created reservations ['c41bc94c-9fda-413c-b8f1-b4c0c17813a1', '98c93fb2-8bc7-40c1-b94d-e7e7c86c4d36', 'e9f75195-78d9-46aa-83e5-2bc8653c298b', '91233fc2-ecbd-4507-b887-82e586c35657'] {{(pid=89182) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 12:19:05 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-42b7ad3a-ef82-4191-b79c-d53606171c89 tempest-VolumesSnapshotListTestJSON-1847501116 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:19:05 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-04d4b181-42cc-4924-9450-623bc60bd6f6 tempest-ServerRescueNegativeTestJSON-1046577311 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:19:05 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-04d4b181-42cc-4924-9450-623bc60bd6f6 tempest-ServerRescueNegativeTestJSON-1046577311 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:19:05 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-04d4b181-42cc-4924-9450-623bc60bd6f6 tempest-ServerRescueNegativeTestJSON-1046577311 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:19:05 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-04d4b181-42cc-4924-9450-623bc60bd6f6 tempest-ServerRescueNegativeTestJSON-1046577311 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:19:05 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-04d4b181-42cc-4924-9450-623bc60bd6f6 tempest-ServerRescueNegativeTestJSON-1046577311 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:19:05 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-04d4b181-42cc-4924-9450-623bc60bd6f6 tempest-ServerRescueNegativeTestJSON-1046577311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:19:05 devstack sudo[95860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 Jul 31 12:19:05 devstack sudo[95860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:19:05 devstack sudo[95860]: pam_unix(sudo:session): session closed for user root Jul 31 12:19:05 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-04d4b181-42cc-4924-9450-623bc60bd6f6 tempest-ServerRescueNegativeTestJSON-1046577311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2" returned: 0 in 0.456s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:19:05 devstack cinder-volume[89182]: DEBUG cinder.manager [None req-04d4b181-42cc-4924-9450-623bc60bd6f6 tempest-ServerRescueNegativeTestJSON-1046577311 None] Notifying Schedulers of capabilities ... {{(pid=89182) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 12:19:05 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-04d4b181-42cc-4924-9450-623bc60bd6f6 tempest-ServerRescueNegativeTestJSON-1046577311 None] Deleted volume successfully. Jul 31 12:19:05 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-04d4b181-42cc-4924-9450-623bc60bd6f6 tempest-ServerRescueNegativeTestJSON-1046577311 None] Lock "cinder-36d51079-8c4c-4230-b7de-b5fc3eb5c036-delete_volume" released by "delete_volume" :: held 2.545s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:19:05 devstack sudo[95856]: pam_unix(sudo:session): session closed for user root Jul 31 12:19:05 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-b0a4bc51-90f5-476d-8018-dcb8f1f20cfd tempest-VolumesSnapshotTestJSON-1809567557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-b24c8676-80e7-4ae1-bb0d-f648cf80bce8 1073741824" returned: 0 in 1.030s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:19:06 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-b0a4bc51-90f5-476d-8018-dcb8f1f20cfd tempest-VolumesSnapshotTestJSON-1809567557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-b24c8676-80e7-4ae1-bb0d-f648cf80bce8 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:19:06 devstack sudo[95869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-b24c8676-80e7-4ae1-bb0d-f648cf80bce8 Jul 31 12:19:06 devstack sudo[95869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:19:06 devstack sudo[95869]: pam_unix(sudo:session): session closed for user root Jul 31 12:19:06 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-b0a4bc51-90f5-476d-8018-dcb8f1f20cfd tempest-VolumesSnapshotTestJSON-1809567557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-b24c8676-80e7-4ae1-bb0d-f648cf80bce8" returned: 0 in 0.561s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:19:06 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-b0a4bc51-90f5-476d-8018-dcb8f1f20cfd tempest-VolumesSnapshotTestJSON-1809567557 None] <== create_volume: return (1688ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'} {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 12:19:06 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-b0a4bc51-90f5-476d-8018-dcb8f1f20cfd tempest-VolumesSnapshotTestJSON-1809567557 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.704s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:19:06 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-42b7ad3a-ef82-4191-b79c-d53606171c89 tempest-VolumesSnapshotListTestJSON-1847501116 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.269s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:19:06 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-b0a4bc51-90f5-476d-8018-dcb8f1f20cfd tempest-VolumesSnapshotTestJSON-1809567557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55cea2dd-97ab-44f7-97c1-6d11d77cf25e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b24c8676-80e7-4ae1-bb0d-f648cf80bce8', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:19:06 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-b0a4bc51-90f5-476d-8018-dcb8f1f20cfd tempest-VolumesSnapshotTestJSON-1809567557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d74766d8-d05c-43a0-b1a8-ff3133de7222) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:19:06 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-42b7ad3a-ef82-4191-b79c-d53606171c89 tempest-VolumesSnapshotListTestJSON-1847501116 None] Creating offline snapshot bd5f667a-6759-4eaf-acb8-c58b0d9cdfc0 of volume 62ecccd7-9e16-4c9d-af3c-eaba24bb5169 {{(pid=89182) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 31 12:19:06 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-b0a4bc51-90f5-476d-8018-dcb8f1f20cfd tempest-VolumesSnapshotTestJSON-1809567557 None] Volume volume-b24c8676-80e7-4ae1-bb0d-f648cf80bce8 (b24c8676-80e7-4ae1-bb0d-f648cf80bce8): created successfully Jul 31 12:19:06 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-b0a4bc51-90f5-476d-8018-dcb8f1f20cfd tempest-VolumesSnapshotTestJSON-1809567557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d74766d8-d05c-43a0-b1a8-ff3133de7222) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:19:06 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-b0a4bc51-90f5-476d-8018-dcb8f1f20cfd tempest-VolumesSnapshotTestJSON-1809567557 None] Flow 'volume_create_manager' (db69738e-d98d-4b14-91eb-adb818c32d52) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:19:06 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[81455432-5578-449a-b63b-e06a5dae1550]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:19:06 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-42b7ad3a-ef82-4191-b79c-d53606171c89 tempest-VolumesSnapshotListTestJSON-1847501116 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-62ecccd7-9e16-4c9d-af3c-eaba24bb5169.57a8ee46-a318-492a-94ec-2233d55f5402 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:19:06 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-b0a4bc51-90f5-476d-8018-dcb8f1f20cfd tempest-VolumesSnapshotTestJSON-1809567557 None] Created volume successfully. Jul 31 12:19:07 devstack sudo[95883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-62ecccd7-9e16-4c9d-af3c-eaba24bb5169.57a8ee46-a318-492a-94ec-2233d55f5402 Jul 31 12:19:07 devstack sudo[95883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:19:07 devstack sudo[95883]: pam_unix(sudo:session): session closed for user root Jul 31 12:19:07 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-42b7ad3a-ef82-4191-b79c-d53606171c89 tempest-VolumesSnapshotListTestJSON-1847501116 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-62ecccd7-9e16-4c9d-af3c-eaba24bb5169.57a8ee46-a318-492a-94ec-2233d55f5402" returned: 0 in 0.914s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:19:07 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-42b7ad3a-ef82-4191-b79c-d53606171c89 tempest-VolumesSnapshotListTestJSON-1847501116 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-62ecccd7-9e16-4c9d-af3c-eaba24bb5169(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89182) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 12:19:07 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-42b7ad3a-ef82-4191-b79c-d53606171c89 tempest-VolumesSnapshotListTestJSON-1847501116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-62ecccd7-9e16-4c9d-af3c-eaba24bb5169.57a8ee46-a318-492a-94ec-2233d55f5402,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-62ecccd7-9e16-4c9d-af3c-eaba24bb5169.bd5f667a-6759-4eaf-acb8-c58b0d9cdfc0 1G {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:19:07 devstack sudo[95908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-62ecccd7-9e16-4c9d-af3c-eaba24bb5169.57a8ee46-a318-492a-94ec-2233d55f5402,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-62ecccd7-9e16-4c9d-af3c-eaba24bb5169.bd5f667a-6759-4eaf-acb8-c58b0d9cdfc0 1G Jul 31 12:19:07 devstack sudo[95908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:19:08 devstack cinder-volume[89182]: DEBUG dbcounter [-] [89182] Writing DB stats cinder:UPDATE=98,cinder:SELECT=69,cinder:DELETE=10,cinder:INSERT=20 {{(pid=89182) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 12:19:08 devstack cinder-volume[89182]: DEBUG dbcounter [-] [89182] Writing DB stats cinder:SELECT=72,cinder:INSERT=26,cinder:UPDATE=98,cinder:DELETE=9 {{(pid=89182) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 12:19:08 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-c871f528-b8d8-4aac-97fe-0afebbf23829 tempest-VolumesSnapshotTestJSON-1809567557 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:19:09 devstack sudo[95908]: pam_unix(sudo:session): session closed for user root Jul 31 12:19:09 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-42b7ad3a-ef82-4191-b79c-d53606171c89 tempest-VolumesSnapshotListTestJSON-1847501116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-62ecccd7-9e16-4c9d-af3c-eaba24bb5169.57a8ee46-a318-492a-94ec-2233d55f5402,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-62ecccd7-9e16-4c9d-af3c-eaba24bb5169.bd5f667a-6759-4eaf-acb8-c58b0d9cdfc0 1G" returned: 0 in 1.295s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:19:09 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-42b7ad3a-ef82-4191-b79c-d53606171c89 tempest-VolumesSnapshotListTestJSON-1847501116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-62ecccd7-9e16-4c9d-af3c-eaba24bb5169.57a8ee46-a318-492a-94ec-2233d55f5402 -F qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-62ecccd7-9e16-4c9d-af3c-eaba24bb5169.bd5f667a-6759-4eaf-acb8-c58b0d9cdfc0 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:19:09 devstack sudo[95917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-62ecccd7-9e16-4c9d-af3c-eaba24bb5169.57a8ee46-a318-492a-94ec-2233d55f5402 -F qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-62ecccd7-9e16-4c9d-af3c-eaba24bb5169.bd5f667a-6759-4eaf-acb8-c58b0d9cdfc0 Jul 31 12:19:09 devstack sudo[95917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:19:09 devstack sudo[95917]: pam_unix(sudo:session): session closed for user root Jul 31 12:19:09 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-42b7ad3a-ef82-4191-b79c-d53606171c89 tempest-VolumesSnapshotListTestJSON-1847501116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-62ecccd7-9e16-4c9d-af3c-eaba24bb5169.57a8ee46-a318-492a-94ec-2233d55f5402 -F qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-62ecccd7-9e16-4c9d-af3c-eaba24bb5169.bd5f667a-6759-4eaf-acb8-c58b0d9cdfc0" returned: 0 in 0.516s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:19:09 devstack cinder-volume[89182]: WARNING cinder.volume.drivers.remotefs [None req-42b7ad3a-ef82-4191-b79c-d53606171c89 tempest-VolumesSnapshotListTestJSON-1847501116 None] /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-62ecccd7-9e16-4c9d-af3c-eaba24bb5169.bd5f667a-6759-4eaf-acb8-c58b0d9cdfc0 is being set with open permissions: ugo+rw Jul 31 12:19:09 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-42b7ad3a-ef82-4191-b79c-d53606171c89 tempest-VolumesSnapshotListTestJSON-1847501116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-62ecccd7-9e16-4c9d-af3c-eaba24bb5169.bd5f667a-6759-4eaf-acb8-c58b0d9cdfc0 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:19:09 devstack sudo[95923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-62ecccd7-9e16-4c9d-af3c-eaba24bb5169.bd5f667a-6759-4eaf-acb8-c58b0d9cdfc0 Jul 31 12:19:09 devstack sudo[95923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:19:10 devstack sudo[95923]: pam_unix(sudo:session): session closed for user root Jul 31 12:19:10 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-42b7ad3a-ef82-4191-b79c-d53606171c89 tempest-VolumesSnapshotListTestJSON-1847501116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-62ecccd7-9e16-4c9d-af3c-eaba24bb5169.bd5f667a-6759-4eaf-acb8-c58b0d9cdfc0" returned: 0 in 0.528s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:19:10 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-42b7ad3a-ef82-4191-b79c-d53606171c89 tempest-VolumesSnapshotListTestJSON-1847501116 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.576s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:19:10 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-c871f528-b8d8-4aac-97fe-0afebbf23829 tempest-VolumesSnapshotTestJSON-1809567557 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.585s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:19:10 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-c871f528-b8d8-4aac-97fe-0afebbf23829 tempest-VolumesSnapshotTestJSON-1809567557 None] Creating offline snapshot d5229df3-95e1-47ba-a0be-a02bc0774e85 of volume b24c8676-80e7-4ae1-bb0d-f648cf80bce8 {{(pid=89182) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 31 12:19:10 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-42b7ad3a-ef82-4191-b79c-d53606171c89 tempest-VolumesSnapshotListTestJSON-1847501116 None] Create snapshot completed successfully Jul 31 12:19:10 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[42740296-2e9b-4249-8ac8-a7a2423fd5cb]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:19:10 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-c871f528-b8d8-4aac-97fe-0afebbf23829 tempest-VolumesSnapshotTestJSON-1809567557 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-b24c8676-80e7-4ae1-bb0d-f648cf80bce8 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:19:10 devstack sudo[95955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-b24c8676-80e7-4ae1-bb0d-f648cf80bce8 Jul 31 12:19:10 devstack sudo[95955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:19:11 devstack sudo[95955]: pam_unix(sudo:session): session closed for user root Jul 31 12:19:11 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-c871f528-b8d8-4aac-97fe-0afebbf23829 tempest-VolumesSnapshotTestJSON-1809567557 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-b24c8676-80e7-4ae1-bb0d-f648cf80bce8" returned: 0 in 0.876s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:19:11 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-c871f528-b8d8-4aac-97fe-0afebbf23829 tempest-VolumesSnapshotTestJSON-1809567557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-b24c8676-80e7-4ae1-bb0d-f648cf80bce8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-b24c8676-80e7-4ae1-bb0d-f648cf80bce8.d5229df3-95e1-47ba-a0be-a02bc0774e85 1G {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:19:11 devstack sudo[95980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-b24c8676-80e7-4ae1-bb0d-f648cf80bce8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-b24c8676-80e7-4ae1-bb0d-f648cf80bce8.d5229df3-95e1-47ba-a0be-a02bc0774e85 1G Jul 31 12:19:11 devstack sudo[95980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:19:11 devstack sudo[95980]: pam_unix(sudo:session): session closed for user root Jul 31 12:19:11 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-c871f528-b8d8-4aac-97fe-0afebbf23829 tempest-VolumesSnapshotTestJSON-1809567557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-b24c8676-80e7-4ae1-bb0d-f648cf80bce8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-b24c8676-80e7-4ae1-bb0d-f648cf80bce8.d5229df3-95e1-47ba-a0be-a02bc0774e85 1G" returned: 0 in 0.773s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:19:11 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-c871f528-b8d8-4aac-97fe-0afebbf23829 tempest-VolumesSnapshotTestJSON-1809567557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b24c8676-80e7-4ae1-bb0d-f648cf80bce8 -F qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-b24c8676-80e7-4ae1-bb0d-f648cf80bce8.d5229df3-95e1-47ba-a0be-a02bc0774e85 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:19:12 devstack sudo[96020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b24c8676-80e7-4ae1-bb0d-f648cf80bce8 -F qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-b24c8676-80e7-4ae1-bb0d-f648cf80bce8.d5229df3-95e1-47ba-a0be-a02bc0774e85 Jul 31 12:19:12 devstack sudo[96020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:19:12 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-bf84dbff-0f98-4e78-a864-4bc9aa8d8c53 tempest-VolumesSnapshotListTestJSON-1847501116 None] Acquiring lock "cinder-bd5f667a-6759-4eaf-acb8-c58b0d9cdfc0-delete_snapshot" by "delete_snapshot" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:19:12 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-bf84dbff-0f98-4e78-a864-4bc9aa8d8c53 tempest-VolumesSnapshotListTestJSON-1847501116 None] Lock "cinder-bd5f667a-6759-4eaf-acb8-c58b0d9cdfc0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.045s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:19:12 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-bf84dbff-0f98-4e78-a864-4bc9aa8d8c53 tempest-VolumesSnapshotListTestJSON-1847501116 None] Acquiring lock "cinder-quobyte-62ecccd7-9e16-4c9d-af3c-eaba24bb5169" by "delete_snapshot" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:19:12 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-bf84dbff-0f98-4e78-a864-4bc9aa8d8c53 tempest-VolumesSnapshotListTestJSON-1847501116 None] Lock "cinder-quobyte-62ecccd7-9e16-4c9d-af3c-eaba24bb5169" acquired by "delete_snapshot" :: waited 0.019s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:19:12 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-bf84dbff-0f98-4e78-a864-4bc9aa8d8c53 tempest-VolumesSnapshotListTestJSON-1847501116 None] Acquiring lock "cinder-quobyte-bd5f667a-6759-4eaf-acb8-c58b0d9cdfc0" by "_delete_snapshot" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:19:12 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-bf84dbff-0f98-4e78-a864-4bc9aa8d8c53 tempest-VolumesSnapshotListTestJSON-1847501116 None] Lock "cinder-quobyte-bd5f667a-6759-4eaf-acb8-c58b0d9cdfc0" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:19:12 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-bf84dbff-0f98-4e78-a864-4bc9aa8d8c53 tempest-VolumesSnapshotListTestJSON-1847501116 None] Deleting offline snapshot bd5f667a-6759-4eaf-acb8-c58b0d9cdfc0 of volume 62ecccd7-9e16-4c9d-af3c-eaba24bb5169 {{(pid=89182) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 31 12:19:12 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-bf84dbff-0f98-4e78-a864-4bc9aa8d8c53 tempest-VolumesSnapshotListTestJSON-1847501116 None] snapshot_file for this snap is: volume-62ecccd7-9e16-4c9d-af3c-eaba24bb5169.bd5f667a-6759-4eaf-acb8-c58b0d9cdfc0 {{(pid=89182) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 31 12:19:12 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[01f4bc7d-9b9a-42b9-a533-fc005880dc7e]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:19:12 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-bf84dbff-0f98-4e78-a864-4bc9aa8d8c53 tempest-VolumesSnapshotListTestJSON-1847501116 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-62ecccd7-9e16-4c9d-af3c-eaba24bb5169.bd5f667a-6759-4eaf-acb8-c58b0d9cdfc0 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:19:12 devstack sudo[96042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-62ecccd7-9e16-4c9d-af3c-eaba24bb5169.bd5f667a-6759-4eaf-acb8-c58b0d9cdfc0 Jul 31 12:19:12 devstack sudo[96042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:19:12 devstack sudo[96020]: pam_unix(sudo:session): session closed for user root Jul 31 12:19:12 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-c871f528-b8d8-4aac-97fe-0afebbf23829 tempest-VolumesSnapshotTestJSON-1809567557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b24c8676-80e7-4ae1-bb0d-f648cf80bce8 -F qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-b24c8676-80e7-4ae1-bb0d-f648cf80bce8.d5229df3-95e1-47ba-a0be-a02bc0774e85" returned: 0 in 0.576s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:19:12 devstack cinder-volume[89182]: WARNING cinder.volume.drivers.remotefs [None req-c871f528-b8d8-4aac-97fe-0afebbf23829 tempest-VolumesSnapshotTestJSON-1809567557 None] /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-b24c8676-80e7-4ae1-bb0d-f648cf80bce8.d5229df3-95e1-47ba-a0be-a02bc0774e85 is being set with open permissions: ugo+rw Jul 31 12:19:12 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-c871f528-b8d8-4aac-97fe-0afebbf23829 tempest-VolumesSnapshotTestJSON-1809567557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-b24c8676-80e7-4ae1-bb0d-f648cf80bce8.d5229df3-95e1-47ba-a0be-a02bc0774e85 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:19:12 devstack sudo[96047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-b24c8676-80e7-4ae1-bb0d-f648cf80bce8.d5229df3-95e1-47ba-a0be-a02bc0774e85 Jul 31 12:19:12 devstack sudo[96047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:19:12 devstack sudo[96047]: pam_unix(sudo:session): session closed for user root Jul 31 12:19:12 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-c871f528-b8d8-4aac-97fe-0afebbf23829 tempest-VolumesSnapshotTestJSON-1809567557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-b24c8676-80e7-4ae1-bb0d-f648cf80bce8.d5229df3-95e1-47ba-a0be-a02bc0774e85" returned: 0 in 0.342s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:19:12 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-c871f528-b8d8-4aac-97fe-0afebbf23829 tempest-VolumesSnapshotTestJSON-1809567557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-b24c8676-80e7-4ae1-bb0d-f648cf80bce8.info {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:19:12 devstack sudo[96052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-b24c8676-80e7-4ae1-bb0d-f648cf80bce8.info Jul 31 12:19:12 devstack sudo[96052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:19:13 devstack sudo[96042]: pam_unix(sudo:session): session closed for user root Jul 31 12:19:13 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-bf84dbff-0f98-4e78-a864-4bc9aa8d8c53 tempest-VolumesSnapshotListTestJSON-1847501116 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-62ecccd7-9e16-4c9d-af3c-eaba24bb5169.bd5f667a-6759-4eaf-acb8-c58b0d9cdfc0" returned: 0 in 0.732s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:19:13 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-bf84dbff-0f98-4e78-a864-4bc9aa8d8c53 tempest-VolumesSnapshotListTestJSON-1847501116 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-62ecccd7-9e16-4c9d-af3c-eaba24bb5169(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89182) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 12:19:13 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[656ad9d9-2149-4244-8d9e-ea643a476de2]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:19:13 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-bf84dbff-0f98-4e78-a864-4bc9aa8d8c53 tempest-VolumesSnapshotListTestJSON-1847501116 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-62ecccd7-9e16-4c9d-af3c-eaba24bb5169.57a8ee46-a318-492a-94ec-2233d55f5402 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:19:13 devstack sudo[96052]: pam_unix(sudo:session): session closed for user root Jul 31 12:19:13 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-c871f528-b8d8-4aac-97fe-0afebbf23829 tempest-VolumesSnapshotTestJSON-1809567557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-b24c8676-80e7-4ae1-bb0d-f648cf80bce8.info" returned: 0 in 0.341s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:19:13 devstack cinder-volume[89182]: WARNING cinder.volume.drivers.remotefs [None req-c871f528-b8d8-4aac-97fe-0afebbf23829 tempest-VolumesSnapshotTestJSON-1809567557 None] /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-b24c8676-80e7-4ae1-bb0d-f648cf80bce8.info is being set with open permissions: ugo+rw Jul 31 12:19:13 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-c871f528-b8d8-4aac-97fe-0afebbf23829 tempest-VolumesSnapshotTestJSON-1809567557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-b24c8676-80e7-4ae1-bb0d-f648cf80bce8.info {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:19:13 devstack sudo[96055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-62ecccd7-9e16-4c9d-af3c-eaba24bb5169.57a8ee46-a318-492a-94ec-2233d55f5402 Jul 31 12:19:13 devstack sudo[96055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:19:13 devstack sudo[96057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-b24c8676-80e7-4ae1-bb0d-f648cf80bce8.info Jul 31 12:19:13 devstack sudo[96057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:19:13 devstack sudo[96057]: pam_unix(sudo:session): session closed for user root Jul 31 12:19:13 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-c871f528-b8d8-4aac-97fe-0afebbf23829 tempest-VolumesSnapshotTestJSON-1809567557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-b24c8676-80e7-4ae1-bb0d-f648cf80bce8.info" returned: 0 in 0.671s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:19:13 devstack sudo[96055]: pam_unix(sudo:session): session closed for user root Jul 31 12:19:14 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-c871f528-b8d8-4aac-97fe-0afebbf23829 tempest-VolumesSnapshotTestJSON-1809567557 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.777s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:19:14 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-bf84dbff-0f98-4e78-a864-4bc9aa8d8c53 tempest-VolumesSnapshotListTestJSON-1847501116 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-62ecccd7-9e16-4c9d-af3c-eaba24bb5169.57a8ee46-a318-492a-94ec-2233d55f5402" returned: 0 in 0.906s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:19:14 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-bf84dbff-0f98-4e78-a864-4bc9aa8d8c53 tempest-VolumesSnapshotListTestJSON-1847501116 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-62ecccd7-9e16-4c9d-af3c-eaba24bb5169(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89182) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 12:19:14 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-bf84dbff-0f98-4e78-a864-4bc9aa8d8c53 tempest-VolumesSnapshotListTestJSON-1847501116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-62ecccd7-9e16-4c9d-af3c-eaba24bb5169.bd5f667a-6759-4eaf-acb8-c58b0d9cdfc0 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:19:14 devstack sudo[96068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-62ecccd7-9e16-4c9d-af3c-eaba24bb5169.bd5f667a-6759-4eaf-acb8-c58b0d9cdfc0 Jul 31 12:19:14 devstack sudo[96068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:19:14 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-c871f528-b8d8-4aac-97fe-0afebbf23829 tempest-VolumesSnapshotTestJSON-1809567557 None] Create snapshot completed successfully Jul 31 12:19:14 devstack sudo[96068]: pam_unix(sudo:session): session closed for user root Jul 31 12:19:14 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-bf84dbff-0f98-4e78-a864-4bc9aa8d8c53 tempest-VolumesSnapshotListTestJSON-1847501116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-62ecccd7-9e16-4c9d-af3c-eaba24bb5169.bd5f667a-6759-4eaf-acb8-c58b0d9cdfc0" returned: 0 in 0.699s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:19:14 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-bf84dbff-0f98-4e78-a864-4bc9aa8d8c53 tempest-VolumesSnapshotListTestJSON-1847501116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-62ecccd7-9e16-4c9d-af3c-eaba24bb5169.bd5f667a-6759-4eaf-acb8-c58b0d9cdfc0 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:19:14 devstack sudo[96075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-62ecccd7-9e16-4c9d-af3c-eaba24bb5169.bd5f667a-6759-4eaf-acb8-c58b0d9cdfc0 Jul 31 12:19:14 devstack sudo[96075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:19:15 devstack sudo[96075]: pam_unix(sudo:session): session closed for user root Jul 31 12:19:15 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-bf84dbff-0f98-4e78-a864-4bc9aa8d8c53 tempest-VolumesSnapshotListTestJSON-1847501116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-62ecccd7-9e16-4c9d-af3c-eaba24bb5169.bd5f667a-6759-4eaf-acb8-c58b0d9cdfc0" returned: 0 in 0.294s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:19:15 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-bf84dbff-0f98-4e78-a864-4bc9aa8d8c53 tempest-VolumesSnapshotListTestJSON-1847501116 None] Lock "cinder-quobyte-bd5f667a-6759-4eaf-acb8-c58b0d9cdfc0" released by "_delete_snapshot" :: held 2.772s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:19:15 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-bf84dbff-0f98-4e78-a864-4bc9aa8d8c53 tempest-VolumesSnapshotListTestJSON-1847501116 None] Lock "cinder-quobyte-62ecccd7-9e16-4c9d-af3c-eaba24bb5169" released by "delete_snapshot" :: held 2.802s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:19:15 devstack cinder-volume[89182]: DEBUG cinder.quota [None req-bf84dbff-0f98-4e78-a864-4bc9aa8d8c53 tempest-VolumesSnapshotListTestJSON-1847501116 None] Created reservations ['71b99d74-2c1e-4ca8-a47c-f621630eeea9', '4c2ff4e2-51ba-41ff-9d07-4462b818f304', 'a72543d5-c4c0-4199-ad17-0d551974e6ee', '578de748-9991-4c44-b827-8b0d220554df'] {{(pid=89182) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 12:19:15 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-bf84dbff-0f98-4e78-a864-4bc9aa8d8c53 tempest-VolumesSnapshotListTestJSON-1847501116 None] Delete snapshot completed successfully. Jul 31 12:19:15 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-bf84dbff-0f98-4e78-a864-4bc9aa8d8c53 tempest-VolumesSnapshotListTestJSON-1847501116 None] Lock "cinder-bd5f667a-6759-4eaf-acb8-c58b0d9cdfc0-delete_snapshot" released by "delete_snapshot" :: held 3.023s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:19:15 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-2d3a842f-c283-40b3-987f-b6b793e7ca99 tempest-VolumesSnapshotTestJSON-1809567557 None] Acquiring lock "cinder-d5229df3-95e1-47ba-a0be-a02bc0774e85-delete_snapshot" by "delete_snapshot" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:19:15 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-2bb3875f-4054-4615-b274-b17b61cd42e4 tempest-VolumesSnapshotListTestJSON-1847501116 None] Acquiring lock "cinder-57a8ee46-a318-492a-94ec-2233d55f5402-delete_snapshot" by "delete_snapshot" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:19:15 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-2d3a842f-c283-40b3-987f-b6b793e7ca99 tempest-VolumesSnapshotTestJSON-1809567557 None] Lock "cinder-d5229df3-95e1-47ba-a0be-a02bc0774e85-delete_snapshot" acquired by "delete_snapshot" :: waited 0.085s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:19:15 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-2bb3875f-4054-4615-b274-b17b61cd42e4 tempest-VolumesSnapshotListTestJSON-1847501116 None] Lock "cinder-57a8ee46-a318-492a-94ec-2233d55f5402-delete_snapshot" acquired by "delete_snapshot" :: waited 0.071s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:19:15 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-2bb3875f-4054-4615-b274-b17b61cd42e4 tempest-VolumesSnapshotListTestJSON-1847501116 None] Acquiring lock "cinder-quobyte-62ecccd7-9e16-4c9d-af3c-eaba24bb5169" by "delete_snapshot" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:19:15 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-2bb3875f-4054-4615-b274-b17b61cd42e4 tempest-VolumesSnapshotListTestJSON-1847501116 None] Lock "cinder-quobyte-62ecccd7-9e16-4c9d-af3c-eaba24bb5169" acquired by "delete_snapshot" :: waited 0.044s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:19:15 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-2bb3875f-4054-4615-b274-b17b61cd42e4 tempest-VolumesSnapshotListTestJSON-1847501116 None] Acquiring lock "cinder-quobyte-57a8ee46-a318-492a-94ec-2233d55f5402" by "_delete_snapshot" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:19:15 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-2d3a842f-c283-40b3-987f-b6b793e7ca99 tempest-VolumesSnapshotTestJSON-1809567557 None] Acquiring lock "cinder-quobyte-b24c8676-80e7-4ae1-bb0d-f648cf80bce8" by "delete_snapshot" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:19:15 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-2bb3875f-4054-4615-b274-b17b61cd42e4 tempest-VolumesSnapshotListTestJSON-1847501116 None] Lock "cinder-quobyte-57a8ee46-a318-492a-94ec-2233d55f5402" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:19:15 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-2bb3875f-4054-4615-b274-b17b61cd42e4 tempest-VolumesSnapshotListTestJSON-1847501116 None] Deleting offline snapshot 57a8ee46-a318-492a-94ec-2233d55f5402 of volume 62ecccd7-9e16-4c9d-af3c-eaba24bb5169 {{(pid=89182) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 31 12:19:15 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-2bb3875f-4054-4615-b274-b17b61cd42e4 tempest-VolumesSnapshotListTestJSON-1847501116 None] snapshot_file for this snap is: volume-62ecccd7-9e16-4c9d-af3c-eaba24bb5169.57a8ee46-a318-492a-94ec-2233d55f5402 {{(pid=89182) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 31 12:19:15 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-2d3a842f-c283-40b3-987f-b6b793e7ca99 tempest-VolumesSnapshotTestJSON-1809567557 None] Lock "cinder-quobyte-b24c8676-80e7-4ae1-bb0d-f648cf80bce8" acquired by "delete_snapshot" :: waited 0.080s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:19:15 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-2d3a842f-c283-40b3-987f-b6b793e7ca99 tempest-VolumesSnapshotTestJSON-1809567557 None] Acquiring lock "cinder-quobyte-d5229df3-95e1-47ba-a0be-a02bc0774e85" by "_delete_snapshot" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:19:15 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[332f755e-6648-47fa-982b-89cf08107c88]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:19:15 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-2bb3875f-4054-4615-b274-b17b61cd42e4 tempest-VolumesSnapshotListTestJSON-1847501116 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-62ecccd7-9e16-4c9d-af3c-eaba24bb5169.57a8ee46-a318-492a-94ec-2233d55f5402 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:19:15 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-2d3a842f-c283-40b3-987f-b6b793e7ca99 tempest-VolumesSnapshotTestJSON-1809567557 None] Lock "cinder-quobyte-d5229df3-95e1-47ba-a0be-a02bc0774e85" acquired by "_delete_snapshot" :: waited 0.039s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:19:15 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-2d3a842f-c283-40b3-987f-b6b793e7ca99 tempest-VolumesSnapshotTestJSON-1809567557 None] Deleting offline snapshot d5229df3-95e1-47ba-a0be-a02bc0774e85 of volume b24c8676-80e7-4ae1-bb0d-f648cf80bce8 {{(pid=89182) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 31 12:19:15 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-2d3a842f-c283-40b3-987f-b6b793e7ca99 tempest-VolumesSnapshotTestJSON-1809567557 None] snapshot_file for this snap is: volume-b24c8676-80e7-4ae1-bb0d-f648cf80bce8.d5229df3-95e1-47ba-a0be-a02bc0774e85 {{(pid=89182) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 31 12:19:15 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[8067a867-0173-4cb3-8b5f-e66acd245e22]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:19:15 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-2d3a842f-c283-40b3-987f-b6b793e7ca99 tempest-VolumesSnapshotTestJSON-1809567557 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-b24c8676-80e7-4ae1-bb0d-f648cf80bce8.d5229df3-95e1-47ba-a0be-a02bc0774e85 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:19:15 devstack sudo[96078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-62ecccd7-9e16-4c9d-af3c-eaba24bb5169.57a8ee46-a318-492a-94ec-2233d55f5402 Jul 31 12:19:16 devstack sudo[96078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:19:16 devstack sudo[96080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-b24c8676-80e7-4ae1-bb0d-f648cf80bce8.d5229df3-95e1-47ba-a0be-a02bc0774e85 Jul 31 12:19:16 devstack sudo[96080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:19:16 devstack sudo[96078]: pam_unix(sudo:session): session closed for user root Jul 31 12:19:16 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-2bb3875f-4054-4615-b274-b17b61cd42e4 tempest-VolumesSnapshotListTestJSON-1847501116 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-62ecccd7-9e16-4c9d-af3c-eaba24bb5169.57a8ee46-a318-492a-94ec-2233d55f5402" returned: 0 in 0.731s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:19:16 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-2bb3875f-4054-4615-b274-b17b61cd42e4 tempest-VolumesSnapshotListTestJSON-1847501116 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-62ecccd7-9e16-4c9d-af3c-eaba24bb5169(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89182) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 12:19:16 devstack sudo[96080]: pam_unix(sudo:session): session closed for user root Jul 31 12:19:16 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-2d3a842f-c283-40b3-987f-b6b793e7ca99 tempest-VolumesSnapshotTestJSON-1809567557 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-b24c8676-80e7-4ae1-bb0d-f648cf80bce8.d5229df3-95e1-47ba-a0be-a02bc0774e85" returned: 0 in 0.693s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:19:16 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-2d3a842f-c283-40b3-987f-b6b793e7ca99 tempest-VolumesSnapshotTestJSON-1809567557 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b24c8676-80e7-4ae1-bb0d-f648cf80bce8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89182) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 12:19:16 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[3befe4e2-d432-4f75-bea7-fbd63571218f]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:19:16 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-2bb3875f-4054-4615-b274-b17b61cd42e4 tempest-VolumesSnapshotListTestJSON-1847501116 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-62ecccd7-9e16-4c9d-af3c-eaba24bb5169.046be853-2f5f-4709-b73a-58edf86beb1d {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:19:16 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee3be243-499d-4c8d-b7f2-5fa01d0eadc3]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:19:16 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-2d3a842f-c283-40b3-987f-b6b793e7ca99 tempest-VolumesSnapshotTestJSON-1809567557 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-b24c8676-80e7-4ae1-bb0d-f648cf80bce8 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:19:16 devstack sudo[96090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-62ecccd7-9e16-4c9d-af3c-eaba24bb5169.046be853-2f5f-4709-b73a-58edf86beb1d Jul 31 12:19:16 devstack sudo[96090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:19:16 devstack sudo[96091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-b24c8676-80e7-4ae1-bb0d-f648cf80bce8 Jul 31 12:19:16 devstack sudo[96091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:19:17 devstack sudo[96091]: pam_unix(sudo:session): session closed for user root Jul 31 12:19:17 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-2d3a842f-c283-40b3-987f-b6b793e7ca99 tempest-VolumesSnapshotTestJSON-1809567557 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-b24c8676-80e7-4ae1-bb0d-f648cf80bce8" returned: 0 in 0.643s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:19:17 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-2d3a842f-c283-40b3-987f-b6b793e7ca99 tempest-VolumesSnapshotTestJSON-1809567557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-b24c8676-80e7-4ae1-bb0d-f648cf80bce8.d5229df3-95e1-47ba-a0be-a02bc0774e85 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:19:17 devstack sudo[96102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-b24c8676-80e7-4ae1-bb0d-f648cf80bce8.d5229df3-95e1-47ba-a0be-a02bc0774e85 Jul 31 12:19:17 devstack sudo[96102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:19:17 devstack sudo[96090]: pam_unix(sudo:session): session closed for user root Jul 31 12:19:17 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-2bb3875f-4054-4615-b274-b17b61cd42e4 tempest-VolumesSnapshotListTestJSON-1847501116 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-62ecccd7-9e16-4c9d-af3c-eaba24bb5169.046be853-2f5f-4709-b73a-58edf86beb1d" returned: 0 in 0.704s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:19:17 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-2bb3875f-4054-4615-b274-b17b61cd42e4 tempest-VolumesSnapshotListTestJSON-1847501116 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-62ecccd7-9e16-4c9d-af3c-eaba24bb5169(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89182) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 12:19:17 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-2bb3875f-4054-4615-b274-b17b61cd42e4 tempest-VolumesSnapshotListTestJSON-1847501116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-62ecccd7-9e16-4c9d-af3c-eaba24bb5169.57a8ee46-a318-492a-94ec-2233d55f5402 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:19:17 devstack sudo[96104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-62ecccd7-9e16-4c9d-af3c-eaba24bb5169.57a8ee46-a318-492a-94ec-2233d55f5402 Jul 31 12:19:17 devstack sudo[96104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:19:17 devstack sudo[96102]: pam_unix(sudo:session): session closed for user root Jul 31 12:19:17 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-2d3a842f-c283-40b3-987f-b6b793e7ca99 tempest-VolumesSnapshotTestJSON-1809567557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-b24c8676-80e7-4ae1-bb0d-f648cf80bce8.d5229df3-95e1-47ba-a0be-a02bc0774e85" returned: 0 in 0.470s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:19:17 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-2d3a842f-c283-40b3-987f-b6b793e7ca99 tempest-VolumesSnapshotTestJSON-1809567557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-b24c8676-80e7-4ae1-bb0d-f648cf80bce8.d5229df3-95e1-47ba-a0be-a02bc0774e85 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:19:17 devstack sudo[96113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-b24c8676-80e7-4ae1-bb0d-f648cf80bce8.d5229df3-95e1-47ba-a0be-a02bc0774e85 Jul 31 12:19:17 devstack sudo[96113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:19:18 devstack sudo[96104]: pam_unix(sudo:session): session closed for user root Jul 31 12:19:18 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-2bb3875f-4054-4615-b274-b17b61cd42e4 tempest-VolumesSnapshotListTestJSON-1847501116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-62ecccd7-9e16-4c9d-af3c-eaba24bb5169.57a8ee46-a318-492a-94ec-2233d55f5402" returned: 0 in 0.720s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:19:18 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-2bb3875f-4054-4615-b274-b17b61cd42e4 tempest-VolumesSnapshotListTestJSON-1847501116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-62ecccd7-9e16-4c9d-af3c-eaba24bb5169.57a8ee46-a318-492a-94ec-2233d55f5402 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:19:18 devstack sudo[96113]: pam_unix(sudo:session): session closed for user root Jul 31 12:19:18 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-2d3a842f-c283-40b3-987f-b6b793e7ca99 tempest-VolumesSnapshotTestJSON-1809567557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-b24c8676-80e7-4ae1-bb0d-f648cf80bce8.d5229df3-95e1-47ba-a0be-a02bc0774e85" returned: 0 in 0.351s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:19:18 devstack sudo[96117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-62ecccd7-9e16-4c9d-af3c-eaba24bb5169.57a8ee46-a318-492a-94ec-2233d55f5402 Jul 31 12:19:18 devstack sudo[96117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:19:18 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-2d3a842f-c283-40b3-987f-b6b793e7ca99 tempest-VolumesSnapshotTestJSON-1809567557 None] Lock "cinder-quobyte-d5229df3-95e1-47ba-a0be-a02bc0774e85" released by "_delete_snapshot" :: held 2.425s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:19:18 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-2d3a842f-c283-40b3-987f-b6b793e7ca99 tempest-VolumesSnapshotTestJSON-1809567557 None] Lock "cinder-quobyte-b24c8676-80e7-4ae1-bb0d-f648cf80bce8" released by "delete_snapshot" :: held 2.488s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:19:18 devstack cinder-volume[89182]: DEBUG cinder.quota [None req-2d3a842f-c283-40b3-987f-b6b793e7ca99 tempest-VolumesSnapshotTestJSON-1809567557 None] Created reservations ['803fed91-6d5e-4699-8874-5a45118f0080', 'e1d194c3-e00e-4860-846c-8e6425ad119b', 'c2c94277-0605-456f-947d-90ff6ac72615', '7874304f-38ed-4222-a2ca-2dba53e4aa82'] {{(pid=89182) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 12:19:18 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-2d3a842f-c283-40b3-987f-b6b793e7ca99 tempest-VolumesSnapshotTestJSON-1809567557 None] Delete snapshot completed successfully. Jul 31 12:19:18 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-2d3a842f-c283-40b3-987f-b6b793e7ca99 tempest-VolumesSnapshotTestJSON-1809567557 None] Lock "cinder-d5229df3-95e1-47ba-a0be-a02bc0774e85-delete_snapshot" released by "delete_snapshot" :: held 2.827s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:19:18 devstack sudo[96117]: pam_unix(sudo:session): session closed for user root Jul 31 12:19:18 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-2bb3875f-4054-4615-b274-b17b61cd42e4 tempest-VolumesSnapshotListTestJSON-1847501116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-62ecccd7-9e16-4c9d-af3c-eaba24bb5169.57a8ee46-a318-492a-94ec-2233d55f5402" returned: 0 in 0.503s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:19:18 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-2bb3875f-4054-4615-b274-b17b61cd42e4 tempest-VolumesSnapshotListTestJSON-1847501116 None] Lock "cinder-quobyte-57a8ee46-a318-492a-94ec-2233d55f5402" released by "_delete_snapshot" :: held 2.884s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:19:18 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-2bb3875f-4054-4615-b274-b17b61cd42e4 tempest-VolumesSnapshotListTestJSON-1847501116 None] Lock "cinder-quobyte-62ecccd7-9e16-4c9d-af3c-eaba24bb5169" released by "delete_snapshot" :: held 2.929s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:19:18 devstack cinder-volume[89182]: DEBUG cinder.quota [None req-2bb3875f-4054-4615-b274-b17b61cd42e4 tempest-VolumesSnapshotListTestJSON-1847501116 None] Created reservations ['de0c06f6-957a-498a-b28c-0f87f92e66a4', '616d579f-8ca1-4477-be06-0f8a3be36ca2', '11123c10-d6ba-4fdd-8488-b74d51ea1782', '6a3bf6b2-5df6-4ddf-a07c-c5c6bf71c5b7'] {{(pid=89182) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 12:19:18 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-2bb3875f-4054-4615-b274-b17b61cd42e4 tempest-VolumesSnapshotListTestJSON-1847501116 None] Delete snapshot completed successfully. Jul 31 12:19:18 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-2bb3875f-4054-4615-b274-b17b61cd42e4 tempest-VolumesSnapshotListTestJSON-1847501116 None] Lock "cinder-57a8ee46-a318-492a-94ec-2233d55f5402-delete_snapshot" released by "delete_snapshot" :: held 3.140s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:19:18 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-f9c67bcd-8d1a-4b08-8fca-be73e9519c0d tempest-VolumesSnapshotListTestJSON-1847501116 None] Acquiring lock "cinder-046be853-2f5f-4709-b73a-58edf86beb1d-delete_snapshot" by "delete_snapshot" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:19:18 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-f9c67bcd-8d1a-4b08-8fca-be73e9519c0d tempest-VolumesSnapshotListTestJSON-1847501116 None] Lock "cinder-046be853-2f5f-4709-b73a-58edf86beb1d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:19:18 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-f9c67bcd-8d1a-4b08-8fca-be73e9519c0d tempest-VolumesSnapshotListTestJSON-1847501116 None] Acquiring lock "cinder-quobyte-62ecccd7-9e16-4c9d-af3c-eaba24bb5169" by "delete_snapshot" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:19:18 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-f9c67bcd-8d1a-4b08-8fca-be73e9519c0d tempest-VolumesSnapshotListTestJSON-1847501116 None] Lock "cinder-quobyte-62ecccd7-9e16-4c9d-af3c-eaba24bb5169" acquired by "delete_snapshot" :: waited 0.031s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:19:18 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-f9c67bcd-8d1a-4b08-8fca-be73e9519c0d tempest-VolumesSnapshotListTestJSON-1847501116 None] Acquiring lock "cinder-quobyte-046be853-2f5f-4709-b73a-58edf86beb1d" by "_delete_snapshot" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:19:19 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-f9c67bcd-8d1a-4b08-8fca-be73e9519c0d tempest-VolumesSnapshotListTestJSON-1847501116 None] Lock "cinder-quobyte-046be853-2f5f-4709-b73a-58edf86beb1d" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:19:19 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-f9c67bcd-8d1a-4b08-8fca-be73e9519c0d tempest-VolumesSnapshotListTestJSON-1847501116 None] Deleting offline snapshot 046be853-2f5f-4709-b73a-58edf86beb1d of volume 62ecccd7-9e16-4c9d-af3c-eaba24bb5169 {{(pid=89182) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 31 12:19:19 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-f9c67bcd-8d1a-4b08-8fca-be73e9519c0d tempest-VolumesSnapshotListTestJSON-1847501116 None] snapshot_file for this snap is: volume-62ecccd7-9e16-4c9d-af3c-eaba24bb5169.046be853-2f5f-4709-b73a-58edf86beb1d {{(pid=89182) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 31 12:19:19 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b9f55ef-2671-4eb9-ad96-ece5652eebad]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:19:19 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-f9c67bcd-8d1a-4b08-8fca-be73e9519c0d tempest-VolumesSnapshotListTestJSON-1847501116 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-62ecccd7-9e16-4c9d-af3c-eaba24bb5169.046be853-2f5f-4709-b73a-58edf86beb1d {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:19:19 devstack sudo[96121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-62ecccd7-9e16-4c9d-af3c-eaba24bb5169.046be853-2f5f-4709-b73a-58edf86beb1d Jul 31 12:19:19 devstack sudo[96121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:19:19 devstack sudo[96121]: pam_unix(sudo:session): session closed for user root Jul 31 12:19:19 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-f9c67bcd-8d1a-4b08-8fca-be73e9519c0d tempest-VolumesSnapshotListTestJSON-1847501116 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-62ecccd7-9e16-4c9d-af3c-eaba24bb5169.046be853-2f5f-4709-b73a-58edf86beb1d" returned: 0 in 0.558s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:19:19 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-f9c67bcd-8d1a-4b08-8fca-be73e9519c0d tempest-VolumesSnapshotListTestJSON-1847501116 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-62ecccd7-9e16-4c9d-af3c-eaba24bb5169(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89182) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 12:19:19 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[25623e31-45bd-4f1c-9e6c-576d8e4e1071]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:19:19 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-f9c67bcd-8d1a-4b08-8fca-be73e9519c0d tempest-VolumesSnapshotListTestJSON-1847501116 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-62ecccd7-9e16-4c9d-af3c-eaba24bb5169 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:19:19 devstack cinder-volume[89182]: DEBUG cinder.volume.flows.manager.create_volume [None req-9192e3bb-f1cd-4076-82ba-3a2f9262d965 tempest-VolumesSnapshotTestJSON-1809567557 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89182) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 12:19:19 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-9192e3bb-f1cd-4076-82ba-3a2f9262d965 tempest-VolumesSnapshotTestJSON-1809567557 None] Flow 'volume_create_manager' (6c9bb249-9241-4e24-b3a2-06ddba5c0b8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:19:19 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-9192e3bb-f1cd-4076-82ba-3a2f9262d965 tempest-VolumesSnapshotTestJSON-1809567557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (770cbba9-0d6f-4c4c-9702-52af5fb959f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:19:19 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-9192e3bb-f1cd-4076-82ba-3a2f9262d965 tempest-VolumesSnapshotTestJSON-1809567557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (770cbba9-0d6f-4c4c-9702-52af5fb959f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:19:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2113367402',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06f030d5-2fd3-48c4-a4da-ee1fed011586,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='973c0b5551ab4879b114262098af54d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:19:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:19:20Z,use_quota=True,user_id='a4512f81d8c949f5ac15e6b3f39585c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:19:19 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-9192e3bb-f1cd-4076-82ba-3a2f9262d965 tempest-VolumesSnapshotTestJSON-1809567557 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ebf313f9-2ac1-4fed-8de9-0912713fc5bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:19:19 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-9192e3bb-f1cd-4076-82ba-3a2f9262d965 tempest-VolumesSnapshotTestJSON-1809567557 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ebf313f9-2ac1-4fed-8de9-0912713fc5bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:19:19 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-9192e3bb-f1cd-4076-82ba-3a2f9262d965 tempest-VolumesSnapshotTestJSON-1809567557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0547ec57-b57c-427e-b253-1f06233fb269) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:19:19 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-9192e3bb-f1cd-4076-82ba-3a2f9262d965 tempest-VolumesSnapshotTestJSON-1809567557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0547ec57-b57c-427e-b253-1f06233fb269) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '06f030d5-2fd3-48c4-a4da-ee1fed011586', 'volume_name': 'volume-06f030d5-2fd3-48c4-a4da-ee1fed011586', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:19:19 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-9192e3bb-f1cd-4076-82ba-3a2f9262d965 tempest-VolumesSnapshotTestJSON-1809567557 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6dee8e4e-22cc-4861-a983-e081afe6c429) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:19:19 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-9192e3bb-f1cd-4076-82ba-3a2f9262d965 tempest-VolumesSnapshotTestJSON-1809567557 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6dee8e4e-22cc-4861-a983-e081afe6c429) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:19:19 devstack sudo[96127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-62ecccd7-9e16-4c9d-af3c-eaba24bb5169 Jul 31 12:19:19 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-9192e3bb-f1cd-4076-82ba-3a2f9262d965 tempest-VolumesSnapshotTestJSON-1809567557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (643186da-65b4-47ce-8f08-de358d9f4a90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:19:19 devstack sudo[96127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:19:19 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-9192e3bb-f1cd-4076-82ba-3a2f9262d965 tempest-VolumesSnapshotTestJSON-1809567557 None] Volume 06f030d5-2fd3-48c4-a4da-ee1fed011586: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-06f030d5-2fd3-48c4-a4da-ee1fed011586', 'volume_size': 1} Jul 31 12:19:19 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-9192e3bb-f1cd-4076-82ba-3a2f9262d965 tempest-VolumesSnapshotTestJSON-1809567557 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:19:19 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-9192e3bb-f1cd-4076-82ba-3a2f9262d965 tempest-VolumesSnapshotTestJSON-1809567557 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:19:19 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-9192e3bb-f1cd-4076-82ba-3a2f9262d965 tempest-VolumesSnapshotTestJSON-1809567557 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:19:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2113367402',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06f030d5-2fd3-48c4-a4da-ee1fed011586,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='973c0b5551ab4879b114262098af54d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:19:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:19:20Z,use_quota=True,user_id='a4512f81d8c949f5ac15e6b3f39585c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)}" {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 12:19:19 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-9192e3bb-f1cd-4076-82ba-3a2f9262d965 tempest-VolumesSnapshotTestJSON-1809567557 None] Creating volume 06f030d5-2fd3-48c4-a4da-ee1fed011586 {{(pid=89182) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 12:19:19 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-9192e3bb-f1cd-4076-82ba-3a2f9262d965 tempest-VolumesSnapshotTestJSON-1809567557 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:19:19 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-9192e3bb-f1cd-4076-82ba-3a2f9262d965 tempest-VolumesSnapshotTestJSON-1809567557 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:19:19 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-9192e3bb-f1cd-4076-82ba-3a2f9262d965 tempest-VolumesSnapshotTestJSON-1809567557 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:19:19 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-9192e3bb-f1cd-4076-82ba-3a2f9262d965 tempest-VolumesSnapshotTestJSON-1809567557 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:19:19 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-9192e3bb-f1cd-4076-82ba-3a2f9262d965 tempest-VolumesSnapshotTestJSON-1809567557 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:19:19 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-9192e3bb-f1cd-4076-82ba-3a2f9262d965 tempest-VolumesSnapshotTestJSON-1809567557 None] Selected osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 as target Quobyte volume. {{(pid=89182) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 12:19:19 devstack cinder-volume[89182]: INFO cinder.volume.drivers.remotefs [None req-9192e3bb-f1cd-4076-82ba-3a2f9262d965 tempest-VolumesSnapshotTestJSON-1809567557 None] casted to osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 Jul 31 12:19:19 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-9192e3bb-f1cd-4076-82ba-3a2f9262d965 tempest-VolumesSnapshotTestJSON-1809567557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-06f030d5-2fd3-48c4-a4da-ee1fed011586 1073741824 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:19:19 devstack sudo[96129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-06f030d5-2fd3-48c4-a4da-ee1fed011586 1073741824 Jul 31 12:19:19 devstack sudo[96129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:19:20 devstack sudo[96127]: pam_unix(sudo:session): session closed for user root Jul 31 12:19:20 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-f9c67bcd-8d1a-4b08-8fca-be73e9519c0d tempest-VolumesSnapshotListTestJSON-1847501116 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-62ecccd7-9e16-4c9d-af3c-eaba24bb5169" returned: 0 in 0.531s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:19:20 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-f9c67bcd-8d1a-4b08-8fca-be73e9519c0d tempest-VolumesSnapshotListTestJSON-1847501116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-62ecccd7-9e16-4c9d-af3c-eaba24bb5169.046be853-2f5f-4709-b73a-58edf86beb1d {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:19:20 devstack sudo[96137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-62ecccd7-9e16-4c9d-af3c-eaba24bb5169.046be853-2f5f-4709-b73a-58edf86beb1d Jul 31 12:19:20 devstack sudo[96137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:19:20 devstack sudo[96129]: pam_unix(sudo:session): session closed for user root Jul 31 12:19:20 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-9192e3bb-f1cd-4076-82ba-3a2f9262d965 tempest-VolumesSnapshotTestJSON-1809567557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-06f030d5-2fd3-48c4-a4da-ee1fed011586 1073741824" returned: 0 in 0.584s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:19:20 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-9192e3bb-f1cd-4076-82ba-3a2f9262d965 tempest-VolumesSnapshotTestJSON-1809567557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-06f030d5-2fd3-48c4-a4da-ee1fed011586 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:19:20 devstack sudo[96141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-06f030d5-2fd3-48c4-a4da-ee1fed011586 Jul 31 12:19:20 devstack sudo[96141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:19:20 devstack sudo[96137]: pam_unix(sudo:session): session closed for user root Jul 31 12:19:20 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-f9c67bcd-8d1a-4b08-8fca-be73e9519c0d tempest-VolumesSnapshotListTestJSON-1847501116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-62ecccd7-9e16-4c9d-af3c-eaba24bb5169.046be853-2f5f-4709-b73a-58edf86beb1d" returned: 0 in 0.620s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:19:20 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-f9c67bcd-8d1a-4b08-8fca-be73e9519c0d tempest-VolumesSnapshotListTestJSON-1847501116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-62ecccd7-9e16-4c9d-af3c-eaba24bb5169.046be853-2f5f-4709-b73a-58edf86beb1d {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:19:20 devstack sudo[96147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-62ecccd7-9e16-4c9d-af3c-eaba24bb5169.046be853-2f5f-4709-b73a-58edf86beb1d Jul 31 12:19:20 devstack sudo[96147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:19:20 devstack sudo[96141]: pam_unix(sudo:session): session closed for user root Jul 31 12:19:20 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-9192e3bb-f1cd-4076-82ba-3a2f9262d965 tempest-VolumesSnapshotTestJSON-1809567557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-06f030d5-2fd3-48c4-a4da-ee1fed011586" returned: 0 in 0.427s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:19:20 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-9192e3bb-f1cd-4076-82ba-3a2f9262d965 tempest-VolumesSnapshotTestJSON-1809567557 None] <== create_volume: return (1097ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'} {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 12:19:20 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-9192e3bb-f1cd-4076-82ba-3a2f9262d965 tempest-VolumesSnapshotTestJSON-1809567557 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.100s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:19:20 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-9192e3bb-f1cd-4076-82ba-3a2f9262d965 tempest-VolumesSnapshotTestJSON-1809567557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (643186da-65b4-47ce-8f08-de358d9f4a90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-06f030d5-2fd3-48c4-a4da-ee1fed011586', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:19:20 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-9192e3bb-f1cd-4076-82ba-3a2f9262d965 tempest-VolumesSnapshotTestJSON-1809567557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7bdee491-d4e4-4801-9eb2-6e6370d59787) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:19:20 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-9192e3bb-f1cd-4076-82ba-3a2f9262d965 tempest-VolumesSnapshotTestJSON-1809567557 None] Volume volume-06f030d5-2fd3-48c4-a4da-ee1fed011586 (06f030d5-2fd3-48c4-a4da-ee1fed011586): created successfully Jul 31 12:19:20 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-9192e3bb-f1cd-4076-82ba-3a2f9262d965 tempest-VolumesSnapshotTestJSON-1809567557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7bdee491-d4e4-4801-9eb2-6e6370d59787) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:19:20 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-9192e3bb-f1cd-4076-82ba-3a2f9262d965 tempest-VolumesSnapshotTestJSON-1809567557 None] Flow 'volume_create_manager' (6c9bb249-9241-4e24-b3a2-06ddba5c0b8e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:19:20 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-9192e3bb-f1cd-4076-82ba-3a2f9262d965 tempest-VolumesSnapshotTestJSON-1809567557 None] Created volume successfully. Jul 31 12:19:21 devstack sudo[96147]: pam_unix(sudo:session): session closed for user root Jul 31 12:19:21 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-f9c67bcd-8d1a-4b08-8fca-be73e9519c0d tempest-VolumesSnapshotListTestJSON-1847501116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-62ecccd7-9e16-4c9d-af3c-eaba24bb5169.046be853-2f5f-4709-b73a-58edf86beb1d" returned: 0 in 0.373s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:19:21 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-f9c67bcd-8d1a-4b08-8fca-be73e9519c0d tempest-VolumesSnapshotListTestJSON-1847501116 None] Lock "cinder-quobyte-046be853-2f5f-4709-b73a-58edf86beb1d" released by "_delete_snapshot" :: held 2.240s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:19:21 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-f9c67bcd-8d1a-4b08-8fca-be73e9519c0d tempest-VolumesSnapshotListTestJSON-1847501116 None] Lock "cinder-quobyte-62ecccd7-9e16-4c9d-af3c-eaba24bb5169" released by "delete_snapshot" :: held 2.272s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:19:21 devstack cinder-volume[89182]: DEBUG cinder.quota [None req-f9c67bcd-8d1a-4b08-8fca-be73e9519c0d tempest-VolumesSnapshotListTestJSON-1847501116 None] Created reservations ['2d48dde1-c195-4d6a-b72c-905bb09c037f', '775c71b9-047b-49e6-8e49-ee2fa69827fe', '0ddd0fee-993d-4654-a295-ab4c72dab261', '4a926430-6adf-40c8-87fe-526f434595df'] {{(pid=89182) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 12:19:21 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-f9c67bcd-8d1a-4b08-8fca-be73e9519c0d tempest-VolumesSnapshotListTestJSON-1847501116 None] Delete snapshot completed successfully. Jul 31 12:19:21 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-f9c67bcd-8d1a-4b08-8fca-be73e9519c0d tempest-VolumesSnapshotListTestJSON-1847501116 None] Lock "cinder-046be853-2f5f-4709-b73a-58edf86beb1d-delete_snapshot" released by "delete_snapshot" :: held 2.487s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:19:21 devstack cinder-volume[89182]: DEBUG oslo_service.periodic_task [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89182) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 31 12:19:21 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:19:21 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:19:21 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:19:21 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:19:21 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:19:21 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:19:21 devstack sudo[96152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 Jul 31 12:19:21 devstack sudo[96152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:19:22 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-f1ca892e-8474-4103-ba54-b0c73af708e7 tempest-VolumesSnapshotTestJSON-1809567557 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:19:22 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-f1ca892e-8474-4103-ba54-b0c73af708e7 tempest-VolumesSnapshotTestJSON-1809567557 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:19:22 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-f1ca892e-8474-4103-ba54-b0c73af708e7 tempest-VolumesSnapshotTestJSON-1809567557 None] Creating offline snapshot 8a84c497-4501-4872-89e3-3814e80b5af8 of volume 06f030d5-2fd3-48c4-a4da-ee1fed011586 {{(pid=89182) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 31 12:19:22 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0c23b36-b10a-4d3f-8223-b9b867c5872f]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:19:22 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-f1ca892e-8474-4103-ba54-b0c73af708e7 tempest-VolumesSnapshotTestJSON-1809567557 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-06f030d5-2fd3-48c4-a4da-ee1fed011586 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:19:22 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-f6190181-42d6-43af-8108-3fe73159eb9b tempest-VolumesSnapshotListTestJSON-1847501116 None] Acquiring lock "cinder-62ecccd7-9e16-4c9d-af3c-eaba24bb5169-delete_volume" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:19:22 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-f6190181-42d6-43af-8108-3fe73159eb9b tempest-VolumesSnapshotListTestJSON-1847501116 None] Lock "cinder-62ecccd7-9e16-4c9d-af3c-eaba24bb5169-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:19:22 devstack sudo[96154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-06f030d5-2fd3-48c4-a4da-ee1fed011586 Jul 31 12:19:22 devstack sudo[96154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:19:22 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-f6190181-42d6-43af-8108-3fe73159eb9b tempest-VolumesSnapshotListTestJSON-1847501116 None] Acquiring lock "cinder-quobyte-62ecccd7-9e16-4c9d-af3c-eaba24bb5169" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:19:22 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-f6190181-42d6-43af-8108-3fe73159eb9b tempest-VolumesSnapshotListTestJSON-1847501116 None] Lock "cinder-quobyte-62ecccd7-9e16-4c9d-af3c-eaba24bb5169" acquired by "delete_volume" :: waited 0.072s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:19:22 devstack sudo[96152]: pam_unix(sudo:session): session closed for user root Jul 31 12:19:22 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2" returned: 0 in 0.769s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:19:22 devstack cinder-volume[89182]: DEBUG cinder.manager [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] Notifying Schedulers of capabilities ... {{(pid=89182) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 12:19:22 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c3ade73-3e2a-47ca-aefc-47ed6a95c440]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:19:22 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-f6190181-42d6-43af-8108-3fe73159eb9b tempest-VolumesSnapshotListTestJSON-1847501116 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-62ecccd7-9e16-4c9d-af3c-eaba24bb5169 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:19:22 devstack sudo[96154]: pam_unix(sudo:session): session closed for user root Jul 31 12:19:22 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-f1ca892e-8474-4103-ba54-b0c73af708e7 tempest-VolumesSnapshotTestJSON-1809567557 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-06f030d5-2fd3-48c4-a4da-ee1fed011586" returned: 0 in 0.545s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:19:22 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-f1ca892e-8474-4103-ba54-b0c73af708e7 tempest-VolumesSnapshotTestJSON-1809567557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-06f030d5-2fd3-48c4-a4da-ee1fed011586,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-06f030d5-2fd3-48c4-a4da-ee1fed011586.8a84c497-4501-4872-89e3-3814e80b5af8 1G {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:19:22 devstack sudo[96163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-06f030d5-2fd3-48c4-a4da-ee1fed011586,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-06f030d5-2fd3-48c4-a4da-ee1fed011586.8a84c497-4501-4872-89e3-3814e80b5af8 1G Jul 31 12:19:22 devstack sudo[96163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:19:22 devstack sudo[96161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-62ecccd7-9e16-4c9d-af3c-eaba24bb5169 Jul 31 12:19:22 devstack sudo[96161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:19:23 devstack sudo[96161]: pam_unix(sudo:session): session closed for user root Jul 31 12:19:23 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-f6190181-42d6-43af-8108-3fe73159eb9b tempest-VolumesSnapshotListTestJSON-1847501116 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-62ecccd7-9e16-4c9d-af3c-eaba24bb5169" returned: 0 in 0.642s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:19:23 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-f6190181-42d6-43af-8108-3fe73159eb9b tempest-VolumesSnapshotListTestJSON-1847501116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-62ecccd7-9e16-4c9d-af3c-eaba24bb5169 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:19:23 devstack sudo[96179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-62ecccd7-9e16-4c9d-af3c-eaba24bb5169 Jul 31 12:19:23 devstack sudo[96179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:19:23 devstack sudo[96163]: pam_unix(sudo:session): session closed for user root Jul 31 12:19:23 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-f1ca892e-8474-4103-ba54-b0c73af708e7 tempest-VolumesSnapshotTestJSON-1809567557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-06f030d5-2fd3-48c4-a4da-ee1fed011586,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-06f030d5-2fd3-48c4-a4da-ee1fed011586.8a84c497-4501-4872-89e3-3814e80b5af8 1G" returned: 0 in 0.906s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:19:23 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-f1ca892e-8474-4103-ba54-b0c73af708e7 tempest-VolumesSnapshotTestJSON-1809567557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-06f030d5-2fd3-48c4-a4da-ee1fed011586 -F qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-06f030d5-2fd3-48c4-a4da-ee1fed011586.8a84c497-4501-4872-89e3-3814e80b5af8 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:19:23 devstack sudo[96181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-06f030d5-2fd3-48c4-a4da-ee1fed011586 -F qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-06f030d5-2fd3-48c4-a4da-ee1fed011586.8a84c497-4501-4872-89e3-3814e80b5af8 Jul 31 12:19:23 devstack sudo[96181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:19:23 devstack sudo[96179]: pam_unix(sudo:session): session closed for user root Jul 31 12:19:23 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-f6190181-42d6-43af-8108-3fe73159eb9b tempest-VolumesSnapshotListTestJSON-1847501116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-62ecccd7-9e16-4c9d-af3c-eaba24bb5169" returned: 0 in 0.479s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:19:23 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-f6190181-42d6-43af-8108-3fe73159eb9b tempest-VolumesSnapshotListTestJSON-1847501116 None] Lock "cinder-quobyte-62ecccd7-9e16-4c9d-af3c-eaba24bb5169" released by "delete_volume" :: held 1.284s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:19:23 devstack cinder-volume[89182]: DEBUG cinder.quota [None req-f6190181-42d6-43af-8108-3fe73159eb9b tempest-VolumesSnapshotListTestJSON-1847501116 None] Created reservations ['4cdaa6a5-2ac5-4435-ad5f-163a6538dd31', '12dbd00d-4688-45b0-9d89-cafce4df6e4f', 'abc06402-3941-4adc-bb58-7366def53110', 'bc63580c-b90a-4e8a-84b9-4df31ccbf713'] {{(pid=89182) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 12:19:24 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-f6190181-42d6-43af-8108-3fe73159eb9b tempest-VolumesSnapshotListTestJSON-1847501116 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:19:24 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-f6190181-42d6-43af-8108-3fe73159eb9b tempest-VolumesSnapshotListTestJSON-1847501116 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:19:24 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-f6190181-42d6-43af-8108-3fe73159eb9b tempest-VolumesSnapshotListTestJSON-1847501116 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:19:24 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-f6190181-42d6-43af-8108-3fe73159eb9b tempest-VolumesSnapshotListTestJSON-1847501116 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:19:24 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-f6190181-42d6-43af-8108-3fe73159eb9b tempest-VolumesSnapshotListTestJSON-1847501116 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.034s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:19:24 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-f6190181-42d6-43af-8108-3fe73159eb9b tempest-VolumesSnapshotListTestJSON-1847501116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:19:24 devstack sudo[96187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 Jul 31 12:19:24 devstack sudo[96187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:19:24 devstack sudo[96181]: pam_unix(sudo:session): session closed for user root Jul 31 12:19:24 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-f1ca892e-8474-4103-ba54-b0c73af708e7 tempest-VolumesSnapshotTestJSON-1809567557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-06f030d5-2fd3-48c4-a4da-ee1fed011586 -F qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-06f030d5-2fd3-48c4-a4da-ee1fed011586.8a84c497-4501-4872-89e3-3814e80b5af8" returned: 0 in 0.528s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:19:24 devstack cinder-volume[89182]: WARNING cinder.volume.drivers.remotefs [None req-f1ca892e-8474-4103-ba54-b0c73af708e7 tempest-VolumesSnapshotTestJSON-1809567557 None] /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-06f030d5-2fd3-48c4-a4da-ee1fed011586.8a84c497-4501-4872-89e3-3814e80b5af8 is being set with open permissions: ugo+rw Jul 31 12:19:24 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-f1ca892e-8474-4103-ba54-b0c73af708e7 tempest-VolumesSnapshotTestJSON-1809567557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-06f030d5-2fd3-48c4-a4da-ee1fed011586.8a84c497-4501-4872-89e3-3814e80b5af8 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:19:24 devstack sudo[96189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-06f030d5-2fd3-48c4-a4da-ee1fed011586.8a84c497-4501-4872-89e3-3814e80b5af8 Jul 31 12:19:24 devstack sudo[96189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:19:24 devstack sudo[96187]: pam_unix(sudo:session): session closed for user root Jul 31 12:19:24 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-f6190181-42d6-43af-8108-3fe73159eb9b tempest-VolumesSnapshotListTestJSON-1847501116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2" returned: 0 in 0.347s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:19:24 devstack cinder-volume[89182]: DEBUG cinder.manager [None req-f6190181-42d6-43af-8108-3fe73159eb9b tempest-VolumesSnapshotListTestJSON-1847501116 None] Notifying Schedulers of capabilities ... {{(pid=89182) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 12:19:24 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-f6190181-42d6-43af-8108-3fe73159eb9b tempest-VolumesSnapshotListTestJSON-1847501116 None] Deleted volume successfully. Jul 31 12:19:24 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-f6190181-42d6-43af-8108-3fe73159eb9b tempest-VolumesSnapshotListTestJSON-1847501116 None] Lock "cinder-62ecccd7-9e16-4c9d-af3c-eaba24bb5169-delete_volume" released by "delete_volume" :: held 2.131s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:19:24 devstack sudo[96189]: pam_unix(sudo:session): session closed for user root Jul 31 12:19:24 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-f1ca892e-8474-4103-ba54-b0c73af708e7 tempest-VolumesSnapshotTestJSON-1809567557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-06f030d5-2fd3-48c4-a4da-ee1fed011586.8a84c497-4501-4872-89e3-3814e80b5af8" returned: 0 in 0.339s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:19:24 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-f1ca892e-8474-4103-ba54-b0c73af708e7 tempest-VolumesSnapshotTestJSON-1809567557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-06f030d5-2fd3-48c4-a4da-ee1fed011586.info {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:19:24 devstack sudo[96193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-06f030d5-2fd3-48c4-a4da-ee1fed011586.info Jul 31 12:19:24 devstack sudo[96193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:19:24 devstack sudo[96193]: pam_unix(sudo:session): session closed for user root Jul 31 12:19:24 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-f1ca892e-8474-4103-ba54-b0c73af708e7 tempest-VolumesSnapshotTestJSON-1809567557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-06f030d5-2fd3-48c4-a4da-ee1fed011586.info" returned: 0 in 0.337s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:19:24 devstack cinder-volume[89182]: WARNING cinder.volume.drivers.remotefs [None req-f1ca892e-8474-4103-ba54-b0c73af708e7 tempest-VolumesSnapshotTestJSON-1809567557 None] /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-06f030d5-2fd3-48c4-a4da-ee1fed011586.info is being set with open permissions: ugo+rw Jul 31 12:19:24 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-f1ca892e-8474-4103-ba54-b0c73af708e7 tempest-VolumesSnapshotTestJSON-1809567557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-06f030d5-2fd3-48c4-a4da-ee1fed011586.info {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:19:25 devstack sudo[96196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-06f030d5-2fd3-48c4-a4da-ee1fed011586.info Jul 31 12:19:25 devstack sudo[96196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:19:25 devstack sudo[96196]: pam_unix(sudo:session): session closed for user root Jul 31 12:19:25 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-f1ca892e-8474-4103-ba54-b0c73af708e7 tempest-VolumesSnapshotTestJSON-1809567557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-06f030d5-2fd3-48c4-a4da-ee1fed011586.info" returned: 0 in 0.416s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:19:25 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-f1ca892e-8474-4103-ba54-b0c73af708e7 tempest-VolumesSnapshotTestJSON-1809567557 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.269s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:19:25 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-f1ca892e-8474-4103-ba54-b0c73af708e7 tempest-VolumesSnapshotTestJSON-1809567557 None] Create snapshot completed successfully Jul 31 12:19:27 devstack cinder-volume[89182]: DEBUG cinder.volume.flows.manager.create_volume [None req-ba982431-0c81-4dbc-b8c7-611c138562b2 tempest-VolumesSnapshotTestJSON-1809567557 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89182) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 12:19:27 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-ba982431-0c81-4dbc-b8c7-611c138562b2 tempest-VolumesSnapshotTestJSON-1809567557 None] Flow 'volume_create_manager' (6c0e087d-f8f2-49a2-8844-42b666b4a37c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:19:27 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-ba982431-0c81-4dbc-b8c7-611c138562b2 tempest-VolumesSnapshotTestJSON-1809567557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6aa018c8-6eb9-49fb-ac65-e902a396298f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:19:27 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-ba982431-0c81-4dbc-b8c7-611c138562b2 tempest-VolumesSnapshotTestJSON-1809567557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6aa018c8-6eb9-49fb-ac65-e902a396298f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:19:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1095109808',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ce91b06-1006-48ab-b74c-fba472ed7bbc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='973c0b5551ab4879b114262098af54d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:19:27Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=8a84c497-4501-4872-89e3-3814e80b5af8,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:19:27Z,use_quota=True,user_id='a4512f81d8c949f5ac15e6b3f39585c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:19:27 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-ba982431-0c81-4dbc-b8c7-611c138562b2 tempest-VolumesSnapshotTestJSON-1809567557 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a37dba0-2019-4618-9ff0-8060289424d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:19:27 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-ba982431-0c81-4dbc-b8c7-611c138562b2 tempest-VolumesSnapshotTestJSON-1809567557 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a37dba0-2019-4618-9ff0-8060289424d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:19:27 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-ba982431-0c81-4dbc-b8c7-611c138562b2 tempest-VolumesSnapshotTestJSON-1809567557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5630862-8ccb-490b-84ce-1dfa4122a319) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:19:27 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-ba982431-0c81-4dbc-b8c7-611c138562b2 tempest-VolumesSnapshotTestJSON-1809567557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5630862-8ccb-490b-84ce-1dfa4122a319) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '9ce91b06-1006-48ab-b74c-fba472ed7bbc', 'volume_name': 'volume-9ce91b06-1006-48ab-b74c-fba472ed7bbc', 'volume_size': 2, 'snapshot_id': '8a84c497-4501-4872-89e3-3814e80b5af8'}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:19:27 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-ba982431-0c81-4dbc-b8c7-611c138562b2 tempest-VolumesSnapshotTestJSON-1809567557 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14ed1187-c57e-4d0d-b935-5d153efa9229) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:19:27 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-ba982431-0c81-4dbc-b8c7-611c138562b2 tempest-VolumesSnapshotTestJSON-1809567557 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14ed1187-c57e-4d0d-b935-5d153efa9229) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:19:27 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-ba982431-0c81-4dbc-b8c7-611c138562b2 tempest-VolumesSnapshotTestJSON-1809567557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c12eb8f-da61-448f-8791-e8ad565514d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:19:27 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-ba982431-0c81-4dbc-b8c7-611c138562b2 tempest-VolumesSnapshotTestJSON-1809567557 None] Volume 9ce91b06-1006-48ab-b74c-fba472ed7bbc: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-9ce91b06-1006-48ab-b74c-fba472ed7bbc', 'volume_size': 2, 'snapshot_id': '8a84c497-4501-4872-89e3-3814e80b5af8'} Jul 31 12:19:27 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-ba982431-0c81-4dbc-b8c7-611c138562b2 tempest-VolumesSnapshotTestJSON-1809567557 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:19:27 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-ba982431-0c81-4dbc-b8c7-611c138562b2 tempest-VolumesSnapshotTestJSON-1809567557 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:19:27 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-ba982431-0c81-4dbc-b8c7-611c138562b2 tempest-VolumesSnapshotTestJSON-1809567557 None] Acquiring lock "cinder-quobyte-8a84c497-4501-4872-89e3-3814e80b5af8-9ce91b06-1006-48ab-b74c-fba472ed7bbc" by "_create_volume_from_snapshot" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:19:27 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-ba982431-0c81-4dbc-b8c7-611c138562b2 tempest-VolumesSnapshotTestJSON-1809567557 None] Lock "cinder-quobyte-8a84c497-4501-4872-89e3-3814e80b5af8-9ce91b06-1006-48ab-b74c-fba472ed7bbc" acquired by "_create_volume_from_snapshot" :: waited 0.018s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:19:27 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-ba982431-0c81-4dbc-b8c7-611c138562b2 tempest-VolumesSnapshotTestJSON-1809567557 None] Creating volume 9ce91b06-1006-48ab-b74c-fba472ed7bbc from snapshot 8a84c497-4501-4872-89e3-3814e80b5af8 {{(pid=89182) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 31 12:19:27 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-ba982431-0c81-4dbc-b8c7-611c138562b2 tempest-VolumesSnapshotTestJSON-1809567557 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:19:27 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-ba982431-0c81-4dbc-b8c7-611c138562b2 tempest-VolumesSnapshotTestJSON-1809567557 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:19:27 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-ba982431-0c81-4dbc-b8c7-611c138562b2 tempest-VolumesSnapshotTestJSON-1809567557 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:19:27 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-ba982431-0c81-4dbc-b8c7-611c138562b2 tempest-VolumesSnapshotTestJSON-1809567557 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:19:27 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-ba982431-0c81-4dbc-b8c7-611c138562b2 tempest-VolumesSnapshotTestJSON-1809567557 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:19:27 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-ba982431-0c81-4dbc-b8c7-611c138562b2 tempest-VolumesSnapshotTestJSON-1809567557 None] Selected osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 as target Quobyte volume. {{(pid=89182) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 12:19:27 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-ba982431-0c81-4dbc-b8c7-611c138562b2 tempest-VolumesSnapshotTestJSON-1809567557 None] Acquiring lock "cinder-quobyte-9ce91b06-1006-48ab-b74c-fba472ed7bbc" by "_copy_volume_from_snapshot" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:19:27 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-ba982431-0c81-4dbc-b8c7-611c138562b2 tempest-VolumesSnapshotTestJSON-1809567557 None] Lock "cinder-quobyte-9ce91b06-1006-48ab-b74c-fba472ed7bbc" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:19:27 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-ba982431-0c81-4dbc-b8c7-611c138562b2 tempest-VolumesSnapshotTestJSON-1809567557 None] snapshot: 8a84c497-4501-4872-89e3-3814e80b5af8, volume: 9ce91b06-1006-48ab-b74c-fba472ed7bbc, {{(pid=89182) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Jul 31 12:19:27 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-ba982431-0c81-4dbc-b8c7-611c138562b2 tempest-VolumesSnapshotTestJSON-1809567557 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:19:27 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-ba982431-0c81-4dbc-b8c7-611c138562b2 tempest-VolumesSnapshotTestJSON-1809567557 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:19:27 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-ba982431-0c81-4dbc-b8c7-611c138562b2 tempest-VolumesSnapshotTestJSON-1809567557 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:19:27 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-ba982431-0c81-4dbc-b8c7-611c138562b2 tempest-VolumesSnapshotTestJSON-1809567557 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:19:27 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-ba982431-0c81-4dbc-b8c7-611c138562b2 tempest-VolumesSnapshotTestJSON-1809567557 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:19:27 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba991d52-b6ba-43cc-954a-873c5bfbb9bc]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:19:27 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-ba982431-0c81-4dbc-b8c7-611c138562b2 tempest-VolumesSnapshotTestJSON-1809567557 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-06f030d5-2fd3-48c4-a4da-ee1fed011586.8a84c497-4501-4872-89e3-3814e80b5af8 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:19:27 devstack sudo[96229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-06f030d5-2fd3-48c4-a4da-ee1fed011586.8a84c497-4501-4872-89e3-3814e80b5af8 Jul 31 12:19:27 devstack sudo[96229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:19:27 devstack sudo[96229]: pam_unix(sudo:session): session closed for user root Jul 31 12:19:27 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-ba982431-0c81-4dbc-b8c7-611c138562b2 tempest-VolumesSnapshotTestJSON-1809567557 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-06f030d5-2fd3-48c4-a4da-ee1fed011586.8a84c497-4501-4872-89e3-3814e80b5af8" returned: 0 in 0.414s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:19:27 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-ba982431-0c81-4dbc-b8c7-611c138562b2 tempest-VolumesSnapshotTestJSON-1809567557 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-06f030d5-2fd3-48c4-a4da-ee1fed011586(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89182) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 12:19:27 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd01c7a7-18b7-4122-8ece-47e4f6432d48]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:19:27 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-ba982431-0c81-4dbc-b8c7-611c138562b2 tempest-VolumesSnapshotTestJSON-1809567557 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-06f030d5-2fd3-48c4-a4da-ee1fed011586 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:19:27 devstack sudo[96234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-06f030d5-2fd3-48c4-a4da-ee1fed011586 Jul 31 12:19:27 devstack sudo[96234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:19:28 devstack sudo[96234]: pam_unix(sudo:session): session closed for user root Jul 31 12:19:28 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-ba982431-0c81-4dbc-b8c7-611c138562b2 tempest-VolumesSnapshotTestJSON-1809567557 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-06f030d5-2fd3-48c4-a4da-ee1fed011586" returned: 0 in 0.455s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:19:28 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-ba982431-0c81-4dbc-b8c7-611c138562b2 tempest-VolumesSnapshotTestJSON-1809567557 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-06f030d5-2fd3-48c4-a4da-ee1fed011586 {{(pid=89182) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Jul 31 12:19:28 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-ba982431-0c81-4dbc-b8c7-611c138562b2 tempest-VolumesSnapshotTestJSON-1809567557 None] Creating direct copy from snapshot {{(pid=89182) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Jul 31 12:19:28 devstack cinder-volume[89182]: DEBUG cinder.utils [None req-ba982431-0c81-4dbc-b8c7-611c138562b2 tempest-VolumesSnapshotTestJSON-1809567557 None] Path /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-9ce91b06-1006-48ab-b74c-fba472ed7bbc not found in is_blk_device check {{(pid=89182) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 31 12:19:28 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-ba982431-0c81-4dbc-b8c7-611c138562b2 tempest-VolumesSnapshotTestJSON-1809567557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-06f030d5-2fd3-48c4-a4da-ee1fed011586 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-9ce91b06-1006-48ab-b74c-fba472ed7bbc {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:19:28 devstack sudo[96239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-06f030d5-2fd3-48c4-a4da-ee1fed011586 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-9ce91b06-1006-48ab-b74c-fba472ed7bbc Jul 31 12:19:28 devstack sudo[96239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:19:34 devstack sudo[96239]: pam_unix(sudo:session): session closed for user root Jul 31 12:19:34 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-ba982431-0c81-4dbc-b8c7-611c138562b2 tempest-VolumesSnapshotTestJSON-1809567557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-06f030d5-2fd3-48c4-a4da-ee1fed011586 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-9ce91b06-1006-48ab-b74c-fba472ed7bbc" returned: 0 in 5.859s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:19:34 devstack cinder-volume[89182]: DEBUG cinder.image.image_utils [None req-ba982431-0c81-4dbc-b8c7-611c138562b2 tempest-VolumesSnapshotTestJSON-1809567557 None] Image conversion details: src /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-06f030d5-2fd3-48c4-a4da-ee1fed011586, size 1024.00 MB, duration 5.86 sec, destination /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-9ce91b06-1006-48ab-b74c-fba472ed7bbc {{(pid=89182) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 31 12:19:34 devstack cinder-volume[89182]: INFO cinder.image.image_utils [None req-ba982431-0c81-4dbc-b8c7-611c138562b2 tempest-VolumesSnapshotTestJSON-1809567557 None] Converted 1024.00 MB image at 174.74 MB/s Jul 31 12:19:34 devstack cinder-volume[89182]: WARNING cinder.volume.drivers.remotefs [None req-ba982431-0c81-4dbc-b8c7-611c138562b2 tempest-VolumesSnapshotTestJSON-1809567557 None] /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-9ce91b06-1006-48ab-b74c-fba472ed7bbc is being set with open permissions: ugo+rw Jul 31 12:19:34 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-ba982431-0c81-4dbc-b8c7-611c138562b2 tempest-VolumesSnapshotTestJSON-1809567557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-9ce91b06-1006-48ab-b74c-fba472ed7bbc {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:19:34 devstack sudo[96289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-9ce91b06-1006-48ab-b74c-fba472ed7bbc Jul 31 12:19:34 devstack sudo[96289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:19:34 devstack sudo[96289]: pam_unix(sudo:session): session closed for user root Jul 31 12:19:34 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-ba982431-0c81-4dbc-b8c7-611c138562b2 tempest-VolumesSnapshotTestJSON-1809567557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-9ce91b06-1006-48ab-b74c-fba472ed7bbc" returned: 0 in 0.349s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:19:34 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-ba982431-0c81-4dbc-b8c7-611c138562b2 tempest-VolumesSnapshotTestJSON-1809567557 None] Lock "cinder-quobyte-9ce91b06-1006-48ab-b74c-fba472ed7bbc" released by "_copy_volume_from_snapshot" :: held 7.186s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:19:34 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-ba982431-0c81-4dbc-b8c7-611c138562b2 tempest-VolumesSnapshotTestJSON-1809567557 None] Lock "cinder-quobyte-8a84c497-4501-4872-89e3-3814e80b5af8-9ce91b06-1006-48ab-b74c-fba472ed7bbc" released by "_create_volume_from_snapshot" :: held 7.315s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:19:34 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-ba982431-0c81-4dbc-b8c7-611c138562b2 tempest-VolumesSnapshotTestJSON-1809567557 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.334s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:19:34 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-ba982431-0c81-4dbc-b8c7-611c138562b2 tempest-VolumesSnapshotTestJSON-1809567557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c12eb8f-da61-448f-8791-e8ad565514d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ce91b06-1006-48ab-b74c-fba472ed7bbc', 'volume_size': 2, 'snapshot_id': '8a84c497-4501-4872-89e3-3814e80b5af8'}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:19:34 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-ba982431-0c81-4dbc-b8c7-611c138562b2 tempest-VolumesSnapshotTestJSON-1809567557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6fa175aa-7d40-400a-88a2-d35d96a84a7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:19:34 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-ba982431-0c81-4dbc-b8c7-611c138562b2 tempest-VolumesSnapshotTestJSON-1809567557 None] Volume volume-9ce91b06-1006-48ab-b74c-fba472ed7bbc (9ce91b06-1006-48ab-b74c-fba472ed7bbc): created successfully Jul 31 12:19:34 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-ba982431-0c81-4dbc-b8c7-611c138562b2 tempest-VolumesSnapshotTestJSON-1809567557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6fa175aa-7d40-400a-88a2-d35d96a84a7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:19:34 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-ba982431-0c81-4dbc-b8c7-611c138562b2 tempest-VolumesSnapshotTestJSON-1809567557 None] Flow 'volume_create_manager' (6c0e087d-f8f2-49a2-8844-42b666b4a37c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:19:34 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-ba982431-0c81-4dbc-b8c7-611c138562b2 tempest-VolumesSnapshotTestJSON-1809567557 None] Created volume successfully. Jul 31 12:19:35 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-d47f7c41-e6fc-4133-918b-beae5236cb81 tempest-VolumesSnapshotTestJSON-1809567557 None] Acquiring lock "cinder-9ce91b06-1006-48ab-b74c-fba472ed7bbc-delete_volume" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:19:35 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-d47f7c41-e6fc-4133-918b-beae5236cb81 tempest-VolumesSnapshotTestJSON-1809567557 None] Lock "cinder-9ce91b06-1006-48ab-b74c-fba472ed7bbc-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:19:35 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-d47f7c41-e6fc-4133-918b-beae5236cb81 tempest-VolumesSnapshotTestJSON-1809567557 None] Acquiring lock "cinder-quobyte-9ce91b06-1006-48ab-b74c-fba472ed7bbc" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:19:35 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-d47f7c41-e6fc-4133-918b-beae5236cb81 tempest-VolumesSnapshotTestJSON-1809567557 None] Lock "cinder-quobyte-9ce91b06-1006-48ab-b74c-fba472ed7bbc" acquired by "delete_volume" :: waited 0.021s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:19:35 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[71c62dc2-033a-4f94-89a6-37daf8592b46]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:19:35 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-d47f7c41-e6fc-4133-918b-beae5236cb81 tempest-VolumesSnapshotTestJSON-1809567557 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-9ce91b06-1006-48ab-b74c-fba472ed7bbc {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:19:35 devstack sudo[96292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-9ce91b06-1006-48ab-b74c-fba472ed7bbc Jul 31 12:19:35 devstack sudo[96292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:19:35 devstack sudo[96292]: pam_unix(sudo:session): session closed for user root Jul 31 12:19:35 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-d47f7c41-e6fc-4133-918b-beae5236cb81 tempest-VolumesSnapshotTestJSON-1809567557 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-9ce91b06-1006-48ab-b74c-fba472ed7bbc" returned: 0 in 0.528s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:19:35 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-d47f7c41-e6fc-4133-918b-beae5236cb81 tempest-VolumesSnapshotTestJSON-1809567557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-9ce91b06-1006-48ab-b74c-fba472ed7bbc {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:19:35 devstack sudo[96297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-9ce91b06-1006-48ab-b74c-fba472ed7bbc Jul 31 12:19:35 devstack sudo[96297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:19:36 devstack sudo[96297]: pam_unix(sudo:session): session closed for user root Jul 31 12:19:36 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-d47f7c41-e6fc-4133-918b-beae5236cb81 tempest-VolumesSnapshotTestJSON-1809567557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-9ce91b06-1006-48ab-b74c-fba472ed7bbc" returned: 0 in 0.336s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:19:36 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-d47f7c41-e6fc-4133-918b-beae5236cb81 tempest-VolumesSnapshotTestJSON-1809567557 None] Lock "cinder-quobyte-9ce91b06-1006-48ab-b74c-fba472ed7bbc" released by "delete_volume" :: held 0.940s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:19:36 devstack cinder-volume[89182]: DEBUG cinder.quota [None req-d47f7c41-e6fc-4133-918b-beae5236cb81 tempest-VolumesSnapshotTestJSON-1809567557 None] Created reservations ['0cd9362e-fae4-4a90-a9fd-a85ea90ab189', '18ad6216-4bd8-4a7e-904e-16843b7480c7', '3e0e2732-0eb8-4ceb-9c4e-7a8966a75413', 'a7379d5f-a85e-4d3f-94b0-ae9026f14cd0'] {{(pid=89182) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 12:19:36 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-d47f7c41-e6fc-4133-918b-beae5236cb81 tempest-VolumesSnapshotTestJSON-1809567557 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:19:36 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-d47f7c41-e6fc-4133-918b-beae5236cb81 tempest-VolumesSnapshotTestJSON-1809567557 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:19:36 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-d47f7c41-e6fc-4133-918b-beae5236cb81 tempest-VolumesSnapshotTestJSON-1809567557 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:19:36 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-d47f7c41-e6fc-4133-918b-beae5236cb81 tempest-VolumesSnapshotTestJSON-1809567557 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:19:36 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-d47f7c41-e6fc-4133-918b-beae5236cb81 tempest-VolumesSnapshotTestJSON-1809567557 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:19:36 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-d47f7c41-e6fc-4133-918b-beae5236cb81 tempest-VolumesSnapshotTestJSON-1809567557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:19:36 devstack sudo[96301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 Jul 31 12:19:36 devstack sudo[96301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:19:36 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-f441cc6f-7b33-411a-b64d-3284f442db3a tempest-VolumesSnapshotTestJSON-1809567557 None] Acquiring lock "cinder-8a84c497-4501-4872-89e3-3814e80b5af8-delete_snapshot" by "delete_snapshot" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:19:36 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-f441cc6f-7b33-411a-b64d-3284f442db3a tempest-VolumesSnapshotTestJSON-1809567557 None] Lock "cinder-8a84c497-4501-4872-89e3-3814e80b5af8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.063s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:19:36 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-f441cc6f-7b33-411a-b64d-3284f442db3a tempest-VolumesSnapshotTestJSON-1809567557 None] Acquiring lock "cinder-quobyte-06f030d5-2fd3-48c4-a4da-ee1fed011586" by "delete_snapshot" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:19:36 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-f441cc6f-7b33-411a-b64d-3284f442db3a tempest-VolumesSnapshotTestJSON-1809567557 None] Lock "cinder-quobyte-06f030d5-2fd3-48c4-a4da-ee1fed011586" acquired by "delete_snapshot" :: waited 0.034s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:19:36 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-f441cc6f-7b33-411a-b64d-3284f442db3a tempest-VolumesSnapshotTestJSON-1809567557 None] Acquiring lock "cinder-quobyte-8a84c497-4501-4872-89e3-3814e80b5af8" by "_delete_snapshot" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:19:36 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-f441cc6f-7b33-411a-b64d-3284f442db3a tempest-VolumesSnapshotTestJSON-1809567557 None] Lock "cinder-quobyte-8a84c497-4501-4872-89e3-3814e80b5af8" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:19:36 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-f441cc6f-7b33-411a-b64d-3284f442db3a tempest-VolumesSnapshotTestJSON-1809567557 None] Deleting offline snapshot 8a84c497-4501-4872-89e3-3814e80b5af8 of volume 06f030d5-2fd3-48c4-a4da-ee1fed011586 {{(pid=89182) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 31 12:19:36 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-f441cc6f-7b33-411a-b64d-3284f442db3a tempest-VolumesSnapshotTestJSON-1809567557 None] snapshot_file for this snap is: volume-06f030d5-2fd3-48c4-a4da-ee1fed011586.8a84c497-4501-4872-89e3-3814e80b5af8 {{(pid=89182) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 31 12:19:36 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f25304e-095b-4466-b866-eb4163922d15]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:19:36 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-f441cc6f-7b33-411a-b64d-3284f442db3a tempest-VolumesSnapshotTestJSON-1809567557 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-06f030d5-2fd3-48c4-a4da-ee1fed011586.8a84c497-4501-4872-89e3-3814e80b5af8 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:19:36 devstack sudo[96301]: pam_unix(sudo:session): session closed for user root Jul 31 12:19:36 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-d47f7c41-e6fc-4133-918b-beae5236cb81 tempest-VolumesSnapshotTestJSON-1809567557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2" returned: 0 in 0.350s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:19:36 devstack cinder-volume[89182]: DEBUG cinder.manager [None req-d47f7c41-e6fc-4133-918b-beae5236cb81 tempest-VolumesSnapshotTestJSON-1809567557 None] Notifying Schedulers of capabilities ... {{(pid=89182) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 12:19:36 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-d47f7c41-e6fc-4133-918b-beae5236cb81 tempest-VolumesSnapshotTestJSON-1809567557 None] Deleted volume successfully. Jul 31 12:19:36 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-d47f7c41-e6fc-4133-918b-beae5236cb81 tempest-VolumesSnapshotTestJSON-1809567557 None] Lock "cinder-9ce91b06-1006-48ab-b74c-fba472ed7bbc-delete_volume" released by "delete_volume" :: held 1.583s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:19:36 devstack sudo[96304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-06f030d5-2fd3-48c4-a4da-ee1fed011586.8a84c497-4501-4872-89e3-3814e80b5af8 Jul 31 12:19:36 devstack sudo[96304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:19:37 devstack sudo[96304]: pam_unix(sudo:session): session closed for user root Jul 31 12:19:37 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-f441cc6f-7b33-411a-b64d-3284f442db3a tempest-VolumesSnapshotTestJSON-1809567557 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-06f030d5-2fd3-48c4-a4da-ee1fed011586.8a84c497-4501-4872-89e3-3814e80b5af8" returned: 0 in 0.566s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:19:37 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-f441cc6f-7b33-411a-b64d-3284f442db3a tempest-VolumesSnapshotTestJSON-1809567557 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-06f030d5-2fd3-48c4-a4da-ee1fed011586(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89182) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 12:19:37 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[71f0a843-e159-4f4d-9128-19522c8c3117]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:19:37 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-f441cc6f-7b33-411a-b64d-3284f442db3a tempest-VolumesSnapshotTestJSON-1809567557 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-06f030d5-2fd3-48c4-a4da-ee1fed011586 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:19:37 devstack sudo[96309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-06f030d5-2fd3-48c4-a4da-ee1fed011586 Jul 31 12:19:37 devstack sudo[96309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:19:38 devstack sudo[96309]: pam_unix(sudo:session): session closed for user root Jul 31 12:19:38 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-f441cc6f-7b33-411a-b64d-3284f442db3a tempest-VolumesSnapshotTestJSON-1809567557 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-06f030d5-2fd3-48c4-a4da-ee1fed011586" returned: 0 in 0.776s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:19:38 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-f441cc6f-7b33-411a-b64d-3284f442db3a tempest-VolumesSnapshotTestJSON-1809567557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-06f030d5-2fd3-48c4-a4da-ee1fed011586.8a84c497-4501-4872-89e3-3814e80b5af8 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:19:38 devstack sudo[96320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-06f030d5-2fd3-48c4-a4da-ee1fed011586.8a84c497-4501-4872-89e3-3814e80b5af8 Jul 31 12:19:38 devstack sudo[96320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:19:38 devstack cinder-volume[89182]: DEBUG cinder.volume.flows.manager.create_volume [None req-b23add8d-7dd9-458d-9994-4de48820b383 tempest-AttachVolumeTestJSON-657338358 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89182) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 12:19:38 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-b23add8d-7dd9-458d-9994-4de48820b383 tempest-AttachVolumeTestJSON-657338358 None] Flow 'volume_create_manager' (2a97ce2e-6434-4563-93f7-15e2e212cbc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:19:38 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-b23add8d-7dd9-458d-9994-4de48820b383 tempest-AttachVolumeTestJSON-657338358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d13571c-ae8a-4c33-ae21-6d005f43bbed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:19:38 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-b23add8d-7dd9-458d-9994-4de48820b383 tempest-AttachVolumeTestJSON-657338358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d13571c-ae8a-4c33-ae21-6d005f43bbed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:19:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-722443242',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67c83eeb-6bff-4ee3-8b43-244f7d434d73,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3bfcd1d00c440ec9eb594004353c12c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:19:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:19:38Z,use_quota=True,user_id='47b2b4c1aaac48cea4a566ecbcd7921b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:19:38 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-b23add8d-7dd9-458d-9994-4de48820b383 tempest-AttachVolumeTestJSON-657338358 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e4d3fd5-d820-4f09-b8ae-ccba483d54e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:19:38 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-b23add8d-7dd9-458d-9994-4de48820b383 tempest-AttachVolumeTestJSON-657338358 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e4d3fd5-d820-4f09-b8ae-ccba483d54e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:19:38 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-b23add8d-7dd9-458d-9994-4de48820b383 tempest-AttachVolumeTestJSON-657338358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87bb2f3a-b47a-4e74-b4f0-3aebd5c62a6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:19:38 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-b23add8d-7dd9-458d-9994-4de48820b383 tempest-AttachVolumeTestJSON-657338358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87bb2f3a-b47a-4e74-b4f0-3aebd5c62a6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '67c83eeb-6bff-4ee3-8b43-244f7d434d73', 'volume_name': 'volume-67c83eeb-6bff-4ee3-8b43-244f7d434d73', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:19:38 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-b23add8d-7dd9-458d-9994-4de48820b383 tempest-AttachVolumeTestJSON-657338358 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e522724-0d41-4cf3-ad0b-89d7be0d7dd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:19:38 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-b23add8d-7dd9-458d-9994-4de48820b383 tempest-AttachVolumeTestJSON-657338358 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e522724-0d41-4cf3-ad0b-89d7be0d7dd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:19:38 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-b23add8d-7dd9-458d-9994-4de48820b383 tempest-AttachVolumeTestJSON-657338358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33b02c71-ce36-4b28-bcb6-21059209431c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:19:38 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-b23add8d-7dd9-458d-9994-4de48820b383 tempest-AttachVolumeTestJSON-657338358 None] Volume 67c83eeb-6bff-4ee3-8b43-244f7d434d73: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-67c83eeb-6bff-4ee3-8b43-244f7d434d73', 'volume_size': 1} Jul 31 12:19:38 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-b23add8d-7dd9-458d-9994-4de48820b383 tempest-AttachVolumeTestJSON-657338358 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:19:38 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-b23add8d-7dd9-458d-9994-4de48820b383 tempest-AttachVolumeTestJSON-657338358 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:19:38 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-b23add8d-7dd9-458d-9994-4de48820b383 tempest-AttachVolumeTestJSON-657338358 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:19:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-722443242',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67c83eeb-6bff-4ee3-8b43-244f7d434d73,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3bfcd1d00c440ec9eb594004353c12c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:19:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:19:38Z,use_quota=True,user_id='47b2b4c1aaac48cea4a566ecbcd7921b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)}" {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 12:19:38 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-b23add8d-7dd9-458d-9994-4de48820b383 tempest-AttachVolumeTestJSON-657338358 None] Creating volume 67c83eeb-6bff-4ee3-8b43-244f7d434d73 {{(pid=89182) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 12:19:38 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-b23add8d-7dd9-458d-9994-4de48820b383 tempest-AttachVolumeTestJSON-657338358 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:19:38 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-b23add8d-7dd9-458d-9994-4de48820b383 tempest-AttachVolumeTestJSON-657338358 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:19:38 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-b23add8d-7dd9-458d-9994-4de48820b383 tempest-AttachVolumeTestJSON-657338358 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:19:38 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-b23add8d-7dd9-458d-9994-4de48820b383 tempest-AttachVolumeTestJSON-657338358 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:19:38 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-b23add8d-7dd9-458d-9994-4de48820b383 tempest-AttachVolumeTestJSON-657338358 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:19:38 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-b23add8d-7dd9-458d-9994-4de48820b383 tempest-AttachVolumeTestJSON-657338358 None] Selected osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 as target Quobyte volume. {{(pid=89182) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 12:19:38 devstack cinder-volume[89182]: INFO cinder.volume.drivers.remotefs [None req-b23add8d-7dd9-458d-9994-4de48820b383 tempest-AttachVolumeTestJSON-657338358 None] casted to osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 Jul 31 12:19:38 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-b23add8d-7dd9-458d-9994-4de48820b383 tempest-AttachVolumeTestJSON-657338358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-67c83eeb-6bff-4ee3-8b43-244f7d434d73 1073741824 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:19:38 devstack sudo[96325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-67c83eeb-6bff-4ee3-8b43-244f7d434d73 1073741824 Jul 31 12:19:38 devstack sudo[96325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:19:38 devstack sudo[96320]: pam_unix(sudo:session): session closed for user root Jul 31 12:19:38 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-f441cc6f-7b33-411a-b64d-3284f442db3a tempest-VolumesSnapshotTestJSON-1809567557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-06f030d5-2fd3-48c4-a4da-ee1fed011586.8a84c497-4501-4872-89e3-3814e80b5af8" returned: 0 in 0.623s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:19:38 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-f441cc6f-7b33-411a-b64d-3284f442db3a tempest-VolumesSnapshotTestJSON-1809567557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-06f030d5-2fd3-48c4-a4da-ee1fed011586.8a84c497-4501-4872-89e3-3814e80b5af8 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:19:38 devstack sudo[96327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-06f030d5-2fd3-48c4-a4da-ee1fed011586.8a84c497-4501-4872-89e3-3814e80b5af8 Jul 31 12:19:38 devstack sudo[96327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:19:39 devstack sudo[96327]: pam_unix(sudo:session): session closed for user root Jul 31 12:19:39 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-f441cc6f-7b33-411a-b64d-3284f442db3a tempest-VolumesSnapshotTestJSON-1809567557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-06f030d5-2fd3-48c4-a4da-ee1fed011586.8a84c497-4501-4872-89e3-3814e80b5af8" returned: 0 in 0.322s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:19:39 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-f441cc6f-7b33-411a-b64d-3284f442db3a tempest-VolumesSnapshotTestJSON-1809567557 None] Lock "cinder-quobyte-8a84c497-4501-4872-89e3-3814e80b5af8" released by "_delete_snapshot" :: held 2.445s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:19:39 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-f441cc6f-7b33-411a-b64d-3284f442db3a tempest-VolumesSnapshotTestJSON-1809567557 None] Lock "cinder-quobyte-06f030d5-2fd3-48c4-a4da-ee1fed011586" released by "delete_snapshot" :: held 2.485s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:19:39 devstack cinder-volume[89182]: DEBUG cinder.quota [None req-f441cc6f-7b33-411a-b64d-3284f442db3a tempest-VolumesSnapshotTestJSON-1809567557 None] Created reservations ['926ebc62-c890-4c73-8bcf-e427efaff41c', 'fda2269c-584f-4444-9635-b9033ee02562', 'ae571d71-4d79-4e69-9f6d-f838f2db9e81', '56f8a616-a406-4e1a-bf21-c557ccc34fc0'] {{(pid=89182) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 12:19:39 devstack sudo[96325]: pam_unix(sudo:session): session closed for user root Jul 31 12:19:39 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-b23add8d-7dd9-458d-9994-4de48820b383 tempest-AttachVolumeTestJSON-657338358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-67c83eeb-6bff-4ee3-8b43-244f7d434d73 1073741824" returned: 0 in 0.571s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:19:39 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-b23add8d-7dd9-458d-9994-4de48820b383 tempest-AttachVolumeTestJSON-657338358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-67c83eeb-6bff-4ee3-8b43-244f7d434d73 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:19:39 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-f441cc6f-7b33-411a-b64d-3284f442db3a tempest-VolumesSnapshotTestJSON-1809567557 None] Delete snapshot completed successfully. Jul 31 12:19:39 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-f441cc6f-7b33-411a-b64d-3284f442db3a tempest-VolumesSnapshotTestJSON-1809567557 None] Lock "cinder-8a84c497-4501-4872-89e3-3814e80b5af8-delete_snapshot" released by "delete_snapshot" :: held 2.735s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:19:39 devstack sudo[96333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-67c83eeb-6bff-4ee3-8b43-244f7d434d73 Jul 31 12:19:39 devstack sudo[96333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:19:39 devstack sudo[96333]: pam_unix(sudo:session): session closed for user root Jul 31 12:19:39 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-b23add8d-7dd9-458d-9994-4de48820b383 tempest-AttachVolumeTestJSON-657338358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-67c83eeb-6bff-4ee3-8b43-244f7d434d73" returned: 0 in 0.320s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:19:39 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-b23add8d-7dd9-458d-9994-4de48820b383 tempest-AttachVolumeTestJSON-657338358 None] <== create_volume: return (962ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'} {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 12:19:39 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-b23add8d-7dd9-458d-9994-4de48820b383 tempest-AttachVolumeTestJSON-657338358 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.964s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:19:39 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-b23add8d-7dd9-458d-9994-4de48820b383 tempest-AttachVolumeTestJSON-657338358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33b02c71-ce36-4b28-bcb6-21059209431c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-67c83eeb-6bff-4ee3-8b43-244f7d434d73', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:19:39 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-b23add8d-7dd9-458d-9994-4de48820b383 tempest-AttachVolumeTestJSON-657338358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9470d47-b0b3-46f0-8be4-677ecb59f828) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:19:39 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-b23add8d-7dd9-458d-9994-4de48820b383 tempest-AttachVolumeTestJSON-657338358 None] Volume volume-67c83eeb-6bff-4ee3-8b43-244f7d434d73 (67c83eeb-6bff-4ee3-8b43-244f7d434d73): created successfully Jul 31 12:19:39 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-b23add8d-7dd9-458d-9994-4de48820b383 tempest-AttachVolumeTestJSON-657338358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9470d47-b0b3-46f0-8be4-677ecb59f828) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:19:39 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-b23add8d-7dd9-458d-9994-4de48820b383 tempest-AttachVolumeTestJSON-657338358 None] Flow 'volume_create_manager' (2a97ce2e-6434-4563-93f7-15e2e212cbc4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:19:39 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-b23add8d-7dd9-458d-9994-4de48820b383 tempest-AttachVolumeTestJSON-657338358 None] Created volume successfully. Jul 31 12:19:39 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-66d2cf91-4b1d-4b2b-96e8-53642ff300bd tempest-VolumesSnapshotTestJSON-1809567557 None] Acquiring lock "cinder-06f030d5-2fd3-48c4-a4da-ee1fed011586-delete_volume" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:19:40 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-66d2cf91-4b1d-4b2b-96e8-53642ff300bd tempest-VolumesSnapshotTestJSON-1809567557 None] Lock "cinder-06f030d5-2fd3-48c4-a4da-ee1fed011586-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:19:40 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-66d2cf91-4b1d-4b2b-96e8-53642ff300bd tempest-VolumesSnapshotTestJSON-1809567557 None] Acquiring lock "cinder-quobyte-06f030d5-2fd3-48c4-a4da-ee1fed011586" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:19:40 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-66d2cf91-4b1d-4b2b-96e8-53642ff300bd tempest-VolumesSnapshotTestJSON-1809567557 None] Lock "cinder-quobyte-06f030d5-2fd3-48c4-a4da-ee1fed011586" acquired by "delete_volume" :: waited 0.016s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:19:40 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[17f8f826-9127-445c-9569-8216a0ab30d0]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:19:40 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-66d2cf91-4b1d-4b2b-96e8-53642ff300bd tempest-VolumesSnapshotTestJSON-1809567557 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-06f030d5-2fd3-48c4-a4da-ee1fed011586 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:19:40 devstack sudo[96336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-06f030d5-2fd3-48c4-a4da-ee1fed011586 Jul 31 12:19:40 devstack sudo[96336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:19:40 devstack sudo[96336]: pam_unix(sudo:session): session closed for user root Jul 31 12:19:40 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-66d2cf91-4b1d-4b2b-96e8-53642ff300bd tempest-VolumesSnapshotTestJSON-1809567557 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-06f030d5-2fd3-48c4-a4da-ee1fed011586" returned: 0 in 0.572s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:19:40 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-66d2cf91-4b1d-4b2b-96e8-53642ff300bd tempest-VolumesSnapshotTestJSON-1809567557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-06f030d5-2fd3-48c4-a4da-ee1fed011586 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:19:40 devstack sudo[96342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-06f030d5-2fd3-48c4-a4da-ee1fed011586 Jul 31 12:19:40 devstack sudo[96342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:19:41 devstack sudo[96342]: pam_unix(sudo:session): session closed for user root Jul 31 12:19:41 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-66d2cf91-4b1d-4b2b-96e8-53642ff300bd tempest-VolumesSnapshotTestJSON-1809567557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-06f030d5-2fd3-48c4-a4da-ee1fed011586" returned: 0 in 0.326s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:19:41 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-66d2cf91-4b1d-4b2b-96e8-53642ff300bd tempest-VolumesSnapshotTestJSON-1809567557 None] Lock "cinder-quobyte-06f030d5-2fd3-48c4-a4da-ee1fed011586" released by "delete_volume" :: held 0.979s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:19:41 devstack cinder-volume[89182]: DEBUG cinder.quota [None req-66d2cf91-4b1d-4b2b-96e8-53642ff300bd tempest-VolumesSnapshotTestJSON-1809567557 None] Created reservations ['71e4b7d3-c0c1-4d7c-ae24-95b053943b2b', '80ffa66e-c6ec-485b-8bca-6fdf86367819', '70299dd6-31f8-4cd7-8db0-975d73b37aa2', '7b8d713a-025c-451f-bad1-816d2d8d9a47'] {{(pid=89182) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 12:19:41 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-66d2cf91-4b1d-4b2b-96e8-53642ff300bd tempest-VolumesSnapshotTestJSON-1809567557 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:19:41 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-66d2cf91-4b1d-4b2b-96e8-53642ff300bd tempest-VolumesSnapshotTestJSON-1809567557 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:19:41 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-66d2cf91-4b1d-4b2b-96e8-53642ff300bd tempest-VolumesSnapshotTestJSON-1809567557 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:19:41 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-66d2cf91-4b1d-4b2b-96e8-53642ff300bd tempest-VolumesSnapshotTestJSON-1809567557 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:19:41 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-66d2cf91-4b1d-4b2b-96e8-53642ff300bd tempest-VolumesSnapshotTestJSON-1809567557 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:19:41 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-66d2cf91-4b1d-4b2b-96e8-53642ff300bd tempest-VolumesSnapshotTestJSON-1809567557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:19:41 devstack sudo[96350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 Jul 31 12:19:41 devstack sudo[96350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:19:41 devstack sudo[96350]: pam_unix(sudo:session): session closed for user root Jul 31 12:19:41 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-66d2cf91-4b1d-4b2b-96e8-53642ff300bd tempest-VolumesSnapshotTestJSON-1809567557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2" returned: 0 in 0.365s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:19:41 devstack cinder-volume[89182]: DEBUG cinder.manager [None req-66d2cf91-4b1d-4b2b-96e8-53642ff300bd tempest-VolumesSnapshotTestJSON-1809567557 None] Notifying Schedulers of capabilities ... {{(pid=89182) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 12:19:41 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-66d2cf91-4b1d-4b2b-96e8-53642ff300bd tempest-VolumesSnapshotTestJSON-1809567557 None] Deleted volume successfully. Jul 31 12:19:41 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-66d2cf91-4b1d-4b2b-96e8-53642ff300bd tempest-VolumesSnapshotTestJSON-1809567557 None] Lock "cinder-06f030d5-2fd3-48c4-a4da-ee1fed011586-delete_volume" released by "delete_volume" :: held 1.708s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:19:41 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [req-ede6e967-e199-49ae-a162-7952b68168ca req-ff210fd6-241b-4f9d-8a1b-663549b08d79 tempest-AttachVolumeTestJSON-657338358 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:19:41 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [req-ede6e967-e199-49ae-a162-7952b68168ca req-ff210fd6-241b-4f9d-8a1b-663549b08d79 tempest-AttachVolumeTestJSON-657338358 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:19:41 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [req-ede6e967-e199-49ae-a162-7952b68168ca req-ff210fd6-241b-4f9d-8a1b-663549b08d79 tempest-AttachVolumeTestJSON-657338358 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:19:41 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [req-ede6e967-e199-49ae-a162-7952b68168ca req-ff210fd6-241b-4f9d-8a1b-663549b08d79 tempest-AttachVolumeTestJSON-657338358 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88', 'name': 'volume-67c83eeb-6bff-4ee3-8b43-244f7d434d73', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '15996cd5-f8c2-42c4-9787-581b4c398daa', 'enforce_multipath': True} {{(pid=89182) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 31 12:19:41 devstack cinder-volume[89182]: INFO cinder.volume.manager [req-ede6e967-e199-49ae-a162-7952b68168ca req-ff210fd6-241b-4f9d-8a1b-663549b08d79 tempest-AttachVolumeTestJSON-657338358 None] attachment_update completed successfully. Jul 31 12:19:43 devstack cinder-volume[89182]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff75cf8f-d87e-41ab-8854-0a4aaf02ecca tempest-VolumesSnapshotTestJSON-1809567557 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89182) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 12:19:43 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-ff75cf8f-d87e-41ab-8854-0a4aaf02ecca tempest-VolumesSnapshotTestJSON-1809567557 None] Flow 'volume_create_manager' (467055dd-65ba-4ebb-b0cc-8fd2df3de7ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:19:43 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-ff75cf8f-d87e-41ab-8854-0a4aaf02ecca tempest-VolumesSnapshotTestJSON-1809567557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac2c2147-b9e6-4b89-a35b-6d37c1d72858) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:19:43 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-ff75cf8f-d87e-41ab-8854-0a4aaf02ecca tempest-VolumesSnapshotTestJSON-1809567557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac2c2147-b9e6-4b89-a35b-6d37c1d72858) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:19:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2055268824',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48c75461-f86f-42f7-9013-40cce51a8d58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='973c0b5551ab4879b114262098af54d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:19:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:19:43Z,use_quota=True,user_id='a4512f81d8c949f5ac15e6b3f39585c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:19:43 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-ff75cf8f-d87e-41ab-8854-0a4aaf02ecca tempest-VolumesSnapshotTestJSON-1809567557 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e56c545-1c2b-46a8-81ed-0ec62428406c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:19:43 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-ff75cf8f-d87e-41ab-8854-0a4aaf02ecca tempest-VolumesSnapshotTestJSON-1809567557 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e56c545-1c2b-46a8-81ed-0ec62428406c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:19:43 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-ff75cf8f-d87e-41ab-8854-0a4aaf02ecca tempest-VolumesSnapshotTestJSON-1809567557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cdfe3bd5-1a53-4a45-a02a-34f54c3adb4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:19:43 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-ff75cf8f-d87e-41ab-8854-0a4aaf02ecca tempest-VolumesSnapshotTestJSON-1809567557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cdfe3bd5-1a53-4a45-a02a-34f54c3adb4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '48c75461-f86f-42f7-9013-40cce51a8d58', 'volume_name': 'volume-48c75461-f86f-42f7-9013-40cce51a8d58', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:19:43 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-ff75cf8f-d87e-41ab-8854-0a4aaf02ecca tempest-VolumesSnapshotTestJSON-1809567557 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4bf08e39-3600-49ac-8819-c3823095cb75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:19:43 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-ff75cf8f-d87e-41ab-8854-0a4aaf02ecca tempest-VolumesSnapshotTestJSON-1809567557 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4bf08e39-3600-49ac-8819-c3823095cb75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:19:43 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-ff75cf8f-d87e-41ab-8854-0a4aaf02ecca tempest-VolumesSnapshotTestJSON-1809567557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22d4854b-22ee-4cda-ba47-15aec12ddbb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:19:43 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-ff75cf8f-d87e-41ab-8854-0a4aaf02ecca tempest-VolumesSnapshotTestJSON-1809567557 None] Volume 48c75461-f86f-42f7-9013-40cce51a8d58: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-48c75461-f86f-42f7-9013-40cce51a8d58', 'volume_size': 1} Jul 31 12:19:43 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-ff75cf8f-d87e-41ab-8854-0a4aaf02ecca tempest-VolumesSnapshotTestJSON-1809567557 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:19:43 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-ff75cf8f-d87e-41ab-8854-0a4aaf02ecca tempest-VolumesSnapshotTestJSON-1809567557 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:19:43 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-ff75cf8f-d87e-41ab-8854-0a4aaf02ecca tempest-VolumesSnapshotTestJSON-1809567557 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:19:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2055268824',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48c75461-f86f-42f7-9013-40cce51a8d58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='973c0b5551ab4879b114262098af54d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:19:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:19:43Z,use_quota=True,user_id='a4512f81d8c949f5ac15e6b3f39585c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)}" {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 12:19:43 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-ff75cf8f-d87e-41ab-8854-0a4aaf02ecca tempest-VolumesSnapshotTestJSON-1809567557 None] Creating volume 48c75461-f86f-42f7-9013-40cce51a8d58 {{(pid=89182) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 12:19:43 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-ff75cf8f-d87e-41ab-8854-0a4aaf02ecca tempest-VolumesSnapshotTestJSON-1809567557 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:19:43 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-ff75cf8f-d87e-41ab-8854-0a4aaf02ecca tempest-VolumesSnapshotTestJSON-1809567557 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:19:43 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-ff75cf8f-d87e-41ab-8854-0a4aaf02ecca tempest-VolumesSnapshotTestJSON-1809567557 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:19:43 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-ff75cf8f-d87e-41ab-8854-0a4aaf02ecca tempest-VolumesSnapshotTestJSON-1809567557 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:19:43 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-ff75cf8f-d87e-41ab-8854-0a4aaf02ecca tempest-VolumesSnapshotTestJSON-1809567557 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:19:43 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-ff75cf8f-d87e-41ab-8854-0a4aaf02ecca tempest-VolumesSnapshotTestJSON-1809567557 None] Selected osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 as target Quobyte volume. {{(pid=89182) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 12:19:43 devstack cinder-volume[89182]: INFO cinder.volume.drivers.remotefs [None req-ff75cf8f-d87e-41ab-8854-0a4aaf02ecca tempest-VolumesSnapshotTestJSON-1809567557 None] casted to osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 Jul 31 12:19:43 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-ff75cf8f-d87e-41ab-8854-0a4aaf02ecca tempest-VolumesSnapshotTestJSON-1809567557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-48c75461-f86f-42f7-9013-40cce51a8d58 1073741824 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:19:43 devstack sudo[96750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-48c75461-f86f-42f7-9013-40cce51a8d58 1073741824 Jul 31 12:19:43 devstack sudo[96750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:19:43 devstack sudo[96750]: pam_unix(sudo:session): session closed for user root Jul 31 12:19:43 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-ff75cf8f-d87e-41ab-8854-0a4aaf02ecca tempest-VolumesSnapshotTestJSON-1809567557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-48c75461-f86f-42f7-9013-40cce51a8d58 1073741824" returned: 0 in 0.761s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:19:44 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-ff75cf8f-d87e-41ab-8854-0a4aaf02ecca tempest-VolumesSnapshotTestJSON-1809567557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-48c75461-f86f-42f7-9013-40cce51a8d58 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:19:44 devstack sudo[96758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-48c75461-f86f-42f7-9013-40cce51a8d58 Jul 31 12:19:44 devstack sudo[96758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:19:44 devstack sudo[96758]: pam_unix(sudo:session): session closed for user root Jul 31 12:19:44 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-ff75cf8f-d87e-41ab-8854-0a4aaf02ecca tempest-VolumesSnapshotTestJSON-1809567557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-48c75461-f86f-42f7-9013-40cce51a8d58" returned: 0 in 0.421s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:19:44 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-ff75cf8f-d87e-41ab-8854-0a4aaf02ecca tempest-VolumesSnapshotTestJSON-1809567557 None] <== create_volume: return (1276ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'} {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 12:19:44 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-ff75cf8f-d87e-41ab-8854-0a4aaf02ecca tempest-VolumesSnapshotTestJSON-1809567557 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.279s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:19:44 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-ff75cf8f-d87e-41ab-8854-0a4aaf02ecca tempest-VolumesSnapshotTestJSON-1809567557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22d4854b-22ee-4cda-ba47-15aec12ddbb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-48c75461-f86f-42f7-9013-40cce51a8d58', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:19:44 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-ff75cf8f-d87e-41ab-8854-0a4aaf02ecca tempest-VolumesSnapshotTestJSON-1809567557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be568620-18b6-471c-8884-6e6b9b772d9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:19:44 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-ff75cf8f-d87e-41ab-8854-0a4aaf02ecca tempest-VolumesSnapshotTestJSON-1809567557 None] Volume volume-48c75461-f86f-42f7-9013-40cce51a8d58 (48c75461-f86f-42f7-9013-40cce51a8d58): created successfully Jul 31 12:19:44 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-ff75cf8f-d87e-41ab-8854-0a4aaf02ecca tempest-VolumesSnapshotTestJSON-1809567557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be568620-18b6-471c-8884-6e6b9b772d9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:19:44 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-ff75cf8f-d87e-41ab-8854-0a4aaf02ecca tempest-VolumesSnapshotTestJSON-1809567557 None] Flow 'volume_create_manager' (467055dd-65ba-4ebb-b0cc-8fd2df3de7ec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:19:44 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-ff75cf8f-d87e-41ab-8854-0a4aaf02ecca tempest-VolumesSnapshotTestJSON-1809567557 None] Created volume successfully. Jul 31 12:19:45 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-046f8778-06ca-4861-958a-557c27052a9b tempest-VolumesSnapshotTestJSON-1809567557 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:19:45 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-046f8778-06ca-4861-958a-557c27052a9b tempest-VolumesSnapshotTestJSON-1809567557 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:19:45 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-046f8778-06ca-4861-958a-557c27052a9b tempest-VolumesSnapshotTestJSON-1809567557 None] Creating offline snapshot 6ed4c0d2-6150-4c65-b43d-c54a4f78ff7f of volume 48c75461-f86f-42f7-9013-40cce51a8d58 {{(pid=89182) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 31 12:19:45 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a27ba1c-3ac2-46ab-bada-d416b5ab644e]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:19:45 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-046f8778-06ca-4861-958a-557c27052a9b tempest-VolumesSnapshotTestJSON-1809567557 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-48c75461-f86f-42f7-9013-40cce51a8d58 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:19:45 devstack sudo[96785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-48c75461-f86f-42f7-9013-40cce51a8d58 Jul 31 12:19:45 devstack sudo[96785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:19:46 devstack sudo[96785]: pam_unix(sudo:session): session closed for user root Jul 31 12:19:46 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-046f8778-06ca-4861-958a-557c27052a9b tempest-VolumesSnapshotTestJSON-1809567557 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-48c75461-f86f-42f7-9013-40cce51a8d58" returned: 0 in 0.475s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:19:46 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-046f8778-06ca-4861-958a-557c27052a9b tempest-VolumesSnapshotTestJSON-1809567557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-48c75461-f86f-42f7-9013-40cce51a8d58,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-48c75461-f86f-42f7-9013-40cce51a8d58.6ed4c0d2-6150-4c65-b43d-c54a4f78ff7f 1G {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:19:46 devstack sudo[96795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-48c75461-f86f-42f7-9013-40cce51a8d58,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-48c75461-f86f-42f7-9013-40cce51a8d58.6ed4c0d2-6150-4c65-b43d-c54a4f78ff7f 1G Jul 31 12:19:46 devstack sudo[96795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:19:46 devstack sudo[96795]: pam_unix(sudo:session): session closed for user root Jul 31 12:19:46 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-046f8778-06ca-4861-958a-557c27052a9b tempest-VolumesSnapshotTestJSON-1809567557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-48c75461-f86f-42f7-9013-40cce51a8d58,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-48c75461-f86f-42f7-9013-40cce51a8d58.6ed4c0d2-6150-4c65-b43d-c54a4f78ff7f 1G" returned: 0 in 0.505s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:19:46 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-046f8778-06ca-4861-958a-557c27052a9b tempest-VolumesSnapshotTestJSON-1809567557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-48c75461-f86f-42f7-9013-40cce51a8d58 -F qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-48c75461-f86f-42f7-9013-40cce51a8d58.6ed4c0d2-6150-4c65-b43d-c54a4f78ff7f {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:19:46 devstack sudo[96801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-48c75461-f86f-42f7-9013-40cce51a8d58 -F qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-48c75461-f86f-42f7-9013-40cce51a8d58.6ed4c0d2-6150-4c65-b43d-c54a4f78ff7f Jul 31 12:19:46 devstack sudo[96801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:19:46 devstack sudo[96801]: pam_unix(sudo:session): session closed for user root Jul 31 12:19:46 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-046f8778-06ca-4861-958a-557c27052a9b tempest-VolumesSnapshotTestJSON-1809567557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-48c75461-f86f-42f7-9013-40cce51a8d58 -F qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-48c75461-f86f-42f7-9013-40cce51a8d58.6ed4c0d2-6150-4c65-b43d-c54a4f78ff7f" returned: 0 in 0.409s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:19:46 devstack cinder-volume[89182]: WARNING cinder.volume.drivers.remotefs [None req-046f8778-06ca-4861-958a-557c27052a9b tempest-VolumesSnapshotTestJSON-1809567557 None] /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-48c75461-f86f-42f7-9013-40cce51a8d58.6ed4c0d2-6150-4c65-b43d-c54a4f78ff7f is being set with open permissions: ugo+rw Jul 31 12:19:46 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-046f8778-06ca-4861-958a-557c27052a9b tempest-VolumesSnapshotTestJSON-1809567557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-48c75461-f86f-42f7-9013-40cce51a8d58.6ed4c0d2-6150-4c65-b43d-c54a4f78ff7f {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:19:47 devstack sudo[96806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-48c75461-f86f-42f7-9013-40cce51a8d58.6ed4c0d2-6150-4c65-b43d-c54a4f78ff7f Jul 31 12:19:47 devstack sudo[96806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:19:47 devstack sudo[96806]: pam_unix(sudo:session): session closed for user root Jul 31 12:19:47 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-046f8778-06ca-4861-958a-557c27052a9b tempest-VolumesSnapshotTestJSON-1809567557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-48c75461-f86f-42f7-9013-40cce51a8d58.6ed4c0d2-6150-4c65-b43d-c54a4f78ff7f" returned: 0 in 0.373s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:19:47 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-046f8778-06ca-4861-958a-557c27052a9b tempest-VolumesSnapshotTestJSON-1809567557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-48c75461-f86f-42f7-9013-40cce51a8d58.info {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:19:47 devstack sudo[96810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-48c75461-f86f-42f7-9013-40cce51a8d58.info Jul 31 12:19:47 devstack sudo[96810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:19:47 devstack sudo[96810]: pam_unix(sudo:session): session closed for user root Jul 31 12:19:47 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-046f8778-06ca-4861-958a-557c27052a9b tempest-VolumesSnapshotTestJSON-1809567557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-48c75461-f86f-42f7-9013-40cce51a8d58.info" returned: 0 in 0.443s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:19:47 devstack cinder-volume[89182]: WARNING cinder.volume.drivers.remotefs [None req-046f8778-06ca-4861-958a-557c27052a9b tempest-VolumesSnapshotTestJSON-1809567557 None] /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-48c75461-f86f-42f7-9013-40cce51a8d58.info is being set with open permissions: ugo+rw Jul 31 12:19:47 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-046f8778-06ca-4861-958a-557c27052a9b tempest-VolumesSnapshotTestJSON-1809567557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-48c75461-f86f-42f7-9013-40cce51a8d58.info {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:19:47 devstack sudo[96816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-48c75461-f86f-42f7-9013-40cce51a8d58.info Jul 31 12:19:47 devstack sudo[96816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:19:48 devstack sudo[96816]: pam_unix(sudo:session): session closed for user root Jul 31 12:19:48 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-046f8778-06ca-4861-958a-557c27052a9b tempest-VolumesSnapshotTestJSON-1809567557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-48c75461-f86f-42f7-9013-40cce51a8d58.info" returned: 0 in 0.409s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:19:48 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-046f8778-06ca-4861-958a-557c27052a9b tempest-VolumesSnapshotTestJSON-1809567557 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.748s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:19:48 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-046f8778-06ca-4861-958a-557c27052a9b tempest-VolumesSnapshotTestJSON-1809567557 None] Create snapshot completed successfully Jul 31 12:19:49 devstack cinder-volume[89182]: DEBUG cinder.volume.flows.manager.create_volume [None req-71dad28d-a288-4287-93c4-fce99730a253 tempest-VolumesSnapshotTestJSON-1809567557 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89182) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 12:19:49 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-71dad28d-a288-4287-93c4-fce99730a253 tempest-VolumesSnapshotTestJSON-1809567557 None] Flow 'volume_create_manager' (23c9ef39-086f-4832-be8e-72fbb994d0ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:19:49 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-71dad28d-a288-4287-93c4-fce99730a253 tempest-VolumesSnapshotTestJSON-1809567557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3fe9ca1-c5c1-4851-af7e-46180028cffb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:19:49 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-71dad28d-a288-4287-93c4-fce99730a253 tempest-VolumesSnapshotTestJSON-1809567557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3fe9ca1-c5c1-4851-af7e-46180028cffb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:19:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-898015777',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb7b1874-8dbc-4fd2-a9b9-6dd86ec80676,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='973c0b5551ab4879b114262098af54d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:19:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=6ed4c0d2-6150-4c65-b43d-c54a4f78ff7f,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:19:50Z,use_quota=True,user_id='a4512f81d8c949f5ac15e6b3f39585c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:19:49 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-71dad28d-a288-4287-93c4-fce99730a253 tempest-VolumesSnapshotTestJSON-1809567557 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (273d08cc-1fbf-4304-be72-22d09e6511a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:19:49 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-71dad28d-a288-4287-93c4-fce99730a253 tempest-VolumesSnapshotTestJSON-1809567557 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (273d08cc-1fbf-4304-be72-22d09e6511a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:19:49 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-71dad28d-a288-4287-93c4-fce99730a253 tempest-VolumesSnapshotTestJSON-1809567557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (256b0d55-cb77-4dc2-8ca7-4a3f6f6a9b49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:19:49 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-71dad28d-a288-4287-93c4-fce99730a253 tempest-VolumesSnapshotTestJSON-1809567557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (256b0d55-cb77-4dc2-8ca7-4a3f6f6a9b49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'cb7b1874-8dbc-4fd2-a9b9-6dd86ec80676', 'volume_name': 'volume-cb7b1874-8dbc-4fd2-a9b9-6dd86ec80676', 'volume_size': 1, 'snapshot_id': '6ed4c0d2-6150-4c65-b43d-c54a4f78ff7f'}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:19:49 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-71dad28d-a288-4287-93c4-fce99730a253 tempest-VolumesSnapshotTestJSON-1809567557 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (537f9550-e840-4aad-b66e-78410ea51816) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:19:49 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-71dad28d-a288-4287-93c4-fce99730a253 tempest-VolumesSnapshotTestJSON-1809567557 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (537f9550-e840-4aad-b66e-78410ea51816) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:19:49 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-71dad28d-a288-4287-93c4-fce99730a253 tempest-VolumesSnapshotTestJSON-1809567557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76073567-29f0-48e6-9fb7-9262ad254071) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:19:49 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-71dad28d-a288-4287-93c4-fce99730a253 tempest-VolumesSnapshotTestJSON-1809567557 None] Volume cb7b1874-8dbc-4fd2-a9b9-6dd86ec80676: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-cb7b1874-8dbc-4fd2-a9b9-6dd86ec80676', 'volume_size': 1, 'snapshot_id': '6ed4c0d2-6150-4c65-b43d-c54a4f78ff7f'} Jul 31 12:19:49 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-71dad28d-a288-4287-93c4-fce99730a253 tempest-VolumesSnapshotTestJSON-1809567557 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:19:49 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-71dad28d-a288-4287-93c4-fce99730a253 tempest-VolumesSnapshotTestJSON-1809567557 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:19:49 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-71dad28d-a288-4287-93c4-fce99730a253 tempest-VolumesSnapshotTestJSON-1809567557 None] Acquiring lock "cinder-quobyte-6ed4c0d2-6150-4c65-b43d-c54a4f78ff7f-cb7b1874-8dbc-4fd2-a9b9-6dd86ec80676" by "_create_volume_from_snapshot" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:19:49 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-71dad28d-a288-4287-93c4-fce99730a253 tempest-VolumesSnapshotTestJSON-1809567557 None] Lock "cinder-quobyte-6ed4c0d2-6150-4c65-b43d-c54a4f78ff7f-cb7b1874-8dbc-4fd2-a9b9-6dd86ec80676" acquired by "_create_volume_from_snapshot" :: waited 0.026s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:19:49 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-71dad28d-a288-4287-93c4-fce99730a253 tempest-VolumesSnapshotTestJSON-1809567557 None] Creating volume cb7b1874-8dbc-4fd2-a9b9-6dd86ec80676 from snapshot 6ed4c0d2-6150-4c65-b43d-c54a4f78ff7f {{(pid=89182) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 31 12:19:49 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-71dad28d-a288-4287-93c4-fce99730a253 tempest-VolumesSnapshotTestJSON-1809567557 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:19:49 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-71dad28d-a288-4287-93c4-fce99730a253 tempest-VolumesSnapshotTestJSON-1809567557 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:19:49 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-71dad28d-a288-4287-93c4-fce99730a253 tempest-VolumesSnapshotTestJSON-1809567557 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:19:49 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-71dad28d-a288-4287-93c4-fce99730a253 tempest-VolumesSnapshotTestJSON-1809567557 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:19:49 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-71dad28d-a288-4287-93c4-fce99730a253 tempest-VolumesSnapshotTestJSON-1809567557 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:19:49 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-71dad28d-a288-4287-93c4-fce99730a253 tempest-VolumesSnapshotTestJSON-1809567557 None] Selected osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 as target Quobyte volume. {{(pid=89182) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 12:19:49 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-71dad28d-a288-4287-93c4-fce99730a253 tempest-VolumesSnapshotTestJSON-1809567557 None] Acquiring lock "cinder-quobyte-cb7b1874-8dbc-4fd2-a9b9-6dd86ec80676" by "_copy_volume_from_snapshot" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:19:49 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-71dad28d-a288-4287-93c4-fce99730a253 tempest-VolumesSnapshotTestJSON-1809567557 None] Lock "cinder-quobyte-cb7b1874-8dbc-4fd2-a9b9-6dd86ec80676" acquired by "_copy_volume_from_snapshot" :: waited 0.022s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:19:49 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-71dad28d-a288-4287-93c4-fce99730a253 tempest-VolumesSnapshotTestJSON-1809567557 None] snapshot: 6ed4c0d2-6150-4c65-b43d-c54a4f78ff7f, volume: cb7b1874-8dbc-4fd2-a9b9-6dd86ec80676, {{(pid=89182) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Jul 31 12:19:50 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-71dad28d-a288-4287-93c4-fce99730a253 tempest-VolumesSnapshotTestJSON-1809567557 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:19:50 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-71dad28d-a288-4287-93c4-fce99730a253 tempest-VolumesSnapshotTestJSON-1809567557 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:19:50 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-71dad28d-a288-4287-93c4-fce99730a253 tempest-VolumesSnapshotTestJSON-1809567557 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:19:50 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-71dad28d-a288-4287-93c4-fce99730a253 tempest-VolumesSnapshotTestJSON-1809567557 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:19:50 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-71dad28d-a288-4287-93c4-fce99730a253 tempest-VolumesSnapshotTestJSON-1809567557 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:19:50 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[be723d89-e815-4463-839e-dde210c7c378]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:19:50 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-71dad28d-a288-4287-93c4-fce99730a253 tempest-VolumesSnapshotTestJSON-1809567557 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-48c75461-f86f-42f7-9013-40cce51a8d58.6ed4c0d2-6150-4c65-b43d-c54a4f78ff7f {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:19:50 devstack sudo[96937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-48c75461-f86f-42f7-9013-40cce51a8d58.6ed4c0d2-6150-4c65-b43d-c54a4f78ff7f Jul 31 12:19:50 devstack sudo[96937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:19:50 devstack sudo[96937]: pam_unix(sudo:session): session closed for user root Jul 31 12:19:50 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-71dad28d-a288-4287-93c4-fce99730a253 tempest-VolumesSnapshotTestJSON-1809567557 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-48c75461-f86f-42f7-9013-40cce51a8d58.6ed4c0d2-6150-4c65-b43d-c54a4f78ff7f" returned: 0 in 0.650s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:19:50 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-71dad28d-a288-4287-93c4-fce99730a253 tempest-VolumesSnapshotTestJSON-1809567557 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-48c75461-f86f-42f7-9013-40cce51a8d58(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89182) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 12:19:50 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[56062c54-9796-4fd1-aa19-a2454b4c3307]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:19:50 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-71dad28d-a288-4287-93c4-fce99730a253 tempest-VolumesSnapshotTestJSON-1809567557 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-48c75461-f86f-42f7-9013-40cce51a8d58 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:19:51 devstack sudo[96952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-48c75461-f86f-42f7-9013-40cce51a8d58 Jul 31 12:19:51 devstack sudo[96952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:19:51 devstack sudo[96952]: pam_unix(sudo:session): session closed for user root Jul 31 12:19:51 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-71dad28d-a288-4287-93c4-fce99730a253 tempest-VolumesSnapshotTestJSON-1809567557 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-48c75461-f86f-42f7-9013-40cce51a8d58" returned: 0 in 0.718s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:19:51 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-71dad28d-a288-4287-93c4-fce99730a253 tempest-VolumesSnapshotTestJSON-1809567557 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-48c75461-f86f-42f7-9013-40cce51a8d58 {{(pid=89182) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Jul 31 12:19:51 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-71dad28d-a288-4287-93c4-fce99730a253 tempest-VolumesSnapshotTestJSON-1809567557 None] Creating direct copy from snapshot {{(pid=89182) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Jul 31 12:19:51 devstack cinder-volume[89182]: DEBUG cinder.utils [None req-71dad28d-a288-4287-93c4-fce99730a253 tempest-VolumesSnapshotTestJSON-1809567557 None] Path /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-cb7b1874-8dbc-4fd2-a9b9-6dd86ec80676 not found in is_blk_device check {{(pid=89182) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 31 12:19:51 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-71dad28d-a288-4287-93c4-fce99730a253 tempest-VolumesSnapshotTestJSON-1809567557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-48c75461-f86f-42f7-9013-40cce51a8d58 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-cb7b1874-8dbc-4fd2-a9b9-6dd86ec80676 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:19:51 devstack sudo[97321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-48c75461-f86f-42f7-9013-40cce51a8d58 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-cb7b1874-8dbc-4fd2-a9b9-6dd86ec80676 Jul 31 12:19:51 devstack sudo[97321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:19:58 devstack sudo[97321]: pam_unix(sudo:session): session closed for user root Jul 31 12:19:58 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-71dad28d-a288-4287-93c4-fce99730a253 tempest-VolumesSnapshotTestJSON-1809567557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-48c75461-f86f-42f7-9013-40cce51a8d58 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-cb7b1874-8dbc-4fd2-a9b9-6dd86ec80676" returned: 0 in 6.973s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:19:58 devstack cinder-volume[89182]: DEBUG cinder.image.image_utils [None req-71dad28d-a288-4287-93c4-fce99730a253 tempest-VolumesSnapshotTestJSON-1809567557 None] Image conversion details: src /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-48c75461-f86f-42f7-9013-40cce51a8d58, size 1024.00 MB, duration 6.98 sec, destination /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-cb7b1874-8dbc-4fd2-a9b9-6dd86ec80676 {{(pid=89182) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 31 12:19:58 devstack cinder-volume[89182]: INFO cinder.image.image_utils [None req-71dad28d-a288-4287-93c4-fce99730a253 tempest-VolumesSnapshotTestJSON-1809567557 None] Converted 1024.00 MB image at 146.78 MB/s Jul 31 12:19:58 devstack cinder-volume[89182]: WARNING cinder.volume.drivers.remotefs [None req-71dad28d-a288-4287-93c4-fce99730a253 tempest-VolumesSnapshotTestJSON-1809567557 None] /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-cb7b1874-8dbc-4fd2-a9b9-6dd86ec80676 is being set with open permissions: ugo+rw Jul 31 12:19:58 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-71dad28d-a288-4287-93c4-fce99730a253 tempest-VolumesSnapshotTestJSON-1809567557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-cb7b1874-8dbc-4fd2-a9b9-6dd86ec80676 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:19:58 devstack sudo[97451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-cb7b1874-8dbc-4fd2-a9b9-6dd86ec80676 Jul 31 12:19:58 devstack sudo[97451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:19:58 devstack sudo[97451]: pam_unix(sudo:session): session closed for user root Jul 31 12:19:58 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-71dad28d-a288-4287-93c4-fce99730a253 tempest-VolumesSnapshotTestJSON-1809567557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-cb7b1874-8dbc-4fd2-a9b9-6dd86ec80676" returned: 0 in 0.374s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:19:58 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-71dad28d-a288-4287-93c4-fce99730a253 tempest-VolumesSnapshotTestJSON-1809567557 None] Lock "cinder-quobyte-cb7b1874-8dbc-4fd2-a9b9-6dd86ec80676" released by "_copy_volume_from_snapshot" :: held 8.865s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:19:58 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-71dad28d-a288-4287-93c4-fce99730a253 tempest-VolumesSnapshotTestJSON-1809567557 None] Lock "cinder-quobyte-6ed4c0d2-6150-4c65-b43d-c54a4f78ff7f-cb7b1874-8dbc-4fd2-a9b9-6dd86ec80676" released by "_create_volume_from_snapshot" :: held 8.969s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:19:58 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-71dad28d-a288-4287-93c4-fce99730a253 tempest-VolumesSnapshotTestJSON-1809567557 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.996s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:19:58 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-71dad28d-a288-4287-93c4-fce99730a253 tempest-VolumesSnapshotTestJSON-1809567557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76073567-29f0-48e6-9fb7-9262ad254071) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cb7b1874-8dbc-4fd2-a9b9-6dd86ec80676', 'volume_size': 1, 'snapshot_id': '6ed4c0d2-6150-4c65-b43d-c54a4f78ff7f'}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:19:58 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-71dad28d-a288-4287-93c4-fce99730a253 tempest-VolumesSnapshotTestJSON-1809567557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b3464a9-912b-4d03-96d9-ef61b49a54ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:19:59 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-71dad28d-a288-4287-93c4-fce99730a253 tempest-VolumesSnapshotTestJSON-1809567557 None] Volume volume-cb7b1874-8dbc-4fd2-a9b9-6dd86ec80676 (cb7b1874-8dbc-4fd2-a9b9-6dd86ec80676): created successfully Jul 31 12:19:59 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-71dad28d-a288-4287-93c4-fce99730a253 tempest-VolumesSnapshotTestJSON-1809567557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b3464a9-912b-4d03-96d9-ef61b49a54ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:19:59 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-71dad28d-a288-4287-93c4-fce99730a253 tempest-VolumesSnapshotTestJSON-1809567557 None] Flow 'volume_create_manager' (23c9ef39-086f-4832-be8e-72fbb994d0ae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:19:59 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-71dad28d-a288-4287-93c4-fce99730a253 tempest-VolumesSnapshotTestJSON-1809567557 None] Created volume successfully. Jul 31 12:20:00 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-c5a1a067-4e26-4b35-9816-68224cb6ebb8 tempest-VolumesSnapshotTestJSON-1809567557 None] Acquiring lock "cinder-cb7b1874-8dbc-4fd2-a9b9-6dd86ec80676-delete_volume" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:20:00 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-c5a1a067-4e26-4b35-9816-68224cb6ebb8 tempest-VolumesSnapshotTestJSON-1809567557 None] Lock "cinder-cb7b1874-8dbc-4fd2-a9b9-6dd86ec80676-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:20:00 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-c5a1a067-4e26-4b35-9816-68224cb6ebb8 tempest-VolumesSnapshotTestJSON-1809567557 None] Acquiring lock "cinder-quobyte-cb7b1874-8dbc-4fd2-a9b9-6dd86ec80676" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:20:00 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-c5a1a067-4e26-4b35-9816-68224cb6ebb8 tempest-VolumesSnapshotTestJSON-1809567557 None] Lock "cinder-quobyte-cb7b1874-8dbc-4fd2-a9b9-6dd86ec80676" acquired by "delete_volume" :: waited 0.039s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:20:00 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d928b4e-9274-4eae-aee1-fbeb5efc0bf3]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:20:00 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-c5a1a067-4e26-4b35-9816-68224cb6ebb8 tempest-VolumesSnapshotTestJSON-1809567557 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-cb7b1874-8dbc-4fd2-a9b9-6dd86ec80676 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:20:00 devstack sudo[97455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-cb7b1874-8dbc-4fd2-a9b9-6dd86ec80676 Jul 31 12:20:00 devstack sudo[97455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:20:01 devstack sudo[97455]: pam_unix(sudo:session): session closed for user root Jul 31 12:20:01 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-c5a1a067-4e26-4b35-9816-68224cb6ebb8 tempest-VolumesSnapshotTestJSON-1809567557 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-cb7b1874-8dbc-4fd2-a9b9-6dd86ec80676" returned: 0 in 0.667s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:20:01 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-c5a1a067-4e26-4b35-9816-68224cb6ebb8 tempest-VolumesSnapshotTestJSON-1809567557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-cb7b1874-8dbc-4fd2-a9b9-6dd86ec80676 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:20:01 devstack sudo[97463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-cb7b1874-8dbc-4fd2-a9b9-6dd86ec80676 Jul 31 12:20:01 devstack sudo[97463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:20:01 devstack sudo[97463]: pam_unix(sudo:session): session closed for user root Jul 31 12:20:01 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-c5a1a067-4e26-4b35-9816-68224cb6ebb8 tempest-VolumesSnapshotTestJSON-1809567557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-cb7b1874-8dbc-4fd2-a9b9-6dd86ec80676" returned: 0 in 0.453s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:20:01 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-c5a1a067-4e26-4b35-9816-68224cb6ebb8 tempest-VolumesSnapshotTestJSON-1809567557 None] Lock "cinder-quobyte-cb7b1874-8dbc-4fd2-a9b9-6dd86ec80676" released by "delete_volume" :: held 1.194s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:20:01 devstack cinder-volume[89182]: DEBUG cinder.quota [None req-c5a1a067-4e26-4b35-9816-68224cb6ebb8 tempest-VolumesSnapshotTestJSON-1809567557 None] Created reservations ['e88c1930-f743-471f-93c5-e41c9c61c8b3', '6e8e9d15-f1bc-4b6e-9e2c-98f1354500ef', '02c7e45c-d7db-4de4-a235-3cff733f70f7', 'dac6e831-78d1-4bcf-8c29-15234e8a4b71'] {{(pid=89182) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 12:20:02 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-c5a1a067-4e26-4b35-9816-68224cb6ebb8 tempest-VolumesSnapshotTestJSON-1809567557 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:20:02 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-c5a1a067-4e26-4b35-9816-68224cb6ebb8 tempest-VolumesSnapshotTestJSON-1809567557 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:20:02 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-c5a1a067-4e26-4b35-9816-68224cb6ebb8 tempest-VolumesSnapshotTestJSON-1809567557 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:20:02 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-c5a1a067-4e26-4b35-9816-68224cb6ebb8 tempest-VolumesSnapshotTestJSON-1809567557 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:20:02 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-c5a1a067-4e26-4b35-9816-68224cb6ebb8 tempest-VolumesSnapshotTestJSON-1809567557 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:20:02 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-c5a1a067-4e26-4b35-9816-68224cb6ebb8 tempest-VolumesSnapshotTestJSON-1809567557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:20:02 devstack sudo[97467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 Jul 31 12:20:02 devstack sudo[97467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:20:02 devstack sudo[97467]: pam_unix(sudo:session): session closed for user root Jul 31 12:20:02 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-c5a1a067-4e26-4b35-9816-68224cb6ebb8 tempest-VolumesSnapshotTestJSON-1809567557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2" returned: 0 in 0.817s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:20:02 devstack cinder-volume[89182]: DEBUG cinder.manager [None req-c5a1a067-4e26-4b35-9816-68224cb6ebb8 tempest-VolumesSnapshotTestJSON-1809567557 None] Notifying Schedulers of capabilities ... {{(pid=89182) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 12:20:02 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-c5a1a067-4e26-4b35-9816-68224cb6ebb8 tempest-VolumesSnapshotTestJSON-1809567557 None] Deleted volume successfully. Jul 31 12:20:02 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-c5a1a067-4e26-4b35-9816-68224cb6ebb8 tempest-VolumesSnapshotTestJSON-1809567557 None] Lock "cinder-cb7b1874-8dbc-4fd2-a9b9-6dd86ec80676-delete_volume" released by "delete_volume" :: held 2.550s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:20:03 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-96d18a6f-eca0-44f9-a438-bd355103da32 tempest-VolumesSnapshotTestJSON-1809567557 None] Acquiring lock "cinder-6ed4c0d2-6150-4c65-b43d-c54a4f78ff7f-delete_snapshot" by "delete_snapshot" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:20:03 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-96d18a6f-eca0-44f9-a438-bd355103da32 tempest-VolumesSnapshotTestJSON-1809567557 None] Lock "cinder-6ed4c0d2-6150-4c65-b43d-c54a4f78ff7f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.043s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:20:03 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-96d18a6f-eca0-44f9-a438-bd355103da32 tempest-VolumesSnapshotTestJSON-1809567557 None] Acquiring lock "cinder-quobyte-48c75461-f86f-42f7-9013-40cce51a8d58" by "delete_snapshot" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:20:03 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-96d18a6f-eca0-44f9-a438-bd355103da32 tempest-VolumesSnapshotTestJSON-1809567557 None] Lock "cinder-quobyte-48c75461-f86f-42f7-9013-40cce51a8d58" acquired by "delete_snapshot" :: waited 0.040s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:20:03 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-96d18a6f-eca0-44f9-a438-bd355103da32 tempest-VolumesSnapshotTestJSON-1809567557 None] Acquiring lock "cinder-quobyte-6ed4c0d2-6150-4c65-b43d-c54a4f78ff7f" by "_delete_snapshot" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:20:03 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-96d18a6f-eca0-44f9-a438-bd355103da32 tempest-VolumesSnapshotTestJSON-1809567557 None] Lock "cinder-quobyte-6ed4c0d2-6150-4c65-b43d-c54a4f78ff7f" acquired by "_delete_snapshot" :: waited 0.043s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:20:03 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-96d18a6f-eca0-44f9-a438-bd355103da32 tempest-VolumesSnapshotTestJSON-1809567557 None] Deleting offline snapshot 6ed4c0d2-6150-4c65-b43d-c54a4f78ff7f of volume 48c75461-f86f-42f7-9013-40cce51a8d58 {{(pid=89182) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 31 12:20:03 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-96d18a6f-eca0-44f9-a438-bd355103da32 tempest-VolumesSnapshotTestJSON-1809567557 None] snapshot_file for this snap is: volume-48c75461-f86f-42f7-9013-40cce51a8d58.6ed4c0d2-6150-4c65-b43d-c54a4f78ff7f {{(pid=89182) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 31 12:20:03 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[952c5128-27a6-4e39-918c-ac38b097f916]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:20:03 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-96d18a6f-eca0-44f9-a438-bd355103da32 tempest-VolumesSnapshotTestJSON-1809567557 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-48c75461-f86f-42f7-9013-40cce51a8d58.6ed4c0d2-6150-4c65-b43d-c54a4f78ff7f {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:20:03 devstack sudo[97471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-48c75461-f86f-42f7-9013-40cce51a8d58.6ed4c0d2-6150-4c65-b43d-c54a4f78ff7f Jul 31 12:20:03 devstack sudo[97471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:20:04 devstack sudo[97471]: pam_unix(sudo:session): session closed for user root Jul 31 12:20:04 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-96d18a6f-eca0-44f9-a438-bd355103da32 tempest-VolumesSnapshotTestJSON-1809567557 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-48c75461-f86f-42f7-9013-40cce51a8d58.6ed4c0d2-6150-4c65-b43d-c54a4f78ff7f" returned: 0 in 1.171s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:20:04 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-96d18a6f-eca0-44f9-a438-bd355103da32 tempest-VolumesSnapshotTestJSON-1809567557 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-48c75461-f86f-42f7-9013-40cce51a8d58(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89182) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 12:20:04 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ab6e9e6-b2f4-4245-a859-712bd86e4f8f]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:20:04 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-96d18a6f-eca0-44f9-a438-bd355103da32 tempest-VolumesSnapshotTestJSON-1809567557 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-48c75461-f86f-42f7-9013-40cce51a8d58 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:20:04 devstack sudo[97480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-48c75461-f86f-42f7-9013-40cce51a8d58 Jul 31 12:20:04 devstack sudo[97480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:20:05 devstack sudo[97480]: pam_unix(sudo:session): session closed for user root Jul 31 12:20:05 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-96d18a6f-eca0-44f9-a438-bd355103da32 tempest-VolumesSnapshotTestJSON-1809567557 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-48c75461-f86f-42f7-9013-40cce51a8d58" returned: 0 in 1.266s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:20:05 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-96d18a6f-eca0-44f9-a438-bd355103da32 tempest-VolumesSnapshotTestJSON-1809567557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-48c75461-f86f-42f7-9013-40cce51a8d58.6ed4c0d2-6150-4c65-b43d-c54a4f78ff7f {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:20:05 devstack sudo[97498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-48c75461-f86f-42f7-9013-40cce51a8d58.6ed4c0d2-6150-4c65-b43d-c54a4f78ff7f Jul 31 12:20:05 devstack sudo[97498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:20:06 devstack sudo[97498]: pam_unix(sudo:session): session closed for user root Jul 31 12:20:06 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-96d18a6f-eca0-44f9-a438-bd355103da32 tempest-VolumesSnapshotTestJSON-1809567557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-48c75461-f86f-42f7-9013-40cce51a8d58.6ed4c0d2-6150-4c65-b43d-c54a4f78ff7f" returned: 0 in 0.929s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:20:06 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-96d18a6f-eca0-44f9-a438-bd355103da32 tempest-VolumesSnapshotTestJSON-1809567557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-48c75461-f86f-42f7-9013-40cce51a8d58.6ed4c0d2-6150-4c65-b43d-c54a4f78ff7f {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:20:06 devstack sudo[97508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-48c75461-f86f-42f7-9013-40cce51a8d58.6ed4c0d2-6150-4c65-b43d-c54a4f78ff7f Jul 31 12:20:06 devstack sudo[97508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:20:07 devstack sudo[97508]: pam_unix(sudo:session): session closed for user root Jul 31 12:20:07 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-96d18a6f-eca0-44f9-a438-bd355103da32 tempest-VolumesSnapshotTestJSON-1809567557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-48c75461-f86f-42f7-9013-40cce51a8d58.6ed4c0d2-6150-4c65-b43d-c54a4f78ff7f" returned: 0 in 0.459s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:20:07 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-96d18a6f-eca0-44f9-a438-bd355103da32 tempest-VolumesSnapshotTestJSON-1809567557 None] Lock "cinder-quobyte-6ed4c0d2-6150-4c65-b43d-c54a4f78ff7f" released by "_delete_snapshot" :: held 4.046s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:20:07 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-96d18a6f-eca0-44f9-a438-bd355103da32 tempest-VolumesSnapshotTestJSON-1809567557 None] Lock "cinder-quobyte-48c75461-f86f-42f7-9013-40cce51a8d58" released by "delete_snapshot" :: held 4.101s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:20:07 devstack cinder-volume[89182]: DEBUG cinder.quota [None req-96d18a6f-eca0-44f9-a438-bd355103da32 tempest-VolumesSnapshotTestJSON-1809567557 None] Created reservations ['30176d98-676f-4efa-aba2-12c168e4e8b6', '6b3587a3-f650-4c3e-8d17-b682fdb45f00', 'bf2035e4-a801-45e1-a670-0968424b48f4', '6995372f-6930-4e59-8233-a8c59f3804a1'] {{(pid=89182) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 12:20:07 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-96d18a6f-eca0-44f9-a438-bd355103da32 tempest-VolumesSnapshotTestJSON-1809567557 None] Delete snapshot completed successfully. Jul 31 12:20:07 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-96d18a6f-eca0-44f9-a438-bd355103da32 tempest-VolumesSnapshotTestJSON-1809567557 None] Lock "cinder-6ed4c0d2-6150-4c65-b43d-c54a4f78ff7f-delete_snapshot" released by "delete_snapshot" :: held 4.529s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:20:07 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-e1db4554-631d-4c70-9b76-ea2d806309dc tempest-VolumesSnapshotTestJSON-1809567557 None] Acquiring lock "cinder-48c75461-f86f-42f7-9013-40cce51a8d58-delete_volume" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:20:07 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-e1db4554-631d-4c70-9b76-ea2d806309dc tempest-VolumesSnapshotTestJSON-1809567557 None] Lock "cinder-48c75461-f86f-42f7-9013-40cce51a8d58-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:20:07 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-e1db4554-631d-4c70-9b76-ea2d806309dc tempest-VolumesSnapshotTestJSON-1809567557 None] Acquiring lock "cinder-quobyte-48c75461-f86f-42f7-9013-40cce51a8d58" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:20:07 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-e1db4554-631d-4c70-9b76-ea2d806309dc tempest-VolumesSnapshotTestJSON-1809567557 None] Lock "cinder-quobyte-48c75461-f86f-42f7-9013-40cce51a8d58" acquired by "delete_volume" :: waited 0.030s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:20:08 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a505361-1e10-4622-b37c-1c35aa09bf7f]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:20:08 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-e1db4554-631d-4c70-9b76-ea2d806309dc tempest-VolumesSnapshotTestJSON-1809567557 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-48c75461-f86f-42f7-9013-40cce51a8d58 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:20:08 devstack sudo[97511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-48c75461-f86f-42f7-9013-40cce51a8d58 Jul 31 12:20:08 devstack sudo[97511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:20:09 devstack sudo[97511]: pam_unix(sudo:session): session closed for user root Jul 31 12:20:09 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-e1db4554-631d-4c70-9b76-ea2d806309dc tempest-VolumesSnapshotTestJSON-1809567557 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-48c75461-f86f-42f7-9013-40cce51a8d58" returned: 0 in 0.953s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:20:09 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-e1db4554-631d-4c70-9b76-ea2d806309dc tempest-VolumesSnapshotTestJSON-1809567557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-48c75461-f86f-42f7-9013-40cce51a8d58 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:20:09 devstack sudo[97516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-48c75461-f86f-42f7-9013-40cce51a8d58 Jul 31 12:20:09 devstack sudo[97516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:20:09 devstack sudo[97516]: pam_unix(sudo:session): session closed for user root Jul 31 12:20:09 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-e1db4554-631d-4c70-9b76-ea2d806309dc tempest-VolumesSnapshotTestJSON-1809567557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-48c75461-f86f-42f7-9013-40cce51a8d58" returned: 0 in 0.528s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:20:09 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-e1db4554-631d-4c70-9b76-ea2d806309dc tempest-VolumesSnapshotTestJSON-1809567557 None] Lock "cinder-quobyte-48c75461-f86f-42f7-9013-40cce51a8d58" released by "delete_volume" :: held 1.617s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:20:09 devstack cinder-volume[89182]: DEBUG dbcounter [-] [89182] Writing DB stats cinder:SELECT=97,cinder:DELETE=7,cinder:UPDATE=81,cinder:INSERT=26 {{(pid=89182) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 12:20:09 devstack cinder-volume[89182]: DEBUG dbcounter [-] [89182] Writing DB stats cinder:SELECT=84,cinder:UPDATE=94,cinder:INSERT=22,cinder:DELETE=6 {{(pid=89182) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 12:20:09 devstack cinder-volume[89182]: DEBUG cinder.quota [None req-e1db4554-631d-4c70-9b76-ea2d806309dc tempest-VolumesSnapshotTestJSON-1809567557 None] Created reservations ['a5d9ec65-5b40-4993-9ef7-7321a66afaf8', 'a0950859-3474-487a-9de6-901c9c6ec8a3', '40ae2235-043d-4279-a675-1686cf5d9b15', 'bf9dd1e5-687f-4823-9e00-5cc38fa3d8ec'] {{(pid=89182) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 12:20:09 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-e1db4554-631d-4c70-9b76-ea2d806309dc tempest-VolumesSnapshotTestJSON-1809567557 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:20:09 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-e1db4554-631d-4c70-9b76-ea2d806309dc tempest-VolumesSnapshotTestJSON-1809567557 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:20:09 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-e1db4554-631d-4c70-9b76-ea2d806309dc tempest-VolumesSnapshotTestJSON-1809567557 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:20:09 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-e1db4554-631d-4c70-9b76-ea2d806309dc tempest-VolumesSnapshotTestJSON-1809567557 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:20:09 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-e1db4554-631d-4c70-9b76-ea2d806309dc tempest-VolumesSnapshotTestJSON-1809567557 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:20:09 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-e1db4554-631d-4c70-9b76-ea2d806309dc tempest-VolumesSnapshotTestJSON-1809567557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:20:09 devstack sudo[97543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 Jul 31 12:20:09 devstack sudo[97543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:20:10 devstack sudo[97543]: pam_unix(sudo:session): session closed for user root Jul 31 12:20:10 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-e1db4554-631d-4c70-9b76-ea2d806309dc tempest-VolumesSnapshotTestJSON-1809567557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2" returned: 0 in 0.328s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:20:10 devstack cinder-volume[89182]: DEBUG cinder.manager [None req-e1db4554-631d-4c70-9b76-ea2d806309dc tempest-VolumesSnapshotTestJSON-1809567557 None] Notifying Schedulers of capabilities ... {{(pid=89182) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 12:20:10 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-e1db4554-631d-4c70-9b76-ea2d806309dc tempest-VolumesSnapshotTestJSON-1809567557 None] Deleted volume successfully. Jul 31 12:20:10 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-e1db4554-631d-4c70-9b76-ea2d806309dc tempest-VolumesSnapshotTestJSON-1809567557 None] Lock "cinder-48c75461-f86f-42f7-9013-40cce51a8d58-delete_volume" released by "delete_volume" :: held 2.370s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:20:10 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-0cc4c8bf-bafc-4ec2-90af-c644b82e5194 tempest-VolumesSnapshotTestJSON-1809567557 None] Acquiring lock "cinder-b24c8676-80e7-4ae1-bb0d-f648cf80bce8-delete_volume" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:20:10 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-0cc4c8bf-bafc-4ec2-90af-c644b82e5194 tempest-VolumesSnapshotTestJSON-1809567557 None] Lock "cinder-b24c8676-80e7-4ae1-bb0d-f648cf80bce8-delete_volume" acquired by "delete_volume" :: waited 0.066s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:20:10 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-0cc4c8bf-bafc-4ec2-90af-c644b82e5194 tempest-VolumesSnapshotTestJSON-1809567557 None] Acquiring lock "cinder-quobyte-b24c8676-80e7-4ae1-bb0d-f648cf80bce8" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:20:10 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-0cc4c8bf-bafc-4ec2-90af-c644b82e5194 tempest-VolumesSnapshotTestJSON-1809567557 None] Lock "cinder-quobyte-b24c8676-80e7-4ae1-bb0d-f648cf80bce8" acquired by "delete_volume" :: waited 0.033s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:20:10 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[27726b92-ca6c-42be-bc2c-fb7a560df060]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:20:10 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-0cc4c8bf-bafc-4ec2-90af-c644b82e5194 tempest-VolumesSnapshotTestJSON-1809567557 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-b24c8676-80e7-4ae1-bb0d-f648cf80bce8 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:20:11 devstack sudo[97546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-b24c8676-80e7-4ae1-bb0d-f648cf80bce8 Jul 31 12:20:11 devstack sudo[97546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:20:11 devstack sudo[97546]: pam_unix(sudo:session): session closed for user root Jul 31 12:20:11 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-0cc4c8bf-bafc-4ec2-90af-c644b82e5194 tempest-VolumesSnapshotTestJSON-1809567557 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-b24c8676-80e7-4ae1-bb0d-f648cf80bce8" returned: 0 in 0.659s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:20:11 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-0cc4c8bf-bafc-4ec2-90af-c644b82e5194 tempest-VolumesSnapshotTestJSON-1809567557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-b24c8676-80e7-4ae1-bb0d-f648cf80bce8 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:20:11 devstack sudo[97551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-b24c8676-80e7-4ae1-bb0d-f648cf80bce8 Jul 31 12:20:11 devstack sudo[97551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:20:12 devstack sudo[97551]: pam_unix(sudo:session): session closed for user root Jul 31 12:20:12 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-0cc4c8bf-bafc-4ec2-90af-c644b82e5194 tempest-VolumesSnapshotTestJSON-1809567557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-b24c8676-80e7-4ae1-bb0d-f648cf80bce8" returned: 0 in 0.602s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:20:12 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-0cc4c8bf-bafc-4ec2-90af-c644b82e5194 tempest-VolumesSnapshotTestJSON-1809567557 None] Lock "cinder-quobyte-b24c8676-80e7-4ae1-bb0d-f648cf80bce8" released by "delete_volume" :: held 1.395s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:20:12 devstack cinder-volume[89182]: DEBUG cinder.quota [None req-0cc4c8bf-bafc-4ec2-90af-c644b82e5194 tempest-VolumesSnapshotTestJSON-1809567557 None] Created reservations ['cd7bd332-954c-47e8-a71d-302d66a234fb', '45b7488d-0fee-4e47-af8d-3370ff899295', 'fffa724b-0417-4d46-a2cf-72cc446fa6be', 'f5f816fa-2219-4441-8b5a-ef4980de0a3f'] {{(pid=89182) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 12:20:12 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-0cc4c8bf-bafc-4ec2-90af-c644b82e5194 tempest-VolumesSnapshotTestJSON-1809567557 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:20:12 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-0cc4c8bf-bafc-4ec2-90af-c644b82e5194 tempest-VolumesSnapshotTestJSON-1809567557 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:20:12 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-0cc4c8bf-bafc-4ec2-90af-c644b82e5194 tempest-VolumesSnapshotTestJSON-1809567557 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:20:12 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-0cc4c8bf-bafc-4ec2-90af-c644b82e5194 tempest-VolumesSnapshotTestJSON-1809567557 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:20:12 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-0cc4c8bf-bafc-4ec2-90af-c644b82e5194 tempest-VolumesSnapshotTestJSON-1809567557 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:20:12 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-0cc4c8bf-bafc-4ec2-90af-c644b82e5194 tempest-VolumesSnapshotTestJSON-1809567557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:20:12 devstack sudo[97591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 Jul 31 12:20:12 devstack sudo[97591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:20:13 devstack sudo[97591]: pam_unix(sudo:session): session closed for user root Jul 31 12:20:13 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-0cc4c8bf-bafc-4ec2-90af-c644b82e5194 tempest-VolumesSnapshotTestJSON-1809567557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2" returned: 0 in 0.623s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:20:13 devstack cinder-volume[89182]: DEBUG cinder.manager [None req-0cc4c8bf-bafc-4ec2-90af-c644b82e5194 tempest-VolumesSnapshotTestJSON-1809567557 None] Notifying Schedulers of capabilities ... {{(pid=89182) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 12:20:13 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-0cc4c8bf-bafc-4ec2-90af-c644b82e5194 tempest-VolumesSnapshotTestJSON-1809567557 None] Deleted volume successfully. Jul 31 12:20:13 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-0cc4c8bf-bafc-4ec2-90af-c644b82e5194 tempest-VolumesSnapshotTestJSON-1809567557 None] Lock "cinder-b24c8676-80e7-4ae1-bb0d-f648cf80bce8-delete_volume" released by "delete_volume" :: held 2.596s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:20:16 devstack cinder-volume[89182]: DEBUG cinder.volume.flows.manager.create_volume [None req-e81a08c6-3743-49f3-864e-6e1841b1cc5f tempest-TestInstancesWithCinderVolumes-1834445134 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89182) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 12:20:16 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-e81a08c6-3743-49f3-864e-6e1841b1cc5f tempest-TestInstancesWithCinderVolumes-1834445134 None] Flow 'volume_create_manager' (ed572e2e-bdf0-4bc9-b848-67c7c1fffea0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:20:16 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-e81a08c6-3743-49f3-864e-6e1841b1cc5f tempest-TestInstancesWithCinderVolumes-1834445134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad715c53-6f28-48ea-be89-152342326c9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:20:16 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-e81a08c6-3743-49f3-864e-6e1841b1cc5f tempest-TestInstancesWithCinderVolumes-1834445134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad715c53-6f28-48ea-be89-152342326c9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:20:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1578775519',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f347f21-66c9-4df1-a98b-8199b5933ef9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a078f8856a3b4a3d8665861186965816',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:20:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:20:16Z,use_quota=True,user_id='a46b058707494fef96d1bd2013ca0d35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14500041-e1c9-460b-a996-81d07383e0e3),volume_type_id=14500041-e1c9-460b-a996-81d07383e0e3)' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:20:16 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-e81a08c6-3743-49f3-864e-6e1841b1cc5f tempest-TestInstancesWithCinderVolumes-1834445134 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (059e7d92-977a-4285-ac64-61196a37cb8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:20:16 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-e81a08c6-3743-49f3-864e-6e1841b1cc5f tempest-TestInstancesWithCinderVolumes-1834445134 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (059e7d92-977a-4285-ac64-61196a37cb8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:20:16 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-e81a08c6-3743-49f3-864e-6e1841b1cc5f tempest-TestInstancesWithCinderVolumes-1834445134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f14929f9-e92f-4cd6-84e3-f72eded285fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:20:16 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-e81a08c6-3743-49f3-864e-6e1841b1cc5f tempest-TestInstancesWithCinderVolumes-1834445134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f14929f9-e92f-4cd6-84e3-f72eded285fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3f347f21-66c9-4df1-a98b-8199b5933ef9', 'volume_name': 'volume-3f347f21-66c9-4df1-a98b-8199b5933ef9', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:20:16 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-e81a08c6-3743-49f3-864e-6e1841b1cc5f tempest-TestInstancesWithCinderVolumes-1834445134 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d19c1ba-6b35-4f82-b98e-2c03aefd4438) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:20:16 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-e81a08c6-3743-49f3-864e-6e1841b1cc5f tempest-TestInstancesWithCinderVolumes-1834445134 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d19c1ba-6b35-4f82-b98e-2c03aefd4438) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:20:16 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-e81a08c6-3743-49f3-864e-6e1841b1cc5f tempest-TestInstancesWithCinderVolumes-1834445134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8446c1f-4047-4296-90b3-88d5c9bf9a84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:20:16 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-e81a08c6-3743-49f3-864e-6e1841b1cc5f tempest-TestInstancesWithCinderVolumes-1834445134 None] Volume 3f347f21-66c9-4df1-a98b-8199b5933ef9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3f347f21-66c9-4df1-a98b-8199b5933ef9', 'volume_size': 1} Jul 31 12:20:16 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-e81a08c6-3743-49f3-864e-6e1841b1cc5f tempest-TestInstancesWithCinderVolumes-1834445134 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:20:16 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-e81a08c6-3743-49f3-864e-6e1841b1cc5f tempest-TestInstancesWithCinderVolumes-1834445134 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:20:16 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-e81a08c6-3743-49f3-864e-6e1841b1cc5f tempest-TestInstancesWithCinderVolumes-1834445134 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:20:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1578775519',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f347f21-66c9-4df1-a98b-8199b5933ef9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a078f8856a3b4a3d8665861186965816',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:20:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:20:16Z,use_quota=True,user_id='a46b058707494fef96d1bd2013ca0d35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14500041-e1c9-460b-a996-81d07383e0e3),volume_type_id=14500041-e1c9-460b-a996-81d07383e0e3)}" {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 12:20:16 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-e81a08c6-3743-49f3-864e-6e1841b1cc5f tempest-TestInstancesWithCinderVolumes-1834445134 None] Creating volume 3f347f21-66c9-4df1-a98b-8199b5933ef9 {{(pid=89182) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 12:20:16 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-e81a08c6-3743-49f3-864e-6e1841b1cc5f tempest-TestInstancesWithCinderVolumes-1834445134 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:20:16 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-e81a08c6-3743-49f3-864e-6e1841b1cc5f tempest-TestInstancesWithCinderVolumes-1834445134 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:20:16 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-e81a08c6-3743-49f3-864e-6e1841b1cc5f tempest-TestInstancesWithCinderVolumes-1834445134 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:20:16 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-e81a08c6-3743-49f3-864e-6e1841b1cc5f tempest-TestInstancesWithCinderVolumes-1834445134 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:20:16 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-e81a08c6-3743-49f3-864e-6e1841b1cc5f tempest-TestInstancesWithCinderVolumes-1834445134 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:20:16 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-e81a08c6-3743-49f3-864e-6e1841b1cc5f tempest-TestInstancesWithCinderVolumes-1834445134 None] Selected osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 as target Quobyte volume. {{(pid=89182) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 12:20:16 devstack cinder-volume[89182]: INFO cinder.volume.drivers.remotefs [None req-e81a08c6-3743-49f3-864e-6e1841b1cc5f tempest-TestInstancesWithCinderVolumes-1834445134 None] casted to osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 Jul 31 12:20:16 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-e81a08c6-3743-49f3-864e-6e1841b1cc5f tempest-TestInstancesWithCinderVolumes-1834445134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-3f347f21-66c9-4df1-a98b-8199b5933ef9 1073741824 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:20:16 devstack sudo[97654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-3f347f21-66c9-4df1-a98b-8199b5933ef9 1073741824 Jul 31 12:20:16 devstack sudo[97654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:20:16 devstack cinder-volume[89182]: DEBUG cinder.volume.flows.manager.create_volume [None req-0cf55048-9afe-4e4d-89bb-cd3d739bffc3 tempest-TestInstancesWithCinderVolumes-1834445134 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89182) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 12:20:16 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-0cf55048-9afe-4e4d-89bb-cd3d739bffc3 tempest-TestInstancesWithCinderVolumes-1834445134 None] Flow 'volume_create_manager' (f521acd6-8488-4b7a-a2ad-76432b676367) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:20:16 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-0cf55048-9afe-4e4d-89bb-cd3d739bffc3 tempest-TestInstancesWithCinderVolumes-1834445134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (188b4452-34e6-434b-b44e-ddf3a040a3c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:20:16 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-0cf55048-9afe-4e4d-89bb-cd3d739bffc3 tempest-TestInstancesWithCinderVolumes-1834445134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (188b4452-34e6-434b-b44e-ddf3a040a3c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:20:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1607141589',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=178a700e-e9e9-4154-a41e-e391c35c50f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a078f8856a3b4a3d8665861186965816',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:20:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:20:17Z,use_quota=True,user_id='a46b058707494fef96d1bd2013ca0d35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9863889c-3755-4f06-b81b-84f35373c7fd),volume_type_id=9863889c-3755-4f06-b81b-84f35373c7fd)' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:20:16 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-0cf55048-9afe-4e4d-89bb-cd3d739bffc3 tempest-TestInstancesWithCinderVolumes-1834445134 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bddb009a-6afd-4602-ae3d-643d92326a61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:20:16 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-0cf55048-9afe-4e4d-89bb-cd3d739bffc3 tempest-TestInstancesWithCinderVolumes-1834445134 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bddb009a-6afd-4602-ae3d-643d92326a61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:20:16 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-0cf55048-9afe-4e4d-89bb-cd3d739bffc3 tempest-TestInstancesWithCinderVolumes-1834445134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14f75be3-a049-4c9d-a8f1-1567e93c3f12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:20:17 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-0cf55048-9afe-4e4d-89bb-cd3d739bffc3 tempest-TestInstancesWithCinderVolumes-1834445134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14f75be3-a049-4c9d-a8f1-1567e93c3f12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '178a700e-e9e9-4154-a41e-e391c35c50f2', 'volume_name': 'volume-178a700e-e9e9-4154-a41e-e391c35c50f2', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:20:17 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-0cf55048-9afe-4e4d-89bb-cd3d739bffc3 tempest-TestInstancesWithCinderVolumes-1834445134 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47ef16f4-dc02-4ab8-a789-c91aba31b47e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:20:17 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-0cf55048-9afe-4e4d-89bb-cd3d739bffc3 tempest-TestInstancesWithCinderVolumes-1834445134 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47ef16f4-dc02-4ab8-a789-c91aba31b47e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:20:17 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-0cf55048-9afe-4e4d-89bb-cd3d739bffc3 tempest-TestInstancesWithCinderVolumes-1834445134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e88c1b72-ada5-4644-814d-3f3064696722) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:20:17 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-0cf55048-9afe-4e4d-89bb-cd3d739bffc3 tempest-TestInstancesWithCinderVolumes-1834445134 None] Volume 178a700e-e9e9-4154-a41e-e391c35c50f2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-178a700e-e9e9-4154-a41e-e391c35c50f2', 'volume_size': 1} Jul 31 12:20:17 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-0cf55048-9afe-4e4d-89bb-cd3d739bffc3 tempest-TestInstancesWithCinderVolumes-1834445134 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:20:17 devstack sudo[97654]: pam_unix(sudo:session): session closed for user root Jul 31 12:20:17 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-e81a08c6-3743-49f3-864e-6e1841b1cc5f tempest-TestInstancesWithCinderVolumes-1834445134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-3f347f21-66c9-4df1-a98b-8199b5933ef9 1073741824" returned: 0 in 0.958s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:20:17 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-e81a08c6-3743-49f3-864e-6e1841b1cc5f tempest-TestInstancesWithCinderVolumes-1834445134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-3f347f21-66c9-4df1-a98b-8199b5933ef9 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:20:17 devstack sudo[97662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-3f347f21-66c9-4df1-a98b-8199b5933ef9 Jul 31 12:20:17 devstack sudo[97662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:20:17 devstack sudo[97662]: pam_unix(sudo:session): session closed for user root Jul 31 12:20:17 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-e81a08c6-3743-49f3-864e-6e1841b1cc5f tempest-TestInstancesWithCinderVolumes-1834445134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-3f347f21-66c9-4df1-a98b-8199b5933ef9" returned: 0 in 0.357s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:20:17 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-e81a08c6-3743-49f3-864e-6e1841b1cc5f tempest-TestInstancesWithCinderVolumes-1834445134 None] <== create_volume: return (1432ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'} {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 12:20:17 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-e81a08c6-3743-49f3-864e-6e1841b1cc5f tempest-TestInstancesWithCinderVolumes-1834445134 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.435s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:20:17 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-0cf55048-9afe-4e4d-89bb-cd3d739bffc3 tempest-TestInstancesWithCinderVolumes-1834445134 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.910s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:20:17 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-0cf55048-9afe-4e4d-89bb-cd3d739bffc3 tempest-TestInstancesWithCinderVolumes-1834445134 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:20:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1607141589',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=178a700e-e9e9-4154-a41e-e391c35c50f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a078f8856a3b4a3d8665861186965816',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:20:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:20:17Z,use_quota=True,user_id='a46b058707494fef96d1bd2013ca0d35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9863889c-3755-4f06-b81b-84f35373c7fd),volume_type_id=9863889c-3755-4f06-b81b-84f35373c7fd)}" {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 12:20:17 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-0cf55048-9afe-4e4d-89bb-cd3d739bffc3 tempest-TestInstancesWithCinderVolumes-1834445134 None] Creating volume 178a700e-e9e9-4154-a41e-e391c35c50f2 {{(pid=89182) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 12:20:17 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-0cf55048-9afe-4e4d-89bb-cd3d739bffc3 tempest-TestInstancesWithCinderVolumes-1834445134 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:20:17 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-0cf55048-9afe-4e4d-89bb-cd3d739bffc3 tempest-TestInstancesWithCinderVolumes-1834445134 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:20:17 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-0cf55048-9afe-4e4d-89bb-cd3d739bffc3 tempest-TestInstancesWithCinderVolumes-1834445134 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:20:17 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-0cf55048-9afe-4e4d-89bb-cd3d739bffc3 tempest-TestInstancesWithCinderVolumes-1834445134 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:20:17 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-0cf55048-9afe-4e4d-89bb-cd3d739bffc3 tempest-TestInstancesWithCinderVolumes-1834445134 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:20:17 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-0cf55048-9afe-4e4d-89bb-cd3d739bffc3 tempest-TestInstancesWithCinderVolumes-1834445134 None] Selected osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 as target Quobyte volume. {{(pid=89182) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 12:20:17 devstack cinder-volume[89182]: INFO cinder.volume.drivers.remotefs [None req-0cf55048-9afe-4e4d-89bb-cd3d739bffc3 tempest-TestInstancesWithCinderVolumes-1834445134 None] casted to osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 Jul 31 12:20:17 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-0cf55048-9afe-4e4d-89bb-cd3d739bffc3 tempest-TestInstancesWithCinderVolumes-1834445134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-178a700e-e9e9-4154-a41e-e391c35c50f2 1073741824 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:20:17 devstack sudo[97665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-178a700e-e9e9-4154-a41e-e391c35c50f2 1073741824 Jul 31 12:20:17 devstack sudo[97665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:20:18 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-e81a08c6-3743-49f3-864e-6e1841b1cc5f tempest-TestInstancesWithCinderVolumes-1834445134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8446c1f-4047-4296-90b3-88d5c9bf9a84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f347f21-66c9-4df1-a98b-8199b5933ef9', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:20:18 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-e81a08c6-3743-49f3-864e-6e1841b1cc5f tempest-TestInstancesWithCinderVolumes-1834445134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c0a1913-70d0-4994-8614-a06915570452) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:20:18 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-e81a08c6-3743-49f3-864e-6e1841b1cc5f tempest-TestInstancesWithCinderVolumes-1834445134 None] Volume volume-3f347f21-66c9-4df1-a98b-8199b5933ef9 (3f347f21-66c9-4df1-a98b-8199b5933ef9): created successfully Jul 31 12:20:18 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-e81a08c6-3743-49f3-864e-6e1841b1cc5f tempest-TestInstancesWithCinderVolumes-1834445134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c0a1913-70d0-4994-8614-a06915570452) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:20:18 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-e81a08c6-3743-49f3-864e-6e1841b1cc5f tempest-TestInstancesWithCinderVolumes-1834445134 None] Flow 'volume_create_manager' (ed572e2e-bdf0-4bc9-b848-67c7c1fffea0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:20:18 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-e81a08c6-3743-49f3-864e-6e1841b1cc5f tempest-TestInstancesWithCinderVolumes-1834445134 None] Created volume successfully. Jul 31 12:20:18 devstack cinder-volume[89182]: DEBUG cinder.volume.flows.manager.create_volume [None req-bf4aa4f1-c58b-44a4-88e7-65856c04ae2e tempest-TestInstancesWithCinderVolumes-1834445134 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89182) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 12:20:18 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-bf4aa4f1-c58b-44a4-88e7-65856c04ae2e tempest-TestInstancesWithCinderVolumes-1834445134 None] Flow 'volume_create_manager' (dd2f535c-3efa-445d-8995-7460f1191f87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:20:18 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-bf4aa4f1-c58b-44a4-88e7-65856c04ae2e tempest-TestInstancesWithCinderVolumes-1834445134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25dc57fa-d5c9-42d7-b00e-1d5adb3ecbae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:20:18 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-bf4aa4f1-c58b-44a4-88e7-65856c04ae2e tempest-TestInstancesWithCinderVolumes-1834445134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25dc57fa-d5c9-42d7-b00e-1d5adb3ecbae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:20:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1670297899',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=079a0a44-f6ba-4763-84ca-49bb8ed21014,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a078f8856a3b4a3d8665861186965816',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:20:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:20:19Z,use_quota=True,user_id='a46b058707494fef96d1bd2013ca0d35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eb26d2b-f8cc-4ba6-bb5c-706641657d45),volume_type_id=6eb26d2b-f8cc-4ba6-bb5c-706641657d45)' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:20:18 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-bf4aa4f1-c58b-44a4-88e7-65856c04ae2e tempest-TestInstancesWithCinderVolumes-1834445134 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0adf8e5-adc0-4974-834f-ddf49b86e00a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:20:18 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-bf4aa4f1-c58b-44a4-88e7-65856c04ae2e tempest-TestInstancesWithCinderVolumes-1834445134 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0adf8e5-adc0-4974-834f-ddf49b86e00a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:20:18 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-bf4aa4f1-c58b-44a4-88e7-65856c04ae2e tempest-TestInstancesWithCinderVolumes-1834445134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1dd2197-c34f-4e31-a4a6-4ba3ab0d8872) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:20:18 devstack cinder-volume[89182]: DEBUG cinder.image.glance [None req-bf4aa4f1-c58b-44a4-88e7-65856c04ae2e tempest-TestInstancesWithCinderVolumes-1834445134 None] Creating Keystone auth plugin from conf {{(pid=89182) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 31 12:20:19 devstack sudo[97665]: pam_unix(sudo:session): session closed for user root Jul 31 12:20:19 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-0cf55048-9afe-4e4d-89bb-cd3d739bffc3 tempest-TestInstancesWithCinderVolumes-1834445134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-178a700e-e9e9-4154-a41e-e391c35c50f2 1073741824" returned: 0 in 1.058s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:20:19 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-0cf55048-9afe-4e4d-89bb-cd3d739bffc3 tempest-TestInstancesWithCinderVolumes-1834445134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-178a700e-e9e9-4154-a41e-e391c35c50f2 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:20:19 devstack sudo[97673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-178a700e-e9e9-4154-a41e-e391c35c50f2 Jul 31 12:20:19 devstack sudo[97673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:20:19 devstack sudo[97673]: pam_unix(sudo:session): session closed for user root Jul 31 12:20:19 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-0cf55048-9afe-4e4d-89bb-cd3d739bffc3 tempest-TestInstancesWithCinderVolumes-1834445134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-178a700e-e9e9-4154-a41e-e391c35c50f2" returned: 0 in 0.519s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:20:19 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-0cf55048-9afe-4e4d-89bb-cd3d739bffc3 tempest-TestInstancesWithCinderVolumes-1834445134 None] <== create_volume: return (1680ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'} {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 12:20:19 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-0cf55048-9afe-4e4d-89bb-cd3d739bffc3 tempest-TestInstancesWithCinderVolumes-1834445134 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.692s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:20:19 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-0cf55048-9afe-4e4d-89bb-cd3d739bffc3 tempest-TestInstancesWithCinderVolumes-1834445134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e88c1b72-ada5-4644-814d-3f3064696722) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-178a700e-e9e9-4154-a41e-e391c35c50f2', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:20:19 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-0cf55048-9afe-4e4d-89bb-cd3d739bffc3 tempest-TestInstancesWithCinderVolumes-1834445134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12bffa6a-a2f9-460e-b3ee-eaabda5e7407) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:20:19 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-0cf55048-9afe-4e4d-89bb-cd3d739bffc3 tempest-TestInstancesWithCinderVolumes-1834445134 None] Volume volume-178a700e-e9e9-4154-a41e-e391c35c50f2 (178a700e-e9e9-4154-a41e-e391c35c50f2): created successfully Jul 31 12:20:19 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-0cf55048-9afe-4e4d-89bb-cd3d739bffc3 tempest-TestInstancesWithCinderVolumes-1834445134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12bffa6a-a2f9-460e-b3ee-eaabda5e7407) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:20:19 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-0cf55048-9afe-4e4d-89bb-cd3d739bffc3 tempest-TestInstancesWithCinderVolumes-1834445134 None] Flow 'volume_create_manager' (f521acd6-8488-4b7a-a2ad-76432b676367) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:20:19 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-0cf55048-9afe-4e4d-89bb-cd3d739bffc3 tempest-TestInstancesWithCinderVolumes-1834445134 None] Created volume successfully. Jul 31 12:20:19 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-bf4aa4f1-c58b-44a4-88e7-65856c04ae2e tempest-TestInstancesWithCinderVolumes-1834445134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1dd2197-c34f-4e31-a4a6-4ba3ab0d8872) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '079a0a44-f6ba-4763-84ca-49bb8ed21014', 'volume_name': 'volume-079a0a44-f6ba-4763-84ca-49bb8ed21014', 'volume_size': 1, 'image_id': '79639e24-cf9c-4f6f-8a88-44e1a30abd13', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/79639e24-cf9c-4f6f-8a88-44e1a30abd13', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1688257265', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a078f8856a3b4a3d8665861186965816', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '79639e24-cf9c-4f6f-8a88-44e1a30abd13', 'created_at': datetime.datetime(2026, 7, 31, 10, 20, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 31, 10, 20, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/79639e24-cf9c-4f6f-8a88-44e1a30abd13/file', 'properties': {}}, 'image_service': }' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:20:19 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-bf4aa4f1-c58b-44a4-88e7-65856c04ae2e tempest-TestInstancesWithCinderVolumes-1834445134 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea9c15db-2fb4-407f-adb4-66fc56a52aca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:20:19 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-bf4aa4f1-c58b-44a4-88e7-65856c04ae2e tempest-TestInstancesWithCinderVolumes-1834445134 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea9c15db-2fb4-407f-adb4-66fc56a52aca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:20:19 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-bf4aa4f1-c58b-44a4-88e7-65856c04ae2e tempest-TestInstancesWithCinderVolumes-1834445134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e6bca3d-2213-4cf2-86c8-13db344c25e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:20:19 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-bf4aa4f1-c58b-44a4-88e7-65856c04ae2e tempest-TestInstancesWithCinderVolumes-1834445134 None] Volume 079a0a44-f6ba-4763-84ca-49bb8ed21014: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-079a0a44-f6ba-4763-84ca-49bb8ed21014', 'volume_size': 1, 'image_id': '79639e24-cf9c-4f6f-8a88-44e1a30abd13', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/79639e24-cf9c-4f6f-8a88-44e1a30abd13', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1688257265', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a078f8856a3b4a3d8665861186965816', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '79639e24-cf9c-4f6f-8a88-44e1a30abd13', 'created_at': datetime.datetime(2026, 7, 31, 10, 20, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 31, 10, 20, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/79639e24-cf9c-4f6f-8a88-44e1a30abd13/file', 'properties': {}}, 'image_service': } Jul 31 12:20:19 devstack cinder-volume[89182]: DEBUG cinder.volume.flows.manager.create_volume [None req-bf4aa4f1-c58b-44a4-88e7-65856c04ae2e tempest-TestInstancesWithCinderVolumes-1834445134 None] Trying to clone 079a0a44-f6ba-4763-84ca-49bb8ed21014 from image 79639e24-cf9c-4f6f-8a88-44e1a30abd13 at location (None, [{'url': 'file:///opt/stack/data/glance/images/79639e24-cf9c-4f6f-8a88-44e1a30abd13', 'metadata': {}}]). {{(pid=89182) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 31 12:20:21 devstack cinder-volume[89182]: DEBUG oslo_service.periodic_task [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89182) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 31 12:20:21 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:20:21 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:20:21 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:20:21 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:20:21 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:20:21 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:20:21 devstack sudo[97705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 Jul 31 12:20:21 devstack sudo[97705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:20:22 devstack sudo[97705]: pam_unix(sudo:session): session closed for user root Jul 31 12:20:22 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2" returned: 0 in 0.457s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:20:22 devstack cinder-volume[89182]: DEBUG cinder.manager [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] Notifying Schedulers of capabilities ... {{(pid=89182) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 12:20:22 devstack cinder-volume[89182]: DEBUG oslo_service.periodic_task [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] Running periodic task VolumeManager._thread_info {{(pid=89182) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 31 12:20:22 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] thread count: 28 {{(pid=89182) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 31 12:20:22 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] thread info: [<_MainThread(MainThread, started 136154603720832)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=89182) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 31 12:20:24 devstack cinder-volume[89182]: DEBUG cinder.volume.flows.manager.create_volume [None req-ebaae731-c213-4559-96ea-2f464bcff3c7 tempest-ServersNegativeTestJSON-75309061 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89182) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 12:20:24 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-ebaae731-c213-4559-96ea-2f464bcff3c7 tempest-ServersNegativeTestJSON-75309061 None] Flow 'volume_create_manager' (b8ebe34f-62ec-4bf0-b768-f3d2c852c9c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:20:24 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-ebaae731-c213-4559-96ea-2f464bcff3c7 tempest-ServersNegativeTestJSON-75309061 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40a3ea24-c2ca-4d9e-9689-6fc60fb1e985) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:20:24 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-ebaae731-c213-4559-96ea-2f464bcff3c7 tempest-ServersNegativeTestJSON-75309061 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40a3ea24-c2ca-4d9e-9689-6fc60fb1e985) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:20:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-811719026',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d82c485d-b4e1-4586-886c-3265cde5f178,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='929e4d1e3439485a9ff8a14feb303a1c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:20:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:20:24Z,use_quota=True,user_id='085124dd52a24bae9a29c4648b2c4695',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:20:24 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-ebaae731-c213-4559-96ea-2f464bcff3c7 tempest-ServersNegativeTestJSON-75309061 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cfb06bfe-2ef0-4849-8e04-e97a7529b3db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:20:24 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-ebaae731-c213-4559-96ea-2f464bcff3c7 tempest-ServersNegativeTestJSON-75309061 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cfb06bfe-2ef0-4849-8e04-e97a7529b3db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:20:24 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-ebaae731-c213-4559-96ea-2f464bcff3c7 tempest-ServersNegativeTestJSON-75309061 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72a3fc71-c150-4dd8-a2f0-d80d6f5ef04a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:20:24 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-ebaae731-c213-4559-96ea-2f464bcff3c7 tempest-ServersNegativeTestJSON-75309061 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72a3fc71-c150-4dd8-a2f0-d80d6f5ef04a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd82c485d-b4e1-4586-886c-3265cde5f178', 'volume_name': 'volume-d82c485d-b4e1-4586-886c-3265cde5f178', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:20:24 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-ebaae731-c213-4559-96ea-2f464bcff3c7 tempest-ServersNegativeTestJSON-75309061 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61376fda-097f-41ec-b77c-c0fbacfd4cc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:20:24 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-ebaae731-c213-4559-96ea-2f464bcff3c7 tempest-ServersNegativeTestJSON-75309061 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61376fda-097f-41ec-b77c-c0fbacfd4cc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:20:24 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-ebaae731-c213-4559-96ea-2f464bcff3c7 tempest-ServersNegativeTestJSON-75309061 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68b9464f-aeb2-4dc4-aff5-79a3bc41e22a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:20:24 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-ebaae731-c213-4559-96ea-2f464bcff3c7 tempest-ServersNegativeTestJSON-75309061 None] Volume d82c485d-b4e1-4586-886c-3265cde5f178: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d82c485d-b4e1-4586-886c-3265cde5f178', 'volume_size': 1} Jul 31 12:20:24 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-ebaae731-c213-4559-96ea-2f464bcff3c7 tempest-ServersNegativeTestJSON-75309061 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:20:24 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-ebaae731-c213-4559-96ea-2f464bcff3c7 tempest-ServersNegativeTestJSON-75309061 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:20:24 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-ebaae731-c213-4559-96ea-2f464bcff3c7 tempest-ServersNegativeTestJSON-75309061 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:20:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-811719026',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d82c485d-b4e1-4586-886c-3265cde5f178,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='929e4d1e3439485a9ff8a14feb303a1c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:20:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:20:24Z,use_quota=True,user_id='085124dd52a24bae9a29c4648b2c4695',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)}" {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 12:20:24 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-ebaae731-c213-4559-96ea-2f464bcff3c7 tempest-ServersNegativeTestJSON-75309061 None] Creating volume d82c485d-b4e1-4586-886c-3265cde5f178 {{(pid=89182) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 12:20:24 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-ebaae731-c213-4559-96ea-2f464bcff3c7 tempest-ServersNegativeTestJSON-75309061 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:20:24 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-ebaae731-c213-4559-96ea-2f464bcff3c7 tempest-ServersNegativeTestJSON-75309061 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:20:24 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-ebaae731-c213-4559-96ea-2f464bcff3c7 tempest-ServersNegativeTestJSON-75309061 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:20:24 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-ebaae731-c213-4559-96ea-2f464bcff3c7 tempest-ServersNegativeTestJSON-75309061 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:20:24 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-ebaae731-c213-4559-96ea-2f464bcff3c7 tempest-ServersNegativeTestJSON-75309061 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:20:24 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-ebaae731-c213-4559-96ea-2f464bcff3c7 tempest-ServersNegativeTestJSON-75309061 None] Selected osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 as target Quobyte volume. {{(pid=89182) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 12:20:24 devstack cinder-volume[89182]: INFO cinder.volume.drivers.remotefs [None req-ebaae731-c213-4559-96ea-2f464bcff3c7 tempest-ServersNegativeTestJSON-75309061 None] casted to osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 Jul 31 12:20:24 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-ebaae731-c213-4559-96ea-2f464bcff3c7 tempest-ServersNegativeTestJSON-75309061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-d82c485d-b4e1-4586-886c-3265cde5f178 1073741824 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:20:24 devstack sudo[97724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-d82c485d-b4e1-4586-886c-3265cde5f178 1073741824 Jul 31 12:20:24 devstack sudo[97724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:20:25 devstack sudo[97724]: pam_unix(sudo:session): session closed for user root Jul 31 12:20:25 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-ebaae731-c213-4559-96ea-2f464bcff3c7 tempest-ServersNegativeTestJSON-75309061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-d82c485d-b4e1-4586-886c-3265cde5f178 1073741824" returned: 0 in 0.623s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:20:25 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-ebaae731-c213-4559-96ea-2f464bcff3c7 tempest-ServersNegativeTestJSON-75309061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-d82c485d-b4e1-4586-886c-3265cde5f178 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:20:25 devstack sudo[97730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-d82c485d-b4e1-4586-886c-3265cde5f178 Jul 31 12:20:25 devstack sudo[97730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:20:25 devstack cinder-volume[89182]: DEBUG cinder.image.image_utils [None req-bf4aa4f1-c58b-44a4-88e7-65856c04ae2e tempest-TestInstancesWithCinderVolumes-1834445134 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_79639e24-cf9c-4f6f-8a88-44e1a30abd13_xyuydhzkdevstack@QuobyteHD, size 20.69 MB, duration 5.39 sec {{(pid=89182) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 31 12:20:25 devstack cinder-volume[89182]: INFO cinder.image.image_utils [None req-bf4aa4f1-c58b-44a4-88e7-65856c04ae2e tempest-TestInstancesWithCinderVolumes-1834445134 None] Image download 20.69 MB at 3.84 MB/s Jul 31 12:20:25 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ef07d14-96e5-49e1-a6f8-1859399dd2bc]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:20:25 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-bf4aa4f1-c58b-44a4-88e7-65856c04ae2e tempest-TestInstancesWithCinderVolumes-1834445134 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_79639e24-cf9c-4f6f-8a88-44e1a30abd13_xyuydhzkdevstack@QuobyteHD {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:20:25 devstack sudo[97730]: pam_unix(sudo:session): session closed for user root Jul 31 12:20:25 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-ebaae731-c213-4559-96ea-2f464bcff3c7 tempest-ServersNegativeTestJSON-75309061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-d82c485d-b4e1-4586-886c-3265cde5f178" returned: 0 in 0.296s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:20:25 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-ebaae731-c213-4559-96ea-2f464bcff3c7 tempest-ServersNegativeTestJSON-75309061 None] <== create_volume: return (988ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'} {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 12:20:25 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-ebaae731-c213-4559-96ea-2f464bcff3c7 tempest-ServersNegativeTestJSON-75309061 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.995s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:20:25 devstack sudo[97732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_79639e24-cf9c-4f6f-8a88-44e1a30abd13_xyuydhzkdevstack@QuobyteHD Jul 31 12:20:25 devstack sudo[97732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:20:25 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-ebaae731-c213-4559-96ea-2f464bcff3c7 tempest-ServersNegativeTestJSON-75309061 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68b9464f-aeb2-4dc4-aff5-79a3bc41e22a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d82c485d-b4e1-4586-886c-3265cde5f178', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:20:25 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-ebaae731-c213-4559-96ea-2f464bcff3c7 tempest-ServersNegativeTestJSON-75309061 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc6674b7-ca29-448e-ba10-e786d6034604) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:20:25 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-ebaae731-c213-4559-96ea-2f464bcff3c7 tempest-ServersNegativeTestJSON-75309061 None] Volume volume-d82c485d-b4e1-4586-886c-3265cde5f178 (d82c485d-b4e1-4586-886c-3265cde5f178): created successfully Jul 31 12:20:25 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-ebaae731-c213-4559-96ea-2f464bcff3c7 tempest-ServersNegativeTestJSON-75309061 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc6674b7-ca29-448e-ba10-e786d6034604) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:20:25 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-ebaae731-c213-4559-96ea-2f464bcff3c7 tempest-ServersNegativeTestJSON-75309061 None] Flow 'volume_create_manager' (b8ebe34f-62ec-4bf0-b768-f3d2c852c9c6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:20:25 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-ebaae731-c213-4559-96ea-2f464bcff3c7 tempest-ServersNegativeTestJSON-75309061 None] Created volume successfully. Jul 31 12:20:25 devstack sudo[97732]: pam_unix(sudo:session): session closed for user root Jul 31 12:20:25 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-bf4aa4f1-c58b-44a4-88e7-65856c04ae2e tempest-TestInstancesWithCinderVolumes-1834445134 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_79639e24-cf9c-4f6f-8a88-44e1a30abd13_xyuydhzkdevstack@QuobyteHD" returned: 0 in 0.374s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:20:25 devstack cinder-volume[89182]: DEBUG cinder.image.image_utils [None req-bf4aa4f1-c58b-44a4-88e7-65856c04ae2e tempest-TestInstancesWithCinderVolumes-1834445134 None] Temporary image 79639e24-cf9c-4f6f-8a88-44e1a30abd13 is fetched for user a46b058707494fef96d1bd2013ca0d35. {{(pid=89182) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 31 12:20:25 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[da7c4724-c7bd-47ba-961d-d07d65849004]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:20:25 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-bf4aa4f1-c58b-44a4-88e7-65856c04ae2e tempest-TestInstancesWithCinderVolumes-1834445134 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_79639e24-cf9c-4f6f-8a88-44e1a30abd13_xyuydhzkdevstack@QuobyteHD {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:20:25 devstack sudo[97738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_79639e24-cf9c-4f6f-8a88-44e1a30abd13_xyuydhzkdevstack@QuobyteHD Jul 31 12:20:25 devstack sudo[97738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:20:26 devstack sudo[97738]: pam_unix(sudo:session): session closed for user root Jul 31 12:20:26 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-bf4aa4f1-c58b-44a4-88e7-65856c04ae2e tempest-TestInstancesWithCinderVolumes-1834445134 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_79639e24-cf9c-4f6f-8a88-44e1a30abd13_xyuydhzkdevstack@QuobyteHD" returned: 0 in 0.364s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:20:26 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-bf4aa4f1-c58b-44a4-88e7-65856c04ae2e tempest-TestInstancesWithCinderVolumes-1834445134 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:20:26 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-bf4aa4f1-c58b-44a4-88e7-65856c04ae2e tempest-TestInstancesWithCinderVolumes-1834445134 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:20:26 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-bf4aa4f1-c58b-44a4-88e7-65856c04ae2e tempest-TestInstancesWithCinderVolumes-1834445134 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:20:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1670297899',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=079a0a44-f6ba-4763-84ca-49bb8ed21014,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a078f8856a3b4a3d8665861186965816',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:20:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:20:19Z,use_quota=True,user_id='a46b058707494fef96d1bd2013ca0d35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eb26d2b-f8cc-4ba6-bb5c-706641657d45),volume_type_id=6eb26d2b-f8cc-4ba6-bb5c-706641657d45)}" {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 12:20:26 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-bf4aa4f1-c58b-44a4-88e7-65856c04ae2e tempest-TestInstancesWithCinderVolumes-1834445134 None] Creating volume 079a0a44-f6ba-4763-84ca-49bb8ed21014 {{(pid=89182) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 12:20:26 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-bf4aa4f1-c58b-44a4-88e7-65856c04ae2e tempest-TestInstancesWithCinderVolumes-1834445134 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:20:26 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-bf4aa4f1-c58b-44a4-88e7-65856c04ae2e tempest-TestInstancesWithCinderVolumes-1834445134 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:20:26 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-bf4aa4f1-c58b-44a4-88e7-65856c04ae2e tempest-TestInstancesWithCinderVolumes-1834445134 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:20:26 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-bf4aa4f1-c58b-44a4-88e7-65856c04ae2e tempest-TestInstancesWithCinderVolumes-1834445134 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:20:26 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-bf4aa4f1-c58b-44a4-88e7-65856c04ae2e tempest-TestInstancesWithCinderVolumes-1834445134 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:20:26 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-bf4aa4f1-c58b-44a4-88e7-65856c04ae2e tempest-TestInstancesWithCinderVolumes-1834445134 None] Selected osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 as target Quobyte volume. {{(pid=89182) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 12:20:26 devstack cinder-volume[89182]: INFO cinder.volume.drivers.remotefs [None req-bf4aa4f1-c58b-44a4-88e7-65856c04ae2e tempest-TestInstancesWithCinderVolumes-1834445134 None] casted to osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 Jul 31 12:20:26 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-bf4aa4f1-c58b-44a4-88e7-65856c04ae2e tempest-TestInstancesWithCinderVolumes-1834445134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-079a0a44-f6ba-4763-84ca-49bb8ed21014 1073741824 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:20:26 devstack sudo[97744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-079a0a44-f6ba-4763-84ca-49bb8ed21014 1073741824 Jul 31 12:20:26 devstack sudo[97744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:20:26 devstack sudo[97744]: pam_unix(sudo:session): session closed for user root Jul 31 12:20:26 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-bf4aa4f1-c58b-44a4-88e7-65856c04ae2e tempest-TestInstancesWithCinderVolumes-1834445134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-079a0a44-f6ba-4763-84ca-49bb8ed21014 1073741824" returned: 0 in 0.529s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:20:26 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-bf4aa4f1-c58b-44a4-88e7-65856c04ae2e tempest-TestInstancesWithCinderVolumes-1834445134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-079a0a44-f6ba-4763-84ca-49bb8ed21014 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:20:26 devstack sudo[97750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-079a0a44-f6ba-4763-84ca-49bb8ed21014 Jul 31 12:20:26 devstack sudo[97750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:20:27 devstack sudo[97750]: pam_unix(sudo:session): session closed for user root Jul 31 12:20:27 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-bf4aa4f1-c58b-44a4-88e7-65856c04ae2e tempest-TestInstancesWithCinderVolumes-1834445134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-079a0a44-f6ba-4763-84ca-49bb8ed21014" returned: 0 in 0.259s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:20:27 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-bf4aa4f1-c58b-44a4-88e7-65856c04ae2e tempest-TestInstancesWithCinderVolumes-1834445134 None] <== create_volume: return (841ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'} {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 12:20:27 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-bf4aa4f1-c58b-44a4-88e7-65856c04ae2e tempest-TestInstancesWithCinderVolumes-1834445134 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.843s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:20:27 devstack cinder-volume[89182]: DEBUG cinder.volume.volume_utils [None req-bf4aa4f1-c58b-44a4-88e7-65856c04ae2e tempest-TestInstancesWithCinderVolumes-1834445134 None] Attempting download of 79639e24-cf9c-4f6f-8a88-44e1a30abd13 ((None, [{'url': 'file:///opt/stack/data/glance/images/79639e24-cf9c-4f6f-8a88-44e1a30abd13', 'metadata': {}}])) to volume 079a0a44-f6ba-4763-84ca-49bb8ed21014. {{(pid=89182) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 31 12:20:27 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[7638fcc1-04ee-4045-928f-77f315447ab7]: (4, 'raw') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:20:27 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-bf4aa4f1-c58b-44a4-88e7-65856c04ae2e tempest-TestInstancesWithCinderVolumes-1834445134 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_79639e24-cf9c-4f6f-8a88-44e1a30abd13_b_ai1fx4 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:20:27 devstack sudo[97753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_79639e24-cf9c-4f6f-8a88-44e1a30abd13_b_ai1fx4 Jul 31 12:20:27 devstack sudo[97753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:20:27 devstack sudo[97753]: pam_unix(sudo:session): session closed for user root Jul 31 12:20:27 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-bf4aa4f1-c58b-44a4-88e7-65856c04ae2e tempest-TestInstancesWithCinderVolumes-1834445134 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_79639e24-cf9c-4f6f-8a88-44e1a30abd13_b_ai1fx4" returned: 0 in 0.396s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:20:27 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-bf4aa4f1-c58b-44a4-88e7-65856c04ae2e tempest-TestInstancesWithCinderVolumes-1834445134 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_79639e24-cf9c-4f6f-8a88-44e1a30abd13_b_ai1fx4 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:20:27 devstack sudo[97757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_79639e24-cf9c-4f6f-8a88-44e1a30abd13_b_ai1fx4 Jul 31 12:20:27 devstack sudo[97757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:20:27 devstack sudo[97757]: pam_unix(sudo:session): session closed for user root Jul 31 12:20:27 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-bf4aa4f1-c58b-44a4-88e7-65856c04ae2e tempest-TestInstancesWithCinderVolumes-1834445134 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_79639e24-cf9c-4f6f-8a88-44e1a30abd13_b_ai1fx4" returned: 1 in 0.380s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:20:27 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-bf4aa4f1-c58b-44a4-88e7-65856c04ae2e tempest-TestInstancesWithCinderVolumes-1834445134 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_79639e24-cf9c-4f6f-8a88-44e1a30abd13_b_ai1fx4' failed. Not Retrying. {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 31 12:20:27 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[e73696b1-8a16-42cb-b19c-24bcbddebfe2]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:20:27 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-bf4aa4f1-c58b-44a4-88e7-65856c04ae2e tempest-TestInstancesWithCinderVolumes-1834445134 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_79639e24-cf9c-4f6f-8a88-44e1a30abd13_xyuydhzkdevstack@QuobyteHD {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:20:28 devstack sudo[97761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_79639e24-cf9c-4f6f-8a88-44e1a30abd13_xyuydhzkdevstack@QuobyteHD Jul 31 12:20:28 devstack sudo[97761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:20:28 devstack cinder-volume[89182]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec886cea-aba7-4acf-a8ff-3974e2fd628c tempest-ServersNegativeTestJSON-75309061 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89182) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 12:20:28 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-ec886cea-aba7-4acf-a8ff-3974e2fd628c tempest-ServersNegativeTestJSON-75309061 None] Flow 'volume_create_manager' (9bfdd306-f7af-4b4f-97e5-ca4a2408c11f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:20:28 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-ec886cea-aba7-4acf-a8ff-3974e2fd628c tempest-ServersNegativeTestJSON-75309061 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67f9ff48-3ec4-4079-a89c-8eda1d4d3ed2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:20:28 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-ec886cea-aba7-4acf-a8ff-3974e2fd628c tempest-ServersNegativeTestJSON-75309061 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67f9ff48-3ec4-4079-a89c-8eda1d4d3ed2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:20:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1450005999',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e11e052-98d8-4291-abf8-646165febfb5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='929e4d1e3439485a9ff8a14feb303a1c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:20:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:20:28Z,use_quota=True,user_id='085124dd52a24bae9a29c4648b2c4695',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:20:28 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-ec886cea-aba7-4acf-a8ff-3974e2fd628c tempest-ServersNegativeTestJSON-75309061 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92d3253a-6f68-4abe-9f6b-0ce97a088e8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:20:28 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-ec886cea-aba7-4acf-a8ff-3974e2fd628c tempest-ServersNegativeTestJSON-75309061 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92d3253a-6f68-4abe-9f6b-0ce97a088e8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:20:28 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-ec886cea-aba7-4acf-a8ff-3974e2fd628c tempest-ServersNegativeTestJSON-75309061 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2ffe69f-f174-436a-9886-735e06034476) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:20:28 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-ec886cea-aba7-4acf-a8ff-3974e2fd628c tempest-ServersNegativeTestJSON-75309061 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2ffe69f-f174-436a-9886-735e06034476) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5e11e052-98d8-4291-abf8-646165febfb5', 'volume_name': 'volume-5e11e052-98d8-4291-abf8-646165febfb5', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:20:28 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-ec886cea-aba7-4acf-a8ff-3974e2fd628c tempest-ServersNegativeTestJSON-75309061 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f8a669f-1103-4902-b3bb-2f0159c81490) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:20:28 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-ec886cea-aba7-4acf-a8ff-3974e2fd628c tempest-ServersNegativeTestJSON-75309061 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f8a669f-1103-4902-b3bb-2f0159c81490) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:20:28 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-ec886cea-aba7-4acf-a8ff-3974e2fd628c tempest-ServersNegativeTestJSON-75309061 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f88def28-c9d5-4de6-870e-10cc3088328f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:20:28 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-ec886cea-aba7-4acf-a8ff-3974e2fd628c tempest-ServersNegativeTestJSON-75309061 None] Volume 5e11e052-98d8-4291-abf8-646165febfb5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5e11e052-98d8-4291-abf8-646165febfb5', 'volume_size': 1} Jul 31 12:20:28 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-ec886cea-aba7-4acf-a8ff-3974e2fd628c tempest-ServersNegativeTestJSON-75309061 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:20:28 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-ec886cea-aba7-4acf-a8ff-3974e2fd628c tempest-ServersNegativeTestJSON-75309061 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:20:28 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-ec886cea-aba7-4acf-a8ff-3974e2fd628c tempest-ServersNegativeTestJSON-75309061 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:20:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1450005999',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e11e052-98d8-4291-abf8-646165febfb5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='929e4d1e3439485a9ff8a14feb303a1c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:20:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:20:28Z,use_quota=True,user_id='085124dd52a24bae9a29c4648b2c4695',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)}" {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 12:20:28 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-ec886cea-aba7-4acf-a8ff-3974e2fd628c tempest-ServersNegativeTestJSON-75309061 None] Creating volume 5e11e052-98d8-4291-abf8-646165febfb5 {{(pid=89182) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 12:20:28 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-ec886cea-aba7-4acf-a8ff-3974e2fd628c tempest-ServersNegativeTestJSON-75309061 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:20:28 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-ec886cea-aba7-4acf-a8ff-3974e2fd628c tempest-ServersNegativeTestJSON-75309061 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:20:28 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-ec886cea-aba7-4acf-a8ff-3974e2fd628c tempest-ServersNegativeTestJSON-75309061 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:20:28 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-ec886cea-aba7-4acf-a8ff-3974e2fd628c tempest-ServersNegativeTestJSON-75309061 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:20:28 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-ec886cea-aba7-4acf-a8ff-3974e2fd628c tempest-ServersNegativeTestJSON-75309061 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:20:28 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-ec886cea-aba7-4acf-a8ff-3974e2fd628c tempest-ServersNegativeTestJSON-75309061 None] Selected osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 as target Quobyte volume. {{(pid=89182) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 12:20:28 devstack cinder-volume[89182]: INFO cinder.volume.drivers.remotefs [None req-ec886cea-aba7-4acf-a8ff-3974e2fd628c tempest-ServersNegativeTestJSON-75309061 None] casted to osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 Jul 31 12:20:28 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-ec886cea-aba7-4acf-a8ff-3974e2fd628c tempest-ServersNegativeTestJSON-75309061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-5e11e052-98d8-4291-abf8-646165febfb5 1073741824 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:20:28 devstack sudo[97763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-5e11e052-98d8-4291-abf8-646165febfb5 1073741824 Jul 31 12:20:28 devstack sudo[97763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:20:28 devstack sudo[97761]: pam_unix(sudo:session): session closed for user root Jul 31 12:20:28 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-bf4aa4f1-c58b-44a4-88e7-65856c04ae2e tempest-TestInstancesWithCinderVolumes-1834445134 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_79639e24-cf9c-4f6f-8a88-44e1a30abd13_xyuydhzkdevstack@QuobyteHD" returned: 0 in 0.350s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:20:28 devstack cinder-volume[89182]: DEBUG cinder.image.image_utils [None req-bf4aa4f1-c58b-44a4-88e7-65856c04ae2e tempest-TestInstancesWithCinderVolumes-1834445134 None] 79639e24-cf9c-4f6f-8a88-44e1a30abd13 was qcow2, converting to qcow2 {{(pid=89182) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 31 12:20:28 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-bf4aa4f1-c58b-44a4-88e7-65856c04ae2e tempest-TestInstancesWithCinderVolumes-1834445134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_79639e24-cf9c-4f6f-8a88-44e1a30abd13_xyuydhzkdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-079a0a44-f6ba-4763-84ca-49bb8ed21014 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:20:28 devstack sudo[97768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_79639e24-cf9c-4f6f-8a88-44e1a30abd13_xyuydhzkdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-079a0a44-f6ba-4763-84ca-49bb8ed21014 Jul 31 12:20:28 devstack sudo[97768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:20:28 devstack sudo[97763]: pam_unix(sudo:session): session closed for user root Jul 31 12:20:28 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-ec886cea-aba7-4acf-a8ff-3974e2fd628c tempest-ServersNegativeTestJSON-75309061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-5e11e052-98d8-4291-abf8-646165febfb5 1073741824" returned: 0 in 0.667s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:20:28 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-ec886cea-aba7-4acf-a8ff-3974e2fd628c tempest-ServersNegativeTestJSON-75309061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-5e11e052-98d8-4291-abf8-646165febfb5 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:20:28 devstack sudo[97776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-5e11e052-98d8-4291-abf8-646165febfb5 Jul 31 12:20:28 devstack sudo[97776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:20:29 devstack sudo[97776]: pam_unix(sudo:session): session closed for user root Jul 31 12:20:29 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-ec886cea-aba7-4acf-a8ff-3974e2fd628c tempest-ServersNegativeTestJSON-75309061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-5e11e052-98d8-4291-abf8-646165febfb5" returned: 0 in 0.279s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:20:29 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-ec886cea-aba7-4acf-a8ff-3974e2fd628c tempest-ServersNegativeTestJSON-75309061 None] <== create_volume: return (1007ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'} {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 12:20:29 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-ec886cea-aba7-4acf-a8ff-3974e2fd628c tempest-ServersNegativeTestJSON-75309061 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.010s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:20:29 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-ec886cea-aba7-4acf-a8ff-3974e2fd628c tempest-ServersNegativeTestJSON-75309061 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f88def28-c9d5-4de6-870e-10cc3088328f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5e11e052-98d8-4291-abf8-646165febfb5', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:20:29 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-ec886cea-aba7-4acf-a8ff-3974e2fd628c tempest-ServersNegativeTestJSON-75309061 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4cecb56d-dbbd-4338-b373-7364b4a240dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:20:29 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-ec886cea-aba7-4acf-a8ff-3974e2fd628c tempest-ServersNegativeTestJSON-75309061 None] Volume volume-5e11e052-98d8-4291-abf8-646165febfb5 (5e11e052-98d8-4291-abf8-646165febfb5): created successfully Jul 31 12:20:29 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-ec886cea-aba7-4acf-a8ff-3974e2fd628c tempest-ServersNegativeTestJSON-75309061 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4cecb56d-dbbd-4338-b373-7364b4a240dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:20:29 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-ec886cea-aba7-4acf-a8ff-3974e2fd628c tempest-ServersNegativeTestJSON-75309061 None] Flow 'volume_create_manager' (9bfdd306-f7af-4b4f-97e5-ca4a2408c11f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:20:29 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-ec886cea-aba7-4acf-a8ff-3974e2fd628c tempest-ServersNegativeTestJSON-75309061 None] Created volume successfully. Jul 31 12:20:30 devstack sudo[97768]: pam_unix(sudo:session): session closed for user root Jul 31 12:20:30 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-bf4aa4f1-c58b-44a4-88e7-65856c04ae2e tempest-TestInstancesWithCinderVolumes-1834445134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_79639e24-cf9c-4f6f-8a88-44e1a30abd13_xyuydhzkdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-079a0a44-f6ba-4763-84ca-49bb8ed21014" returned: 0 in 2.385s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:20:30 devstack cinder-volume[89182]: DEBUG cinder.image.image_utils [None req-bf4aa4f1-c58b-44a4-88e7-65856c04ae2e tempest-TestInstancesWithCinderVolumes-1834445134 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_79639e24-cf9c-4f6f-8a88-44e1a30abd13_xyuydhzkdevstack@QuobyteHD, size 112.00 MB, duration 2.39 sec, destination /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-079a0a44-f6ba-4763-84ca-49bb8ed21014 {{(pid=89182) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 31 12:20:30 devstack cinder-volume[89182]: INFO cinder.image.image_utils [None req-bf4aa4f1-c58b-44a4-88e7-65856c04ae2e tempest-TestInstancesWithCinderVolumes-1834445134 None] Converted 112.00 MB image at 46.94 MB/s Jul 31 12:20:30 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-bf4aa4f1-c58b-44a4-88e7-65856c04ae2e tempest-TestInstancesWithCinderVolumes-1834445134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-079a0a44-f6ba-4763-84ca-49bb8ed21014 1G {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:20:30 devstack sudo[97782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-079a0a44-f6ba-4763-84ca-49bb8ed21014 1G Jul 31 12:20:30 devstack sudo[97782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:20:31 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-4ce42ce5-96df-4279-94c2-a1acadfbdc4e tempest-ServersNegativeTestJSON-75309061 None] Acquiring lock "cinder-5e11e052-98d8-4291-abf8-646165febfb5-delete_volume" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:20:31 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-4ce42ce5-96df-4279-94c2-a1acadfbdc4e tempest-ServersNegativeTestJSON-75309061 None] Lock "cinder-5e11e052-98d8-4291-abf8-646165febfb5-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:20:31 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-4ce42ce5-96df-4279-94c2-a1acadfbdc4e tempest-ServersNegativeTestJSON-75309061 None] Acquiring lock "cinder-quobyte-5e11e052-98d8-4291-abf8-646165febfb5" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:20:31 devstack sudo[97782]: pam_unix(sudo:session): session closed for user root Jul 31 12:20:31 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-bf4aa4f1-c58b-44a4-88e7-65856c04ae2e tempest-TestInstancesWithCinderVolumes-1834445134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-079a0a44-f6ba-4763-84ca-49bb8ed21014 1G" returned: 0 in 0.467s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:20:31 devstack cinder-volume[89182]: DEBUG cinder.volume.volume_utils [None req-bf4aa4f1-c58b-44a4-88e7-65856c04ae2e tempest-TestInstancesWithCinderVolumes-1834445134 None] Downloaded image 79639e24-cf9c-4f6f-8a88-44e1a30abd13 ((None, [{'url': 'file:///opt/stack/data/glance/images/79639e24-cf9c-4f6f-8a88-44e1a30abd13', 'metadata': {}}])) to volume 079a0a44-f6ba-4763-84ca-49bb8ed21014 successfully. {{(pid=89182) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 31 12:20:31 devstack cinder-volume[89182]: DEBUG cinder.image.image_utils [None req-bf4aa4f1-c58b-44a4-88e7-65856c04ae2e tempest-TestInstancesWithCinderVolumes-1834445134 None] Temporary image 79639e24-cf9c-4f6f-8a88-44e1a30abd13 for user a46b058707494fef96d1bd2013ca0d35 is deleted. {{(pid=89182) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 31 12:20:31 devstack cinder-volume[89182]: DEBUG cinder.volume.volume_utils [None req-bf4aa4f1-c58b-44a4-88e7-65856c04ae2e tempest-TestInstancesWithCinderVolumes-1834445134 None] Marking volume 079a0a44-f6ba-4763-84ca-49bb8ed21014 as bootable. {{(pid=89182) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 31 12:20:31 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-4ce42ce5-96df-4279-94c2-a1acadfbdc4e tempest-ServersNegativeTestJSON-75309061 None] Lock "cinder-quobyte-5e11e052-98d8-4291-abf8-646165febfb5" acquired by "delete_volume" :: waited 0.031s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:20:31 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3608550-b2ce-4560-b478-c9cb768a3b77]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:20:31 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-4ce42ce5-96df-4279-94c2-a1acadfbdc4e tempest-ServersNegativeTestJSON-75309061 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-5e11e052-98d8-4291-abf8-646165febfb5 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:20:31 devstack cinder-volume[89182]: DEBUG cinder.volume.flows.manager.create_volume [None req-bf4aa4f1-c58b-44a4-88e7-65856c04ae2e tempest-TestInstancesWithCinderVolumes-1834445134 None] Copying metadata from image 79639e24-cf9c-4f6f-8a88-44e1a30abd13 to 079a0a44-f6ba-4763-84ca-49bb8ed21014. {{(pid=89182) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 31 12:20:31 devstack cinder-volume[89182]: DEBUG cinder.volume.flows.manager.create_volume [None req-bf4aa4f1-c58b-44a4-88e7-65856c04ae2e tempest-TestInstancesWithCinderVolumes-1834445134 None] Creating volume glance metadata for volume 079a0a44-f6ba-4763-84ca-49bb8ed21014 backed by image 79639e24-cf9c-4f6f-8a88-44e1a30abd13 with: {'image_id': '79639e24-cf9c-4f6f-8a88-44e1a30abd13', 'image_name': 'tempest-scenario-img--1688257265', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=89182) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 31 12:20:31 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-bf4aa4f1-c58b-44a4-88e7-65856c04ae2e tempest-TestInstancesWithCinderVolumes-1834445134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e6bca3d-2213-4cf2-86c8-13db344c25e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-079a0a44-f6ba-4763-84ca-49bb8ed21014', 'volume_size': 1, 'image_id': '79639e24-cf9c-4f6f-8a88-44e1a30abd13', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/79639e24-cf9c-4f6f-8a88-44e1a30abd13', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1688257265', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a078f8856a3b4a3d8665861186965816', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '79639e24-cf9c-4f6f-8a88-44e1a30abd13', 'created_at': datetime.datetime(2026, 7, 31, 10, 20, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 31, 10, 20, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/79639e24-cf9c-4f6f-8a88-44e1a30abd13/file', 'properties': {}}, 'image_service': }' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:20:31 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-bf4aa4f1-c58b-44a4-88e7-65856c04ae2e tempest-TestInstancesWithCinderVolumes-1834445134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (975b4678-885a-48d8-a58b-42143c53bc4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:20:31 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-bf4aa4f1-c58b-44a4-88e7-65856c04ae2e tempest-TestInstancesWithCinderVolumes-1834445134 None] Volume volume-079a0a44-f6ba-4763-84ca-49bb8ed21014 (079a0a44-f6ba-4763-84ca-49bb8ed21014): created successfully Jul 31 12:20:31 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-bf4aa4f1-c58b-44a4-88e7-65856c04ae2e tempest-TestInstancesWithCinderVolumes-1834445134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (975b4678-885a-48d8-a58b-42143c53bc4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:20:31 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-bf4aa4f1-c58b-44a4-88e7-65856c04ae2e tempest-TestInstancesWithCinderVolumes-1834445134 None] Flow 'volume_create_manager' (dd2f535c-3efa-445d-8995-7460f1191f87) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:20:31 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-bf4aa4f1-c58b-44a4-88e7-65856c04ae2e tempest-TestInstancesWithCinderVolumes-1834445134 None] Created volume successfully. Jul 31 12:20:31 devstack sudo[97821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-5e11e052-98d8-4291-abf8-646165febfb5 Jul 31 12:20:31 devstack sudo[97821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:20:31 devstack sudo[97821]: pam_unix(sudo:session): session closed for user root Jul 31 12:20:31 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-4ce42ce5-96df-4279-94c2-a1acadfbdc4e tempest-ServersNegativeTestJSON-75309061 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-5e11e052-98d8-4291-abf8-646165febfb5" returned: 0 in 0.526s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:20:31 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-4ce42ce5-96df-4279-94c2-a1acadfbdc4e tempest-ServersNegativeTestJSON-75309061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-5e11e052-98d8-4291-abf8-646165febfb5 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:20:31 devstack sudo[97828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-5e11e052-98d8-4291-abf8-646165febfb5 Jul 31 12:20:31 devstack sudo[97828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:20:32 devstack sudo[97828]: pam_unix(sudo:session): session closed for user root Jul 31 12:20:32 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-4ce42ce5-96df-4279-94c2-a1acadfbdc4e tempest-ServersNegativeTestJSON-75309061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-5e11e052-98d8-4291-abf8-646165febfb5" returned: 0 in 0.323s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:20:32 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-4ce42ce5-96df-4279-94c2-a1acadfbdc4e tempest-ServersNegativeTestJSON-75309061 None] Lock "cinder-quobyte-5e11e052-98d8-4291-abf8-646165febfb5" released by "delete_volume" :: held 0.903s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:20:32 devstack cinder-volume[89182]: DEBUG cinder.quota [None req-4ce42ce5-96df-4279-94c2-a1acadfbdc4e tempest-ServersNegativeTestJSON-75309061 None] Created reservations ['26a7930a-1680-465c-b8e2-3bc91fa6cd1d', 'e3b83f46-f7bd-44bf-8714-3886cc61d7ce', '6095a8ba-e095-4057-bfa5-a6198957f1b6', '7b472800-bc0f-49fc-b1da-24e57bef347e'] {{(pid=89182) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 12:20:32 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-4ce42ce5-96df-4279-94c2-a1acadfbdc4e tempest-ServersNegativeTestJSON-75309061 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:20:32 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-4ce42ce5-96df-4279-94c2-a1acadfbdc4e tempest-ServersNegativeTestJSON-75309061 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:20:32 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-4ce42ce5-96df-4279-94c2-a1acadfbdc4e tempest-ServersNegativeTestJSON-75309061 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:20:32 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-4ce42ce5-96df-4279-94c2-a1acadfbdc4e tempest-ServersNegativeTestJSON-75309061 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:20:32 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-4ce42ce5-96df-4279-94c2-a1acadfbdc4e tempest-ServersNegativeTestJSON-75309061 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:20:32 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-4ce42ce5-96df-4279-94c2-a1acadfbdc4e tempest-ServersNegativeTestJSON-75309061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:20:32 devstack sudo[97831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 Jul 31 12:20:32 devstack sudo[97831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:20:32 devstack sudo[97831]: pam_unix(sudo:session): session closed for user root Jul 31 12:20:32 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-4ce42ce5-96df-4279-94c2-a1acadfbdc4e tempest-ServersNegativeTestJSON-75309061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2" returned: 0 in 0.317s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:20:32 devstack cinder-volume[89182]: DEBUG cinder.manager [None req-4ce42ce5-96df-4279-94c2-a1acadfbdc4e tempest-ServersNegativeTestJSON-75309061 None] Notifying Schedulers of capabilities ... {{(pid=89182) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 12:20:32 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-4ce42ce5-96df-4279-94c2-a1acadfbdc4e tempest-ServersNegativeTestJSON-75309061 None] Deleted volume successfully. Jul 31 12:20:32 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-4ce42ce5-96df-4279-94c2-a1acadfbdc4e tempest-ServersNegativeTestJSON-75309061 None] Lock "cinder-5e11e052-98d8-4291-abf8-646165febfb5-delete_volume" released by "delete_volume" :: held 1.593s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:20:33 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-1d790cfd-8949-4cfc-9e1f-7ef93c235d2d tempest-ServersNegativeTestJSON-75309061 None] Acquiring lock "cinder-d82c485d-b4e1-4586-886c-3265cde5f178-delete_volume" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:20:33 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-1d790cfd-8949-4cfc-9e1f-7ef93c235d2d tempest-ServersNegativeTestJSON-75309061 None] Lock "cinder-d82c485d-b4e1-4586-886c-3265cde5f178-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:20:33 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-1d790cfd-8949-4cfc-9e1f-7ef93c235d2d tempest-ServersNegativeTestJSON-75309061 None] Acquiring lock "cinder-quobyte-d82c485d-b4e1-4586-886c-3265cde5f178" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:20:33 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-1d790cfd-8949-4cfc-9e1f-7ef93c235d2d tempest-ServersNegativeTestJSON-75309061 None] Lock "cinder-quobyte-d82c485d-b4e1-4586-886c-3265cde5f178" acquired by "delete_volume" :: waited 0.044s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:20:33 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[51a76ea0-20f3-4368-a66f-eea6095d55dd]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:20:33 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-1d790cfd-8949-4cfc-9e1f-7ef93c235d2d tempest-ServersNegativeTestJSON-75309061 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-d82c485d-b4e1-4586-886c-3265cde5f178 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:20:33 devstack sudo[97837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-d82c485d-b4e1-4586-886c-3265cde5f178 Jul 31 12:20:33 devstack sudo[97837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:20:34 devstack sudo[97837]: pam_unix(sudo:session): session closed for user root Jul 31 12:20:34 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-1d790cfd-8949-4cfc-9e1f-7ef93c235d2d tempest-ServersNegativeTestJSON-75309061 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-d82c485d-b4e1-4586-886c-3265cde5f178" returned: 0 in 0.545s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:20:34 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-1d790cfd-8949-4cfc-9e1f-7ef93c235d2d tempest-ServersNegativeTestJSON-75309061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-d82c485d-b4e1-4586-886c-3265cde5f178 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:20:34 devstack sudo[97843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-d82c485d-b4e1-4586-886c-3265cde5f178 Jul 31 12:20:34 devstack sudo[97843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:20:34 devstack sudo[97843]: pam_unix(sudo:session): session closed for user root Jul 31 12:20:34 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-1d790cfd-8949-4cfc-9e1f-7ef93c235d2d tempest-ServersNegativeTestJSON-75309061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-d82c485d-b4e1-4586-886c-3265cde5f178" returned: 0 in 0.337s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:20:34 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-1d790cfd-8949-4cfc-9e1f-7ef93c235d2d tempest-ServersNegativeTestJSON-75309061 None] Lock "cinder-quobyte-d82c485d-b4e1-4586-886c-3265cde5f178" released by "delete_volume" :: held 0.981s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:20:34 devstack cinder-volume[89182]: DEBUG cinder.quota [None req-1d790cfd-8949-4cfc-9e1f-7ef93c235d2d tempest-ServersNegativeTestJSON-75309061 None] Created reservations ['a2b31413-be10-44a5-9f48-f00c5296c13f', '7d43fd47-8ce6-4ee3-9ba9-be8e473fa3eb', 'e3b4a4ce-06f5-447d-ab78-89179f1d12f3', 'ed2ae940-6a6a-410c-9e69-a5c42e12e221'] {{(pid=89182) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 12:20:34 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-1d790cfd-8949-4cfc-9e1f-7ef93c235d2d tempest-ServersNegativeTestJSON-75309061 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:20:34 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-1d790cfd-8949-4cfc-9e1f-7ef93c235d2d tempest-ServersNegativeTestJSON-75309061 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:20:34 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-1d790cfd-8949-4cfc-9e1f-7ef93c235d2d tempest-ServersNegativeTestJSON-75309061 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:20:34 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-1d790cfd-8949-4cfc-9e1f-7ef93c235d2d tempest-ServersNegativeTestJSON-75309061 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:20:34 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-1d790cfd-8949-4cfc-9e1f-7ef93c235d2d tempest-ServersNegativeTestJSON-75309061 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:20:34 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-1d790cfd-8949-4cfc-9e1f-7ef93c235d2d tempest-ServersNegativeTestJSON-75309061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:20:34 devstack sudo[97849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 Jul 31 12:20:34 devstack sudo[97849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:20:35 devstack sudo[97849]: pam_unix(sudo:session): session closed for user root Jul 31 12:20:35 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-1d790cfd-8949-4cfc-9e1f-7ef93c235d2d tempest-ServersNegativeTestJSON-75309061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2" returned: 0 in 0.606s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:20:35 devstack cinder-volume[89182]: DEBUG cinder.manager [None req-1d790cfd-8949-4cfc-9e1f-7ef93c235d2d tempest-ServersNegativeTestJSON-75309061 None] Notifying Schedulers of capabilities ... {{(pid=89182) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 12:20:35 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-1d790cfd-8949-4cfc-9e1f-7ef93c235d2d tempest-ServersNegativeTestJSON-75309061 None] Deleted volume successfully. Jul 31 12:20:35 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-1d790cfd-8949-4cfc-9e1f-7ef93c235d2d tempest-ServersNegativeTestJSON-75309061 None] Lock "cinder-d82c485d-b4e1-4586-886c-3265cde5f178-delete_volume" released by "delete_volume" :: held 1.984s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:20:36 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [req-f7a6815b-98e3-4d4e-b6ef-6b64fd19497b req-419d4891-69d6-4d6d-a784-dcb50d35365a tempest-TestInstancesWithCinderVolumes-1834445134 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:20:36 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [req-f7a6815b-98e3-4d4e-b6ef-6b64fd19497b req-419d4891-69d6-4d6d-a784-dcb50d35365a tempest-TestInstancesWithCinderVolumes-1834445134 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:20:36 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [req-f7a6815b-98e3-4d4e-b6ef-6b64fd19497b req-419d4891-69d6-4d6d-a784-dcb50d35365a tempest-TestInstancesWithCinderVolumes-1834445134 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.036s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:20:36 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [req-f7a6815b-98e3-4d4e-b6ef-6b64fd19497b req-419d4891-69d6-4d6d-a784-dcb50d35365a tempest-TestInstancesWithCinderVolumes-1834445134 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88', 'name': 'volume-079a0a44-f6ba-4763-84ca-49bb8ed21014', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'fa47cb96-fdb9-4e8c-9536-0b2dac34afc1', 'enforce_multipath': True} {{(pid=89182) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 31 12:20:36 devstack cinder-volume[89182]: INFO cinder.volume.manager [req-83cfbbc3-a560-45df-88c4-80a334f520f1 req-fdaf066a-8f53-4900-8ca6-82fa45671e57 tempest-AttachVolumeTestJSON-657338358 None] Terminate volume connection completed successfully. Jul 31 12:20:36 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [req-83cfbbc3-a560-45df-88c4-80a334f520f1 req-fdaf066a-8f53-4900-8ca6-82fa45671e57 tempest-AttachVolumeTestJSON-657338358 None] Deleting attachment 15996cd5-f8c2-42c4-9787-581b4c398daa. {{(pid=89182) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 31 12:20:36 devstack cinder-volume[89182]: INFO cinder.volume.manager [req-f7a6815b-98e3-4d4e-b6ef-6b64fd19497b req-419d4891-69d6-4d6d-a784-dcb50d35365a tempest-TestInstancesWithCinderVolumes-1834445134 None] attachment_update completed successfully. Jul 31 12:20:46 devstack cinder-volume[89182]: DEBUG dbcounter [-] [89182] Writing DB stats cinder:SELECT=37,cinder:INSERT=16,cinder:UPDATE=52,cinder:DELETE=3 {{(pid=89182) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 12:20:46 devstack cinder-volume[89182]: DEBUG dbcounter [-] [89182] Writing DB stats cinder:SELECT=45,cinder:INSERT=14,cinder:UPDATE=47,cinder:DELETE=6 {{(pid=89182) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 12:21:02 devstack cinder-volume[89182]: DEBUG cinder.volume.flows.manager.create_volume [None req-f91e8ba4-fd84-4910-9cc7-44ed2cd07609 tempest-TestShelveInstance-1962959388 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89182) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 12:21:02 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-f91e8ba4-fd84-4910-9cc7-44ed2cd07609 tempest-TestShelveInstance-1962959388 None] Flow 'volume_create_manager' (6562551e-92c7-41f2-b359-6c7fc8f1fb2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:21:02 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-f91e8ba4-fd84-4910-9cc7-44ed2cd07609 tempest-TestShelveInstance-1962959388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e8a9751-f40a-453f-a2e1-8e558a413c8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:21:02 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-f91e8ba4-fd84-4910-9cc7-44ed2cd07609 tempest-TestShelveInstance-1962959388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e8a9751-f40a-453f-a2e1-8e558a413c8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:21:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1601117367',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91b2f55d-f57b-4e71-bf47-1e088bcc3501,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='628f1c3bc45b4058be91cdba4b562ec0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:21:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:21:03Z,use_quota=True,user_id='2c9c99ee58074928a36ffd53fbf68104',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:21:02 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-f91e8ba4-fd84-4910-9cc7-44ed2cd07609 tempest-TestShelveInstance-1962959388 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22b36906-a3eb-41e0-9fdf-dedeb2a06770) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:21:02 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-f91e8ba4-fd84-4910-9cc7-44ed2cd07609 tempest-TestShelveInstance-1962959388 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22b36906-a3eb-41e0-9fdf-dedeb2a06770) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:21:02 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-f91e8ba4-fd84-4910-9cc7-44ed2cd07609 tempest-TestShelveInstance-1962959388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (614eb601-6fe2-4185-88a3-3b4077709b68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:21:02 devstack cinder-volume[89182]: DEBUG cinder.image.glance [None req-f91e8ba4-fd84-4910-9cc7-44ed2cd07609 tempest-TestShelveInstance-1962959388 None] Creating Keystone auth plugin from conf {{(pid=89182) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 31 12:21:03 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-f91e8ba4-fd84-4910-9cc7-44ed2cd07609 tempest-TestShelveInstance-1962959388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (614eb601-6fe2-4185-88a3-3b4077709b68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '91b2f55d-f57b-4e71-bf47-1e088bcc3501', 'volume_name': 'volume-91b2f55d-f57b-4e71-bf47-1e088bcc3501', 'volume_size': 1, 'image_id': '4cbd0fd2-77a8-43ca-bc93-b0249d6daea0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4cbd0fd2-77a8-43ca-bc93-b0249d6daea0', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3f77cb0dad9a46948c9357c65b22aef5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4cbd0fd2-77a8-43ca-bc93-b0249d6daea0', 'created_at': datetime.datetime(2026, 7, 31, 10, 8, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 31, 10, 8, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4cbd0fd2-77a8-43ca-bc93-b0249d6daea0/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:21:03 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-f91e8ba4-fd84-4910-9cc7-44ed2cd07609 tempest-TestShelveInstance-1962959388 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a0b3f6c-87ec-4bf5-834a-ebf88ab6c8e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:21:03 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-f91e8ba4-fd84-4910-9cc7-44ed2cd07609 tempest-TestShelveInstance-1962959388 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a0b3f6c-87ec-4bf5-834a-ebf88ab6c8e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:21:03 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-f91e8ba4-fd84-4910-9cc7-44ed2cd07609 tempest-TestShelveInstance-1962959388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c2c2840-3f02-493b-aa9c-aede333f3f77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:21:03 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-f91e8ba4-fd84-4910-9cc7-44ed2cd07609 tempest-TestShelveInstance-1962959388 None] Volume 91b2f55d-f57b-4e71-bf47-1e088bcc3501: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-91b2f55d-f57b-4e71-bf47-1e088bcc3501', 'volume_size': 1, 'image_id': '4cbd0fd2-77a8-43ca-bc93-b0249d6daea0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4cbd0fd2-77a8-43ca-bc93-b0249d6daea0', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3f77cb0dad9a46948c9357c65b22aef5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4cbd0fd2-77a8-43ca-bc93-b0249d6daea0', 'created_at': datetime.datetime(2026, 7, 31, 10, 8, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 31, 10, 8, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4cbd0fd2-77a8-43ca-bc93-b0249d6daea0/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 31 12:21:03 devstack cinder-volume[89182]: DEBUG cinder.volume.flows.manager.create_volume [None req-f91e8ba4-fd84-4910-9cc7-44ed2cd07609 tempest-TestShelveInstance-1962959388 None] Trying to clone 91b2f55d-f57b-4e71-bf47-1e088bcc3501 from image 4cbd0fd2-77a8-43ca-bc93-b0249d6daea0 at location (None, [{'url': 'file:///opt/stack/data/glance/images/4cbd0fd2-77a8-43ca-bc93-b0249d6daea0', 'metadata': {}}]). {{(pid=89182) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 31 12:21:04 devstack cinder-volume[89182]: DEBUG cinder.image.image_utils [None req-f91e8ba4-fd84-4910-9cc7-44ed2cd07609 tempest-TestShelveInstance-1962959388 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_4cbd0fd2-77a8-43ca-bc93-b0249d6daea0_2hi4eqc4devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=89182) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 31 12:21:04 devstack cinder-volume[89182]: INFO cinder.image.image_utils [None req-f91e8ba4-fd84-4910-9cc7-44ed2cd07609 tempest-TestShelveInstance-1962959388 None] Image download 20.69 MB at 20.69 MB/s Jul 31 12:21:04 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc58a845-7d0b-4007-8fb0-74242c600be8]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:21:04 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-f91e8ba4-fd84-4910-9cc7-44ed2cd07609 tempest-TestShelveInstance-1962959388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4cbd0fd2-77a8-43ca-bc93-b0249d6daea0_2hi4eqc4devstack@QuobyteHD {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:21:04 devstack sudo[98524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4cbd0fd2-77a8-43ca-bc93-b0249d6daea0_2hi4eqc4devstack@QuobyteHD Jul 31 12:21:04 devstack sudo[98524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:21:05 devstack sudo[98524]: pam_unix(sudo:session): session closed for user root Jul 31 12:21:05 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-f91e8ba4-fd84-4910-9cc7-44ed2cd07609 tempest-TestShelveInstance-1962959388 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4cbd0fd2-77a8-43ca-bc93-b0249d6daea0_2hi4eqc4devstack@QuobyteHD" returned: 0 in 0.468s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:21:05 devstack cinder-volume[89182]: DEBUG cinder.image.image_utils [None req-f91e8ba4-fd84-4910-9cc7-44ed2cd07609 tempest-TestShelveInstance-1962959388 None] Temporary image 4cbd0fd2-77a8-43ca-bc93-b0249d6daea0 is fetched for user 2c9c99ee58074928a36ffd53fbf68104. {{(pid=89182) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 31 12:21:05 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bea3d5c-f5cd-40e2-bddc-10ee5ffaf547]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:21:05 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-f91e8ba4-fd84-4910-9cc7-44ed2cd07609 tempest-TestShelveInstance-1962959388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4cbd0fd2-77a8-43ca-bc93-b0249d6daea0_2hi4eqc4devstack@QuobyteHD {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:21:05 devstack sudo[98532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4cbd0fd2-77a8-43ca-bc93-b0249d6daea0_2hi4eqc4devstack@QuobyteHD Jul 31 12:21:05 devstack sudo[98532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:21:05 devstack sudo[98532]: pam_unix(sudo:session): session closed for user root Jul 31 12:21:05 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-f91e8ba4-fd84-4910-9cc7-44ed2cd07609 tempest-TestShelveInstance-1962959388 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4cbd0fd2-77a8-43ca-bc93-b0249d6daea0_2hi4eqc4devstack@QuobyteHD" returned: 0 in 0.520s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:21:05 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-f91e8ba4-fd84-4910-9cc7-44ed2cd07609 tempest-TestShelveInstance-1962959388 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:21:05 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-f91e8ba4-fd84-4910-9cc7-44ed2cd07609 tempest-TestShelveInstance-1962959388 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:21:05 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-f91e8ba4-fd84-4910-9cc7-44ed2cd07609 tempest-TestShelveInstance-1962959388 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:21:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1601117367',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91b2f55d-f57b-4e71-bf47-1e088bcc3501,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='628f1c3bc45b4058be91cdba4b562ec0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:21:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:21:03Z,use_quota=True,user_id='2c9c99ee58074928a36ffd53fbf68104',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)}" {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 12:21:05 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-f91e8ba4-fd84-4910-9cc7-44ed2cd07609 tempest-TestShelveInstance-1962959388 None] Creating volume 91b2f55d-f57b-4e71-bf47-1e088bcc3501 {{(pid=89182) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 12:21:05 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-f91e8ba4-fd84-4910-9cc7-44ed2cd07609 tempest-TestShelveInstance-1962959388 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:21:05 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-f91e8ba4-fd84-4910-9cc7-44ed2cd07609 tempest-TestShelveInstance-1962959388 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:21:05 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-f91e8ba4-fd84-4910-9cc7-44ed2cd07609 tempest-TestShelveInstance-1962959388 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:21:05 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-f91e8ba4-fd84-4910-9cc7-44ed2cd07609 tempest-TestShelveInstance-1962959388 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:21:05 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-f91e8ba4-fd84-4910-9cc7-44ed2cd07609 tempest-TestShelveInstance-1962959388 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:21:05 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-f91e8ba4-fd84-4910-9cc7-44ed2cd07609 tempest-TestShelveInstance-1962959388 None] Selected osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 as target Quobyte volume. {{(pid=89182) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 12:21:05 devstack cinder-volume[89182]: INFO cinder.volume.drivers.remotefs [None req-f91e8ba4-fd84-4910-9cc7-44ed2cd07609 tempest-TestShelveInstance-1962959388 None] casted to osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 Jul 31 12:21:05 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-f91e8ba4-fd84-4910-9cc7-44ed2cd07609 tempest-TestShelveInstance-1962959388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-91b2f55d-f57b-4e71-bf47-1e088bcc3501 1073741824 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:21:05 devstack sudo[98542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-91b2f55d-f57b-4e71-bf47-1e088bcc3501 1073741824 Jul 31 12:21:05 devstack sudo[98542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:21:06 devstack sudo[98542]: pam_unix(sudo:session): session closed for user root Jul 31 12:21:06 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-f91e8ba4-fd84-4910-9cc7-44ed2cd07609 tempest-TestShelveInstance-1962959388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-91b2f55d-f57b-4e71-bf47-1e088bcc3501 1073741824" returned: 0 in 0.822s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:21:06 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-f91e8ba4-fd84-4910-9cc7-44ed2cd07609 tempest-TestShelveInstance-1962959388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-91b2f55d-f57b-4e71-bf47-1e088bcc3501 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:21:06 devstack sudo[98557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-91b2f55d-f57b-4e71-bf47-1e088bcc3501 Jul 31 12:21:06 devstack sudo[98557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:21:07 devstack sudo[98557]: pam_unix(sudo:session): session closed for user root Jul 31 12:21:07 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-f91e8ba4-fd84-4910-9cc7-44ed2cd07609 tempest-TestShelveInstance-1962959388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-91b2f55d-f57b-4e71-bf47-1e088bcc3501" returned: 0 in 0.363s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:21:07 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-f91e8ba4-fd84-4910-9cc7-44ed2cd07609 tempest-TestShelveInstance-1962959388 None] <== create_volume: return (1276ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'} {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 12:21:07 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-f91e8ba4-fd84-4910-9cc7-44ed2cd07609 tempest-TestShelveInstance-1962959388 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.281s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:21:07 devstack cinder-volume[89182]: DEBUG cinder.volume.volume_utils [None req-f91e8ba4-fd84-4910-9cc7-44ed2cd07609 tempest-TestShelveInstance-1962959388 None] Attempting download of 4cbd0fd2-77a8-43ca-bc93-b0249d6daea0 ((None, [{'url': 'file:///opt/stack/data/glance/images/4cbd0fd2-77a8-43ca-bc93-b0249d6daea0', 'metadata': {}}])) to volume 91b2f55d-f57b-4e71-bf47-1e088bcc3501. {{(pid=89182) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 31 12:21:07 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa5277cc-5ced-4ac4-ac92-480a3d73b458]: (4, 'raw') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:21:07 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-f91e8ba4-fd84-4910-9cc7-44ed2cd07609 tempest-TestShelveInstance-1962959388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4cbd0fd2-77a8-43ca-bc93-b0249d6daea0_6f0l4tum {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:21:07 devstack sudo[98560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4cbd0fd2-77a8-43ca-bc93-b0249d6daea0_6f0l4tum Jul 31 12:21:07 devstack sudo[98560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:21:07 devstack sudo[98560]: pam_unix(sudo:session): session closed for user root Jul 31 12:21:07 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-f91e8ba4-fd84-4910-9cc7-44ed2cd07609 tempest-TestShelveInstance-1962959388 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4cbd0fd2-77a8-43ca-bc93-b0249d6daea0_6f0l4tum" returned: 0 in 0.360s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:21:07 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-f91e8ba4-fd84-4910-9cc7-44ed2cd07609 tempest-TestShelveInstance-1962959388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4cbd0fd2-77a8-43ca-bc93-b0249d6daea0_6f0l4tum {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:21:07 devstack sudo[98564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4cbd0fd2-77a8-43ca-bc93-b0249d6daea0_6f0l4tum Jul 31 12:21:07 devstack sudo[98564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:21:07 devstack sudo[98564]: pam_unix(sudo:session): session closed for user root Jul 31 12:21:07 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-f91e8ba4-fd84-4910-9cc7-44ed2cd07609 tempest-TestShelveInstance-1962959388 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4cbd0fd2-77a8-43ca-bc93-b0249d6daea0_6f0l4tum" returned: 1 in 0.347s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:21:07 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-f91e8ba4-fd84-4910-9cc7-44ed2cd07609 tempest-TestShelveInstance-1962959388 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4cbd0fd2-77a8-43ca-bc93-b0249d6daea0_6f0l4tum' failed. Not Retrying. {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 31 12:21:07 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a1fbf22-71e1-4234-8fc1-fc784c2562db]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:21:07 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-f91e8ba4-fd84-4910-9cc7-44ed2cd07609 tempest-TestShelveInstance-1962959388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4cbd0fd2-77a8-43ca-bc93-b0249d6daea0_2hi4eqc4devstack@QuobyteHD {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:21:08 devstack sudo[98568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4cbd0fd2-77a8-43ca-bc93-b0249d6daea0_2hi4eqc4devstack@QuobyteHD Jul 31 12:21:08 devstack sudo[98568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:21:08 devstack sudo[98568]: pam_unix(sudo:session): session closed for user root Jul 31 12:21:08 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-f91e8ba4-fd84-4910-9cc7-44ed2cd07609 tempest-TestShelveInstance-1962959388 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4cbd0fd2-77a8-43ca-bc93-b0249d6daea0_2hi4eqc4devstack@QuobyteHD" returned: 0 in 0.337s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:21:08 devstack cinder-volume[89182]: DEBUG cinder.image.image_utils [None req-f91e8ba4-fd84-4910-9cc7-44ed2cd07609 tempest-TestShelveInstance-1962959388 None] 4cbd0fd2-77a8-43ca-bc93-b0249d6daea0 was qcow2, converting to qcow2 {{(pid=89182) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 31 12:21:08 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-f91e8ba4-fd84-4910-9cc7-44ed2cd07609 tempest-TestShelveInstance-1962959388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4cbd0fd2-77a8-43ca-bc93-b0249d6daea0_2hi4eqc4devstack@QuobyteHD /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-91b2f55d-f57b-4e71-bf47-1e088bcc3501 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:21:08 devstack sudo[98573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4cbd0fd2-77a8-43ca-bc93-b0249d6daea0_2hi4eqc4devstack@QuobyteHD /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-91b2f55d-f57b-4e71-bf47-1e088bcc3501 Jul 31 12:21:08 devstack sudo[98573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:21:10 devstack sudo[98573]: pam_unix(sudo:session): session closed for user root Jul 31 12:21:10 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-f91e8ba4-fd84-4910-9cc7-44ed2cd07609 tempest-TestShelveInstance-1962959388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4cbd0fd2-77a8-43ca-bc93-b0249d6daea0_2hi4eqc4devstack@QuobyteHD /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-91b2f55d-f57b-4e71-bf47-1e088bcc3501" returned: 0 in 1.727s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:21:10 devstack cinder-volume[89182]: DEBUG cinder.image.image_utils [None req-f91e8ba4-fd84-4910-9cc7-44ed2cd07609 tempest-TestShelveInstance-1962959388 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_4cbd0fd2-77a8-43ca-bc93-b0249d6daea0_2hi4eqc4devstack@QuobyteHD, size 112.00 MB, duration 1.73 sec, destination /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-91b2f55d-f57b-4e71-bf47-1e088bcc3501 {{(pid=89182) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 31 12:21:10 devstack cinder-volume[89182]: INFO cinder.image.image_utils [None req-f91e8ba4-fd84-4910-9cc7-44ed2cd07609 tempest-TestShelveInstance-1962959388 None] Converted 112.00 MB image at 64.80 MB/s Jul 31 12:21:10 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-f91e8ba4-fd84-4910-9cc7-44ed2cd07609 tempest-TestShelveInstance-1962959388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-91b2f55d-f57b-4e71-bf47-1e088bcc3501 1G {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:21:10 devstack sudo[98581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-91b2f55d-f57b-4e71-bf47-1e088bcc3501 1G Jul 31 12:21:10 devstack sudo[98581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:21:10 devstack sudo[98581]: pam_unix(sudo:session): session closed for user root Jul 31 12:21:10 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-f91e8ba4-fd84-4910-9cc7-44ed2cd07609 tempest-TestShelveInstance-1962959388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-91b2f55d-f57b-4e71-bf47-1e088bcc3501 1G" returned: 0 in 0.455s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:21:10 devstack cinder-volume[89182]: DEBUG cinder.volume.volume_utils [None req-f91e8ba4-fd84-4910-9cc7-44ed2cd07609 tempest-TestShelveInstance-1962959388 None] Downloaded image 4cbd0fd2-77a8-43ca-bc93-b0249d6daea0 ((None, [{'url': 'file:///opt/stack/data/glance/images/4cbd0fd2-77a8-43ca-bc93-b0249d6daea0', 'metadata': {}}])) to volume 91b2f55d-f57b-4e71-bf47-1e088bcc3501 successfully. {{(pid=89182) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 31 12:21:10 devstack cinder-volume[89182]: DEBUG cinder.image.image_utils [None req-f91e8ba4-fd84-4910-9cc7-44ed2cd07609 tempest-TestShelveInstance-1962959388 None] Temporary image 4cbd0fd2-77a8-43ca-bc93-b0249d6daea0 for user 2c9c99ee58074928a36ffd53fbf68104 is deleted. {{(pid=89182) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 31 12:21:10 devstack cinder-volume[89182]: DEBUG cinder.volume.volume_utils [None req-f91e8ba4-fd84-4910-9cc7-44ed2cd07609 tempest-TestShelveInstance-1962959388 None] Marking volume 91b2f55d-f57b-4e71-bf47-1e088bcc3501 as bootable. {{(pid=89182) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 31 12:21:10 devstack cinder-volume[89182]: DEBUG cinder.volume.flows.manager.create_volume [None req-f91e8ba4-fd84-4910-9cc7-44ed2cd07609 tempest-TestShelveInstance-1962959388 None] Copying metadata from image 4cbd0fd2-77a8-43ca-bc93-b0249d6daea0 to 91b2f55d-f57b-4e71-bf47-1e088bcc3501. {{(pid=89182) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 31 12:21:10 devstack cinder-volume[89182]: DEBUG cinder.volume.flows.manager.create_volume [None req-f91e8ba4-fd84-4910-9cc7-44ed2cd07609 tempest-TestShelveInstance-1962959388 None] Creating volume glance metadata for volume 91b2f55d-f57b-4e71-bf47-1e088bcc3501 backed by image 4cbd0fd2-77a8-43ca-bc93-b0249d6daea0 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '4cbd0fd2-77a8-43ca-bc93-b0249d6daea0', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=89182) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 31 12:21:10 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-f91e8ba4-fd84-4910-9cc7-44ed2cd07609 tempest-TestShelveInstance-1962959388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c2c2840-3f02-493b-aa9c-aede333f3f77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-91b2f55d-f57b-4e71-bf47-1e088bcc3501', 'volume_size': 1, 'image_id': '4cbd0fd2-77a8-43ca-bc93-b0249d6daea0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4cbd0fd2-77a8-43ca-bc93-b0249d6daea0', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3f77cb0dad9a46948c9357c65b22aef5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4cbd0fd2-77a8-43ca-bc93-b0249d6daea0', 'created_at': datetime.datetime(2026, 7, 31, 10, 8, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 31, 10, 8, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4cbd0fd2-77a8-43ca-bc93-b0249d6daea0/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:21:10 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-f91e8ba4-fd84-4910-9cc7-44ed2cd07609 tempest-TestShelveInstance-1962959388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (825e6ccf-4a8d-44e9-9cc2-8d4b4a20a60d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:21:10 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-f91e8ba4-fd84-4910-9cc7-44ed2cd07609 tempest-TestShelveInstance-1962959388 None] Volume volume-91b2f55d-f57b-4e71-bf47-1e088bcc3501 (91b2f55d-f57b-4e71-bf47-1e088bcc3501): created successfully Jul 31 12:21:10 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-f91e8ba4-fd84-4910-9cc7-44ed2cd07609 tempest-TestShelveInstance-1962959388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (825e6ccf-4a8d-44e9-9cc2-8d4b4a20a60d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:21:10 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-f91e8ba4-fd84-4910-9cc7-44ed2cd07609 tempest-TestShelveInstance-1962959388 None] Flow 'volume_create_manager' (6562551e-92c7-41f2-b359-6c7fc8f1fb2d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:21:10 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-f91e8ba4-fd84-4910-9cc7-44ed2cd07609 tempest-TestShelveInstance-1962959388 None] Created volume successfully. Jul 31 12:21:15 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [req-18d7f85c-0015-47e7-8de0-ee6553808569 req-7358058a-4cb7-4208-9f4d-e0a364c1d6ad tempest-TestShelveInstance-1962959388 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:21:15 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [req-18d7f85c-0015-47e7-8de0-ee6553808569 req-7358058a-4cb7-4208-9f4d-e0a364c1d6ad tempest-TestShelveInstance-1962959388 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:21:15 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [req-18d7f85c-0015-47e7-8de0-ee6553808569 req-7358058a-4cb7-4208-9f4d-e0a364c1d6ad tempest-TestShelveInstance-1962959388 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.028s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:21:16 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [req-18d7f85c-0015-47e7-8de0-ee6553808569 req-7358058a-4cb7-4208-9f4d-e0a364c1d6ad tempest-TestShelveInstance-1962959388 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88', 'name': 'volume-91b2f55d-f57b-4e71-bf47-1e088bcc3501', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '309cb4ef-d99f-4fc4-883b-83f1f36aacda', 'enforce_multipath': True} {{(pid=89182) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 31 12:21:16 devstack cinder-volume[89182]: INFO cinder.volume.manager [req-18d7f85c-0015-47e7-8de0-ee6553808569 req-7358058a-4cb7-4208-9f4d-e0a364c1d6ad tempest-TestShelveInstance-1962959388 None] attachment_update completed successfully. Jul 31 12:21:18 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [req-a70d1989-9598-4828-8d89-e596bc3b983d req-5a02197b-2009-4a93-95c1-813df239c28d tempest-TestInstancesWithCinderVolumes-1834445134 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:21:18 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [req-a70d1989-9598-4828-8d89-e596bc3b983d req-5a02197b-2009-4a93-95c1-813df239c28d tempest-TestInstancesWithCinderVolumes-1834445134 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:21:18 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [req-a70d1989-9598-4828-8d89-e596bc3b983d req-5a02197b-2009-4a93-95c1-813df239c28d tempest-TestInstancesWithCinderVolumes-1834445134 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:21:18 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [req-a70d1989-9598-4828-8d89-e596bc3b983d req-5a02197b-2009-4a93-95c1-813df239c28d tempest-TestInstancesWithCinderVolumes-1834445134 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88', 'name': 'volume-3f347f21-66c9-4df1-a98b-8199b5933ef9', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '542b52bd-df88-4cf6-bf0d-80ece342948f', 'enforce_multipath': True} {{(pid=89182) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 31 12:21:18 devstack cinder-volume[89182]: INFO cinder.volume.manager [req-a70d1989-9598-4828-8d89-e596bc3b983d req-5a02197b-2009-4a93-95c1-813df239c28d tempest-TestInstancesWithCinderVolumes-1834445134 None] attachment_update completed successfully. Jul 31 12:21:21 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [req-48793494-a2bb-4853-8c97-696326920e30 req-91c1cc4b-ef03-4936-926d-34f30321e4c7 tempest-TestInstancesWithCinderVolumes-1834445134 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:21:21 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [req-48793494-a2bb-4853-8c97-696326920e30 req-91c1cc4b-ef03-4936-926d-34f30321e4c7 tempest-TestInstancesWithCinderVolumes-1834445134 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:21:21 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [req-48793494-a2bb-4853-8c97-696326920e30 req-91c1cc4b-ef03-4936-926d-34f30321e4c7 tempest-TestInstancesWithCinderVolumes-1834445134 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.021s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:21:21 devstack cinder-volume[89182]: DEBUG oslo_service.periodic_task [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89182) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 31 12:21:21 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:21:21 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:21:21 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:21:21 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:21:21 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:21:21 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:21:21 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [req-48793494-a2bb-4853-8c97-696326920e30 req-91c1cc4b-ef03-4936-926d-34f30321e4c7 tempest-TestInstancesWithCinderVolumes-1834445134 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88', 'name': 'volume-178a700e-e9e9-4154-a41e-e391c35c50f2', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ada81848-ae35-4857-b084-481f70e915af', 'enforce_multipath': True} {{(pid=89182) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 31 12:21:21 devstack sudo[98751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 Jul 31 12:21:21 devstack sudo[98751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:21:22 devstack cinder-volume[89182]: INFO cinder.volume.manager [req-48793494-a2bb-4853-8c97-696326920e30 req-91c1cc4b-ef03-4936-926d-34f30321e4c7 tempest-TestInstancesWithCinderVolumes-1834445134 None] attachment_update completed successfully. Jul 31 12:21:22 devstack sudo[98751]: pam_unix(sudo:session): session closed for user root Jul 31 12:21:22 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2" returned: 0 in 0.414s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:21:22 devstack cinder-volume[89182]: DEBUG cinder.manager [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] Notifying Schedulers of capabilities ... {{(pid=89182) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 12:21:22 devstack cinder-volume[89182]: DEBUG oslo_service.periodic_task [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] Running periodic task VolumeManager._thread_info {{(pid=89182) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 31 12:21:22 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] thread count: 28 {{(pid=89182) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 31 12:21:22 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] thread info: [<_MainThread(MainThread, started 136154603720832)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=89182) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 31 12:21:31 devstack cinder-volume[89182]: INFO cinder.volume.manager [req-cae6d512-3d37-429c-8779-478772c9e4ba req-15228d66-058b-4932-b8f5-2f0c2a9f70c5 tempest-TestInstancesWithCinderVolumes-1834445134 None] Terminate volume connection completed successfully. Jul 31 12:21:31 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [req-cae6d512-3d37-429c-8779-478772c9e4ba req-15228d66-058b-4932-b8f5-2f0c2a9f70c5 tempest-TestInstancesWithCinderVolumes-1834445134 None] Deleting attachment 542b52bd-df88-4cf6-bf0d-80ece342948f. {{(pid=89182) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 31 12:21:33 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-752ba79a-b19d-4a5a-a2bf-96e52d02290b tempest-TestInstancesWithCinderVolumes-1834445134 None] Acquiring lock "cinder-3f347f21-66c9-4df1-a98b-8199b5933ef9-delete_volume" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:21:33 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-752ba79a-b19d-4a5a-a2bf-96e52d02290b tempest-TestInstancesWithCinderVolumes-1834445134 None] Lock "cinder-3f347f21-66c9-4df1-a98b-8199b5933ef9-delete_volume" acquired by "delete_volume" :: waited 0.085s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:21:33 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-752ba79a-b19d-4a5a-a2bf-96e52d02290b tempest-TestInstancesWithCinderVolumes-1834445134 None] Acquiring lock "cinder-quobyte-3f347f21-66c9-4df1-a98b-8199b5933ef9" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:21:33 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-752ba79a-b19d-4a5a-a2bf-96e52d02290b tempest-TestInstancesWithCinderVolumes-1834445134 None] Lock "cinder-quobyte-3f347f21-66c9-4df1-a98b-8199b5933ef9" acquired by "delete_volume" :: waited 0.068s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:21:33 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ab56c5b-fbf3-432a-b814-9cfe30af5b63]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:21:33 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-752ba79a-b19d-4a5a-a2bf-96e52d02290b tempest-TestInstancesWithCinderVolumes-1834445134 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-3f347f21-66c9-4df1-a98b-8199b5933ef9 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:21:33 devstack sudo[98942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-3f347f21-66c9-4df1-a98b-8199b5933ef9 Jul 31 12:21:33 devstack sudo[98942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:21:34 devstack sudo[98942]: pam_unix(sudo:session): session closed for user root Jul 31 12:21:34 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-752ba79a-b19d-4a5a-a2bf-96e52d02290b tempest-TestInstancesWithCinderVolumes-1834445134 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-3f347f21-66c9-4df1-a98b-8199b5933ef9" returned: 0 in 0.650s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:21:34 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-752ba79a-b19d-4a5a-a2bf-96e52d02290b tempest-TestInstancesWithCinderVolumes-1834445134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-3f347f21-66c9-4df1-a98b-8199b5933ef9 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:21:34 devstack sudo[98963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-3f347f21-66c9-4df1-a98b-8199b5933ef9 Jul 31 12:21:34 devstack sudo[98963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:21:34 devstack sudo[98963]: pam_unix(sudo:session): session closed for user root Jul 31 12:21:34 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-752ba79a-b19d-4a5a-a2bf-96e52d02290b tempest-TestInstancesWithCinderVolumes-1834445134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-3f347f21-66c9-4df1-a98b-8199b5933ef9" returned: 0 in 0.519s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:21:34 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-752ba79a-b19d-4a5a-a2bf-96e52d02290b tempest-TestInstancesWithCinderVolumes-1834445134 None] Lock "cinder-quobyte-3f347f21-66c9-4df1-a98b-8199b5933ef9" released by "delete_volume" :: held 1.266s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:21:34 devstack cinder-volume[89182]: WARNING cinder.quota [None req-752ba79a-b19d-4a5a-a2bf-96e52d02290b tempest-TestInstancesWithCinderVolumes-1834445134 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2038177663-921384550 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2038177663-921384550, it is now deprecated. Please use the default quota class for default quota. Jul 31 12:21:34 devstack cinder-volume[89182]: WARNING cinder.quota [None req-752ba79a-b19d-4a5a-a2bf-96e52d02290b tempest-TestInstancesWithCinderVolumes-1834445134 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2038177663-921384550 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2038177663-921384550, it is now deprecated. Please use the default quota class for default quota. Jul 31 12:21:35 devstack cinder-volume[89182]: DEBUG cinder.quota [None req-752ba79a-b19d-4a5a-a2bf-96e52d02290b tempest-TestInstancesWithCinderVolumes-1834445134 None] Created reservations ['488177ec-7c12-4a77-ac1c-a9f7dbd1452b', 'ca01c736-4171-41e7-b2b1-a44576e4859e', '032c1f73-8e80-454d-8fab-2b979d3c97a3', '2cc7cda6-be32-457b-aeec-3c0680887e36'] {{(pid=89182) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 12:21:35 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-752ba79a-b19d-4a5a-a2bf-96e52d02290b tempest-TestInstancesWithCinderVolumes-1834445134 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:21:35 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-752ba79a-b19d-4a5a-a2bf-96e52d02290b tempest-TestInstancesWithCinderVolumes-1834445134 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:21:35 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-752ba79a-b19d-4a5a-a2bf-96e52d02290b tempest-TestInstancesWithCinderVolumes-1834445134 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:21:35 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-752ba79a-b19d-4a5a-a2bf-96e52d02290b tempest-TestInstancesWithCinderVolumes-1834445134 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:21:35 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-752ba79a-b19d-4a5a-a2bf-96e52d02290b tempest-TestInstancesWithCinderVolumes-1834445134 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:21:35 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-752ba79a-b19d-4a5a-a2bf-96e52d02290b tempest-TestInstancesWithCinderVolumes-1834445134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:21:35 devstack sudo[98970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 Jul 31 12:21:35 devstack sudo[98970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:21:36 devstack sudo[98970]: pam_unix(sudo:session): session closed for user root Jul 31 12:21:36 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-752ba79a-b19d-4a5a-a2bf-96e52d02290b tempest-TestInstancesWithCinderVolumes-1834445134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2" returned: 0 in 0.811s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:21:36 devstack cinder-volume[89182]: DEBUG cinder.manager [None req-752ba79a-b19d-4a5a-a2bf-96e52d02290b tempest-TestInstancesWithCinderVolumes-1834445134 None] Notifying Schedulers of capabilities ... {{(pid=89182) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 12:21:36 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-752ba79a-b19d-4a5a-a2bf-96e52d02290b tempest-TestInstancesWithCinderVolumes-1834445134 None] Deleted volume successfully. Jul 31 12:21:36 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-752ba79a-b19d-4a5a-a2bf-96e52d02290b tempest-TestInstancesWithCinderVolumes-1834445134 None] Lock "cinder-3f347f21-66c9-4df1-a98b-8199b5933ef9-delete_volume" released by "delete_volume" :: held 2.965s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:21:41 devstack cinder-volume[89182]: INFO cinder.volume.manager [req-cdd5d3ed-068b-458a-bf47-873ee4feb869 req-624e31ac-c403-40bc-83f6-fecf2d182684 tempest-TestInstancesWithCinderVolumes-1834445134 None] Terminate volume connection completed successfully. Jul 31 12:21:41 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [req-cdd5d3ed-068b-458a-bf47-873ee4feb869 req-624e31ac-c403-40bc-83f6-fecf2d182684 tempest-TestInstancesWithCinderVolumes-1834445134 None] Deleting attachment ada81848-ae35-4857-b084-481f70e915af. {{(pid=89182) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 31 12:21:42 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-72cc5bc9-0225-4fc7-bfb8-1fb5f9dbf32a tempest-TestInstancesWithCinderVolumes-1834445134 None] Acquiring lock "cinder-178a700e-e9e9-4154-a41e-e391c35c50f2-delete_volume" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:21:42 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-72cc5bc9-0225-4fc7-bfb8-1fb5f9dbf32a tempest-TestInstancesWithCinderVolumes-1834445134 None] Lock "cinder-178a700e-e9e9-4154-a41e-e391c35c50f2-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:21:42 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-72cc5bc9-0225-4fc7-bfb8-1fb5f9dbf32a tempest-TestInstancesWithCinderVolumes-1834445134 None] Acquiring lock "cinder-quobyte-178a700e-e9e9-4154-a41e-e391c35c50f2" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:21:42 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-72cc5bc9-0225-4fc7-bfb8-1fb5f9dbf32a tempest-TestInstancesWithCinderVolumes-1834445134 None] Lock "cinder-quobyte-178a700e-e9e9-4154-a41e-e391c35c50f2" acquired by "delete_volume" :: waited 0.071s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:21:42 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[129e8d8c-0c23-4b27-81b9-38a1394cdad9]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:21:42 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-72cc5bc9-0225-4fc7-bfb8-1fb5f9dbf32a tempest-TestInstancesWithCinderVolumes-1834445134 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-178a700e-e9e9-4154-a41e-e391c35c50f2 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:21:43 devstack sudo[99086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-178a700e-e9e9-4154-a41e-e391c35c50f2 Jul 31 12:21:43 devstack sudo[99086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:21:43 devstack sudo[99086]: pam_unix(sudo:session): session closed for user root Jul 31 12:21:43 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-72cc5bc9-0225-4fc7-bfb8-1fb5f9dbf32a tempest-TestInstancesWithCinderVolumes-1834445134 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-178a700e-e9e9-4154-a41e-e391c35c50f2" returned: 0 in 0.782s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:21:43 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-72cc5bc9-0225-4fc7-bfb8-1fb5f9dbf32a tempest-TestInstancesWithCinderVolumes-1834445134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-178a700e-e9e9-4154-a41e-e391c35c50f2 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:21:43 devstack sudo[99109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-178a700e-e9e9-4154-a41e-e391c35c50f2 Jul 31 12:21:43 devstack sudo[99109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:21:44 devstack sudo[99109]: pam_unix(sudo:session): session closed for user root Jul 31 12:21:44 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-72cc5bc9-0225-4fc7-bfb8-1fb5f9dbf32a tempest-TestInstancesWithCinderVolumes-1834445134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-178a700e-e9e9-4154-a41e-e391c35c50f2" returned: 0 in 0.710s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:21:44 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-72cc5bc9-0225-4fc7-bfb8-1fb5f9dbf32a tempest-TestInstancesWithCinderVolumes-1834445134 None] Lock "cinder-quobyte-178a700e-e9e9-4154-a41e-e391c35c50f2" released by "delete_volume" :: held 1.652s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:21:44 devstack cinder-volume[89182]: WARNING cinder.quota [None req-72cc5bc9-0225-4fc7-bfb8-1fb5f9dbf32a tempest-TestInstancesWithCinderVolumes-1834445134 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-724979801-1346450868 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-724979801-1346450868, it is now deprecated. Please use the default quota class for default quota. Jul 31 12:21:44 devstack cinder-volume[89182]: WARNING cinder.quota [None req-72cc5bc9-0225-4fc7-bfb8-1fb5f9dbf32a tempest-TestInstancesWithCinderVolumes-1834445134 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-724979801-1346450868 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-724979801-1346450868, it is now deprecated. Please use the default quota class for default quota. Jul 31 12:21:44 devstack cinder-volume[89182]: DEBUG cinder.quota [None req-72cc5bc9-0225-4fc7-bfb8-1fb5f9dbf32a tempest-TestInstancesWithCinderVolumes-1834445134 None] Created reservations ['231a950c-e6ab-4398-b16c-2889a1c9d8d0', 'd07688e1-ba02-4d1a-a32d-c04d8b8a4c58', '5c449d11-a35b-434b-a750-a2b506975cb9', 'fbc0b833-8319-42a4-a640-8f1cc2d04ea4'] {{(pid=89182) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 12:21:44 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-72cc5bc9-0225-4fc7-bfb8-1fb5f9dbf32a tempest-TestInstancesWithCinderVolumes-1834445134 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:21:44 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-72cc5bc9-0225-4fc7-bfb8-1fb5f9dbf32a tempest-TestInstancesWithCinderVolumes-1834445134 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:21:44 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-72cc5bc9-0225-4fc7-bfb8-1fb5f9dbf32a tempest-TestInstancesWithCinderVolumes-1834445134 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:21:44 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-72cc5bc9-0225-4fc7-bfb8-1fb5f9dbf32a tempest-TestInstancesWithCinderVolumes-1834445134 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:21:44 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-72cc5bc9-0225-4fc7-bfb8-1fb5f9dbf32a tempest-TestInstancesWithCinderVolumes-1834445134 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:21:44 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-72cc5bc9-0225-4fc7-bfb8-1fb5f9dbf32a tempest-TestInstancesWithCinderVolumes-1834445134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:21:44 devstack sudo[99113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 Jul 31 12:21:44 devstack sudo[99113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:21:45 devstack sudo[99113]: pam_unix(sudo:session): session closed for user root Jul 31 12:21:45 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-72cc5bc9-0225-4fc7-bfb8-1fb5f9dbf32a tempest-TestInstancesWithCinderVolumes-1834445134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2" returned: 0 in 0.592s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:21:45 devstack cinder-volume[89182]: DEBUG cinder.manager [None req-72cc5bc9-0225-4fc7-bfb8-1fb5f9dbf32a tempest-TestInstancesWithCinderVolumes-1834445134 None] Notifying Schedulers of capabilities ... {{(pid=89182) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 12:21:45 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-72cc5bc9-0225-4fc7-bfb8-1fb5f9dbf32a tempest-TestInstancesWithCinderVolumes-1834445134 None] Deleted volume successfully. Jul 31 12:21:45 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-72cc5bc9-0225-4fc7-bfb8-1fb5f9dbf32a tempest-TestInstancesWithCinderVolumes-1834445134 None] Lock "cinder-178a700e-e9e9-4154-a41e-e391c35c50f2-delete_volume" released by "delete_volume" :: held 2.840s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:21:50 devstack cinder-volume[89182]: INFO cinder.volume.manager [req-31b558c9-12c3-45f7-a09a-a8773e2c1824 req-a97cce5f-196a-43bf-a67d-d1bf39f0cd41 tempest-TestInstancesWithCinderVolumes-1834445134 None] Terminate volume connection completed successfully. Jul 31 12:21:50 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [req-31b558c9-12c3-45f7-a09a-a8773e2c1824 req-a97cce5f-196a-43bf-a67d-d1bf39f0cd41 tempest-TestInstancesWithCinderVolumes-1834445134 None] Deleting attachment fa47cb96-fdb9-4e8c-9536-0b2dac34afc1. {{(pid=89182) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 31 12:21:51 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-3b5cda40-dd11-41a6-89ca-11d0456211f1 tempest-TestInstancesWithCinderVolumes-1834445134 None] Acquiring lock "cinder-079a0a44-f6ba-4763-84ca-49bb8ed21014-delete_volume" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:21:51 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-3b5cda40-dd11-41a6-89ca-11d0456211f1 tempest-TestInstancesWithCinderVolumes-1834445134 None] Lock "cinder-079a0a44-f6ba-4763-84ca-49bb8ed21014-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:21:51 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-3b5cda40-dd11-41a6-89ca-11d0456211f1 tempest-TestInstancesWithCinderVolumes-1834445134 None] Acquiring lock "cinder-quobyte-079a0a44-f6ba-4763-84ca-49bb8ed21014" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:21:51 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-3b5cda40-dd11-41a6-89ca-11d0456211f1 tempest-TestInstancesWithCinderVolumes-1834445134 None] Lock "cinder-quobyte-079a0a44-f6ba-4763-84ca-49bb8ed21014" acquired by "delete_volume" :: waited 0.015s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:21:52 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[749449ee-9cfc-4bb7-af2e-82f1a841a2c8]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:21:52 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-3b5cda40-dd11-41a6-89ca-11d0456211f1 tempest-TestInstancesWithCinderVolumes-1834445134 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-079a0a44-f6ba-4763-84ca-49bb8ed21014 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:21:52 devstack sudo[99187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-079a0a44-f6ba-4763-84ca-49bb8ed21014 Jul 31 12:21:52 devstack sudo[99187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:21:52 devstack sudo[99187]: pam_unix(sudo:session): session closed for user root Jul 31 12:21:52 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-3b5cda40-dd11-41a6-89ca-11d0456211f1 tempest-TestInstancesWithCinderVolumes-1834445134 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-079a0a44-f6ba-4763-84ca-49bb8ed21014" returned: 0 in 0.416s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:21:52 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-3b5cda40-dd11-41a6-89ca-11d0456211f1 tempest-TestInstancesWithCinderVolumes-1834445134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-079a0a44-f6ba-4763-84ca-49bb8ed21014 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:21:52 devstack sudo[99192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-079a0a44-f6ba-4763-84ca-49bb8ed21014 Jul 31 12:21:52 devstack sudo[99192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:21:52 devstack sudo[99192]: pam_unix(sudo:session): session closed for user root Jul 31 12:21:52 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-3b5cda40-dd11-41a6-89ca-11d0456211f1 tempest-TestInstancesWithCinderVolumes-1834445134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-079a0a44-f6ba-4763-84ca-49bb8ed21014" returned: 0 in 0.274s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:21:52 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-3b5cda40-dd11-41a6-89ca-11d0456211f1 tempest-TestInstancesWithCinderVolumes-1834445134 None] Lock "cinder-quobyte-079a0a44-f6ba-4763-84ca-49bb8ed21014" released by "delete_volume" :: held 0.737s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:21:52 devstack cinder-volume[89182]: WARNING cinder.quota [None req-3b5cda40-dd11-41a6-89ca-11d0456211f1 tempest-TestInstancesWithCinderVolumes-1834445134 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-807497357-2116459632 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-807497357-2116459632, it is now deprecated. Please use the default quota class for default quota. Jul 31 12:21:52 devstack cinder-volume[89182]: WARNING cinder.quota [None req-3b5cda40-dd11-41a6-89ca-11d0456211f1 tempest-TestInstancesWithCinderVolumes-1834445134 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-807497357-2116459632 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-807497357-2116459632, it is now deprecated. Please use the default quota class for default quota. Jul 31 12:21:52 devstack cinder-volume[89182]: DEBUG cinder.quota [None req-3b5cda40-dd11-41a6-89ca-11d0456211f1 tempest-TestInstancesWithCinderVolumes-1834445134 None] Created reservations ['481faec1-904a-46c3-8b96-bf1e4400c6c4', '35e86d37-668f-4139-bab1-9bd3625452ef', 'b525d690-c92d-441e-949c-8f7a6cd9a99a', '4f5019eb-14f1-4eee-a3da-5cf0f80510c5'] {{(pid=89182) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 12:21:52 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-3b5cda40-dd11-41a6-89ca-11d0456211f1 tempest-TestInstancesWithCinderVolumes-1834445134 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:21:52 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-3b5cda40-dd11-41a6-89ca-11d0456211f1 tempest-TestInstancesWithCinderVolumes-1834445134 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:21:52 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-3b5cda40-dd11-41a6-89ca-11d0456211f1 tempest-TestInstancesWithCinderVolumes-1834445134 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:21:52 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-3b5cda40-dd11-41a6-89ca-11d0456211f1 tempest-TestInstancesWithCinderVolumes-1834445134 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:21:52 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-3b5cda40-dd11-41a6-89ca-11d0456211f1 tempest-TestInstancesWithCinderVolumes-1834445134 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:21:52 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-3b5cda40-dd11-41a6-89ca-11d0456211f1 tempest-TestInstancesWithCinderVolumes-1834445134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:21:52 devstack sudo[99195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 Jul 31 12:21:52 devstack sudo[99195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:21:53 devstack sudo[99195]: pam_unix(sudo:session): session closed for user root Jul 31 12:21:53 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-3b5cda40-dd11-41a6-89ca-11d0456211f1 tempest-TestInstancesWithCinderVolumes-1834445134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2" returned: 0 in 0.284s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:21:53 devstack cinder-volume[89182]: DEBUG cinder.manager [None req-3b5cda40-dd11-41a6-89ca-11d0456211f1 tempest-TestInstancesWithCinderVolumes-1834445134 None] Notifying Schedulers of capabilities ... {{(pid=89182) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 12:21:53 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-3b5cda40-dd11-41a6-89ca-11d0456211f1 tempest-TestInstancesWithCinderVolumes-1834445134 None] Deleted volume successfully. Jul 31 12:21:53 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-3b5cda40-dd11-41a6-89ca-11d0456211f1 tempest-TestInstancesWithCinderVolumes-1834445134 None] Lock "cinder-079a0a44-f6ba-4763-84ca-49bb8ed21014-delete_volume" released by "delete_volume" :: held 1.263s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:21:59 devstack cinder-volume[89182]: DEBUG dbcounter [-] [89182] Writing DB stats cinder:UPDATE=34,cinder:SELECT=44,cinder:INSERT=15,cinder:DELETE=1 {{(pid=89182) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 12:21:59 devstack cinder-volume[89182]: DEBUG dbcounter [-] [89182] Writing DB stats cinder:SELECT=52,cinder:UPDATE=34,cinder:INSERT=11,cinder:DELETE=3 {{(pid=89182) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 12:21:59 devstack cinder-volume[89182]: DEBUG cinder.volume.flows.manager.create_volume [None req-446612ee-9126-436d-b34e-f151b5921b20 tempest-AttachVolumeNegativeTest-1979015609 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89182) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 12:21:59 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-446612ee-9126-436d-b34e-f151b5921b20 tempest-AttachVolumeNegativeTest-1979015609 None] Flow 'volume_create_manager' (df8c7cdc-a356-4304-8438-3084cc58415a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:21:59 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-446612ee-9126-436d-b34e-f151b5921b20 tempest-AttachVolumeNegativeTest-1979015609 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (611df872-23c2-48f9-8187-f883001fe261) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:22:00 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-446612ee-9126-436d-b34e-f151b5921b20 tempest-AttachVolumeNegativeTest-1979015609 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (611df872-23c2-48f9-8187-f883001fe261) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:22:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-349238208',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91f3108b-2aea-4ab2-a662-f0f35c13f19d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9581615e2dc443ea56b640260015955',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:22:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:22:00Z,use_quota=True,user_id='1b0f4502906f47628207383e0140cd35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:22:00 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-446612ee-9126-436d-b34e-f151b5921b20 tempest-AttachVolumeNegativeTest-1979015609 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ea4824d-25e2-4cd5-9f7b-1e5e0e148950) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:22:00 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-446612ee-9126-436d-b34e-f151b5921b20 tempest-AttachVolumeNegativeTest-1979015609 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ea4824d-25e2-4cd5-9f7b-1e5e0e148950) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:22:00 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-446612ee-9126-436d-b34e-f151b5921b20 tempest-AttachVolumeNegativeTest-1979015609 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a17eccd3-fbfe-4989-894b-8842fc173989) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:22:00 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-446612ee-9126-436d-b34e-f151b5921b20 tempest-AttachVolumeNegativeTest-1979015609 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a17eccd3-fbfe-4989-894b-8842fc173989) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '91f3108b-2aea-4ab2-a662-f0f35c13f19d', 'volume_name': 'volume-91f3108b-2aea-4ab2-a662-f0f35c13f19d', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:22:00 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-446612ee-9126-436d-b34e-f151b5921b20 tempest-AttachVolumeNegativeTest-1979015609 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25ebbc81-2c7f-47d0-9b96-b0d557af1a0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:22:00 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-446612ee-9126-436d-b34e-f151b5921b20 tempest-AttachVolumeNegativeTest-1979015609 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25ebbc81-2c7f-47d0-9b96-b0d557af1a0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:22:00 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-446612ee-9126-436d-b34e-f151b5921b20 tempest-AttachVolumeNegativeTest-1979015609 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (883439d6-f20c-4c29-b44f-607eca227c67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:22:00 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-446612ee-9126-436d-b34e-f151b5921b20 tempest-AttachVolumeNegativeTest-1979015609 None] Volume 91f3108b-2aea-4ab2-a662-f0f35c13f19d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-91f3108b-2aea-4ab2-a662-f0f35c13f19d', 'volume_size': 1} Jul 31 12:22:00 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-446612ee-9126-436d-b34e-f151b5921b20 tempest-AttachVolumeNegativeTest-1979015609 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:22:00 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-446612ee-9126-436d-b34e-f151b5921b20 tempest-AttachVolumeNegativeTest-1979015609 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:22:00 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-446612ee-9126-436d-b34e-f151b5921b20 tempest-AttachVolumeNegativeTest-1979015609 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:22:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-349238208',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91f3108b-2aea-4ab2-a662-f0f35c13f19d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9581615e2dc443ea56b640260015955',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:22:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:22:00Z,use_quota=True,user_id='1b0f4502906f47628207383e0140cd35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)}" {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 12:22:00 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-446612ee-9126-436d-b34e-f151b5921b20 tempest-AttachVolumeNegativeTest-1979015609 None] Creating volume 91f3108b-2aea-4ab2-a662-f0f35c13f19d {{(pid=89182) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 12:22:00 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-446612ee-9126-436d-b34e-f151b5921b20 tempest-AttachVolumeNegativeTest-1979015609 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:22:00 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-446612ee-9126-436d-b34e-f151b5921b20 tempest-AttachVolumeNegativeTest-1979015609 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:22:00 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-446612ee-9126-436d-b34e-f151b5921b20 tempest-AttachVolumeNegativeTest-1979015609 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:22:00 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-446612ee-9126-436d-b34e-f151b5921b20 tempest-AttachVolumeNegativeTest-1979015609 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:22:00 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-446612ee-9126-436d-b34e-f151b5921b20 tempest-AttachVolumeNegativeTest-1979015609 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:22:00 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-446612ee-9126-436d-b34e-f151b5921b20 tempest-AttachVolumeNegativeTest-1979015609 None] Selected osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 as target Quobyte volume. {{(pid=89182) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 12:22:00 devstack cinder-volume[89182]: INFO cinder.volume.drivers.remotefs [None req-446612ee-9126-436d-b34e-f151b5921b20 tempest-AttachVolumeNegativeTest-1979015609 None] casted to osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 Jul 31 12:22:00 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-446612ee-9126-436d-b34e-f151b5921b20 tempest-AttachVolumeNegativeTest-1979015609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-91f3108b-2aea-4ab2-a662-f0f35c13f19d 1073741824 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:22:00 devstack sudo[99235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-91f3108b-2aea-4ab2-a662-f0f35c13f19d 1073741824 Jul 31 12:22:00 devstack sudo[99235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:22:00 devstack sudo[99235]: pam_unix(sudo:session): session closed for user root Jul 31 12:22:00 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-446612ee-9126-436d-b34e-f151b5921b20 tempest-AttachVolumeNegativeTest-1979015609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-91f3108b-2aea-4ab2-a662-f0f35c13f19d 1073741824" returned: 0 in 0.554s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:22:00 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-446612ee-9126-436d-b34e-f151b5921b20 tempest-AttachVolumeNegativeTest-1979015609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-91f3108b-2aea-4ab2-a662-f0f35c13f19d {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:22:00 devstack sudo[99241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-91f3108b-2aea-4ab2-a662-f0f35c13f19d Jul 31 12:22:00 devstack sudo[99241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:22:00 devstack sudo[99241]: pam_unix(sudo:session): session closed for user root Jul 31 12:22:00 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-446612ee-9126-436d-b34e-f151b5921b20 tempest-AttachVolumeNegativeTest-1979015609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-91f3108b-2aea-4ab2-a662-f0f35c13f19d" returned: 0 in 0.269s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:22:00 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-446612ee-9126-436d-b34e-f151b5921b20 tempest-AttachVolumeNegativeTest-1979015609 None] <== create_volume: return (874ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'} {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 12:22:00 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-446612ee-9126-436d-b34e-f151b5921b20 tempest-AttachVolumeNegativeTest-1979015609 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.879s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:22:00 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-446612ee-9126-436d-b34e-f151b5921b20 tempest-AttachVolumeNegativeTest-1979015609 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (883439d6-f20c-4c29-b44f-607eca227c67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-91f3108b-2aea-4ab2-a662-f0f35c13f19d', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:22:00 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-446612ee-9126-436d-b34e-f151b5921b20 tempest-AttachVolumeNegativeTest-1979015609 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b5adf0b-6057-4053-88e6-b0508be485cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:22:00 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-446612ee-9126-436d-b34e-f151b5921b20 tempest-AttachVolumeNegativeTest-1979015609 None] Volume volume-91f3108b-2aea-4ab2-a662-f0f35c13f19d (91f3108b-2aea-4ab2-a662-f0f35c13f19d): created successfully Jul 31 12:22:00 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-446612ee-9126-436d-b34e-f151b5921b20 tempest-AttachVolumeNegativeTest-1979015609 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b5adf0b-6057-4053-88e6-b0508be485cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:22:00 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-446612ee-9126-436d-b34e-f151b5921b20 tempest-AttachVolumeNegativeTest-1979015609 None] Flow 'volume_create_manager' (df8c7cdc-a356-4304-8438-3084cc58415a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:22:00 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-446612ee-9126-436d-b34e-f151b5921b20 tempest-AttachVolumeNegativeTest-1979015609 None] Created volume successfully. Jul 31 12:22:02 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [req-f7cf0d37-c182-4133-bc97-ad74f7d7e6a2 req-fb9c02c8-978d-4b71-b0de-e9d4769bf710 tempest-AttachVolumeNegativeTest-1979015609 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:22:02 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [req-f7cf0d37-c182-4133-bc97-ad74f7d7e6a2 req-fb9c02c8-978d-4b71-b0de-e9d4769bf710 tempest-AttachVolumeNegativeTest-1979015609 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:22:02 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [req-f7cf0d37-c182-4133-bc97-ad74f7d7e6a2 req-fb9c02c8-978d-4b71-b0de-e9d4769bf710 tempest-AttachVolumeNegativeTest-1979015609 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:22:02 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [req-f7cf0d37-c182-4133-bc97-ad74f7d7e6a2 req-fb9c02c8-978d-4b71-b0de-e9d4769bf710 tempest-AttachVolumeNegativeTest-1979015609 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88', 'name': 'volume-91f3108b-2aea-4ab2-a662-f0f35c13f19d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f652c9ec-a70b-4e8f-ab7a-311620ee8ea9', 'enforce_multipath': True} {{(pid=89182) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 31 12:22:02 devstack cinder-volume[89182]: INFO cinder.volume.manager [req-f7cf0d37-c182-4133-bc97-ad74f7d7e6a2 req-fb9c02c8-978d-4b71-b0de-e9d4769bf710 tempest-AttachVolumeNegativeTest-1979015609 None] attachment_update completed successfully. Jul 31 12:22:09 devstack cinder-volume[89182]: INFO cinder.volume.manager [req-66dd239d-9e33-4fce-a570-3cb1903e9da7 req-ff151f10-09ed-4cdf-93bd-3de2b5515900 tempest-TestShelveInstance-1962959388 None] Terminate volume connection completed successfully. Jul 31 12:22:09 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [req-66dd239d-9e33-4fce-a570-3cb1903e9da7 req-ff151f10-09ed-4cdf-93bd-3de2b5515900 tempest-TestShelveInstance-1962959388 None] Deleting attachment 309cb4ef-d99f-4fc4-883b-83f1f36aacda. {{(pid=89182) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 31 12:22:10 devstack cinder-volume[89182]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a36f17a-b390-4170-865c-d4f4576dd64a tempest-AttachVolumeTestJSON-657338358 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89182) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 12:22:10 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-8a36f17a-b390-4170-865c-d4f4576dd64a tempest-AttachVolumeTestJSON-657338358 None] Flow 'volume_create_manager' (28c05788-ecef-419a-a345-488df7d9354f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:22:10 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-8a36f17a-b390-4170-865c-d4f4576dd64a tempest-AttachVolumeTestJSON-657338358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (688a20d2-f225-43f1-a578-62d2c3dac237) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:22:10 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-8a36f17a-b390-4170-865c-d4f4576dd64a tempest-AttachVolumeTestJSON-657338358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (688a20d2-f225-43f1-a578-62d2c3dac237) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:22:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1618309955',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9adc30ab-e75a-4814-ac7c-9d289ba89563,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3bfcd1d00c440ec9eb594004353c12c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:22:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:22:10Z,use_quota=True,user_id='47b2b4c1aaac48cea4a566ecbcd7921b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:22:10 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-8a36f17a-b390-4170-865c-d4f4576dd64a tempest-AttachVolumeTestJSON-657338358 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (370fa94b-ee20-41a2-8640-baff596d08ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:22:10 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-8a36f17a-b390-4170-865c-d4f4576dd64a tempest-AttachVolumeTestJSON-657338358 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (370fa94b-ee20-41a2-8640-baff596d08ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:22:10 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-8a36f17a-b390-4170-865c-d4f4576dd64a tempest-AttachVolumeTestJSON-657338358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4e90cce-fde7-4224-ab4d-9fad8c62f096) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:22:10 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-8a36f17a-b390-4170-865c-d4f4576dd64a tempest-AttachVolumeTestJSON-657338358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4e90cce-fde7-4224-ab4d-9fad8c62f096) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9adc30ab-e75a-4814-ac7c-9d289ba89563', 'volume_name': 'volume-9adc30ab-e75a-4814-ac7c-9d289ba89563', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:22:10 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-8a36f17a-b390-4170-865c-d4f4576dd64a tempest-AttachVolumeTestJSON-657338358 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e6ca425-dd17-4a90-bffb-eb4703fe2715) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:22:10 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-8a36f17a-b390-4170-865c-d4f4576dd64a tempest-AttachVolumeTestJSON-657338358 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e6ca425-dd17-4a90-bffb-eb4703fe2715) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:22:10 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-8a36f17a-b390-4170-865c-d4f4576dd64a tempest-AttachVolumeTestJSON-657338358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b905e4c-1304-4b16-af96-2f3bc02a4376) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:22:10 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-8a36f17a-b390-4170-865c-d4f4576dd64a tempest-AttachVolumeTestJSON-657338358 None] Volume 9adc30ab-e75a-4814-ac7c-9d289ba89563: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9adc30ab-e75a-4814-ac7c-9d289ba89563', 'volume_size': 1} Jul 31 12:22:10 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-8a36f17a-b390-4170-865c-d4f4576dd64a tempest-AttachVolumeTestJSON-657338358 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:22:10 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-8a36f17a-b390-4170-865c-d4f4576dd64a tempest-AttachVolumeTestJSON-657338358 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:22:10 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-8a36f17a-b390-4170-865c-d4f4576dd64a tempest-AttachVolumeTestJSON-657338358 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:22:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1618309955',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9adc30ab-e75a-4814-ac7c-9d289ba89563,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3bfcd1d00c440ec9eb594004353c12c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:22:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:22:10Z,use_quota=True,user_id='47b2b4c1aaac48cea4a566ecbcd7921b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)}" {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 12:22:10 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-8a36f17a-b390-4170-865c-d4f4576dd64a tempest-AttachVolumeTestJSON-657338358 None] Creating volume 9adc30ab-e75a-4814-ac7c-9d289ba89563 {{(pid=89182) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 12:22:10 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-8a36f17a-b390-4170-865c-d4f4576dd64a tempest-AttachVolumeTestJSON-657338358 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:22:10 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-8a36f17a-b390-4170-865c-d4f4576dd64a tempest-AttachVolumeTestJSON-657338358 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:22:10 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-8a36f17a-b390-4170-865c-d4f4576dd64a tempest-AttachVolumeTestJSON-657338358 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:22:10 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-8a36f17a-b390-4170-865c-d4f4576dd64a tempest-AttachVolumeTestJSON-657338358 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:22:10 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-8a36f17a-b390-4170-865c-d4f4576dd64a tempest-AttachVolumeTestJSON-657338358 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:22:10 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-8a36f17a-b390-4170-865c-d4f4576dd64a tempest-AttachVolumeTestJSON-657338358 None] Selected osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 as target Quobyte volume. {{(pid=89182) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 12:22:10 devstack cinder-volume[89182]: INFO cinder.volume.drivers.remotefs [None req-8a36f17a-b390-4170-865c-d4f4576dd64a tempest-AttachVolumeTestJSON-657338358 None] casted to osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 Jul 31 12:22:10 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-8a36f17a-b390-4170-865c-d4f4576dd64a tempest-AttachVolumeTestJSON-657338358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-9adc30ab-e75a-4814-ac7c-9d289ba89563 1073741824 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:22:10 devstack sudo[99318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-9adc30ab-e75a-4814-ac7c-9d289ba89563 1073741824 Jul 31 12:22:10 devstack sudo[99318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:22:11 devstack sudo[99318]: pam_unix(sudo:session): session closed for user root Jul 31 12:22:11 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-8a36f17a-b390-4170-865c-d4f4576dd64a tempest-AttachVolumeTestJSON-657338358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-9adc30ab-e75a-4814-ac7c-9d289ba89563 1073741824" returned: 0 in 0.741s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:22:11 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-8a36f17a-b390-4170-865c-d4f4576dd64a tempest-AttachVolumeTestJSON-657338358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-9adc30ab-e75a-4814-ac7c-9d289ba89563 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:22:11 devstack sudo[99326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-9adc30ab-e75a-4814-ac7c-9d289ba89563 Jul 31 12:22:11 devstack sudo[99326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:22:11 devstack sudo[99326]: pam_unix(sudo:session): session closed for user root Jul 31 12:22:11 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-8a36f17a-b390-4170-865c-d4f4576dd64a tempest-AttachVolumeTestJSON-657338358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-9adc30ab-e75a-4814-ac7c-9d289ba89563" returned: 0 in 0.335s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:22:11 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-8a36f17a-b390-4170-865c-d4f4576dd64a tempest-AttachVolumeTestJSON-657338358 None] <== create_volume: return (1175ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'} {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 12:22:11 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-8a36f17a-b390-4170-865c-d4f4576dd64a tempest-AttachVolumeTestJSON-657338358 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.182s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:22:11 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-8a36f17a-b390-4170-865c-d4f4576dd64a tempest-AttachVolumeTestJSON-657338358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b905e4c-1304-4b16-af96-2f3bc02a4376) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9adc30ab-e75a-4814-ac7c-9d289ba89563', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:22:11 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-8a36f17a-b390-4170-865c-d4f4576dd64a tempest-AttachVolumeTestJSON-657338358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35fd796c-9206-4714-a657-0e975e75bd73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:22:11 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-8a36f17a-b390-4170-865c-d4f4576dd64a tempest-AttachVolumeTestJSON-657338358 None] Volume volume-9adc30ab-e75a-4814-ac7c-9d289ba89563 (9adc30ab-e75a-4814-ac7c-9d289ba89563): created successfully Jul 31 12:22:11 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-8a36f17a-b390-4170-865c-d4f4576dd64a tempest-AttachVolumeTestJSON-657338358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35fd796c-9206-4714-a657-0e975e75bd73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:22:11 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-8a36f17a-b390-4170-865c-d4f4576dd64a tempest-AttachVolumeTestJSON-657338358 None] Flow 'volume_create_manager' (28c05788-ecef-419a-a345-488df7d9354f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:22:11 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-8a36f17a-b390-4170-865c-d4f4576dd64a tempest-AttachVolumeTestJSON-657338358 None] Created volume successfully. Jul 31 12:22:13 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [req-f3bd8693-e818-4562-a27e-d15d6156badb req-7dad60a0-dce0-4fdd-86e7-339ca1ed1352 tempest-AttachVolumeTestJSON-657338358 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:22:13 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [req-f3bd8693-e818-4562-a27e-d15d6156badb req-7dad60a0-dce0-4fdd-86e7-339ca1ed1352 tempest-AttachVolumeTestJSON-657338358 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:22:13 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [req-f3bd8693-e818-4562-a27e-d15d6156badb req-7dad60a0-dce0-4fdd-86e7-339ca1ed1352 tempest-AttachVolumeTestJSON-657338358 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.021s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:22:13 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [req-f3bd8693-e818-4562-a27e-d15d6156badb req-7dad60a0-dce0-4fdd-86e7-339ca1ed1352 tempest-AttachVolumeTestJSON-657338358 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88', 'name': 'volume-9adc30ab-e75a-4814-ac7c-9d289ba89563', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '12b99b16-4990-4e42-9e5a-cbdf4e72ef32', 'enforce_multipath': True} {{(pid=89182) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 31 12:22:13 devstack cinder-volume[89182]: INFO cinder.volume.manager [req-f3bd8693-e818-4562-a27e-d15d6156badb req-7dad60a0-dce0-4fdd-86e7-339ca1ed1352 tempest-AttachVolumeTestJSON-657338358 None] attachment_update completed successfully. Jul 31 12:22:15 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [req-8f7c0104-bb47-452b-94ef-8b494b844ece req-becb98f1-a8c9-421b-ab2f-bd2f3bf95e2f tempest-TestShelveInstance-1962959388 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:22:15 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [req-8f7c0104-bb47-452b-94ef-8b494b844ece req-becb98f1-a8c9-421b-ab2f-bd2f3bf95e2f tempest-TestShelveInstance-1962959388 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:22:15 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [req-8f7c0104-bb47-452b-94ef-8b494b844ece req-becb98f1-a8c9-421b-ab2f-bd2f3bf95e2f tempest-TestShelveInstance-1962959388 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.029s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:22:15 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [req-8f7c0104-bb47-452b-94ef-8b494b844ece req-becb98f1-a8c9-421b-ab2f-bd2f3bf95e2f tempest-TestShelveInstance-1962959388 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88', 'name': 'volume-91b2f55d-f57b-4e71-bf47-1e088bcc3501', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6d62f3a5-3d17-404e-aaf7-a91042da8fb1', 'enforce_multipath': True} {{(pid=89182) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 31 12:22:16 devstack cinder-volume[89182]: INFO cinder.volume.manager [req-8f7c0104-bb47-452b-94ef-8b494b844ece req-becb98f1-a8c9-421b-ab2f-bd2f3bf95e2f tempest-TestShelveInstance-1962959388 None] attachment_update completed successfully. Jul 31 12:22:16 devstack cinder-volume[89182]: DEBUG cinder.volume.flows.manager.create_volume [None req-aef29ac1-a4b4-4dea-b001-059244727177 tempest-AttachVolumeTestJSON-657338358 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89182) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 12:22:16 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-aef29ac1-a4b4-4dea-b001-059244727177 tempest-AttachVolumeTestJSON-657338358 None] Flow 'volume_create_manager' (268ab255-c78a-4f60-a6be-2d027f08f81c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:22:16 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-aef29ac1-a4b4-4dea-b001-059244727177 tempest-AttachVolumeTestJSON-657338358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f0bcfe6-9c4f-4f01-b825-f1a1371848e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:22:17 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-aef29ac1-a4b4-4dea-b001-059244727177 tempest-AttachVolumeTestJSON-657338358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f0bcfe6-9c4f-4f01-b825-f1a1371848e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:22:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-846548373',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b45ff00-42b1-49d7-871f-0384ae97a34c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3bfcd1d00c440ec9eb594004353c12c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:22:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:22:17Z,use_quota=True,user_id='47b2b4c1aaac48cea4a566ecbcd7921b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:22:17 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-aef29ac1-a4b4-4dea-b001-059244727177 tempest-AttachVolumeTestJSON-657338358 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5f582bb-0d9a-45f3-b70c-45e60fd17936) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:22:17 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-aef29ac1-a4b4-4dea-b001-059244727177 tempest-AttachVolumeTestJSON-657338358 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5f582bb-0d9a-45f3-b70c-45e60fd17936) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:22:17 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-aef29ac1-a4b4-4dea-b001-059244727177 tempest-AttachVolumeTestJSON-657338358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7334956c-fb99-4b6f-8127-4130464da45f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:22:17 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-aef29ac1-a4b4-4dea-b001-059244727177 tempest-AttachVolumeTestJSON-657338358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7334956c-fb99-4b6f-8127-4130464da45f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0b45ff00-42b1-49d7-871f-0384ae97a34c', 'volume_name': 'volume-0b45ff00-42b1-49d7-871f-0384ae97a34c', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:22:17 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-aef29ac1-a4b4-4dea-b001-059244727177 tempest-AttachVolumeTestJSON-657338358 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4f0a4d1-dacb-439f-b41b-d22f1ff1b5b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:22:17 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-aef29ac1-a4b4-4dea-b001-059244727177 tempest-AttachVolumeTestJSON-657338358 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4f0a4d1-dacb-439f-b41b-d22f1ff1b5b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:22:17 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-aef29ac1-a4b4-4dea-b001-059244727177 tempest-AttachVolumeTestJSON-657338358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (409d6779-123a-4c2a-aef0-7fd59ecec29c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:22:17 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-aef29ac1-a4b4-4dea-b001-059244727177 tempest-AttachVolumeTestJSON-657338358 None] Volume 0b45ff00-42b1-49d7-871f-0384ae97a34c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0b45ff00-42b1-49d7-871f-0384ae97a34c', 'volume_size': 1} Jul 31 12:22:17 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-aef29ac1-a4b4-4dea-b001-059244727177 tempest-AttachVolumeTestJSON-657338358 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:22:17 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-aef29ac1-a4b4-4dea-b001-059244727177 tempest-AttachVolumeTestJSON-657338358 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:22:17 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-aef29ac1-a4b4-4dea-b001-059244727177 tempest-AttachVolumeTestJSON-657338358 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:22:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-846548373',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b45ff00-42b1-49d7-871f-0384ae97a34c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3bfcd1d00c440ec9eb594004353c12c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:22:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:22:17Z,use_quota=True,user_id='47b2b4c1aaac48cea4a566ecbcd7921b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)}" {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 12:22:17 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-aef29ac1-a4b4-4dea-b001-059244727177 tempest-AttachVolumeTestJSON-657338358 None] Creating volume 0b45ff00-42b1-49d7-871f-0384ae97a34c {{(pid=89182) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 12:22:17 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-aef29ac1-a4b4-4dea-b001-059244727177 tempest-AttachVolumeTestJSON-657338358 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:22:17 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-aef29ac1-a4b4-4dea-b001-059244727177 tempest-AttachVolumeTestJSON-657338358 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:22:17 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-aef29ac1-a4b4-4dea-b001-059244727177 tempest-AttachVolumeTestJSON-657338358 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:22:17 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-aef29ac1-a4b4-4dea-b001-059244727177 tempest-AttachVolumeTestJSON-657338358 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:22:17 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-aef29ac1-a4b4-4dea-b001-059244727177 tempest-AttachVolumeTestJSON-657338358 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:22:17 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-aef29ac1-a4b4-4dea-b001-059244727177 tempest-AttachVolumeTestJSON-657338358 None] Selected osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 as target Quobyte volume. {{(pid=89182) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 12:22:17 devstack cinder-volume[89182]: INFO cinder.volume.drivers.remotefs [None req-aef29ac1-a4b4-4dea-b001-059244727177 tempest-AttachVolumeTestJSON-657338358 None] casted to osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 Jul 31 12:22:17 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-aef29ac1-a4b4-4dea-b001-059244727177 tempest-AttachVolumeTestJSON-657338358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0b45ff00-42b1-49d7-871f-0384ae97a34c 1073741824 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:22:17 devstack sudo[99416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0b45ff00-42b1-49d7-871f-0384ae97a34c 1073741824 Jul 31 12:22:17 devstack sudo[99416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:22:17 devstack sudo[99416]: pam_unix(sudo:session): session closed for user root Jul 31 12:22:17 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-aef29ac1-a4b4-4dea-b001-059244727177 tempest-AttachVolumeTestJSON-657338358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0b45ff00-42b1-49d7-871f-0384ae97a34c 1073741824" returned: 0 in 0.854s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:22:17 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-aef29ac1-a4b4-4dea-b001-059244727177 tempest-AttachVolumeTestJSON-657338358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0b45ff00-42b1-49d7-871f-0384ae97a34c {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:22:18 devstack sudo[99421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0b45ff00-42b1-49d7-871f-0384ae97a34c Jul 31 12:22:18 devstack sudo[99421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:22:18 devstack sudo[99421]: pam_unix(sudo:session): session closed for user root Jul 31 12:22:18 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-aef29ac1-a4b4-4dea-b001-059244727177 tempest-AttachVolumeTestJSON-657338358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0b45ff00-42b1-49d7-871f-0384ae97a34c" returned: 0 in 0.466s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:22:18 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-aef29ac1-a4b4-4dea-b001-059244727177 tempest-AttachVolumeTestJSON-657338358 None] <== create_volume: return (1386ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'} {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 12:22:18 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-aef29ac1-a4b4-4dea-b001-059244727177 tempest-AttachVolumeTestJSON-657338358 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.390s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:22:18 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-aef29ac1-a4b4-4dea-b001-059244727177 tempest-AttachVolumeTestJSON-657338358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (409d6779-123a-4c2a-aef0-7fd59ecec29c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0b45ff00-42b1-49d7-871f-0384ae97a34c', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:22:18 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-aef29ac1-a4b4-4dea-b001-059244727177 tempest-AttachVolumeTestJSON-657338358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94325b52-b597-455a-ab5c-819f099589a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:22:18 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-aef29ac1-a4b4-4dea-b001-059244727177 tempest-AttachVolumeTestJSON-657338358 None] Volume volume-0b45ff00-42b1-49d7-871f-0384ae97a34c (0b45ff00-42b1-49d7-871f-0384ae97a34c): created successfully Jul 31 12:22:18 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-aef29ac1-a4b4-4dea-b001-059244727177 tempest-AttachVolumeTestJSON-657338358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94325b52-b597-455a-ab5c-819f099589a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:22:18 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-aef29ac1-a4b4-4dea-b001-059244727177 tempest-AttachVolumeTestJSON-657338358 None] Flow 'volume_create_manager' (268ab255-c78a-4f60-a6be-2d027f08f81c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:22:18 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-aef29ac1-a4b4-4dea-b001-059244727177 tempest-AttachVolumeTestJSON-657338358 None] Created volume successfully. Jul 31 12:22:20 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [req-43b2b36b-a538-4953-ac23-8a358cabd56f req-bdc147e2-0921-45b5-8fd8-6bc2c43d7391 tempest-AttachVolumeTestJSON-657338358 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:22:20 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [req-43b2b36b-a538-4953-ac23-8a358cabd56f req-bdc147e2-0921-45b5-8fd8-6bc2c43d7391 tempest-AttachVolumeTestJSON-657338358 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:22:20 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [req-43b2b36b-a538-4953-ac23-8a358cabd56f req-bdc147e2-0921-45b5-8fd8-6bc2c43d7391 tempest-AttachVolumeTestJSON-657338358 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.026s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:22:20 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [req-43b2b36b-a538-4953-ac23-8a358cabd56f req-bdc147e2-0921-45b5-8fd8-6bc2c43d7391 tempest-AttachVolumeTestJSON-657338358 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88', 'name': 'volume-0b45ff00-42b1-49d7-871f-0384ae97a34c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '05a38c26-f2bc-4600-84d4-3eadb27355ef', 'enforce_multipath': True} {{(pid=89182) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 31 12:22:21 devstack cinder-volume[89182]: INFO cinder.volume.manager [req-43b2b36b-a538-4953-ac23-8a358cabd56f req-bdc147e2-0921-45b5-8fd8-6bc2c43d7391 tempest-AttachVolumeTestJSON-657338358 None] attachment_update completed successfully. Jul 31 12:22:21 devstack cinder-volume[89182]: DEBUG oslo_service.periodic_task [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89182) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 31 12:22:21 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:22:21 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:22:21 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:22:22 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:22:22 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.047s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:22:22 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:22:22 devstack sudo[99453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 Jul 31 12:22:22 devstack sudo[99453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:22:22 devstack sudo[99453]: pam_unix(sudo:session): session closed for user root Jul 31 12:22:22 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2" returned: 0 in 0.752s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:22:22 devstack cinder-volume[89182]: DEBUG cinder.manager [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] Notifying Schedulers of capabilities ... {{(pid=89182) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 12:22:22 devstack cinder-volume[89182]: DEBUG oslo_service.periodic_task [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] Running periodic task VolumeManager._thread_info {{(pid=89182) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 31 12:22:22 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] thread count: 28 {{(pid=89182) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 31 12:22:22 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] thread info: [<_MainThread(MainThread, started 136154603720832)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=89182) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 31 12:22:25 devstack cinder-volume[89182]: INFO cinder.volume.manager [req-b6c63a75-f7d9-4a0f-8d44-945c1c892d9f req-092ba881-60bf-428b-94ae-d3f73021675c tempest-AttachVolumeTestJSON-657338358 None] Terminate volume connection completed successfully. Jul 31 12:22:25 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [req-b6c63a75-f7d9-4a0f-8d44-945c1c892d9f req-092ba881-60bf-428b-94ae-d3f73021675c tempest-AttachVolumeTestJSON-657338358 None] Deleting attachment 12b99b16-4990-4e42-9e5a-cbdf4e72ef32. {{(pid=89182) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 31 12:22:28 devstack cinder-volume[89182]: INFO cinder.volume.manager [req-8b1d79eb-df3a-4ef0-a09b-43384dd7c9ba req-44b0064e-3589-4bf8-80fb-346df38e42a3 tempest-AttachVolumeTestJSON-657338358 None] Terminate volume connection completed successfully. Jul 31 12:22:28 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [req-8b1d79eb-df3a-4ef0-a09b-43384dd7c9ba req-44b0064e-3589-4bf8-80fb-346df38e42a3 tempest-AttachVolumeTestJSON-657338358 None] Deleting attachment 05a38c26-f2bc-4600-84d4-3eadb27355ef. {{(pid=89182) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 31 12:22:36 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-9743d9a4-bed4-4ac4-8611-c8cdb88a58f9 tempest-AttachVolumeTestJSON-657338358 None] Acquiring lock "cinder-0b45ff00-42b1-49d7-871f-0384ae97a34c-delete_volume" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:22:36 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-9743d9a4-bed4-4ac4-8611-c8cdb88a58f9 tempest-AttachVolumeTestJSON-657338358 None] Lock "cinder-0b45ff00-42b1-49d7-871f-0384ae97a34c-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:22:36 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-9743d9a4-bed4-4ac4-8611-c8cdb88a58f9 tempest-AttachVolumeTestJSON-657338358 None] Acquiring lock "cinder-quobyte-0b45ff00-42b1-49d7-871f-0384ae97a34c" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:22:36 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-9743d9a4-bed4-4ac4-8611-c8cdb88a58f9 tempest-AttachVolumeTestJSON-657338358 None] Lock "cinder-quobyte-0b45ff00-42b1-49d7-871f-0384ae97a34c" acquired by "delete_volume" :: waited 0.025s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:22:36 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[5edc3c3a-9a5b-4a3a-a82a-b864a0339791]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:22:36 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-9743d9a4-bed4-4ac4-8611-c8cdb88a58f9 tempest-AttachVolumeTestJSON-657338358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0b45ff00-42b1-49d7-871f-0384ae97a34c {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:22:36 devstack sudo[99651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0b45ff00-42b1-49d7-871f-0384ae97a34c Jul 31 12:22:36 devstack sudo[99651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:22:37 devstack sudo[99651]: pam_unix(sudo:session): session closed for user root Jul 31 12:22:37 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-9743d9a4-bed4-4ac4-8611-c8cdb88a58f9 tempest-AttachVolumeTestJSON-657338358 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0b45ff00-42b1-49d7-871f-0384ae97a34c" returned: 0 in 0.733s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:22:37 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-9743d9a4-bed4-4ac4-8611-c8cdb88a58f9 tempest-AttachVolumeTestJSON-657338358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0b45ff00-42b1-49d7-871f-0384ae97a34c {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:22:37 devstack sudo[99656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0b45ff00-42b1-49d7-871f-0384ae97a34c Jul 31 12:22:37 devstack sudo[99656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:22:38 devstack sudo[99656]: pam_unix(sudo:session): session closed for user root Jul 31 12:22:38 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-9743d9a4-bed4-4ac4-8611-c8cdb88a58f9 tempest-AttachVolumeTestJSON-657338358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0b45ff00-42b1-49d7-871f-0384ae97a34c" returned: 0 in 0.526s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:22:38 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-9743d9a4-bed4-4ac4-8611-c8cdb88a58f9 tempest-AttachVolumeTestJSON-657338358 None] Lock "cinder-quobyte-0b45ff00-42b1-49d7-871f-0384ae97a34c" released by "delete_volume" :: held 1.336s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:22:38 devstack cinder-volume[89182]: DEBUG cinder.quota [None req-9743d9a4-bed4-4ac4-8611-c8cdb88a58f9 tempest-AttachVolumeTestJSON-657338358 None] Created reservations ['52e23f17-d559-45e6-a94c-9cd917ccbef8', '174613d3-ccdb-4e95-b3a9-0882b4808653', '17fad54b-0c3f-4314-b4ee-c18d50835b9d', '0aa2a005-e9ae-49c6-86a4-67344a513e56'] {{(pid=89182) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 12:22:38 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-9743d9a4-bed4-4ac4-8611-c8cdb88a58f9 tempest-AttachVolumeTestJSON-657338358 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:22:38 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-9743d9a4-bed4-4ac4-8611-c8cdb88a58f9 tempest-AttachVolumeTestJSON-657338358 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:22:38 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-9743d9a4-bed4-4ac4-8611-c8cdb88a58f9 tempest-AttachVolumeTestJSON-657338358 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:22:38 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-9743d9a4-bed4-4ac4-8611-c8cdb88a58f9 tempest-AttachVolumeTestJSON-657338358 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:22:38 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-9743d9a4-bed4-4ac4-8611-c8cdb88a58f9 tempest-AttachVolumeTestJSON-657338358 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:22:38 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-9743d9a4-bed4-4ac4-8611-c8cdb88a58f9 tempest-AttachVolumeTestJSON-657338358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:22:38 devstack sudo[99659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 Jul 31 12:22:38 devstack sudo[99659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:22:38 devstack sudo[99659]: pam_unix(sudo:session): session closed for user root Jul 31 12:22:38 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-9743d9a4-bed4-4ac4-8611-c8cdb88a58f9 tempest-AttachVolumeTestJSON-657338358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2" returned: 0 in 0.334s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:22:38 devstack cinder-volume[89182]: DEBUG cinder.manager [None req-9743d9a4-bed4-4ac4-8611-c8cdb88a58f9 tempest-AttachVolumeTestJSON-657338358 None] Notifying Schedulers of capabilities ... {{(pid=89182) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 12:22:38 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-9743d9a4-bed4-4ac4-8611-c8cdb88a58f9 tempest-AttachVolumeTestJSON-657338358 None] Deleted volume successfully. Jul 31 12:22:38 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-9743d9a4-bed4-4ac4-8611-c8cdb88a58f9 tempest-AttachVolumeTestJSON-657338358 None] Lock "cinder-0b45ff00-42b1-49d7-871f-0384ae97a34c-delete_volume" released by "delete_volume" :: held 2.009s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:22:39 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-887d61a6-e6f5-4667-8041-a486970057b2 tempest-AttachVolumeTestJSON-657338358 None] Acquiring lock "cinder-9adc30ab-e75a-4814-ac7c-9d289ba89563-delete_volume" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:22:39 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-887d61a6-e6f5-4667-8041-a486970057b2 tempest-AttachVolumeTestJSON-657338358 None] Lock "cinder-9adc30ab-e75a-4814-ac7c-9d289ba89563-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:22:39 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-887d61a6-e6f5-4667-8041-a486970057b2 tempest-AttachVolumeTestJSON-657338358 None] Acquiring lock "cinder-quobyte-9adc30ab-e75a-4814-ac7c-9d289ba89563" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:22:39 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-887d61a6-e6f5-4667-8041-a486970057b2 tempest-AttachVolumeTestJSON-657338358 None] Lock "cinder-quobyte-9adc30ab-e75a-4814-ac7c-9d289ba89563" acquired by "delete_volume" :: waited 0.021s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:22:39 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[55b0efb6-767f-428a-bbb4-0c35ecad35bf]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:22:39 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-887d61a6-e6f5-4667-8041-a486970057b2 tempest-AttachVolumeTestJSON-657338358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-9adc30ab-e75a-4814-ac7c-9d289ba89563 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:22:39 devstack cinder-volume[89182]: DEBUG cinder.volume.flows.manager.create_volume [None req-5ec68886-991e-40a5-8398-3bfadc669ef0 tempest-TestImageHashVerification-1219040370 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89182) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 12:22:39 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-5ec68886-991e-40a5-8398-3bfadc669ef0 tempest-TestImageHashVerification-1219040370 None] Flow 'volume_create_manager' (8f8faf0b-6e91-4a5f-95ab-559ac0da1c19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:22:39 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-5ec68886-991e-40a5-8398-3bfadc669ef0 tempest-TestImageHashVerification-1219040370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b365049c-85f2-4cea-b233-0039226ed416) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:22:39 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-5ec68886-991e-40a5-8398-3bfadc669ef0 tempest-TestImageHashVerification-1219040370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b365049c-85f2-4cea-b233-0039226ed416) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:22:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-1964793772',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24a12be5-acc1-4ea1-9fa3-baaf44cf80f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7cdcad0a35f549f8974c5b9e5ef9f4d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:22:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:22:39Z,use_quota=True,user_id='6d157329ead743fea25d7d35325ce7dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:22:39 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-5ec68886-991e-40a5-8398-3bfadc669ef0 tempest-TestImageHashVerification-1219040370 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba99ad9a-372f-4c04-92ca-3e49ab53f8b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:22:39 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-5ec68886-991e-40a5-8398-3bfadc669ef0 tempest-TestImageHashVerification-1219040370 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba99ad9a-372f-4c04-92ca-3e49ab53f8b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:22:39 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-5ec68886-991e-40a5-8398-3bfadc669ef0 tempest-TestImageHashVerification-1219040370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fbcc55dc-cf0d-4fe8-b38c-20eef6f63cb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:22:39 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-5ec68886-991e-40a5-8398-3bfadc669ef0 tempest-TestImageHashVerification-1219040370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fbcc55dc-cf0d-4fe8-b38c-20eef6f63cb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '24a12be5-acc1-4ea1-9fa3-baaf44cf80f0', 'volume_name': 'volume-24a12be5-acc1-4ea1-9fa3-baaf44cf80f0', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:22:39 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-5ec68886-991e-40a5-8398-3bfadc669ef0 tempest-TestImageHashVerification-1219040370 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e038425a-9c62-4d8f-a7bc-149980ded42f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:22:39 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-5ec68886-991e-40a5-8398-3bfadc669ef0 tempest-TestImageHashVerification-1219040370 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e038425a-9c62-4d8f-a7bc-149980ded42f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:22:39 devstack sudo[99662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-9adc30ab-e75a-4814-ac7c-9d289ba89563 Jul 31 12:22:39 devstack sudo[99662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:22:39 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-5ec68886-991e-40a5-8398-3bfadc669ef0 tempest-TestImageHashVerification-1219040370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ed1d781-cd33-45da-9923-5139a32b05e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:22:39 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-5ec68886-991e-40a5-8398-3bfadc669ef0 tempest-TestImageHashVerification-1219040370 None] Volume 24a12be5-acc1-4ea1-9fa3-baaf44cf80f0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-24a12be5-acc1-4ea1-9fa3-baaf44cf80f0', 'volume_size': 1} Jul 31 12:22:39 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-5ec68886-991e-40a5-8398-3bfadc669ef0 tempest-TestImageHashVerification-1219040370 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:22:39 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-5ec68886-991e-40a5-8398-3bfadc669ef0 tempest-TestImageHashVerification-1219040370 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:22:39 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-5ec68886-991e-40a5-8398-3bfadc669ef0 tempest-TestImageHashVerification-1219040370 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:22:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-1964793772',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24a12be5-acc1-4ea1-9fa3-baaf44cf80f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7cdcad0a35f549f8974c5b9e5ef9f4d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:22:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:22:39Z,use_quota=True,user_id='6d157329ead743fea25d7d35325ce7dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)}" {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 12:22:39 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-5ec68886-991e-40a5-8398-3bfadc669ef0 tempest-TestImageHashVerification-1219040370 None] Creating volume 24a12be5-acc1-4ea1-9fa3-baaf44cf80f0 {{(pid=89182) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 12:22:39 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-5ec68886-991e-40a5-8398-3bfadc669ef0 tempest-TestImageHashVerification-1219040370 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:22:39 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-5ec68886-991e-40a5-8398-3bfadc669ef0 tempest-TestImageHashVerification-1219040370 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:22:39 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-5ec68886-991e-40a5-8398-3bfadc669ef0 tempest-TestImageHashVerification-1219040370 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:22:39 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-5ec68886-991e-40a5-8398-3bfadc669ef0 tempest-TestImageHashVerification-1219040370 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:22:39 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-5ec68886-991e-40a5-8398-3bfadc669ef0 tempest-TestImageHashVerification-1219040370 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:22:39 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-5ec68886-991e-40a5-8398-3bfadc669ef0 tempest-TestImageHashVerification-1219040370 None] Selected osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 as target Quobyte volume. {{(pid=89182) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 12:22:39 devstack cinder-volume[89182]: INFO cinder.volume.drivers.remotefs [None req-5ec68886-991e-40a5-8398-3bfadc669ef0 tempest-TestImageHashVerification-1219040370 None] casted to osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 Jul 31 12:22:39 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-5ec68886-991e-40a5-8398-3bfadc669ef0 tempest-TestImageHashVerification-1219040370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-24a12be5-acc1-4ea1-9fa3-baaf44cf80f0 1073741824 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:22:39 devstack sudo[99664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-24a12be5-acc1-4ea1-9fa3-baaf44cf80f0 1073741824 Jul 31 12:22:39 devstack sudo[99664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:22:39 devstack sudo[99662]: pam_unix(sudo:session): session closed for user root Jul 31 12:22:39 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-887d61a6-e6f5-4667-8041-a486970057b2 tempest-AttachVolumeTestJSON-657338358 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-9adc30ab-e75a-4814-ac7c-9d289ba89563" returned: 0 in 0.460s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:22:39 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-887d61a6-e6f5-4667-8041-a486970057b2 tempest-AttachVolumeTestJSON-657338358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-9adc30ab-e75a-4814-ac7c-9d289ba89563 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:22:39 devstack sudo[99672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-9adc30ab-e75a-4814-ac7c-9d289ba89563 Jul 31 12:22:39 devstack sudo[99672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:22:39 devstack sudo[99664]: pam_unix(sudo:session): session closed for user root Jul 31 12:22:39 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-5ec68886-991e-40a5-8398-3bfadc669ef0 tempest-TestImageHashVerification-1219040370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-24a12be5-acc1-4ea1-9fa3-baaf44cf80f0 1073741824" returned: 0 in 0.562s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:22:40 devstack sudo[99672]: pam_unix(sudo:session): session closed for user root Jul 31 12:22:40 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-887d61a6-e6f5-4667-8041-a486970057b2 tempest-AttachVolumeTestJSON-657338358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-9adc30ab-e75a-4814-ac7c-9d289ba89563" returned: 0 in 0.297s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:22:40 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-5ec68886-991e-40a5-8398-3bfadc669ef0 tempest-TestImageHashVerification-1219040370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-24a12be5-acc1-4ea1-9fa3-baaf44cf80f0 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:22:40 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-887d61a6-e6f5-4667-8041-a486970057b2 tempest-AttachVolumeTestJSON-657338358 None] Lock "cinder-quobyte-9adc30ab-e75a-4814-ac7c-9d289ba89563" released by "delete_volume" :: held 0.825s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:22:40 devstack sudo[99677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-24a12be5-acc1-4ea1-9fa3-baaf44cf80f0 Jul 31 12:22:40 devstack sudo[99677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:22:40 devstack cinder-volume[89182]: DEBUG cinder.quota [None req-887d61a6-e6f5-4667-8041-a486970057b2 tempest-AttachVolumeTestJSON-657338358 None] Created reservations ['adbfeb37-db54-4a8e-9b1c-7ec4ef4c5e49', '06b2313e-4176-4bee-8c00-354410ba574a', '9836660c-8f77-4a21-810a-1d317f0570fd', '19b06b9f-ab08-4643-9214-4f342b84a6b6'] {{(pid=89182) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 12:22:40 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-887d61a6-e6f5-4667-8041-a486970057b2 tempest-AttachVolumeTestJSON-657338358 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:22:40 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-887d61a6-e6f5-4667-8041-a486970057b2 tempest-AttachVolumeTestJSON-657338358 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:22:40 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-887d61a6-e6f5-4667-8041-a486970057b2 tempest-AttachVolumeTestJSON-657338358 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:22:40 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-887d61a6-e6f5-4667-8041-a486970057b2 tempest-AttachVolumeTestJSON-657338358 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:22:40 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-887d61a6-e6f5-4667-8041-a486970057b2 tempest-AttachVolumeTestJSON-657338358 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:22:40 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-887d61a6-e6f5-4667-8041-a486970057b2 tempest-AttachVolumeTestJSON-657338358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:22:40 devstack sudo[99680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 Jul 31 12:22:40 devstack sudo[99680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:22:40 devstack sudo[99677]: pam_unix(sudo:session): session closed for user root Jul 31 12:22:40 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-5ec68886-991e-40a5-8398-3bfadc669ef0 tempest-TestImageHashVerification-1219040370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-24a12be5-acc1-4ea1-9fa3-baaf44cf80f0" returned: 0 in 0.334s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:22:40 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-5ec68886-991e-40a5-8398-3bfadc669ef0 tempest-TestImageHashVerification-1219040370 None] <== create_volume: return (964ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'} {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 12:22:40 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-5ec68886-991e-40a5-8398-3bfadc669ef0 tempest-TestImageHashVerification-1219040370 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.968s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:22:40 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-5ec68886-991e-40a5-8398-3bfadc669ef0 tempest-TestImageHashVerification-1219040370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ed1d781-cd33-45da-9923-5139a32b05e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-24a12be5-acc1-4ea1-9fa3-baaf44cf80f0', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:22:40 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-5ec68886-991e-40a5-8398-3bfadc669ef0 tempest-TestImageHashVerification-1219040370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a43f1c9e-2da6-4c90-8f6f-21a0bd0dcb39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:22:40 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-5ec68886-991e-40a5-8398-3bfadc669ef0 tempest-TestImageHashVerification-1219040370 None] Volume volume-24a12be5-acc1-4ea1-9fa3-baaf44cf80f0 (24a12be5-acc1-4ea1-9fa3-baaf44cf80f0): created successfully Jul 31 12:22:40 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-5ec68886-991e-40a5-8398-3bfadc669ef0 tempest-TestImageHashVerification-1219040370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a43f1c9e-2da6-4c90-8f6f-21a0bd0dcb39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:22:40 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-5ec68886-991e-40a5-8398-3bfadc669ef0 tempest-TestImageHashVerification-1219040370 None] Flow 'volume_create_manager' (8f8faf0b-6e91-4a5f-95ab-559ac0da1c19) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:22:40 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-5ec68886-991e-40a5-8398-3bfadc669ef0 tempest-TestImageHashVerification-1219040370 None] Created volume successfully. Jul 31 12:22:40 devstack sudo[99680]: pam_unix(sudo:session): session closed for user root Jul 31 12:22:40 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-887d61a6-e6f5-4667-8041-a486970057b2 tempest-AttachVolumeTestJSON-657338358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2" returned: 0 in 0.322s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:22:40 devstack cinder-volume[89182]: DEBUG cinder.manager [None req-887d61a6-e6f5-4667-8041-a486970057b2 tempest-AttachVolumeTestJSON-657338358 None] Notifying Schedulers of capabilities ... {{(pid=89182) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 12:22:40 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-887d61a6-e6f5-4667-8041-a486970057b2 tempest-AttachVolumeTestJSON-657338358 None] Deleted volume successfully. Jul 31 12:22:40 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-887d61a6-e6f5-4667-8041-a486970057b2 tempest-AttachVolumeTestJSON-657338358 None] Lock "cinder-9adc30ab-e75a-4814-ac7c-9d289ba89563-delete_volume" released by "delete_volume" :: held 1.592s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:22:41 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-43696b18-b18f-4062-a5ed-28150b06439e tempest-AttachVolumeTestJSON-657338358 None] Acquiring lock "cinder-67c83eeb-6bff-4ee3-8b43-244f7d434d73-delete_volume" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:22:41 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-43696b18-b18f-4062-a5ed-28150b06439e tempest-AttachVolumeTestJSON-657338358 None] Lock "cinder-67c83eeb-6bff-4ee3-8b43-244f7d434d73-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:22:41 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-43696b18-b18f-4062-a5ed-28150b06439e tempest-AttachVolumeTestJSON-657338358 None] Acquiring lock "cinder-quobyte-67c83eeb-6bff-4ee3-8b43-244f7d434d73" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:22:41 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-43696b18-b18f-4062-a5ed-28150b06439e tempest-AttachVolumeTestJSON-657338358 None] Lock "cinder-quobyte-67c83eeb-6bff-4ee3-8b43-244f7d434d73" acquired by "delete_volume" :: waited 0.026s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:22:41 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6dedd68-bfdf-4b53-9aa6-1ed64cfd74b9]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:22:41 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-43696b18-b18f-4062-a5ed-28150b06439e tempest-AttachVolumeTestJSON-657338358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-67c83eeb-6bff-4ee3-8b43-244f7d434d73 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:22:41 devstack sudo[99683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-67c83eeb-6bff-4ee3-8b43-244f7d434d73 Jul 31 12:22:41 devstack sudo[99683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:22:42 devstack sudo[99683]: pam_unix(sudo:session): session closed for user root Jul 31 12:22:42 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-43696b18-b18f-4062-a5ed-28150b06439e tempest-AttachVolumeTestJSON-657338358 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-67c83eeb-6bff-4ee3-8b43-244f7d434d73" returned: 0 in 0.403s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:22:42 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-43696b18-b18f-4062-a5ed-28150b06439e tempest-AttachVolumeTestJSON-657338358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-67c83eeb-6bff-4ee3-8b43-244f7d434d73 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:22:42 devstack sudo[99688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-67c83eeb-6bff-4ee3-8b43-244f7d434d73 Jul 31 12:22:42 devstack sudo[99688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:22:42 devstack sudo[99688]: pam_unix(sudo:session): session closed for user root Jul 31 12:22:42 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-43696b18-b18f-4062-a5ed-28150b06439e tempest-AttachVolumeTestJSON-657338358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-67c83eeb-6bff-4ee3-8b43-244f7d434d73" returned: 0 in 0.278s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:22:42 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-43696b18-b18f-4062-a5ed-28150b06439e tempest-AttachVolumeTestJSON-657338358 None] Lock "cinder-quobyte-67c83eeb-6bff-4ee3-8b43-244f7d434d73" released by "delete_volume" :: held 0.722s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:22:42 devstack cinder-volume[89182]: DEBUG cinder.quota [None req-43696b18-b18f-4062-a5ed-28150b06439e tempest-AttachVolumeTestJSON-657338358 None] Created reservations ['a376e44e-a05f-4ca6-a69c-b73c16a81aad', '4a0f95fe-257b-4ddf-b61a-f72412ed9c91', '23dd277c-9b26-49f7-9e16-2aff64eb43fd', '5472875f-fc66-4718-804a-65c4b1fdef11'] {{(pid=89182) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 12:22:42 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-466e14ba-f02e-412c-b9c6-153721b592db tempest-TestImageHashVerification-1219040370 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:22:42 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-466e14ba-f02e-412c-b9c6-153721b592db tempest-TestImageHashVerification-1219040370 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:22:42 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-43696b18-b18f-4062-a5ed-28150b06439e tempest-AttachVolumeTestJSON-657338358 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:22:42 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-43696b18-b18f-4062-a5ed-28150b06439e tempest-AttachVolumeTestJSON-657338358 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:22:42 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-43696b18-b18f-4062-a5ed-28150b06439e tempest-AttachVolumeTestJSON-657338358 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:22:42 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-43696b18-b18f-4062-a5ed-28150b06439e tempest-AttachVolumeTestJSON-657338358 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:22:42 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-43696b18-b18f-4062-a5ed-28150b06439e tempest-AttachVolumeTestJSON-657338358 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:22:42 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-43696b18-b18f-4062-a5ed-28150b06439e tempest-AttachVolumeTestJSON-657338358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:22:42 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[047c36cc-b6b1-4198-b366-b254f77d74ce]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:22:42 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-466e14ba-f02e-412c-b9c6-153721b592db tempest-TestImageHashVerification-1219040370 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-24a12be5-acc1-4ea1-9fa3-baaf44cf80f0 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:22:42 devstack sudo[99693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 Jul 31 12:22:42 devstack sudo[99693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:22:42 devstack sudo[99694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-24a12be5-acc1-4ea1-9fa3-baaf44cf80f0 Jul 31 12:22:42 devstack sudo[99694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:22:42 devstack sudo[99693]: pam_unix(sudo:session): session closed for user root Jul 31 12:22:42 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-43696b18-b18f-4062-a5ed-28150b06439e tempest-AttachVolumeTestJSON-657338358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2" returned: 0 in 0.475s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:22:42 devstack cinder-volume[89182]: DEBUG cinder.manager [None req-43696b18-b18f-4062-a5ed-28150b06439e tempest-AttachVolumeTestJSON-657338358 None] Notifying Schedulers of capabilities ... {{(pid=89182) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 12:22:43 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-43696b18-b18f-4062-a5ed-28150b06439e tempest-AttachVolumeTestJSON-657338358 None] Deleted volume successfully. Jul 31 12:22:43 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-43696b18-b18f-4062-a5ed-28150b06439e tempest-AttachVolumeTestJSON-657338358 None] Lock "cinder-67c83eeb-6bff-4ee3-8b43-244f7d434d73-delete_volume" released by "delete_volume" :: held 1.509s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:22:43 devstack sudo[99694]: pam_unix(sudo:session): session closed for user root Jul 31 12:22:43 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-466e14ba-f02e-412c-b9c6-153721b592db tempest-TestImageHashVerification-1219040370 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-24a12be5-acc1-4ea1-9fa3-baaf44cf80f0" returned: 0 in 0.628s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:22:43 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[906f78f0-fae4-441b-ab7d-56cb88a4147f]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:22:43 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-466e14ba-f02e-412c-b9c6-153721b592db tempest-TestImageHashVerification-1219040370 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-24a12be5-acc1-4ea1-9fa3-baaf44cf80f0 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:22:43 devstack sudo[99705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-24a12be5-acc1-4ea1-9fa3-baaf44cf80f0 Jul 31 12:22:43 devstack sudo[99705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:22:43 devstack sudo[99705]: pam_unix(sudo:session): session closed for user root Jul 31 12:22:43 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-466e14ba-f02e-412c-b9c6-153721b592db tempest-TestImageHashVerification-1219040370 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-24a12be5-acc1-4ea1-9fa3-baaf44cf80f0" returned: 0 in 0.608s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:22:43 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-466e14ba-f02e-412c-b9c6-153721b592db tempest-TestImageHashVerification-1219040370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-24a12be5-acc1-4ea1-9fa3-baaf44cf80f0 /opt/stack/data/cinder/conversion/24a12be5-acc1-4ea1-9fa3-baaf44cf80f0.temp_image.1b0dea6c-e1bc-45f9-950d-0edfb2724b42jahxr_mt.img {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:22:43 devstack sudo[99733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-24a12be5-acc1-4ea1-9fa3-baaf44cf80f0 /opt/stack/data/cinder/conversion/24a12be5-acc1-4ea1-9fa3-baaf44cf80f0.temp_image.1b0dea6c-e1bc-45f9-950d-0edfb2724b42jahxr_mt.img Jul 31 12:22:43 devstack sudo[99733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:22:49 devstack sudo[99733]: pam_unix(sudo:session): session closed for user root Jul 31 12:22:49 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-466e14ba-f02e-412c-b9c6-153721b592db tempest-TestImageHashVerification-1219040370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-24a12be5-acc1-4ea1-9fa3-baaf44cf80f0 /opt/stack/data/cinder/conversion/24a12be5-acc1-4ea1-9fa3-baaf44cf80f0.temp_image.1b0dea6c-e1bc-45f9-950d-0edfb2724b42jahxr_mt.img" returned: 0 in 5.413s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:22:49 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1f55865-5ebc-4c9e-99e0-6fb21abd8f6a]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:22:49 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-466e14ba-f02e-412c-b9c6-153721b592db tempest-TestImageHashVerification-1219040370 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-24a12be5-acc1-4ea1-9fa3-baaf44cf80f0 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:22:49 devstack sudo[99761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-24a12be5-acc1-4ea1-9fa3-baaf44cf80f0 Jul 31 12:22:49 devstack sudo[99761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:22:49 devstack sudo[99761]: pam_unix(sudo:session): session closed for user root Jul 31 12:22:49 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-466e14ba-f02e-412c-b9c6-153721b592db tempest-TestImageHashVerification-1219040370 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-24a12be5-acc1-4ea1-9fa3-baaf44cf80f0" returned: 0 in 0.660s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:22:49 devstack cinder-volume[89182]: DEBUG cinder.image.image_utils [None req-466e14ba-f02e-412c-b9c6-153721b592db tempest-TestImageHashVerification-1219040370 None] Image conversion details: src /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-24a12be5-acc1-4ea1-9fa3-baaf44cf80f0, size 1024.00 MB, duration 5.42 sec, destination /opt/stack/data/cinder/conversion/24a12be5-acc1-4ea1-9fa3-baaf44cf80f0.temp_image.1b0dea6c-e1bc-45f9-950d-0edfb2724b42jahxr_mt.img {{(pid=89182) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 31 12:22:49 devstack cinder-volume[89182]: INFO cinder.image.image_utils [None req-466e14ba-f02e-412c-b9c6-153721b592db tempest-TestImageHashVerification-1219040370 None] Converted 1024.00 MB image at 188.94 MB/s Jul 31 12:22:49 devstack cinder-volume[89182]: DEBUG cinder.image.image_utils [None req-466e14ba-f02e-412c-b9c6-153721b592db tempest-TestImageHashVerification-1219040370 None] 1b0dea6c-e1bc-45f9-950d-0edfb2724b42 was raw, no need to convert to raw {{(pid=89182) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Jul 31 12:22:51 devstack cinder-volume[89182]: INFO cinder.volume.manager [req-eed59ee9-59bb-4dde-b728-029aa02df81f req-c411dced-91ba-4714-9f42-f9b1f437d87d tempest-AttachVolumeNegativeTest-1979015609 None] Terminate volume connection completed successfully. Jul 31 12:22:51 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [req-eed59ee9-59bb-4dde-b728-029aa02df81f req-c411dced-91ba-4714-9f42-f9b1f437d87d tempest-AttachVolumeNegativeTest-1979015609 None] Deleting attachment f652c9ec-a70b-4e8f-ab7a-311620ee8ea9. {{(pid=89182) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 31 12:22:55 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-8c14cacf-6819-4c66-9ee7-b9eee505b1a0 tempest-GroupSnapshotsTest-457900778 None] Group tempest-GroupSnapshotsTest-Group-1120256400: creating Jul 31 12:22:55 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-8c14cacf-6819-4c66-9ee7-b9eee505b1a0 tempest-GroupSnapshotsTest-457900778 None] Group tempest-GroupSnapshotsTest-Group-1120256400: created successfully Jul 31 12:22:55 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-8c14cacf-6819-4c66-9ee7-b9eee505b1a0 tempest-GroupSnapshotsTest-457900778 None] Create group completed successfully. Jul 31 12:22:57 devstack cinder-volume[89182]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f18e052-f534-479e-a8e8-9f8c79f55ab7 tempest-GroupSnapshotsTest-457900778 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89182) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 12:22:57 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-8f18e052-f534-479e-a8e8-9f8c79f55ab7 tempest-GroupSnapshotsTest-457900778 None] Flow 'volume_create_manager' (5daf680e-a8a8-4c60-b8a0-05c0647f622f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:22:57 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-8f18e052-f534-479e-a8e8-9f8c79f55ab7 tempest-GroupSnapshotsTest-457900778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06a8bdc3-4ac6-465b-8775-11d0f4177b68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:22:57 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-8f18e052-f534-479e-a8e8-9f8c79f55ab7 tempest-GroupSnapshotsTest-457900778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06a8bdc3-4ac6-465b-8775-11d0f4177b68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:22:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1194259272',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=896f2efb-105a-4bf3-9f00-da9d9d39c8a3,host='devstack@QuobyteHD#QuobyteHD',id=6d1017ca-3585-4ab0-8e93-9d0ed5fcaa0a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8aa57263ea6741369b82e3f2281a3cc8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:22:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:22:58Z,use_quota=True,user_id='b52e6a278ed04e49ba9db889fbd7715f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e67e8fb-c9db-422d-80b4-3931aff04bae),volume_type_id=4e67e8fb-c9db-422d-80b4-3931aff04bae)' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:22:57 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-8f18e052-f534-479e-a8e8-9f8c79f55ab7 tempest-GroupSnapshotsTest-457900778 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99211c5f-85e8-4b11-bf68-3175ebc1446b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:22:57 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-8f18e052-f534-479e-a8e8-9f8c79f55ab7 tempest-GroupSnapshotsTest-457900778 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99211c5f-85e8-4b11-bf68-3175ebc1446b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:22:57 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-8f18e052-f534-479e-a8e8-9f8c79f55ab7 tempest-GroupSnapshotsTest-457900778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba6aa2ff-a16b-4417-82ec-ed29c08168a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:22:57 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-8f18e052-f534-479e-a8e8-9f8c79f55ab7 tempest-GroupSnapshotsTest-457900778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba6aa2ff-a16b-4417-82ec-ed29c08168a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6d1017ca-3585-4ab0-8e93-9d0ed5fcaa0a', 'volume_name': 'volume-6d1017ca-3585-4ab0-8e93-9d0ed5fcaa0a', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:22:57 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-8f18e052-f534-479e-a8e8-9f8c79f55ab7 tempest-GroupSnapshotsTest-457900778 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0c889ac-c2ef-4bc3-bd82-d68371d084ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:22:57 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-8f18e052-f534-479e-a8e8-9f8c79f55ab7 tempest-GroupSnapshotsTest-457900778 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0c889ac-c2ef-4bc3-bd82-d68371d084ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:22:57 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-8f18e052-f534-479e-a8e8-9f8c79f55ab7 tempest-GroupSnapshotsTest-457900778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3a89e62-86b0-4085-9b4d-71babc9c27b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:22:57 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-8f18e052-f534-479e-a8e8-9f8c79f55ab7 tempest-GroupSnapshotsTest-457900778 None] Volume 6d1017ca-3585-4ab0-8e93-9d0ed5fcaa0a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6d1017ca-3585-4ab0-8e93-9d0ed5fcaa0a', 'volume_size': 1} Jul 31 12:22:57 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-8f18e052-f534-479e-a8e8-9f8c79f55ab7 tempest-GroupSnapshotsTest-457900778 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:23:07 devstack cinder-volume[89182]: DEBUG dbcounter [-] [89182] Writing DB stats cinder:SELECT=57,cinder:UPDATE=46,cinder:DELETE=4,cinder:INSERT=7 {{(pid=89182) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 12:23:07 devstack cinder-volume[89182]: DEBUG dbcounter [-] [89182] Writing DB stats cinder:SELECT=56,cinder:INSERT=9,cinder:UPDATE=40,cinder:DELETE=3 {{(pid=89182) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 12:23:09 devstack cinder-volume[89182]: INFO cinder.volume.manager [req-6114763c-1c72-4507-aeaf-1ffb9787007b req-d58634a4-bcf0-4c36-aca5-efcad3d0a7ba tempest-TestShelveInstance-1962959388 None] Terminate volume connection completed successfully. Jul 31 12:23:09 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [req-6114763c-1c72-4507-aeaf-1ffb9787007b req-d58634a4-bcf0-4c36-aca5-efcad3d0a7ba tempest-TestShelveInstance-1962959388 None] Deleting attachment 6d62f3a5-3d17-404e-aaf7-a91042da8fb1. {{(pid=89182) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 31 12:23:09 devstack cinder-volume[89182]: DEBUG cinder.coordination [req-6114763c-1c72-4507-aeaf-1ffb9787007b req-d19bed81-47c2-401e-90af-195a8a384865 tempest-TestShelveInstance-1962959388 None] Acquiring lock "cinder-91b2f55d-f57b-4e71-bf47-1e088bcc3501-delete_volume" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:23:09 devstack cinder-volume[89182]: DEBUG cinder.coordination [req-6114763c-1c72-4507-aeaf-1ffb9787007b req-d19bed81-47c2-401e-90af-195a8a384865 tempest-TestShelveInstance-1962959388 None] Lock "cinder-91b2f55d-f57b-4e71-bf47-1e088bcc3501-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:23:09 devstack cinder-volume[89182]: DEBUG cinder.coordination [req-6114763c-1c72-4507-aeaf-1ffb9787007b req-d19bed81-47c2-401e-90af-195a8a384865 tempest-TestShelveInstance-1962959388 None] Acquiring lock "cinder-quobyte-91b2f55d-f57b-4e71-bf47-1e088bcc3501" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:23:09 devstack cinder-volume[89182]: DEBUG cinder.coordination [req-6114763c-1c72-4507-aeaf-1ffb9787007b req-d19bed81-47c2-401e-90af-195a8a384865 tempest-TestShelveInstance-1962959388 None] Lock "cinder-quobyte-91b2f55d-f57b-4e71-bf47-1e088bcc3501" acquired by "delete_volume" :: waited 0.025s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:23:09 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8bd9fe9-681f-4243-b066-5922ef628e33]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:23:09 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [req-6114763c-1c72-4507-aeaf-1ffb9787007b req-d19bed81-47c2-401e-90af-195a8a384865 tempest-TestShelveInstance-1962959388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-91b2f55d-f57b-4e71-bf47-1e088bcc3501 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:23:09 devstack sudo[99941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-91b2f55d-f57b-4e71-bf47-1e088bcc3501 Jul 31 12:23:09 devstack sudo[99941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:23:10 devstack sudo[99941]: pam_unix(sudo:session): session closed for user root Jul 31 12:23:10 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [req-6114763c-1c72-4507-aeaf-1ffb9787007b req-d19bed81-47c2-401e-90af-195a8a384865 tempest-TestShelveInstance-1962959388 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-91b2f55d-f57b-4e71-bf47-1e088bcc3501" returned: 0 in 0.999s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:23:10 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [req-6114763c-1c72-4507-aeaf-1ffb9787007b req-d19bed81-47c2-401e-90af-195a8a384865 tempest-TestShelveInstance-1962959388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-91b2f55d-f57b-4e71-bf47-1e088bcc3501 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:23:10 devstack sudo[99946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-91b2f55d-f57b-4e71-bf47-1e088bcc3501 Jul 31 12:23:10 devstack sudo[99946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:23:10 devstack sudo[99946]: pam_unix(sudo:session): session closed for user root Jul 31 12:23:10 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [req-6114763c-1c72-4507-aeaf-1ffb9787007b req-d19bed81-47c2-401e-90af-195a8a384865 tempest-TestShelveInstance-1962959388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-91b2f55d-f57b-4e71-bf47-1e088bcc3501" returned: 0 in 0.287s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:23:10 devstack cinder-volume[89182]: DEBUG cinder.coordination [req-6114763c-1c72-4507-aeaf-1ffb9787007b req-d19bed81-47c2-401e-90af-195a8a384865 tempest-TestShelveInstance-1962959388 None] Lock "cinder-quobyte-91b2f55d-f57b-4e71-bf47-1e088bcc3501" released by "delete_volume" :: held 1.379s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:23:10 devstack cinder-volume[89182]: DEBUG cinder.quota [req-6114763c-1c72-4507-aeaf-1ffb9787007b req-d19bed81-47c2-401e-90af-195a8a384865 tempest-TestShelveInstance-1962959388 None] Created reservations ['86fa71a5-12cd-464e-9ffe-cba05c042725', '2ee022f0-17dd-4357-8ae3-9a29a92e23bb', 'fb66c3d3-3839-49fa-887a-f29cfc0388cc', '687a0b02-2162-4c32-8c6f-c7add406dd30'] {{(pid=89182) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 12:23:10 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [req-6114763c-1c72-4507-aeaf-1ffb9787007b req-d19bed81-47c2-401e-90af-195a8a384865 tempest-TestShelveInstance-1962959388 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:23:10 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [req-6114763c-1c72-4507-aeaf-1ffb9787007b req-d19bed81-47c2-401e-90af-195a8a384865 tempest-TestShelveInstance-1962959388 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:23:10 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [req-6114763c-1c72-4507-aeaf-1ffb9787007b req-d19bed81-47c2-401e-90af-195a8a384865 tempest-TestShelveInstance-1962959388 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:23:10 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [req-6114763c-1c72-4507-aeaf-1ffb9787007b req-d19bed81-47c2-401e-90af-195a8a384865 tempest-TestShelveInstance-1962959388 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:23:10 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [req-6114763c-1c72-4507-aeaf-1ffb9787007b req-d19bed81-47c2-401e-90af-195a8a384865 tempest-TestShelveInstance-1962959388 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:23:10 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [req-6114763c-1c72-4507-aeaf-1ffb9787007b req-d19bed81-47c2-401e-90af-195a8a384865 tempest-TestShelveInstance-1962959388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:23:10 devstack sudo[99949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 Jul 31 12:23:10 devstack sudo[99949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:23:11 devstack sudo[99949]: pam_unix(sudo:session): session closed for user root Jul 31 12:23:11 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [req-6114763c-1c72-4507-aeaf-1ffb9787007b req-d19bed81-47c2-401e-90af-195a8a384865 tempest-TestShelveInstance-1962959388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2" returned: 0 in 0.457s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:23:11 devstack cinder-volume[89182]: DEBUG cinder.manager [req-6114763c-1c72-4507-aeaf-1ffb9787007b req-d19bed81-47c2-401e-90af-195a8a384865 tempest-TestShelveInstance-1962959388 None] Notifying Schedulers of capabilities ... {{(pid=89182) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 12:23:11 devstack cinder-volume[89182]: INFO cinder.volume.manager [req-6114763c-1c72-4507-aeaf-1ffb9787007b req-d19bed81-47c2-401e-90af-195a8a384865 tempest-TestShelveInstance-1962959388 None] Deleted volume successfully. Jul 31 12:23:11 devstack cinder-volume[89182]: DEBUG cinder.coordination [req-6114763c-1c72-4507-aeaf-1ffb9787007b req-d19bed81-47c2-401e-90af-195a8a384865 tempest-TestShelveInstance-1962959388 None] Lock "cinder-91b2f55d-f57b-4e71-bf47-1e088bcc3501-delete_volume" released by "delete_volume" :: held 2.149s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:23:17 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-466e14ba-f02e-412c-b9c6-153721b592db tempest-TestImageHashVerification-1219040370 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 34.833s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:23:17 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-466e14ba-f02e-412c-b9c6-153721b592db tempest-TestImageHashVerification-1219040370 None] Uploaded volume to glance image-id: 1b0dea6c-e1bc-45f9-950d-0edfb2724b42. {{(pid=89182) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jul 31 12:23:17 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-8f18e052-f534-479e-a8e8-9f8c79f55ab7 tempest-GroupSnapshotsTest-457900778 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 19.571s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:23:17 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-8f18e052-f534-479e-a8e8-9f8c79f55ab7 tempest-GroupSnapshotsTest-457900778 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=896f2efb-105a-4bf3-9f00-da9d9d39c8a3,created_at=2026-07-31T10:22:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1194259272',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=896f2efb-105a-4bf3-9f00-da9d9d39c8a3,host='devstack@QuobyteHD#QuobyteHD',id=6d1017ca-3585-4ab0-8e93-9d0ed5fcaa0a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8aa57263ea6741369b82e3f2281a3cc8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:22:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:22:58Z,use_quota=True,user_id='b52e6a278ed04e49ba9db889fbd7715f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e67e8fb-c9db-422d-80b4-3931aff04bae),volume_type_id=4e67e8fb-c9db-422d-80b4-3931aff04bae)}" {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 12:23:17 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-8f18e052-f534-479e-a8e8-9f8c79f55ab7 tempest-GroupSnapshotsTest-457900778 None] Creating volume 6d1017ca-3585-4ab0-8e93-9d0ed5fcaa0a {{(pid=89182) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 12:23:17 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-8f18e052-f534-479e-a8e8-9f8c79f55ab7 tempest-GroupSnapshotsTest-457900778 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:23:17 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-8f18e052-f534-479e-a8e8-9f8c79f55ab7 tempest-GroupSnapshotsTest-457900778 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:23:17 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-8f18e052-f534-479e-a8e8-9f8c79f55ab7 tempest-GroupSnapshotsTest-457900778 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:23:17 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-8f18e052-f534-479e-a8e8-9f8c79f55ab7 tempest-GroupSnapshotsTest-457900778 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:23:17 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-8f18e052-f534-479e-a8e8-9f8c79f55ab7 tempest-GroupSnapshotsTest-457900778 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:23:17 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-8f18e052-f534-479e-a8e8-9f8c79f55ab7 tempest-GroupSnapshotsTest-457900778 None] Selected osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 as target Quobyte volume. {{(pid=89182) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 12:23:17 devstack cinder-volume[89182]: INFO cinder.volume.drivers.remotefs [None req-8f18e052-f534-479e-a8e8-9f8c79f55ab7 tempest-GroupSnapshotsTest-457900778 None] casted to osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 Jul 31 12:23:17 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-8f18e052-f534-479e-a8e8-9f8c79f55ab7 tempest-GroupSnapshotsTest-457900778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-6d1017ca-3585-4ab0-8e93-9d0ed5fcaa0a 1073741824 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:23:17 devstack sudo[99957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-6d1017ca-3585-4ab0-8e93-9d0ed5fcaa0a 1073741824 Jul 31 12:23:17 devstack sudo[99957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:23:17 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-466e14ba-f02e-412c-b9c6-153721b592db tempest-TestImageHashVerification-1219040370 None] Copy volume to image completed successfully. Jul 31 12:23:17 devstack sudo[99957]: pam_unix(sudo:session): session closed for user root Jul 31 12:23:17 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-8f18e052-f534-479e-a8e8-9f8c79f55ab7 tempest-GroupSnapshotsTest-457900778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-6d1017ca-3585-4ab0-8e93-9d0ed5fcaa0a 1073741824" returned: 0 in 0.536s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:23:17 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-8f18e052-f534-479e-a8e8-9f8c79f55ab7 tempest-GroupSnapshotsTest-457900778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-6d1017ca-3585-4ab0-8e93-9d0ed5fcaa0a {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:23:17 devstack sudo[99962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-6d1017ca-3585-4ab0-8e93-9d0ed5fcaa0a Jul 31 12:23:17 devstack sudo[99962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:23:18 devstack sudo[99962]: pam_unix(sudo:session): session closed for user root Jul 31 12:23:18 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-8f18e052-f534-479e-a8e8-9f8c79f55ab7 tempest-GroupSnapshotsTest-457900778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-6d1017ca-3585-4ab0-8e93-9d0ed5fcaa0a" returned: 0 in 0.317s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:23:18 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-8f18e052-f534-479e-a8e8-9f8c79f55ab7 tempest-GroupSnapshotsTest-457900778 None] <== create_volume: return (904ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'} {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 12:23:18 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-8f18e052-f534-479e-a8e8-9f8c79f55ab7 tempest-GroupSnapshotsTest-457900778 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.909s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:23:18 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-8f18e052-f534-479e-a8e8-9f8c79f55ab7 tempest-GroupSnapshotsTest-457900778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3a89e62-86b0-4085-9b4d-71babc9c27b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6d1017ca-3585-4ab0-8e93-9d0ed5fcaa0a', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:23:18 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-8f18e052-f534-479e-a8e8-9f8c79f55ab7 tempest-GroupSnapshotsTest-457900778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36742229-2242-4358-b50e-f62091c47c93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:23:18 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-8f18e052-f534-479e-a8e8-9f8c79f55ab7 tempest-GroupSnapshotsTest-457900778 None] Volume volume-6d1017ca-3585-4ab0-8e93-9d0ed5fcaa0a (6d1017ca-3585-4ab0-8e93-9d0ed5fcaa0a): created successfully Jul 31 12:23:18 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-8f18e052-f534-479e-a8e8-9f8c79f55ab7 tempest-GroupSnapshotsTest-457900778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36742229-2242-4358-b50e-f62091c47c93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:23:18 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-8f18e052-f534-479e-a8e8-9f8c79f55ab7 tempest-GroupSnapshotsTest-457900778 None] Flow 'volume_create_manager' (5daf680e-a8a8-4c60-b8a0-05c0647f622f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:23:18 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-8f18e052-f534-479e-a8e8-9f8c79f55ab7 tempest-GroupSnapshotsTest-457900778 None] Created volume successfully. Jul 31 12:23:19 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-89616ae0-0ed1-426d-a173-dba98840ef6e tempest-TestImageHashVerification-1219040370 None] Acquiring lock "cinder-24a12be5-acc1-4ea1-9fa3-baaf44cf80f0-delete_volume" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:23:19 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-89616ae0-0ed1-426d-a173-dba98840ef6e tempest-TestImageHashVerification-1219040370 None] Lock "cinder-24a12be5-acc1-4ea1-9fa3-baaf44cf80f0-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:23:19 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-89616ae0-0ed1-426d-a173-dba98840ef6e tempest-TestImageHashVerification-1219040370 None] Acquiring lock "cinder-quobyte-24a12be5-acc1-4ea1-9fa3-baaf44cf80f0" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:23:19 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-89616ae0-0ed1-426d-a173-dba98840ef6e tempest-TestImageHashVerification-1219040370 None] Lock "cinder-quobyte-24a12be5-acc1-4ea1-9fa3-baaf44cf80f0" acquired by "delete_volume" :: waited 0.023s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:23:19 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e340832-9091-43b9-ac83-f3f3be94890f]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:23:19 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-89616ae0-0ed1-426d-a173-dba98840ef6e tempest-TestImageHashVerification-1219040370 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-24a12be5-acc1-4ea1-9fa3-baaf44cf80f0 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:23:19 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-0aff5161-bdae-40e2-94b5-168093b3e898 tempest-GroupSnapshotsTest-457900778 None] GroupSnapshot 70f1ce6d-e02f-4530-8f8d-85c11461ecaf: creating. Jul 31 12:23:19 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-0aff5161-bdae-40e2-94b5-168093b3e898 tempest-GroupSnapshotsTest-457900778 None] Group snapshot 70f1ce6d-e02f-4530-8f8d-85c11461ecaf: creating. {{(pid=89182) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 31 12:23:19 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-0aff5161-bdae-40e2-94b5-168093b3e898 tempest-GroupSnapshotsTest-457900778 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:23:19 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-0aff5161-bdae-40e2-94b5-168093b3e898 tempest-GroupSnapshotsTest-457900778 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:23:19 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-0aff5161-bdae-40e2-94b5-168093b3e898 tempest-GroupSnapshotsTest-457900778 None] Creating offline snapshot 2618d0df-e214-4c1d-9f11-35c9322beb08 of volume 6d1017ca-3585-4ab0-8e93-9d0ed5fcaa0a {{(pid=89182) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 31 12:23:19 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbf94d2a-19f5-48ec-8721-c5fccf7e1563]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:23:19 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-0aff5161-bdae-40e2-94b5-168093b3e898 tempest-GroupSnapshotsTest-457900778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-6d1017ca-3585-4ab0-8e93-9d0ed5fcaa0a {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:23:19 devstack sudo[99966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-24a12be5-acc1-4ea1-9fa3-baaf44cf80f0 Jul 31 12:23:19 devstack sudo[99966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:23:19 devstack sudo[99967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-6d1017ca-3585-4ab0-8e93-9d0ed5fcaa0a Jul 31 12:23:19 devstack sudo[99967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:23:19 devstack sudo[99966]: pam_unix(sudo:session): session closed for user root Jul 31 12:23:19 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-89616ae0-0ed1-426d-a173-dba98840ef6e tempest-TestImageHashVerification-1219040370 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-24a12be5-acc1-4ea1-9fa3-baaf44cf80f0" returned: 0 in 0.498s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:23:19 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-89616ae0-0ed1-426d-a173-dba98840ef6e tempest-TestImageHashVerification-1219040370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-24a12be5-acc1-4ea1-9fa3-baaf44cf80f0 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:23:19 devstack sudo[99976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-24a12be5-acc1-4ea1-9fa3-baaf44cf80f0 Jul 31 12:23:19 devstack sudo[99976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:23:19 devstack sudo[99967]: pam_unix(sudo:session): session closed for user root Jul 31 12:23:19 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-0aff5161-bdae-40e2-94b5-168093b3e898 tempest-GroupSnapshotsTest-457900778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-6d1017ca-3585-4ab0-8e93-9d0ed5fcaa0a" returned: 0 in 0.455s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:23:19 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-0aff5161-bdae-40e2-94b5-168093b3e898 tempest-GroupSnapshotsTest-457900778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-6d1017ca-3585-4ab0-8e93-9d0ed5fcaa0a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-6d1017ca-3585-4ab0-8e93-9d0ed5fcaa0a.2618d0df-e214-4c1d-9f11-35c9322beb08 1G {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:23:19 devstack sudo[99978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-6d1017ca-3585-4ab0-8e93-9d0ed5fcaa0a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-6d1017ca-3585-4ab0-8e93-9d0ed5fcaa0a.2618d0df-e214-4c1d-9f11-35c9322beb08 1G Jul 31 12:23:19 devstack sudo[99978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:23:20 devstack sudo[99976]: pam_unix(sudo:session): session closed for user root Jul 31 12:23:20 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-89616ae0-0ed1-426d-a173-dba98840ef6e tempest-TestImageHashVerification-1219040370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-24a12be5-acc1-4ea1-9fa3-baaf44cf80f0" returned: 0 in 0.459s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:23:20 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-89616ae0-0ed1-426d-a173-dba98840ef6e tempest-TestImageHashVerification-1219040370 None] Lock "cinder-quobyte-24a12be5-acc1-4ea1-9fa3-baaf44cf80f0" released by "delete_volume" :: held 1.020s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:23:20 devstack cinder-volume[89182]: DEBUG cinder.quota [None req-89616ae0-0ed1-426d-a173-dba98840ef6e tempest-TestImageHashVerification-1219040370 None] Created reservations ['83a76fca-570d-49c1-a3bd-65935aa396fd', 'a23cb1c2-c9a2-4486-b28a-25194ab39315', '2de34a48-5196-4b55-b096-b8bec7e77e56', 'c821ee97-aaf2-414c-b163-a9a9568e6bc0'] {{(pid=89182) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 12:23:20 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-89616ae0-0ed1-426d-a173-dba98840ef6e tempest-TestImageHashVerification-1219040370 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:23:20 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-89616ae0-0ed1-426d-a173-dba98840ef6e tempest-TestImageHashVerification-1219040370 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:23:20 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-89616ae0-0ed1-426d-a173-dba98840ef6e tempest-TestImageHashVerification-1219040370 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:23:20 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-89616ae0-0ed1-426d-a173-dba98840ef6e tempest-TestImageHashVerification-1219040370 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:23:20 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-89616ae0-0ed1-426d-a173-dba98840ef6e tempest-TestImageHashVerification-1219040370 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:23:20 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-89616ae0-0ed1-426d-a173-dba98840ef6e tempest-TestImageHashVerification-1219040370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:23:20 devstack sudo[99978]: pam_unix(sudo:session): session closed for user root Jul 31 12:23:20 devstack sudo[99985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 Jul 31 12:23:20 devstack sudo[99985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:23:20 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-0aff5161-bdae-40e2-94b5-168093b3e898 tempest-GroupSnapshotsTest-457900778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-6d1017ca-3585-4ab0-8e93-9d0ed5fcaa0a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-6d1017ca-3585-4ab0-8e93-9d0ed5fcaa0a.2618d0df-e214-4c1d-9f11-35c9322beb08 1G" returned: 0 in 0.659s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:23:20 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-0aff5161-bdae-40e2-94b5-168093b3e898 tempest-GroupSnapshotsTest-457900778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6d1017ca-3585-4ab0-8e93-9d0ed5fcaa0a -F qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-6d1017ca-3585-4ab0-8e93-9d0ed5fcaa0a.2618d0df-e214-4c1d-9f11-35c9322beb08 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:23:20 devstack sudo[99987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6d1017ca-3585-4ab0-8e93-9d0ed5fcaa0a -F qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-6d1017ca-3585-4ab0-8e93-9d0ed5fcaa0a.2618d0df-e214-4c1d-9f11-35c9322beb08 Jul 31 12:23:20 devstack sudo[99987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:23:20 devstack sudo[99985]: pam_unix(sudo:session): session closed for user root Jul 31 12:23:20 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-89616ae0-0ed1-426d-a173-dba98840ef6e tempest-TestImageHashVerification-1219040370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2" returned: 0 in 0.365s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:23:20 devstack cinder-volume[89182]: DEBUG cinder.manager [None req-89616ae0-0ed1-426d-a173-dba98840ef6e tempest-TestImageHashVerification-1219040370 None] Notifying Schedulers of capabilities ... {{(pid=89182) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 12:23:20 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-89616ae0-0ed1-426d-a173-dba98840ef6e tempest-TestImageHashVerification-1219040370 None] Deleted volume successfully. Jul 31 12:23:20 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-89616ae0-0ed1-426d-a173-dba98840ef6e tempest-TestImageHashVerification-1219040370 None] Lock "cinder-24a12be5-acc1-4ea1-9fa3-baaf44cf80f0-delete_volume" released by "delete_volume" :: held 1.726s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:23:21 devstack sudo[99987]: pam_unix(sudo:session): session closed for user root Jul 31 12:23:21 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-0aff5161-bdae-40e2-94b5-168093b3e898 tempest-GroupSnapshotsTest-457900778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6d1017ca-3585-4ab0-8e93-9d0ed5fcaa0a -F qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-6d1017ca-3585-4ab0-8e93-9d0ed5fcaa0a.2618d0df-e214-4c1d-9f11-35c9322beb08" returned: 0 in 0.549s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:23:21 devstack cinder-volume[89182]: WARNING cinder.volume.drivers.remotefs [None req-0aff5161-bdae-40e2-94b5-168093b3e898 tempest-GroupSnapshotsTest-457900778 None] /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-6d1017ca-3585-4ab0-8e93-9d0ed5fcaa0a.2618d0df-e214-4c1d-9f11-35c9322beb08 is being set with open permissions: ugo+rw: NotImplementedError Jul 31 12:23:21 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-0aff5161-bdae-40e2-94b5-168093b3e898 tempest-GroupSnapshotsTest-457900778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-6d1017ca-3585-4ab0-8e93-9d0ed5fcaa0a.2618d0df-e214-4c1d-9f11-35c9322beb08 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:23:21 devstack sudo[99994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-6d1017ca-3585-4ab0-8e93-9d0ed5fcaa0a.2618d0df-e214-4c1d-9f11-35c9322beb08 Jul 31 12:23:21 devstack sudo[99994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:23:21 devstack sudo[99994]: pam_unix(sudo:session): session closed for user root Jul 31 12:23:21 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-0aff5161-bdae-40e2-94b5-168093b3e898 tempest-GroupSnapshotsTest-457900778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-6d1017ca-3585-4ab0-8e93-9d0ed5fcaa0a.2618d0df-e214-4c1d-9f11-35c9322beb08" returned: 0 in 0.384s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:23:21 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-0aff5161-bdae-40e2-94b5-168093b3e898 tempest-GroupSnapshotsTest-457900778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-6d1017ca-3585-4ab0-8e93-9d0ed5fcaa0a.info {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:23:21 devstack sudo[100000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-6d1017ca-3585-4ab0-8e93-9d0ed5fcaa0a.info Jul 31 12:23:21 devstack sudo[100000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:23:21 devstack sudo[100000]: pam_unix(sudo:session): session closed for user root Jul 31 12:23:21 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-0aff5161-bdae-40e2-94b5-168093b3e898 tempest-GroupSnapshotsTest-457900778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-6d1017ca-3585-4ab0-8e93-9d0ed5fcaa0a.info" returned: 0 in 0.407s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:23:21 devstack cinder-volume[89182]: WARNING cinder.volume.drivers.remotefs [None req-0aff5161-bdae-40e2-94b5-168093b3e898 tempest-GroupSnapshotsTest-457900778 None] /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-6d1017ca-3585-4ab0-8e93-9d0ed5fcaa0a.info is being set with open permissions: ugo+rw: NotImplementedError Jul 31 12:23:21 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-0aff5161-bdae-40e2-94b5-168093b3e898 tempest-GroupSnapshotsTest-457900778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-6d1017ca-3585-4ab0-8e93-9d0ed5fcaa0a.info {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:23:21 devstack cinder-volume[89182]: DEBUG oslo_service.periodic_task [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89182) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 31 12:23:21 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:23:21 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:23:21 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:23:21 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:23:21 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:23:21 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:23:22 devstack sudo[100005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-6d1017ca-3585-4ab0-8e93-9d0ed5fcaa0a.info Jul 31 12:23:22 devstack sudo[100005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:23:22 devstack sudo[100011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 Jul 31 12:23:22 devstack sudo[100011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:23:22 devstack sudo[100005]: pam_unix(sudo:session): session closed for user root Jul 31 12:23:22 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-0aff5161-bdae-40e2-94b5-168093b3e898 tempest-GroupSnapshotsTest-457900778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-6d1017ca-3585-4ab0-8e93-9d0ed5fcaa0a.info" returned: 0 in 0.545s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:23:22 devstack sudo[100011]: pam_unix(sudo:session): session closed for user root Jul 31 12:23:22 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-0aff5161-bdae-40e2-94b5-168093b3e898 tempest-GroupSnapshotsTest-457900778 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.124s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:23:22 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2" returned: 0 in 0.538s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:23:22 devstack cinder-volume[89182]: DEBUG cinder.manager [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] Notifying Schedulers of capabilities ... {{(pid=89182) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 12:23:22 devstack cinder-volume[89182]: DEBUG oslo_service.periodic_task [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] Running periodic task VolumeManager._thread_info {{(pid=89182) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 31 12:23:22 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] thread count: 28 {{(pid=89182) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 31 12:23:22 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] thread info: [<_MainThread(MainThread, started 136154603720832)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=89182) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 31 12:23:22 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-0aff5161-bdae-40e2-94b5-168093b3e898 tempest-GroupSnapshotsTest-457900778 None] group_snapshot 70f1ce6d-e02f-4530-8f8d-85c11461ecaf: created successfully Jul 31 12:23:24 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-837de8de-8c32-49f5-8175-b8afc00d52b1 tempest-GroupSnapshotsTest-457900778 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:23:24 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-837de8de-8c32-49f5-8175-b8afc00d52b1 tempest-GroupSnapshotsTest-457900778 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:23:24 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-837de8de-8c32-49f5-8175-b8afc00d52b1 tempest-GroupSnapshotsTest-457900778 None] Acquiring lock "cinder-quobyte-2618d0df-e214-4c1d-9f11-35c9322beb08-451df0ff-2424-4668-b494-a4e91ee5a557" by "_create_volume_from_snapshot" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:23:24 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-837de8de-8c32-49f5-8175-b8afc00d52b1 tempest-GroupSnapshotsTest-457900778 None] Lock "cinder-quobyte-2618d0df-e214-4c1d-9f11-35c9322beb08-451df0ff-2424-4668-b494-a4e91ee5a557" acquired by "_create_volume_from_snapshot" :: waited 0.018s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:23:24 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-837de8de-8c32-49f5-8175-b8afc00d52b1 tempest-GroupSnapshotsTest-457900778 None] Creating volume 451df0ff-2424-4668-b494-a4e91ee5a557 from snapshot 2618d0df-e214-4c1d-9f11-35c9322beb08 {{(pid=89182) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 31 12:23:24 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-837de8de-8c32-49f5-8175-b8afc00d52b1 tempest-GroupSnapshotsTest-457900778 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:23:24 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-837de8de-8c32-49f5-8175-b8afc00d52b1 tempest-GroupSnapshotsTest-457900778 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:23:24 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-837de8de-8c32-49f5-8175-b8afc00d52b1 tempest-GroupSnapshotsTest-457900778 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:23:24 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-837de8de-8c32-49f5-8175-b8afc00d52b1 tempest-GroupSnapshotsTest-457900778 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:23:24 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-837de8de-8c32-49f5-8175-b8afc00d52b1 tempest-GroupSnapshotsTest-457900778 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:23:24 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-837de8de-8c32-49f5-8175-b8afc00d52b1 tempest-GroupSnapshotsTest-457900778 None] Selected osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 as target Quobyte volume. {{(pid=89182) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 12:23:24 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-837de8de-8c32-49f5-8175-b8afc00d52b1 tempest-GroupSnapshotsTest-457900778 None] Acquiring lock "cinder-quobyte-451df0ff-2424-4668-b494-a4e91ee5a557" by "_copy_volume_from_snapshot" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:23:24 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-837de8de-8c32-49f5-8175-b8afc00d52b1 tempest-GroupSnapshotsTest-457900778 None] Lock "cinder-quobyte-451df0ff-2424-4668-b494-a4e91ee5a557" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:23:24 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-837de8de-8c32-49f5-8175-b8afc00d52b1 tempest-GroupSnapshotsTest-457900778 None] snapshot: 2618d0df-e214-4c1d-9f11-35c9322beb08, volume: 451df0ff-2424-4668-b494-a4e91ee5a557, {{(pid=89182) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Jul 31 12:23:24 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-837de8de-8c32-49f5-8175-b8afc00d52b1 tempest-GroupSnapshotsTest-457900778 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:23:24 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-837de8de-8c32-49f5-8175-b8afc00d52b1 tempest-GroupSnapshotsTest-457900778 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:23:24 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-837de8de-8c32-49f5-8175-b8afc00d52b1 tempest-GroupSnapshotsTest-457900778 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:23:24 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-837de8de-8c32-49f5-8175-b8afc00d52b1 tempest-GroupSnapshotsTest-457900778 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:23:24 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-837de8de-8c32-49f5-8175-b8afc00d52b1 tempest-GroupSnapshotsTest-457900778 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:23:24 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[11565088-b1d4-470d-97aa-4d10f9d8f6a0]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:23:24 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-837de8de-8c32-49f5-8175-b8afc00d52b1 tempest-GroupSnapshotsTest-457900778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-6d1017ca-3585-4ab0-8e93-9d0ed5fcaa0a.2618d0df-e214-4c1d-9f11-35c9322beb08 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:23:24 devstack sudo[100029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-6d1017ca-3585-4ab0-8e93-9d0ed5fcaa0a.2618d0df-e214-4c1d-9f11-35c9322beb08 Jul 31 12:23:24 devstack sudo[100029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:23:25 devstack sudo[100029]: pam_unix(sudo:session): session closed for user root Jul 31 12:23:25 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-837de8de-8c32-49f5-8175-b8afc00d52b1 tempest-GroupSnapshotsTest-457900778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-6d1017ca-3585-4ab0-8e93-9d0ed5fcaa0a.2618d0df-e214-4c1d-9f11-35c9322beb08" returned: 0 in 0.481s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:23:25 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-837de8de-8c32-49f5-8175-b8afc00d52b1 tempest-GroupSnapshotsTest-457900778 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6d1017ca-3585-4ab0-8e93-9d0ed5fcaa0a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89182) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 12:23:25 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[d895aad9-16f8-4bd9-8a08-aae5ee452aef]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:23:25 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-837de8de-8c32-49f5-8175-b8afc00d52b1 tempest-GroupSnapshotsTest-457900778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-6d1017ca-3585-4ab0-8e93-9d0ed5fcaa0a {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:23:25 devstack sudo[100034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-6d1017ca-3585-4ab0-8e93-9d0ed5fcaa0a Jul 31 12:23:25 devstack sudo[100034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:23:25 devstack sudo[100034]: pam_unix(sudo:session): session closed for user root Jul 31 12:23:25 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-837de8de-8c32-49f5-8175-b8afc00d52b1 tempest-GroupSnapshotsTest-457900778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-6d1017ca-3585-4ab0-8e93-9d0ed5fcaa0a" returned: 0 in 0.485s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:23:25 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-837de8de-8c32-49f5-8175-b8afc00d52b1 tempest-GroupSnapshotsTest-457900778 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-6d1017ca-3585-4ab0-8e93-9d0ed5fcaa0a {{(pid=89182) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Jul 31 12:23:25 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-837de8de-8c32-49f5-8175-b8afc00d52b1 tempest-GroupSnapshotsTest-457900778 None] Creating direct copy from snapshot {{(pid=89182) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Jul 31 12:23:25 devstack cinder-volume[89182]: DEBUG cinder.utils [None req-837de8de-8c32-49f5-8175-b8afc00d52b1 tempest-GroupSnapshotsTest-457900778 None] Path /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-451df0ff-2424-4668-b494-a4e91ee5a557 not found in is_blk_device check {{(pid=89182) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 31 12:23:25 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-837de8de-8c32-49f5-8175-b8afc00d52b1 tempest-GroupSnapshotsTest-457900778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-6d1017ca-3585-4ab0-8e93-9d0ed5fcaa0a /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-451df0ff-2424-4668-b494-a4e91ee5a557 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:23:25 devstack sudo[100040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-6d1017ca-3585-4ab0-8e93-9d0ed5fcaa0a /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-451df0ff-2424-4668-b494-a4e91ee5a557 Jul 31 12:23:25 devstack sudo[100040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:23:31 devstack sudo[100040]: pam_unix(sudo:session): session closed for user root Jul 31 12:23:31 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-837de8de-8c32-49f5-8175-b8afc00d52b1 tempest-GroupSnapshotsTest-457900778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-6d1017ca-3585-4ab0-8e93-9d0ed5fcaa0a /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-451df0ff-2424-4668-b494-a4e91ee5a557" returned: 0 in 6.172s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:23:31 devstack cinder-volume[89182]: DEBUG cinder.image.image_utils [None req-837de8de-8c32-49f5-8175-b8afc00d52b1 tempest-GroupSnapshotsTest-457900778 None] Image conversion details: src /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-6d1017ca-3585-4ab0-8e93-9d0ed5fcaa0a, size 1024.00 MB, duration 6.17 sec, destination /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-451df0ff-2424-4668-b494-a4e91ee5a557 {{(pid=89182) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 31 12:23:31 devstack cinder-volume[89182]: INFO cinder.image.image_utils [None req-837de8de-8c32-49f5-8175-b8afc00d52b1 tempest-GroupSnapshotsTest-457900778 None] Converted 1024.00 MB image at 165.88 MB/s Jul 31 12:23:31 devstack cinder-volume[89182]: WARNING cinder.volume.drivers.remotefs [None req-837de8de-8c32-49f5-8175-b8afc00d52b1 tempest-GroupSnapshotsTest-457900778 None] /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-451df0ff-2424-4668-b494-a4e91ee5a557 is being set with open permissions: ugo+rw: NotImplementedError Jul 31 12:23:31 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-837de8de-8c32-49f5-8175-b8afc00d52b1 tempest-GroupSnapshotsTest-457900778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-451df0ff-2424-4668-b494-a4e91ee5a557 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:23:31 devstack sudo[100063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-451df0ff-2424-4668-b494-a4e91ee5a557 Jul 31 12:23:31 devstack sudo[100063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:23:32 devstack sudo[100063]: pam_unix(sudo:session): session closed for user root Jul 31 12:23:32 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-837de8de-8c32-49f5-8175-b8afc00d52b1 tempest-GroupSnapshotsTest-457900778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-451df0ff-2424-4668-b494-a4e91ee5a557" returned: 0 in 0.343s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:23:32 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-837de8de-8c32-49f5-8175-b8afc00d52b1 tempest-GroupSnapshotsTest-457900778 None] Lock "cinder-quobyte-451df0ff-2424-4668-b494-a4e91ee5a557" released by "_copy_volume_from_snapshot" :: held 7.633s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:23:32 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-837de8de-8c32-49f5-8175-b8afc00d52b1 tempest-GroupSnapshotsTest-457900778 None] Lock "cinder-quobyte-2618d0df-e214-4c1d-9f11-35c9322beb08-451df0ff-2424-4668-b494-a4e91ee5a557" released by "_create_volume_from_snapshot" :: held 7.741s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:23:32 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-837de8de-8c32-49f5-8175-b8afc00d52b1 tempest-GroupSnapshotsTest-457900778 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.761s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:23:32 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-837de8de-8c32-49f5-8175-b8afc00d52b1 tempest-GroupSnapshotsTest-457900778 None] Create group from source-snapshot-70f1ce6d-e02f-4530-8f8d-85c11461ecaf completed successfully. Jul 31 12:23:34 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-9c6238e8-9fe0-48db-a0aa-5131b5c20f04 tempest-GroupSnapshotsTest-457900778 None] Acquiring lock "cinder-quobyte-451df0ff-2424-4668-b494-a4e91ee5a557" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:23:34 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-9c6238e8-9fe0-48db-a0aa-5131b5c20f04 tempest-GroupSnapshotsTest-457900778 None] Lock "cinder-quobyte-451df0ff-2424-4668-b494-a4e91ee5a557" acquired by "delete_volume" :: waited 0.023s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:23:34 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[03a42284-29c0-474d-8c07-93c979ea9bc9]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:23:34 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-9c6238e8-9fe0-48db-a0aa-5131b5c20f04 tempest-GroupSnapshotsTest-457900778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-451df0ff-2424-4668-b494-a4e91ee5a557 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:23:34 devstack sudo[100067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-451df0ff-2424-4668-b494-a4e91ee5a557 Jul 31 12:23:34 devstack sudo[100067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:23:34 devstack sudo[100067]: pam_unix(sudo:session): session closed for user root Jul 31 12:23:34 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-9c6238e8-9fe0-48db-a0aa-5131b5c20f04 tempest-GroupSnapshotsTest-457900778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-451df0ff-2424-4668-b494-a4e91ee5a557" returned: 0 in 0.489s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:23:34 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-9c6238e8-9fe0-48db-a0aa-5131b5c20f04 tempest-GroupSnapshotsTest-457900778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-451df0ff-2424-4668-b494-a4e91ee5a557 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:23:35 devstack sudo[100109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-451df0ff-2424-4668-b494-a4e91ee5a557 Jul 31 12:23:35 devstack sudo[100109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:23:35 devstack sudo[100109]: pam_unix(sudo:session): session closed for user root Jul 31 12:23:35 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-9c6238e8-9fe0-48db-a0aa-5131b5c20f04 tempest-GroupSnapshotsTest-457900778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-451df0ff-2424-4668-b494-a4e91ee5a557" returned: 0 in 0.366s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:23:35 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-9c6238e8-9fe0-48db-a0aa-5131b5c20f04 tempest-GroupSnapshotsTest-457900778 None] Lock "cinder-quobyte-451df0ff-2424-4668-b494-a4e91ee5a557" released by "delete_volume" :: held 0.938s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:23:35 devstack cinder-volume[89182]: DEBUG cinder.quota [None req-9c6238e8-9fe0-48db-a0aa-5131b5c20f04 tempest-GroupSnapshotsTest-457900778 None] Created reservations ['9bf7ca28-1605-4365-9f65-e64f74d3cc91'] {{(pid=89182) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 12:23:35 devstack cinder-volume[89182]: WARNING cinder.quota [None req-9c6238e8-9fe0-48db-a0aa-5131b5c20f04 tempest-GroupSnapshotsTest-457900778 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1929879409 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1929879409, it is now deprecated. Please use the default quota class for default quota. Jul 31 12:23:35 devstack cinder-volume[89182]: WARNING cinder.quota [None req-9c6238e8-9fe0-48db-a0aa-5131b5c20f04 tempest-GroupSnapshotsTest-457900778 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1929879409 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1929879409, it is now deprecated. Please use the default quota class for default quota. Jul 31 12:23:35 devstack cinder-volume[89182]: DEBUG cinder.quota [None req-9c6238e8-9fe0-48db-a0aa-5131b5c20f04 tempest-GroupSnapshotsTest-457900778 None] Created reservations ['e10d1c04-3e41-41db-8d06-83df6659975d', '32577a63-0e12-4f67-8cc9-81f2b71e71b9', 'cc5b3797-6de0-4bb8-8e9c-8c9af0f42f6a', 'de140813-8b9b-4a76-a04a-98dd352fb9f2'] {{(pid=89182) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 12:23:35 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-9c6238e8-9fe0-48db-a0aa-5131b5c20f04 tempest-GroupSnapshotsTest-457900778 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:23:35 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-9c6238e8-9fe0-48db-a0aa-5131b5c20f04 tempest-GroupSnapshotsTest-457900778 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:23:35 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-9c6238e8-9fe0-48db-a0aa-5131b5c20f04 tempest-GroupSnapshotsTest-457900778 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:23:35 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-9c6238e8-9fe0-48db-a0aa-5131b5c20f04 tempest-GroupSnapshotsTest-457900778 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:23:35 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-9c6238e8-9fe0-48db-a0aa-5131b5c20f04 tempest-GroupSnapshotsTest-457900778 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:23:35 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-9c6238e8-9fe0-48db-a0aa-5131b5c20f04 tempest-GroupSnapshotsTest-457900778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:23:35 devstack sudo[100114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 Jul 31 12:23:35 devstack sudo[100114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:23:36 devstack cinder-volume[89182]: DEBUG cinder.volume.flows.manager.create_volume [None req-49e6c935-f9f3-4387-be71-6c92b20a001e tempest-AttachVolumeNegativeTest-1979015609 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89182) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 12:23:36 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-49e6c935-f9f3-4387-be71-6c92b20a001e tempest-AttachVolumeNegativeTest-1979015609 None] Flow 'volume_create_manager' (770f0271-a35d-4179-815d-ddbc120a27f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:23:36 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-49e6c935-f9f3-4387-be71-6c92b20a001e tempest-AttachVolumeNegativeTest-1979015609 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1853a8f-a06c-4216-a032-7fded3bde6e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:23:36 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-49e6c935-f9f3-4387-be71-6c92b20a001e tempest-AttachVolumeNegativeTest-1979015609 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1853a8f-a06c-4216-a032-7fded3bde6e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:23:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1210649280',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89590e7b-f45e-4e7d-b15f-0665cf621da6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9581615e2dc443ea56b640260015955',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:23:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:23:36Z,use_quota=True,user_id='1b0f4502906f47628207383e0140cd35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:23:36 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-49e6c935-f9f3-4387-be71-6c92b20a001e tempest-AttachVolumeNegativeTest-1979015609 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e1ee97e-9ed2-4cab-8e13-b31e07196de5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:23:36 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-49e6c935-f9f3-4387-be71-6c92b20a001e tempest-AttachVolumeNegativeTest-1979015609 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e1ee97e-9ed2-4cab-8e13-b31e07196de5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:23:36 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-49e6c935-f9f3-4387-be71-6c92b20a001e tempest-AttachVolumeNegativeTest-1979015609 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ddbbb3d-9685-4860-8d04-a3abbe3dfdd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:23:36 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-49e6c935-f9f3-4387-be71-6c92b20a001e tempest-AttachVolumeNegativeTest-1979015609 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ddbbb3d-9685-4860-8d04-a3abbe3dfdd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '89590e7b-f45e-4e7d-b15f-0665cf621da6', 'volume_name': 'volume-89590e7b-f45e-4e7d-b15f-0665cf621da6', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:23:36 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-49e6c935-f9f3-4387-be71-6c92b20a001e tempest-AttachVolumeNegativeTest-1979015609 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f6db072-0ed9-4f61-8463-8618f0eb1faf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:23:36 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-49e6c935-f9f3-4387-be71-6c92b20a001e tempest-AttachVolumeNegativeTest-1979015609 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f6db072-0ed9-4f61-8463-8618f0eb1faf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:23:36 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-49e6c935-f9f3-4387-be71-6c92b20a001e tempest-AttachVolumeNegativeTest-1979015609 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28e679a5-8cb8-49f0-8608-e55718732f9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:23:36 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-49e6c935-f9f3-4387-be71-6c92b20a001e tempest-AttachVolumeNegativeTest-1979015609 None] Volume 89590e7b-f45e-4e7d-b15f-0665cf621da6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-89590e7b-f45e-4e7d-b15f-0665cf621da6', 'volume_size': 1} Jul 31 12:23:36 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-49e6c935-f9f3-4387-be71-6c92b20a001e tempest-AttachVolumeNegativeTest-1979015609 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:23:36 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-49e6c935-f9f3-4387-be71-6c92b20a001e tempest-AttachVolumeNegativeTest-1979015609 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:23:36 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-49e6c935-f9f3-4387-be71-6c92b20a001e tempest-AttachVolumeNegativeTest-1979015609 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:23:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1210649280',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89590e7b-f45e-4e7d-b15f-0665cf621da6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9581615e2dc443ea56b640260015955',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:23:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:23:36Z,use_quota=True,user_id='1b0f4502906f47628207383e0140cd35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)}" {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 12:23:36 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-49e6c935-f9f3-4387-be71-6c92b20a001e tempest-AttachVolumeNegativeTest-1979015609 None] Creating volume 89590e7b-f45e-4e7d-b15f-0665cf621da6 {{(pid=89182) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 12:23:36 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-49e6c935-f9f3-4387-be71-6c92b20a001e tempest-AttachVolumeNegativeTest-1979015609 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:23:36 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-49e6c935-f9f3-4387-be71-6c92b20a001e tempest-AttachVolumeNegativeTest-1979015609 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:23:36 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-49e6c935-f9f3-4387-be71-6c92b20a001e tempest-AttachVolumeNegativeTest-1979015609 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:23:36 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-49e6c935-f9f3-4387-be71-6c92b20a001e tempest-AttachVolumeNegativeTest-1979015609 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:23:36 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-49e6c935-f9f3-4387-be71-6c92b20a001e tempest-AttachVolumeNegativeTest-1979015609 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:23:36 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-49e6c935-f9f3-4387-be71-6c92b20a001e tempest-AttachVolumeNegativeTest-1979015609 None] Selected osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 as target Quobyte volume. {{(pid=89182) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 12:23:36 devstack cinder-volume[89182]: INFO cinder.volume.drivers.remotefs [None req-49e6c935-f9f3-4387-be71-6c92b20a001e tempest-AttachVolumeNegativeTest-1979015609 None] casted to osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 Jul 31 12:23:36 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-49e6c935-f9f3-4387-be71-6c92b20a001e tempest-AttachVolumeNegativeTest-1979015609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-89590e7b-f45e-4e7d-b15f-0665cf621da6 1073741824 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:23:36 devstack sudo[100114]: pam_unix(sudo:session): session closed for user root Jul 31 12:23:36 devstack sudo[100117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-89590e7b-f45e-4e7d-b15f-0665cf621da6 1073741824 Jul 31 12:23:36 devstack sudo[100117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:23:36 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-9c6238e8-9fe0-48db-a0aa-5131b5c20f04 tempest-GroupSnapshotsTest-457900778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2" returned: 0 in 0.520s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:23:36 devstack cinder-volume[89182]: DEBUG cinder.manager [None req-9c6238e8-9fe0-48db-a0aa-5131b5c20f04 tempest-GroupSnapshotsTest-457900778 None] Notifying Schedulers of capabilities ... {{(pid=89182) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 12:23:36 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-9c6238e8-9fe0-48db-a0aa-5131b5c20f04 tempest-GroupSnapshotsTest-457900778 None] Delete group completed successfully. Jul 31 12:23:36 devstack sudo[100117]: pam_unix(sudo:session): session closed for user root Jul 31 12:23:36 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-49e6c935-f9f3-4387-be71-6c92b20a001e tempest-AttachVolumeNegativeTest-1979015609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-89590e7b-f45e-4e7d-b15f-0665cf621da6 1073741824" returned: 0 in 0.603s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:23:36 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-49e6c935-f9f3-4387-be71-6c92b20a001e tempest-AttachVolumeNegativeTest-1979015609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-89590e7b-f45e-4e7d-b15f-0665cf621da6 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:23:36 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-58b8a680-a21f-4bee-8681-366e5c83a0c0 tempest-GroupSnapshotsTest-457900778 None] group_snapshot 70f1ce6d-e02f-4530-8f8d-85c11461ecaf: deleting Jul 31 12:23:36 devstack sudo[100124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-89590e7b-f45e-4e7d-b15f-0665cf621da6 Jul 31 12:23:36 devstack sudo[100124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:23:36 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-58b8a680-a21f-4bee-8681-366e5c83a0c0 tempest-GroupSnapshotsTest-457900778 None] group_snapshot 70f1ce6d-e02f-4530-8f8d-85c11461ecaf: deleting {{(pid=89182) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 31 12:23:37 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-58b8a680-a21f-4bee-8681-366e5c83a0c0 tempest-GroupSnapshotsTest-457900778 None] Acquiring lock "cinder-quobyte-6d1017ca-3585-4ab0-8e93-9d0ed5fcaa0a" by "delete_snapshot" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:23:37 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-58b8a680-a21f-4bee-8681-366e5c83a0c0 tempest-GroupSnapshotsTest-457900778 None] Lock "cinder-quobyte-6d1017ca-3585-4ab0-8e93-9d0ed5fcaa0a" acquired by "delete_snapshot" :: waited 0.027s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:23:37 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-58b8a680-a21f-4bee-8681-366e5c83a0c0 tempest-GroupSnapshotsTest-457900778 None] Acquiring lock "cinder-quobyte-2618d0df-e214-4c1d-9f11-35c9322beb08" by "_delete_snapshot" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:23:37 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-58b8a680-a21f-4bee-8681-366e5c83a0c0 tempest-GroupSnapshotsTest-457900778 None] Lock "cinder-quobyte-2618d0df-e214-4c1d-9f11-35c9322beb08" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:23:37 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-58b8a680-a21f-4bee-8681-366e5c83a0c0 tempest-GroupSnapshotsTest-457900778 None] Deleting offline snapshot 2618d0df-e214-4c1d-9f11-35c9322beb08 of volume 6d1017ca-3585-4ab0-8e93-9d0ed5fcaa0a {{(pid=89182) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 31 12:23:37 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-58b8a680-a21f-4bee-8681-366e5c83a0c0 tempest-GroupSnapshotsTest-457900778 None] snapshot_file for this snap is: volume-6d1017ca-3585-4ab0-8e93-9d0ed5fcaa0a.2618d0df-e214-4c1d-9f11-35c9322beb08 {{(pid=89182) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 31 12:23:37 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[f376042e-8d0f-424c-899c-581bcfbbfeee]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:23:37 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-58b8a680-a21f-4bee-8681-366e5c83a0c0 tempest-GroupSnapshotsTest-457900778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-6d1017ca-3585-4ab0-8e93-9d0ed5fcaa0a.2618d0df-e214-4c1d-9f11-35c9322beb08 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:23:37 devstack sudo[100124]: pam_unix(sudo:session): session closed for user root Jul 31 12:23:37 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-49e6c935-f9f3-4387-be71-6c92b20a001e tempest-AttachVolumeNegativeTest-1979015609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-89590e7b-f45e-4e7d-b15f-0665cf621da6" returned: 0 in 0.309s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:23:37 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-49e6c935-f9f3-4387-be71-6c92b20a001e tempest-AttachVolumeNegativeTest-1979015609 None] <== create_volume: return (1000ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'} {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 12:23:37 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-49e6c935-f9f3-4387-be71-6c92b20a001e tempest-AttachVolumeNegativeTest-1979015609 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.003s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:23:37 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-49e6c935-f9f3-4387-be71-6c92b20a001e tempest-AttachVolumeNegativeTest-1979015609 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28e679a5-8cb8-49f0-8608-e55718732f9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-89590e7b-f45e-4e7d-b15f-0665cf621da6', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:23:37 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-49e6c935-f9f3-4387-be71-6c92b20a001e tempest-AttachVolumeNegativeTest-1979015609 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3387ff85-9e92-4744-be2a-e23a37194cbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:23:37 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-49e6c935-f9f3-4387-be71-6c92b20a001e tempest-AttachVolumeNegativeTest-1979015609 None] Volume volume-89590e7b-f45e-4e7d-b15f-0665cf621da6 (89590e7b-f45e-4e7d-b15f-0665cf621da6): created successfully Jul 31 12:23:37 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-49e6c935-f9f3-4387-be71-6c92b20a001e tempest-AttachVolumeNegativeTest-1979015609 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3387ff85-9e92-4744-be2a-e23a37194cbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:23:37 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-49e6c935-f9f3-4387-be71-6c92b20a001e tempest-AttachVolumeNegativeTest-1979015609 None] Flow 'volume_create_manager' (770f0271-a35d-4179-815d-ddbc120a27f2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:23:37 devstack sudo[100127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-6d1017ca-3585-4ab0-8e93-9d0ed5fcaa0a.2618d0df-e214-4c1d-9f11-35c9322beb08 Jul 31 12:23:37 devstack sudo[100127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:23:37 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-49e6c935-f9f3-4387-be71-6c92b20a001e tempest-AttachVolumeNegativeTest-1979015609 None] Created volume successfully. Jul 31 12:23:37 devstack sudo[100127]: pam_unix(sudo:session): session closed for user root Jul 31 12:23:37 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-58b8a680-a21f-4bee-8681-366e5c83a0c0 tempest-GroupSnapshotsTest-457900778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-6d1017ca-3585-4ab0-8e93-9d0ed5fcaa0a.2618d0df-e214-4c1d-9f11-35c9322beb08" returned: 0 in 0.458s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:23:37 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-58b8a680-a21f-4bee-8681-366e5c83a0c0 tempest-GroupSnapshotsTest-457900778 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6d1017ca-3585-4ab0-8e93-9d0ed5fcaa0a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89182) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 12:23:37 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb17e2e4-5a83-496a-84e2-92532c1fc615]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:23:37 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-58b8a680-a21f-4bee-8681-366e5c83a0c0 tempest-GroupSnapshotsTest-457900778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-6d1017ca-3585-4ab0-8e93-9d0ed5fcaa0a {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:23:37 devstack sudo[100132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-6d1017ca-3585-4ab0-8e93-9d0ed5fcaa0a Jul 31 12:23:37 devstack sudo[100132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:23:38 devstack sudo[100132]: pam_unix(sudo:session): session closed for user root Jul 31 12:23:38 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-58b8a680-a21f-4bee-8681-366e5c83a0c0 tempest-GroupSnapshotsTest-457900778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-6d1017ca-3585-4ab0-8e93-9d0ed5fcaa0a" returned: 0 in 0.851s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:23:38 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-58b8a680-a21f-4bee-8681-366e5c83a0c0 tempest-GroupSnapshotsTest-457900778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-6d1017ca-3585-4ab0-8e93-9d0ed5fcaa0a.2618d0df-e214-4c1d-9f11-35c9322beb08 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:23:38 devstack sudo[100140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-6d1017ca-3585-4ab0-8e93-9d0ed5fcaa0a.2618d0df-e214-4c1d-9f11-35c9322beb08 Jul 31 12:23:38 devstack sudo[100140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:23:39 devstack sudo[100140]: pam_unix(sudo:session): session closed for user root Jul 31 12:23:39 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-58b8a680-a21f-4bee-8681-366e5c83a0c0 tempest-GroupSnapshotsTest-457900778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-6d1017ca-3585-4ab0-8e93-9d0ed5fcaa0a.2618d0df-e214-4c1d-9f11-35c9322beb08" returned: 0 in 0.583s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:23:39 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-58b8a680-a21f-4bee-8681-366e5c83a0c0 tempest-GroupSnapshotsTest-457900778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-6d1017ca-3585-4ab0-8e93-9d0ed5fcaa0a.2618d0df-e214-4c1d-9f11-35c9322beb08 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:23:39 devstack sudo[100154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-6d1017ca-3585-4ab0-8e93-9d0ed5fcaa0a.2618d0df-e214-4c1d-9f11-35c9322beb08 Jul 31 12:23:39 devstack sudo[100154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:23:39 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [req-5ebc2b2e-f8be-4cea-a627-a4173e9e381f req-6eea44ea-670e-4e2f-87b2-ad64df557a51 tempest-AttachVolumeNegativeTest-1979015609 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:23:39 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [req-5ebc2b2e-f8be-4cea-a627-a4173e9e381f req-6eea44ea-670e-4e2f-87b2-ad64df557a51 tempest-AttachVolumeNegativeTest-1979015609 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:23:39 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [req-5ebc2b2e-f8be-4cea-a627-a4173e9e381f req-6eea44ea-670e-4e2f-87b2-ad64df557a51 tempest-AttachVolumeNegativeTest-1979015609 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:23:39 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [req-5ebc2b2e-f8be-4cea-a627-a4173e9e381f req-6eea44ea-670e-4e2f-87b2-ad64df557a51 tempest-AttachVolumeNegativeTest-1979015609 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88', 'name': 'volume-89590e7b-f45e-4e7d-b15f-0665cf621da6', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b9e193f4-892d-447f-905f-34e16ca0fc81', 'enforce_multipath': True} {{(pid=89182) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 31 12:23:39 devstack cinder-volume[89182]: INFO cinder.volume.manager [req-5ebc2b2e-f8be-4cea-a627-a4173e9e381f req-6eea44ea-670e-4e2f-87b2-ad64df557a51 tempest-AttachVolumeNegativeTest-1979015609 None] attachment_update completed successfully. Jul 31 12:23:39 devstack sudo[100154]: pam_unix(sudo:session): session closed for user root Jul 31 12:23:39 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-58b8a680-a21f-4bee-8681-366e5c83a0c0 tempest-GroupSnapshotsTest-457900778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-6d1017ca-3585-4ab0-8e93-9d0ed5fcaa0a.2618d0df-e214-4c1d-9f11-35c9322beb08" returned: 0 in 0.491s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:23:39 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-58b8a680-a21f-4bee-8681-366e5c83a0c0 tempest-GroupSnapshotsTest-457900778 None] Lock "cinder-quobyte-2618d0df-e214-4c1d-9f11-35c9322beb08" released by "_delete_snapshot" :: held 2.546s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:23:39 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-58b8a680-a21f-4bee-8681-366e5c83a0c0 tempest-GroupSnapshotsTest-457900778 None] Lock "cinder-quobyte-6d1017ca-3585-4ab0-8e93-9d0ed5fcaa0a" released by "delete_snapshot" :: held 2.578s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:23:39 devstack cinder-volume[89182]: WARNING cinder.quota [None req-58b8a680-a21f-4bee-8681-366e5c83a0c0 tempest-GroupSnapshotsTest-457900778 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1929879409 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1929879409, it is now deprecated. Please use the default quota class for default quota. Jul 31 12:23:39 devstack cinder-volume[89182]: DEBUG cinder.quota [None req-58b8a680-a21f-4bee-8681-366e5c83a0c0 tempest-GroupSnapshotsTest-457900778 None] Created reservations ['3b424012-c909-4881-9ab1-ec356f297d54', '540c47c0-d231-477f-9591-ba1d4f798d06', '6aafef31-6eba-47c8-8d1a-90a2ef1cb947', '921f95f9-5df9-4ef3-bdaf-f2439710fa4a'] {{(pid=89182) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 12:23:39 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-58b8a680-a21f-4bee-8681-366e5c83a0c0 tempest-GroupSnapshotsTest-457900778 None] group_snapshot 70f1ce6d-e02f-4530-8f8d-85c11461ecaf: deleted successfully Jul 31 12:23:40 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-d62f8959-c5c2-49d1-b782-c0870299a9e7 tempest-GroupSnapshotsTest-457900778 None] Acquiring lock "cinder-quobyte-6d1017ca-3585-4ab0-8e93-9d0ed5fcaa0a" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:23:41 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-d62f8959-c5c2-49d1-b782-c0870299a9e7 tempest-GroupSnapshotsTest-457900778 None] Lock "cinder-quobyte-6d1017ca-3585-4ab0-8e93-9d0ed5fcaa0a" acquired by "delete_volume" :: waited 0.022s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:23:41 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cb8a5a7-3046-48ff-9a03-d9c84c00c307]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:23:41 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-d62f8959-c5c2-49d1-b782-c0870299a9e7 tempest-GroupSnapshotsTest-457900778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-6d1017ca-3585-4ab0-8e93-9d0ed5fcaa0a {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:23:41 devstack sudo[100544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-6d1017ca-3585-4ab0-8e93-9d0ed5fcaa0a Jul 31 12:23:41 devstack sudo[100544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:23:41 devstack sudo[100544]: pam_unix(sudo:session): session closed for user root Jul 31 12:23:41 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-d62f8959-c5c2-49d1-b782-c0870299a9e7 tempest-GroupSnapshotsTest-457900778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-6d1017ca-3585-4ab0-8e93-9d0ed5fcaa0a" returned: 0 in 0.636s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:23:41 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-d62f8959-c5c2-49d1-b782-c0870299a9e7 tempest-GroupSnapshotsTest-457900778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-6d1017ca-3585-4ab0-8e93-9d0ed5fcaa0a {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:23:41 devstack sudo[100549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-6d1017ca-3585-4ab0-8e93-9d0ed5fcaa0a Jul 31 12:23:41 devstack sudo[100549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:23:42 devstack sudo[100549]: pam_unix(sudo:session): session closed for user root Jul 31 12:23:42 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-d62f8959-c5c2-49d1-b782-c0870299a9e7 tempest-GroupSnapshotsTest-457900778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-6d1017ca-3585-4ab0-8e93-9d0ed5fcaa0a" returned: 0 in 0.352s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:23:42 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-d62f8959-c5c2-49d1-b782-c0870299a9e7 tempest-GroupSnapshotsTest-457900778 None] Lock "cinder-quobyte-6d1017ca-3585-4ab0-8e93-9d0ed5fcaa0a" released by "delete_volume" :: held 1.093s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:23:42 devstack cinder-volume[89182]: DEBUG cinder.quota [None req-d62f8959-c5c2-49d1-b782-c0870299a9e7 tempest-GroupSnapshotsTest-457900778 None] Created reservations ['df6bf1dc-07da-46b8-8b43-f0ce4c587676'] {{(pid=89182) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 12:23:42 devstack cinder-volume[89182]: WARNING cinder.db.api [None req-d62f8959-c5c2-49d1-b782-c0870299a9e7 tempest-GroupSnapshotsTest-457900778 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1929879409'] Jul 31 12:23:42 devstack cinder-volume[89182]: DEBUG cinder.quota [None req-d62f8959-c5c2-49d1-b782-c0870299a9e7 tempest-GroupSnapshotsTest-457900778 None] Created reservations ['85881f01-4ce0-44b0-8cf9-d9d93fb00aa3', 'ede3bfa1-a5c3-4ce8-a7e2-f420b58e5d2c', '2a1f507b-0319-44c6-bb5c-81ce86f82346', '00f03860-0f12-438a-b258-49099771519e'] {{(pid=89182) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 12:23:42 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-d62f8959-c5c2-49d1-b782-c0870299a9e7 tempest-GroupSnapshotsTest-457900778 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:23:42 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-d62f8959-c5c2-49d1-b782-c0870299a9e7 tempest-GroupSnapshotsTest-457900778 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:23:42 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-d62f8959-c5c2-49d1-b782-c0870299a9e7 tempest-GroupSnapshotsTest-457900778 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:23:42 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-d62f8959-c5c2-49d1-b782-c0870299a9e7 tempest-GroupSnapshotsTest-457900778 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:23:42 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-d62f8959-c5c2-49d1-b782-c0870299a9e7 tempest-GroupSnapshotsTest-457900778 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:23:42 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-d62f8959-c5c2-49d1-b782-c0870299a9e7 tempest-GroupSnapshotsTest-457900778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:23:42 devstack sudo[100555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 Jul 31 12:23:42 devstack sudo[100555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:23:42 devstack cinder-volume[89182]: INFO cinder.volume.manager [req-d6571b73-f84f-4841-963b-e06ada4a95ef req-48de2f62-e765-4961-9b58-ee17a1ae1b23 tempest-AttachVolumeNegativeTest-1979015609 None] Terminate volume connection completed successfully. Jul 31 12:23:42 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [req-d6571b73-f84f-4841-963b-e06ada4a95ef req-48de2f62-e765-4961-9b58-ee17a1ae1b23 tempest-AttachVolumeNegativeTest-1979015609 None] Deleting attachment b9e193f4-892d-447f-905f-34e16ca0fc81. {{(pid=89182) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 31 12:23:42 devstack sudo[100555]: pam_unix(sudo:session): session closed for user root Jul 31 12:23:42 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-d62f8959-c5c2-49d1-b782-c0870299a9e7 tempest-GroupSnapshotsTest-457900778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2" returned: 0 in 0.373s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:23:42 devstack cinder-volume[89182]: DEBUG cinder.manager [None req-d62f8959-c5c2-49d1-b782-c0870299a9e7 tempest-GroupSnapshotsTest-457900778 None] Notifying Schedulers of capabilities ... {{(pid=89182) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 12:23:42 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-d62f8959-c5c2-49d1-b782-c0870299a9e7 tempest-GroupSnapshotsTest-457900778 None] Delete group completed successfully. Jul 31 12:23:43 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-3b24ad80-9b38-4c27-b604-b1347847a70f tempest-GroupSnapshotsTest-457900778 None] Group tempest-GroupSnapshotsTest-Group-1210751928: creating Jul 31 12:23:43 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-3b24ad80-9b38-4c27-b604-b1347847a70f tempest-GroupSnapshotsTest-457900778 None] Group tempest-GroupSnapshotsTest-Group-1210751928: created successfully Jul 31 12:23:43 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-3b24ad80-9b38-4c27-b604-b1347847a70f tempest-GroupSnapshotsTest-457900778 None] Create group completed successfully. Jul 31 12:23:45 devstack cinder-volume[89182]: DEBUG cinder.volume.flows.manager.create_volume [None req-bb90c6a3-0970-4148-9edc-c9bb024ef4c1 tempest-GroupSnapshotsTest-457900778 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89182) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 12:23:45 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-bb90c6a3-0970-4148-9edc-c9bb024ef4c1 tempest-GroupSnapshotsTest-457900778 None] Flow 'volume_create_manager' (224ce996-5762-443c-9be1-1b217237a9ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:23:45 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-bb90c6a3-0970-4148-9edc-c9bb024ef4c1 tempest-GroupSnapshotsTest-457900778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3de5b49-9ccd-4f9a-9cb3-f6e7a451303e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:23:45 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-bb90c6a3-0970-4148-9edc-c9bb024ef4c1 tempest-GroupSnapshotsTest-457900778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3de5b49-9ccd-4f9a-9cb3-f6e7a451303e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:23:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-695272281',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6e235ad7-6b1c-463a-a13c-d52b1fbf9386,host='devstack@QuobyteHD#QuobyteHD',id=f95811d7-f424-4f4b-8981-9437d7ba191c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8aa57263ea6741369b82e3f2281a3cc8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:23:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:23:46Z,use_quota=True,user_id='b52e6a278ed04e49ba9db889fbd7715f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(46b32b75-4950-47f9-b112-e9bd06fe236f),volume_type_id=46b32b75-4950-47f9-b112-e9bd06fe236f)' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:23:45 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-bb90c6a3-0970-4148-9edc-c9bb024ef4c1 tempest-GroupSnapshotsTest-457900778 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a14e6080-280b-43d4-b840-edece6633acd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:23:45 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-bb90c6a3-0970-4148-9edc-c9bb024ef4c1 tempest-GroupSnapshotsTest-457900778 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a14e6080-280b-43d4-b840-edece6633acd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:23:45 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-bb90c6a3-0970-4148-9edc-c9bb024ef4c1 tempest-GroupSnapshotsTest-457900778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d32679a-aa78-44a9-8ae4-33954ffa169a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:23:45 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-bb90c6a3-0970-4148-9edc-c9bb024ef4c1 tempest-GroupSnapshotsTest-457900778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d32679a-aa78-44a9-8ae4-33954ffa169a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f95811d7-f424-4f4b-8981-9437d7ba191c', 'volume_name': 'volume-f95811d7-f424-4f4b-8981-9437d7ba191c', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:23:45 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-bb90c6a3-0970-4148-9edc-c9bb024ef4c1 tempest-GroupSnapshotsTest-457900778 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b69457d-9405-4876-b55b-fe14c2a30dec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:23:45 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-bb90c6a3-0970-4148-9edc-c9bb024ef4c1 tempest-GroupSnapshotsTest-457900778 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b69457d-9405-4876-b55b-fe14c2a30dec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:23:45 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-bb90c6a3-0970-4148-9edc-c9bb024ef4c1 tempest-GroupSnapshotsTest-457900778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2967c041-bf87-425c-99a2-161b5e5b0f02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:23:45 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-bb90c6a3-0970-4148-9edc-c9bb024ef4c1 tempest-GroupSnapshotsTest-457900778 None] Volume f95811d7-f424-4f4b-8981-9437d7ba191c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f95811d7-f424-4f4b-8981-9437d7ba191c', 'volume_size': 1} Jul 31 12:23:45 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-bb90c6a3-0970-4148-9edc-c9bb024ef4c1 tempest-GroupSnapshotsTest-457900778 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:23:45 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-bb90c6a3-0970-4148-9edc-c9bb024ef4c1 tempest-GroupSnapshotsTest-457900778 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:23:45 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-bb90c6a3-0970-4148-9edc-c9bb024ef4c1 tempest-GroupSnapshotsTest-457900778 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=6e235ad7-6b1c-463a-a13c-d52b1fbf9386,created_at=2026-07-31T10:23:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-695272281',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6e235ad7-6b1c-463a-a13c-d52b1fbf9386,host='devstack@QuobyteHD#QuobyteHD',id=f95811d7-f424-4f4b-8981-9437d7ba191c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8aa57263ea6741369b82e3f2281a3cc8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:23:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:23:46Z,use_quota=True,user_id='b52e6a278ed04e49ba9db889fbd7715f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(46b32b75-4950-47f9-b112-e9bd06fe236f),volume_type_id=46b32b75-4950-47f9-b112-e9bd06fe236f)}" {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 12:23:45 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-bb90c6a3-0970-4148-9edc-c9bb024ef4c1 tempest-GroupSnapshotsTest-457900778 None] Creating volume f95811d7-f424-4f4b-8981-9437d7ba191c {{(pid=89182) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 12:23:45 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-bb90c6a3-0970-4148-9edc-c9bb024ef4c1 tempest-GroupSnapshotsTest-457900778 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:23:45 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-bb90c6a3-0970-4148-9edc-c9bb024ef4c1 tempest-GroupSnapshotsTest-457900778 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:23:45 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-bb90c6a3-0970-4148-9edc-c9bb024ef4c1 tempest-GroupSnapshotsTest-457900778 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:23:45 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-bb90c6a3-0970-4148-9edc-c9bb024ef4c1 tempest-GroupSnapshotsTest-457900778 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:23:45 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-bb90c6a3-0970-4148-9edc-c9bb024ef4c1 tempest-GroupSnapshotsTest-457900778 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:23:45 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-bb90c6a3-0970-4148-9edc-c9bb024ef4c1 tempest-GroupSnapshotsTest-457900778 None] Selected osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 as target Quobyte volume. {{(pid=89182) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 12:23:45 devstack cinder-volume[89182]: INFO cinder.volume.drivers.remotefs [None req-bb90c6a3-0970-4148-9edc-c9bb024ef4c1 tempest-GroupSnapshotsTest-457900778 None] casted to osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 Jul 31 12:23:45 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-bb90c6a3-0970-4148-9edc-c9bb024ef4c1 tempest-GroupSnapshotsTest-457900778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-f95811d7-f424-4f4b-8981-9437d7ba191c 1073741824 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:23:45 devstack sudo[100610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-f95811d7-f424-4f4b-8981-9437d7ba191c 1073741824 Jul 31 12:23:45 devstack sudo[100610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:23:46 devstack sudo[100610]: pam_unix(sudo:session): session closed for user root Jul 31 12:23:46 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-bb90c6a3-0970-4148-9edc-c9bb024ef4c1 tempest-GroupSnapshotsTest-457900778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-f95811d7-f424-4f4b-8981-9437d7ba191c 1073741824" returned: 0 in 0.513s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:23:46 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-bb90c6a3-0970-4148-9edc-c9bb024ef4c1 tempest-GroupSnapshotsTest-457900778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-f95811d7-f424-4f4b-8981-9437d7ba191c {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:23:46 devstack sudo[100618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-f95811d7-f424-4f4b-8981-9437d7ba191c Jul 31 12:23:46 devstack sudo[100618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:23:46 devstack sudo[100618]: pam_unix(sudo:session): session closed for user root Jul 31 12:23:46 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-bb90c6a3-0970-4148-9edc-c9bb024ef4c1 tempest-GroupSnapshotsTest-457900778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-f95811d7-f424-4f4b-8981-9437d7ba191c" returned: 0 in 0.315s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:23:46 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-bb90c6a3-0970-4148-9edc-c9bb024ef4c1 tempest-GroupSnapshotsTest-457900778 None] <== create_volume: return (889ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'} {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 12:23:46 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-bb90c6a3-0970-4148-9edc-c9bb024ef4c1 tempest-GroupSnapshotsTest-457900778 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.895s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:23:46 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-bb90c6a3-0970-4148-9edc-c9bb024ef4c1 tempest-GroupSnapshotsTest-457900778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2967c041-bf87-425c-99a2-161b5e5b0f02) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f95811d7-f424-4f4b-8981-9437d7ba191c', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:23:46 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-bb90c6a3-0970-4148-9edc-c9bb024ef4c1 tempest-GroupSnapshotsTest-457900778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (851a684b-a37e-4b6e-8b5c-6d91fe5b9ed2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:23:46 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-bb90c6a3-0970-4148-9edc-c9bb024ef4c1 tempest-GroupSnapshotsTest-457900778 None] Volume volume-f95811d7-f424-4f4b-8981-9437d7ba191c (f95811d7-f424-4f4b-8981-9437d7ba191c): created successfully Jul 31 12:23:46 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-bb90c6a3-0970-4148-9edc-c9bb024ef4c1 tempest-GroupSnapshotsTest-457900778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (851a684b-a37e-4b6e-8b5c-6d91fe5b9ed2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:23:46 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-bb90c6a3-0970-4148-9edc-c9bb024ef4c1 tempest-GroupSnapshotsTest-457900778 None] Flow 'volume_create_manager' (224ce996-5762-443c-9be1-1b217237a9ab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:23:46 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-bb90c6a3-0970-4148-9edc-c9bb024ef4c1 tempest-GroupSnapshotsTest-457900778 None] Created volume successfully. Jul 31 12:23:47 devstack cinder-volume[89182]: DEBUG cinder.volume.flows.manager.create_volume [None req-97e3b271-f53e-4727-a706-7d76153e2938 tempest-GroupSnapshotsTest-457900778 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89182) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 12:23:47 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-97e3b271-f53e-4727-a706-7d76153e2938 tempest-GroupSnapshotsTest-457900778 None] Flow 'volume_create_manager' (ecd8a93e-dd37-4d74-9cad-d35e681853b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:23:47 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-97e3b271-f53e-4727-a706-7d76153e2938 tempest-GroupSnapshotsTest-457900778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1c37fdb-1ed6-4f1c-a405-a376ef340c58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:23:47 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-97e3b271-f53e-4727-a706-7d76153e2938 tempest-GroupSnapshotsTest-457900778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1c37fdb-1ed6-4f1c-a405-a376ef340c58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:23:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-63676300',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6e235ad7-6b1c-463a-a13c-d52b1fbf9386,host='devstack@QuobyteHD#QuobyteHD',id=5b8e90fe-b242-4a6a-92ec-d5e2b4d567b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8aa57263ea6741369b82e3f2281a3cc8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:23:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:23:48Z,use_quota=True,user_id='b52e6a278ed04e49ba9db889fbd7715f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(46b32b75-4950-47f9-b112-e9bd06fe236f),volume_type_id=46b32b75-4950-47f9-b112-e9bd06fe236f)' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:23:47 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-97e3b271-f53e-4727-a706-7d76153e2938 tempest-GroupSnapshotsTest-457900778 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b21e107e-4adc-4206-a5a9-faba2e41dac9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:23:47 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-97e3b271-f53e-4727-a706-7d76153e2938 tempest-GroupSnapshotsTest-457900778 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b21e107e-4adc-4206-a5a9-faba2e41dac9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:23:47 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-97e3b271-f53e-4727-a706-7d76153e2938 tempest-GroupSnapshotsTest-457900778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97373d77-a8ca-457d-ac76-867a9d7121eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:23:47 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-97e3b271-f53e-4727-a706-7d76153e2938 tempest-GroupSnapshotsTest-457900778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97373d77-a8ca-457d-ac76-867a9d7121eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5b8e90fe-b242-4a6a-92ec-d5e2b4d567b6', 'volume_name': 'volume-5b8e90fe-b242-4a6a-92ec-d5e2b4d567b6', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:23:47 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-97e3b271-f53e-4727-a706-7d76153e2938 tempest-GroupSnapshotsTest-457900778 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (638db843-1360-49c2-a03c-c083abd918f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:23:47 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-97e3b271-f53e-4727-a706-7d76153e2938 tempest-GroupSnapshotsTest-457900778 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (638db843-1360-49c2-a03c-c083abd918f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:23:47 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-97e3b271-f53e-4727-a706-7d76153e2938 tempest-GroupSnapshotsTest-457900778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a82cb48-2bc3-4b8d-aa15-fb58db3e6a1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:23:47 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-97e3b271-f53e-4727-a706-7d76153e2938 tempest-GroupSnapshotsTest-457900778 None] Volume 5b8e90fe-b242-4a6a-92ec-d5e2b4d567b6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5b8e90fe-b242-4a6a-92ec-d5e2b4d567b6', 'volume_size': 1} Jul 31 12:23:47 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-97e3b271-f53e-4727-a706-7d76153e2938 tempest-GroupSnapshotsTest-457900778 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:23:47 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-97e3b271-f53e-4727-a706-7d76153e2938 tempest-GroupSnapshotsTest-457900778 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:23:47 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-97e3b271-f53e-4727-a706-7d76153e2938 tempest-GroupSnapshotsTest-457900778 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=6e235ad7-6b1c-463a-a13c-d52b1fbf9386,created_at=2026-07-31T10:23:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-63676300',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6e235ad7-6b1c-463a-a13c-d52b1fbf9386,host='devstack@QuobyteHD#QuobyteHD',id=5b8e90fe-b242-4a6a-92ec-d5e2b4d567b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8aa57263ea6741369b82e3f2281a3cc8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:23:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:23:48Z,use_quota=True,user_id='b52e6a278ed04e49ba9db889fbd7715f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(46b32b75-4950-47f9-b112-e9bd06fe236f),volume_type_id=46b32b75-4950-47f9-b112-e9bd06fe236f)}" {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 12:23:47 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-97e3b271-f53e-4727-a706-7d76153e2938 tempest-GroupSnapshotsTest-457900778 None] Creating volume 5b8e90fe-b242-4a6a-92ec-d5e2b4d567b6 {{(pid=89182) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 12:23:47 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-97e3b271-f53e-4727-a706-7d76153e2938 tempest-GroupSnapshotsTest-457900778 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:23:47 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-97e3b271-f53e-4727-a706-7d76153e2938 tempest-GroupSnapshotsTest-457900778 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:23:47 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-97e3b271-f53e-4727-a706-7d76153e2938 tempest-GroupSnapshotsTest-457900778 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:23:47 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-97e3b271-f53e-4727-a706-7d76153e2938 tempest-GroupSnapshotsTest-457900778 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:23:47 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-97e3b271-f53e-4727-a706-7d76153e2938 tempest-GroupSnapshotsTest-457900778 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:23:47 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-97e3b271-f53e-4727-a706-7d76153e2938 tempest-GroupSnapshotsTest-457900778 None] Selected osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 as target Quobyte volume. {{(pid=89182) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 12:23:47 devstack cinder-volume[89182]: INFO cinder.volume.drivers.remotefs [None req-97e3b271-f53e-4727-a706-7d76153e2938 tempest-GroupSnapshotsTest-457900778 None] casted to osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 Jul 31 12:23:47 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-97e3b271-f53e-4727-a706-7d76153e2938 tempest-GroupSnapshotsTest-457900778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-5b8e90fe-b242-4a6a-92ec-d5e2b4d567b6 1073741824 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:23:47 devstack sudo[100622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-5b8e90fe-b242-4a6a-92ec-d5e2b4d567b6 1073741824 Jul 31 12:23:47 devstack sudo[100622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:23:48 devstack sudo[100622]: pam_unix(sudo:session): session closed for user root Jul 31 12:23:48 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-97e3b271-f53e-4727-a706-7d76153e2938 tempest-GroupSnapshotsTest-457900778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-5b8e90fe-b242-4a6a-92ec-d5e2b4d567b6 1073741824" returned: 0 in 0.538s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:23:48 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-97e3b271-f53e-4727-a706-7d76153e2938 tempest-GroupSnapshotsTest-457900778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-5b8e90fe-b242-4a6a-92ec-d5e2b4d567b6 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:23:48 devstack sudo[100628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-5b8e90fe-b242-4a6a-92ec-d5e2b4d567b6 Jul 31 12:23:48 devstack sudo[100628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:23:48 devstack sudo[100628]: pam_unix(sudo:session): session closed for user root Jul 31 12:23:48 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-97e3b271-f53e-4727-a706-7d76153e2938 tempest-GroupSnapshotsTest-457900778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-5b8e90fe-b242-4a6a-92ec-d5e2b4d567b6" returned: 0 in 0.291s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:23:48 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-97e3b271-f53e-4727-a706-7d76153e2938 tempest-GroupSnapshotsTest-457900778 None] <== create_volume: return (881ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'} {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 12:23:48 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-97e3b271-f53e-4727-a706-7d76153e2938 tempest-GroupSnapshotsTest-457900778 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.883s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:23:48 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-97e3b271-f53e-4727-a706-7d76153e2938 tempest-GroupSnapshotsTest-457900778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a82cb48-2bc3-4b8d-aa15-fb58db3e6a1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5b8e90fe-b242-4a6a-92ec-d5e2b4d567b6', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:23:48 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-97e3b271-f53e-4727-a706-7d76153e2938 tempest-GroupSnapshotsTest-457900778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4664be46-5958-4c58-a00c-6ca17d76b818) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:23:48 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-97e3b271-f53e-4727-a706-7d76153e2938 tempest-GroupSnapshotsTest-457900778 None] Volume volume-5b8e90fe-b242-4a6a-92ec-d5e2b4d567b6 (5b8e90fe-b242-4a6a-92ec-d5e2b4d567b6): created successfully Jul 31 12:23:48 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-97e3b271-f53e-4727-a706-7d76153e2938 tempest-GroupSnapshotsTest-457900778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4664be46-5958-4c58-a00c-6ca17d76b818) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:23:48 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-97e3b271-f53e-4727-a706-7d76153e2938 tempest-GroupSnapshotsTest-457900778 None] Flow 'volume_create_manager' (ecd8a93e-dd37-4d74-9cad-d35e681853b7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:23:48 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-97e3b271-f53e-4727-a706-7d76153e2938 tempest-GroupSnapshotsTest-457900778 None] Created volume successfully. Jul 31 12:23:50 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-f8178419-ebd3-426f-9598-99c8e5012194 tempest-GroupSnapshotsTest-457900778 None] Update group completed successfully. Jul 31 12:23:51 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-d9ac554f-4f18-40c7-8fd8-392051a84f20 tempest-GroupSnapshotsTest-457900778 None] Update group completed successfully. Jul 31 12:23:52 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-b8673c81-f387-4b15-b853-12651a23b93e tempest-GroupSnapshotsTest-457900778 None] Update group completed successfully. Jul 31 12:23:54 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-eb15ea3c-ab1c-41cc-93e8-f89389673c0d tempest-GroupSnapshotsTest-457900778 None] Update group completed successfully. Jul 31 12:23:55 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-6376a5f1-746c-4419-8fe9-943c12d120c5 tempest-GroupSnapshotsTest-457900778 None] GroupSnapshot a1d15379-13df-46fc-8218-94a701787041: creating. Jul 31 12:23:55 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-6376a5f1-746c-4419-8fe9-943c12d120c5 tempest-GroupSnapshotsTest-457900778 None] Group snapshot a1d15379-13df-46fc-8218-94a701787041: creating. {{(pid=89182) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 31 12:23:55 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-6376a5f1-746c-4419-8fe9-943c12d120c5 tempest-GroupSnapshotsTest-457900778 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:23:55 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-6376a5f1-746c-4419-8fe9-943c12d120c5 tempest-GroupSnapshotsTest-457900778 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:23:55 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-6376a5f1-746c-4419-8fe9-943c12d120c5 tempest-GroupSnapshotsTest-457900778 None] Creating offline snapshot 6a65d2a2-1d5a-4625-bd35-936b788a0b1d of volume f95811d7-f424-4f4b-8981-9437d7ba191c {{(pid=89182) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 31 12:23:55 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[39f5a9fb-b5c5-48e5-99bf-318f8cd51204]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:23:55 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-6376a5f1-746c-4419-8fe9-943c12d120c5 tempest-GroupSnapshotsTest-457900778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-f95811d7-f424-4f4b-8981-9437d7ba191c {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:23:56 devstack sudo[100638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-f95811d7-f424-4f4b-8981-9437d7ba191c Jul 31 12:23:56 devstack sudo[100638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:23:56 devstack sudo[100638]: pam_unix(sudo:session): session closed for user root Jul 31 12:23:56 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-6376a5f1-746c-4419-8fe9-943c12d120c5 tempest-GroupSnapshotsTest-457900778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-f95811d7-f424-4f4b-8981-9437d7ba191c" returned: 0 in 0.454s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:23:56 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-6376a5f1-746c-4419-8fe9-943c12d120c5 tempest-GroupSnapshotsTest-457900778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-f95811d7-f424-4f4b-8981-9437d7ba191c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-f95811d7-f424-4f4b-8981-9437d7ba191c.6a65d2a2-1d5a-4625-bd35-936b788a0b1d 1G {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:23:56 devstack sudo[100644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-f95811d7-f424-4f4b-8981-9437d7ba191c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-f95811d7-f424-4f4b-8981-9437d7ba191c.6a65d2a2-1d5a-4625-bd35-936b788a0b1d 1G Jul 31 12:23:56 devstack sudo[100644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:23:56 devstack sudo[100644]: pam_unix(sudo:session): session closed for user root Jul 31 12:23:56 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-6376a5f1-746c-4419-8fe9-943c12d120c5 tempest-GroupSnapshotsTest-457900778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-f95811d7-f424-4f4b-8981-9437d7ba191c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-f95811d7-f424-4f4b-8981-9437d7ba191c.6a65d2a2-1d5a-4625-bd35-936b788a0b1d 1G" returned: 0 in 0.487s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:23:56 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-6376a5f1-746c-4419-8fe9-943c12d120c5 tempest-GroupSnapshotsTest-457900778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f95811d7-f424-4f4b-8981-9437d7ba191c -F qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-f95811d7-f424-4f4b-8981-9437d7ba191c.6a65d2a2-1d5a-4625-bd35-936b788a0b1d {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:23:56 devstack sudo[100650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f95811d7-f424-4f4b-8981-9437d7ba191c -F qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-f95811d7-f424-4f4b-8981-9437d7ba191c.6a65d2a2-1d5a-4625-bd35-936b788a0b1d Jul 31 12:23:56 devstack sudo[100650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:23:57 devstack sudo[100650]: pam_unix(sudo:session): session closed for user root Jul 31 12:23:57 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-6376a5f1-746c-4419-8fe9-943c12d120c5 tempest-GroupSnapshotsTest-457900778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f95811d7-f424-4f4b-8981-9437d7ba191c -F qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-f95811d7-f424-4f4b-8981-9437d7ba191c.6a65d2a2-1d5a-4625-bd35-936b788a0b1d" returned: 0 in 0.356s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:23:57 devstack cinder-volume[89182]: WARNING cinder.volume.drivers.remotefs [None req-6376a5f1-746c-4419-8fe9-943c12d120c5 tempest-GroupSnapshotsTest-457900778 None] /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-f95811d7-f424-4f4b-8981-9437d7ba191c.6a65d2a2-1d5a-4625-bd35-936b788a0b1d is being set with open permissions: ugo+rw: NotImplementedError Jul 31 12:23:57 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-6376a5f1-746c-4419-8fe9-943c12d120c5 tempest-GroupSnapshotsTest-457900778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-f95811d7-f424-4f4b-8981-9437d7ba191c.6a65d2a2-1d5a-4625-bd35-936b788a0b1d {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:23:57 devstack sudo[100656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-f95811d7-f424-4f4b-8981-9437d7ba191c.6a65d2a2-1d5a-4625-bd35-936b788a0b1d Jul 31 12:23:57 devstack sudo[100656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:23:57 devstack sudo[100656]: pam_unix(sudo:session): session closed for user root Jul 31 12:23:57 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-6376a5f1-746c-4419-8fe9-943c12d120c5 tempest-GroupSnapshotsTest-457900778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-f95811d7-f424-4f4b-8981-9437d7ba191c.6a65d2a2-1d5a-4625-bd35-936b788a0b1d" returned: 0 in 0.298s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:23:57 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-6376a5f1-746c-4419-8fe9-943c12d120c5 tempest-GroupSnapshotsTest-457900778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-f95811d7-f424-4f4b-8981-9437d7ba191c.info {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:23:57 devstack sudo[100659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-f95811d7-f424-4f4b-8981-9437d7ba191c.info Jul 31 12:23:57 devstack sudo[100659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:23:57 devstack sudo[100659]: pam_unix(sudo:session): session closed for user root Jul 31 12:23:57 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-6376a5f1-746c-4419-8fe9-943c12d120c5 tempest-GroupSnapshotsTest-457900778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-f95811d7-f424-4f4b-8981-9437d7ba191c.info" returned: 0 in 0.281s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:23:57 devstack cinder-volume[89182]: WARNING cinder.volume.drivers.remotefs [None req-6376a5f1-746c-4419-8fe9-943c12d120c5 tempest-GroupSnapshotsTest-457900778 None] /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-f95811d7-f424-4f4b-8981-9437d7ba191c.info is being set with open permissions: ugo+rw: NotImplementedError Jul 31 12:23:57 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-6376a5f1-746c-4419-8fe9-943c12d120c5 tempest-GroupSnapshotsTest-457900778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-f95811d7-f424-4f4b-8981-9437d7ba191c.info {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:23:57 devstack sudo[100662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-f95811d7-f424-4f4b-8981-9437d7ba191c.info Jul 31 12:23:57 devstack sudo[100662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:23:58 devstack sudo[100662]: pam_unix(sudo:session): session closed for user root Jul 31 12:23:58 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-6376a5f1-746c-4419-8fe9-943c12d120c5 tempest-GroupSnapshotsTest-457900778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-f95811d7-f424-4f4b-8981-9437d7ba191c.info" returned: 0 in 0.272s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:23:58 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-6376a5f1-746c-4419-8fe9-943c12d120c5 tempest-GroupSnapshotsTest-457900778 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.250s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:23:58 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-6376a5f1-746c-4419-8fe9-943c12d120c5 tempest-GroupSnapshotsTest-457900778 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:23:58 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-6376a5f1-746c-4419-8fe9-943c12d120c5 tempest-GroupSnapshotsTest-457900778 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:23:58 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-6376a5f1-746c-4419-8fe9-943c12d120c5 tempest-GroupSnapshotsTest-457900778 None] Creating offline snapshot 7d50fd2c-0447-47e2-8357-c9e42b02f3cc of volume 5b8e90fe-b242-4a6a-92ec-d5e2b4d567b6 {{(pid=89182) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 31 12:23:58 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc19b765-28a5-40c4-a360-e65e86725091]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:23:58 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-6376a5f1-746c-4419-8fe9-943c12d120c5 tempest-GroupSnapshotsTest-457900778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-5b8e90fe-b242-4a6a-92ec-d5e2b4d567b6 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:23:58 devstack sudo[100665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-5b8e90fe-b242-4a6a-92ec-d5e2b4d567b6 Jul 31 12:23:58 devstack sudo[100665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:23:58 devstack sudo[100665]: pam_unix(sudo:session): session closed for user root Jul 31 12:23:58 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-6376a5f1-746c-4419-8fe9-943c12d120c5 tempest-GroupSnapshotsTest-457900778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-5b8e90fe-b242-4a6a-92ec-d5e2b4d567b6" returned: 0 in 0.408s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:23:58 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-6376a5f1-746c-4419-8fe9-943c12d120c5 tempest-GroupSnapshotsTest-457900778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-5b8e90fe-b242-4a6a-92ec-d5e2b4d567b6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-5b8e90fe-b242-4a6a-92ec-d5e2b4d567b6.7d50fd2c-0447-47e2-8357-c9e42b02f3cc 1G {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:23:58 devstack sudo[100671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-5b8e90fe-b242-4a6a-92ec-d5e2b4d567b6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-5b8e90fe-b242-4a6a-92ec-d5e2b4d567b6.7d50fd2c-0447-47e2-8357-c9e42b02f3cc 1G Jul 31 12:23:58 devstack sudo[100671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:23:59 devstack sudo[100671]: pam_unix(sudo:session): session closed for user root Jul 31 12:23:59 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-6376a5f1-746c-4419-8fe9-943c12d120c5 tempest-GroupSnapshotsTest-457900778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-5b8e90fe-b242-4a6a-92ec-d5e2b4d567b6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-5b8e90fe-b242-4a6a-92ec-d5e2b4d567b6.7d50fd2c-0447-47e2-8357-c9e42b02f3cc 1G" returned: 0 in 0.697s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:23:59 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-6376a5f1-746c-4419-8fe9-943c12d120c5 tempest-GroupSnapshotsTest-457900778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5b8e90fe-b242-4a6a-92ec-d5e2b4d567b6 -F qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-5b8e90fe-b242-4a6a-92ec-d5e2b4d567b6.7d50fd2c-0447-47e2-8357-c9e42b02f3cc {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:23:59 devstack sudo[100677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5b8e90fe-b242-4a6a-92ec-d5e2b4d567b6 -F qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-5b8e90fe-b242-4a6a-92ec-d5e2b4d567b6.7d50fd2c-0447-47e2-8357-c9e42b02f3cc Jul 31 12:23:59 devstack sudo[100677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:23:59 devstack sudo[100677]: pam_unix(sudo:session): session closed for user root Jul 31 12:23:59 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-6376a5f1-746c-4419-8fe9-943c12d120c5 tempest-GroupSnapshotsTest-457900778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5b8e90fe-b242-4a6a-92ec-d5e2b4d567b6 -F qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-5b8e90fe-b242-4a6a-92ec-d5e2b4d567b6.7d50fd2c-0447-47e2-8357-c9e42b02f3cc" returned: 0 in 0.405s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:23:59 devstack cinder-volume[89182]: WARNING cinder.volume.drivers.remotefs [None req-6376a5f1-746c-4419-8fe9-943c12d120c5 tempest-GroupSnapshotsTest-457900778 None] /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-5b8e90fe-b242-4a6a-92ec-d5e2b4d567b6.7d50fd2c-0447-47e2-8357-c9e42b02f3cc is being set with open permissions: ugo+rw: NotImplementedError Jul 31 12:23:59 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-6376a5f1-746c-4419-8fe9-943c12d120c5 tempest-GroupSnapshotsTest-457900778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-5b8e90fe-b242-4a6a-92ec-d5e2b4d567b6.7d50fd2c-0447-47e2-8357-c9e42b02f3cc {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:23:59 devstack sudo[100683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-5b8e90fe-b242-4a6a-92ec-d5e2b4d567b6.7d50fd2c-0447-47e2-8357-c9e42b02f3cc Jul 31 12:23:59 devstack sudo[100683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:24:00 devstack sudo[100683]: pam_unix(sudo:session): session closed for user root Jul 31 12:24:00 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-6376a5f1-746c-4419-8fe9-943c12d120c5 tempest-GroupSnapshotsTest-457900778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-5b8e90fe-b242-4a6a-92ec-d5e2b4d567b6.7d50fd2c-0447-47e2-8357-c9e42b02f3cc" returned: 0 in 0.358s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:24:00 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-6376a5f1-746c-4419-8fe9-943c12d120c5 tempest-GroupSnapshotsTest-457900778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-5b8e90fe-b242-4a6a-92ec-d5e2b4d567b6.info {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:24:00 devstack sudo[100686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-5b8e90fe-b242-4a6a-92ec-d5e2b4d567b6.info Jul 31 12:24:00 devstack sudo[100686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:24:00 devstack sudo[100686]: pam_unix(sudo:session): session closed for user root Jul 31 12:24:00 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-6376a5f1-746c-4419-8fe9-943c12d120c5 tempest-GroupSnapshotsTest-457900778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-5b8e90fe-b242-4a6a-92ec-d5e2b4d567b6.info" returned: 0 in 0.273s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:24:00 devstack cinder-volume[89182]: WARNING cinder.volume.drivers.remotefs [None req-6376a5f1-746c-4419-8fe9-943c12d120c5 tempest-GroupSnapshotsTest-457900778 None] /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-5b8e90fe-b242-4a6a-92ec-d5e2b4d567b6.info is being set with open permissions: ugo+rw: NotImplementedError Jul 31 12:24:00 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-6376a5f1-746c-4419-8fe9-943c12d120c5 tempest-GroupSnapshotsTest-457900778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-5b8e90fe-b242-4a6a-92ec-d5e2b4d567b6.info {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:24:00 devstack sudo[100689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-5b8e90fe-b242-4a6a-92ec-d5e2b4d567b6.info Jul 31 12:24:00 devstack sudo[100689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:24:00 devstack sudo[100689]: pam_unix(sudo:session): session closed for user root Jul 31 12:24:00 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-6376a5f1-746c-4419-8fe9-943c12d120c5 tempest-GroupSnapshotsTest-457900778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-5b8e90fe-b242-4a6a-92ec-d5e2b4d567b6.info" returned: 0 in 0.331s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:24:00 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-6376a5f1-746c-4419-8fe9-943c12d120c5 tempest-GroupSnapshotsTest-457900778 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.600s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:24:00 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-6376a5f1-746c-4419-8fe9-943c12d120c5 tempest-GroupSnapshotsTest-457900778 None] group_snapshot a1d15379-13df-46fc-8218-94a701787041: created successfully Jul 31 12:24:01 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-0ff2b56f-434f-4159-a5fe-06f42ded9fde tempest-GroupSnapshotsTest-457900778 None] group_snapshot a1d15379-13df-46fc-8218-94a701787041: deleting Jul 31 12:24:01 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-0ff2b56f-434f-4159-a5fe-06f42ded9fde tempest-GroupSnapshotsTest-457900778 None] group_snapshot a1d15379-13df-46fc-8218-94a701787041: deleting {{(pid=89182) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 31 12:24:01 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-0ff2b56f-434f-4159-a5fe-06f42ded9fde tempest-GroupSnapshotsTest-457900778 None] Acquiring lock "cinder-quobyte-f95811d7-f424-4f4b-8981-9437d7ba191c" by "delete_snapshot" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:24:01 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-0ff2b56f-434f-4159-a5fe-06f42ded9fde tempest-GroupSnapshotsTest-457900778 None] Lock "cinder-quobyte-f95811d7-f424-4f4b-8981-9437d7ba191c" acquired by "delete_snapshot" :: waited 0.018s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:24:01 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-0ff2b56f-434f-4159-a5fe-06f42ded9fde tempest-GroupSnapshotsTest-457900778 None] Acquiring lock "cinder-quobyte-6a65d2a2-1d5a-4625-bd35-936b788a0b1d" by "_delete_snapshot" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:24:01 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-0ff2b56f-434f-4159-a5fe-06f42ded9fde tempest-GroupSnapshotsTest-457900778 None] Lock "cinder-quobyte-6a65d2a2-1d5a-4625-bd35-936b788a0b1d" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:24:01 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-0ff2b56f-434f-4159-a5fe-06f42ded9fde tempest-GroupSnapshotsTest-457900778 None] Deleting offline snapshot 6a65d2a2-1d5a-4625-bd35-936b788a0b1d of volume f95811d7-f424-4f4b-8981-9437d7ba191c {{(pid=89182) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 31 12:24:01 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-0ff2b56f-434f-4159-a5fe-06f42ded9fde tempest-GroupSnapshotsTest-457900778 None] snapshot_file for this snap is: volume-f95811d7-f424-4f4b-8981-9437d7ba191c.6a65d2a2-1d5a-4625-bd35-936b788a0b1d {{(pid=89182) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 31 12:24:01 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[e71e4a4a-b8e2-4ae2-a329-bfbe7440e8c6]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:24:01 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-0ff2b56f-434f-4159-a5fe-06f42ded9fde tempest-GroupSnapshotsTest-457900778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-f95811d7-f424-4f4b-8981-9437d7ba191c.6a65d2a2-1d5a-4625-bd35-936b788a0b1d {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:24:01 devstack sudo[100692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-f95811d7-f424-4f4b-8981-9437d7ba191c.6a65d2a2-1d5a-4625-bd35-936b788a0b1d Jul 31 12:24:01 devstack sudo[100692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:24:02 devstack sudo[100692]: pam_unix(sudo:session): session closed for user root Jul 31 12:24:02 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-0ff2b56f-434f-4159-a5fe-06f42ded9fde tempest-GroupSnapshotsTest-457900778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-f95811d7-f424-4f4b-8981-9437d7ba191c.6a65d2a2-1d5a-4625-bd35-936b788a0b1d" returned: 0 in 0.518s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:24:02 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-0ff2b56f-434f-4159-a5fe-06f42ded9fde tempest-GroupSnapshotsTest-457900778 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f95811d7-f424-4f4b-8981-9437d7ba191c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89182) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 12:24:02 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b82afeb-f5f5-4cd7-b739-473f06b15ad4]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:24:02 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-0ff2b56f-434f-4159-a5fe-06f42ded9fde tempest-GroupSnapshotsTest-457900778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-f95811d7-f424-4f4b-8981-9437d7ba191c {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:24:02 devstack sudo[100697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-f95811d7-f424-4f4b-8981-9437d7ba191c Jul 31 12:24:02 devstack sudo[100697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:24:02 devstack sudo[100697]: pam_unix(sudo:session): session closed for user root Jul 31 12:24:02 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-0ff2b56f-434f-4159-a5fe-06f42ded9fde tempest-GroupSnapshotsTest-457900778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-f95811d7-f424-4f4b-8981-9437d7ba191c" returned: 0 in 0.485s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:24:02 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-0ff2b56f-434f-4159-a5fe-06f42ded9fde tempest-GroupSnapshotsTest-457900778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-f95811d7-f424-4f4b-8981-9437d7ba191c.6a65d2a2-1d5a-4625-bd35-936b788a0b1d {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:24:02 devstack sudo[100702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-f95811d7-f424-4f4b-8981-9437d7ba191c.6a65d2a2-1d5a-4625-bd35-936b788a0b1d Jul 31 12:24:02 devstack sudo[100702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:24:03 devstack sudo[100702]: pam_unix(sudo:session): session closed for user root Jul 31 12:24:03 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-0ff2b56f-434f-4159-a5fe-06f42ded9fde tempest-GroupSnapshotsTest-457900778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-f95811d7-f424-4f4b-8981-9437d7ba191c.6a65d2a2-1d5a-4625-bd35-936b788a0b1d" returned: 0 in 0.417s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:24:03 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-0ff2b56f-434f-4159-a5fe-06f42ded9fde tempest-GroupSnapshotsTest-457900778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-f95811d7-f424-4f4b-8981-9437d7ba191c.6a65d2a2-1d5a-4625-bd35-936b788a0b1d {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:24:03 devstack sudo[100709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-f95811d7-f424-4f4b-8981-9437d7ba191c.6a65d2a2-1d5a-4625-bd35-936b788a0b1d Jul 31 12:24:03 devstack sudo[100709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:24:03 devstack sudo[100709]: pam_unix(sudo:session): session closed for user root Jul 31 12:24:03 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-0ff2b56f-434f-4159-a5fe-06f42ded9fde tempest-GroupSnapshotsTest-457900778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-f95811d7-f424-4f4b-8981-9437d7ba191c.6a65d2a2-1d5a-4625-bd35-936b788a0b1d" returned: 0 in 0.322s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:24:03 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-0ff2b56f-434f-4159-a5fe-06f42ded9fde tempest-GroupSnapshotsTest-457900778 None] Lock "cinder-quobyte-6a65d2a2-1d5a-4625-bd35-936b788a0b1d" released by "_delete_snapshot" :: held 1.891s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:24:03 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-0ff2b56f-434f-4159-a5fe-06f42ded9fde tempest-GroupSnapshotsTest-457900778 None] Lock "cinder-quobyte-f95811d7-f424-4f4b-8981-9437d7ba191c" released by "delete_snapshot" :: held 1.929s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:24:03 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-0ff2b56f-434f-4159-a5fe-06f42ded9fde tempest-GroupSnapshotsTest-457900778 None] Acquiring lock "cinder-quobyte-5b8e90fe-b242-4a6a-92ec-d5e2b4d567b6" by "delete_snapshot" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:24:03 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-0ff2b56f-434f-4159-a5fe-06f42ded9fde tempest-GroupSnapshotsTest-457900778 None] Lock "cinder-quobyte-5b8e90fe-b242-4a6a-92ec-d5e2b4d567b6" acquired by "delete_snapshot" :: waited 0.020s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:24:03 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-0ff2b56f-434f-4159-a5fe-06f42ded9fde tempest-GroupSnapshotsTest-457900778 None] Acquiring lock "cinder-quobyte-7d50fd2c-0447-47e2-8357-c9e42b02f3cc" by "_delete_snapshot" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:24:03 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-0ff2b56f-434f-4159-a5fe-06f42ded9fde tempest-GroupSnapshotsTest-457900778 None] Lock "cinder-quobyte-7d50fd2c-0447-47e2-8357-c9e42b02f3cc" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:24:03 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-0ff2b56f-434f-4159-a5fe-06f42ded9fde tempest-GroupSnapshotsTest-457900778 None] Deleting offline snapshot 7d50fd2c-0447-47e2-8357-c9e42b02f3cc of volume 5b8e90fe-b242-4a6a-92ec-d5e2b4d567b6 {{(pid=89182) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 31 12:24:03 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-0ff2b56f-434f-4159-a5fe-06f42ded9fde tempest-GroupSnapshotsTest-457900778 None] snapshot_file for this snap is: volume-5b8e90fe-b242-4a6a-92ec-d5e2b4d567b6.7d50fd2c-0447-47e2-8357-c9e42b02f3cc {{(pid=89182) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 31 12:24:03 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca88a655-98d5-4afe-a2b4-31985accf827]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:24:03 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-0ff2b56f-434f-4159-a5fe-06f42ded9fde tempest-GroupSnapshotsTest-457900778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-5b8e90fe-b242-4a6a-92ec-d5e2b4d567b6.7d50fd2c-0447-47e2-8357-c9e42b02f3cc {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:24:03 devstack sudo[100712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-5b8e90fe-b242-4a6a-92ec-d5e2b4d567b6.7d50fd2c-0447-47e2-8357-c9e42b02f3cc Jul 31 12:24:03 devstack sudo[100712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:24:04 devstack sudo[100712]: pam_unix(sudo:session): session closed for user root Jul 31 12:24:04 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-0ff2b56f-434f-4159-a5fe-06f42ded9fde tempest-GroupSnapshotsTest-457900778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-5b8e90fe-b242-4a6a-92ec-d5e2b4d567b6.7d50fd2c-0447-47e2-8357-c9e42b02f3cc" returned: 0 in 0.637s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:24:04 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-0ff2b56f-434f-4159-a5fe-06f42ded9fde tempest-GroupSnapshotsTest-457900778 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5b8e90fe-b242-4a6a-92ec-d5e2b4d567b6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89182) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 12:24:04 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[85785207-c16e-4a31-9f56-bed5d742999d]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:24:04 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-0ff2b56f-434f-4159-a5fe-06f42ded9fde tempest-GroupSnapshotsTest-457900778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-5b8e90fe-b242-4a6a-92ec-d5e2b4d567b6 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:24:04 devstack cinder-volume[89182]: DEBUG cinder.volume.flows.manager.create_volume [None req-bb64f009-ddde-449a-a171-0253c088aaf1 tempest-TestStampPattern-418584557 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89182) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 12:24:04 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-bb64f009-ddde-449a-a171-0253c088aaf1 tempest-TestStampPattern-418584557 None] Flow 'volume_create_manager' (338633ff-229a-4e1f-a4aa-b36814539675) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:24:04 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-bb64f009-ddde-449a-a171-0253c088aaf1 tempest-TestStampPattern-418584557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (720d30e7-2779-422e-b189-c838985b209a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:24:04 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-bb64f009-ddde-449a-a171-0253c088aaf1 tempest-TestStampPattern-418584557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (720d30e7-2779-422e-b189-c838985b209a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:24:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-181722112',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0cea5331-ddf1-4068-bee4-c6518e039abc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9125075c79d741faa9c3b15073a7c183',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:24:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:24:04Z,use_quota=True,user_id='382d36422a8847e3a570abe576efafc3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:24:04 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-bb64f009-ddde-449a-a171-0253c088aaf1 tempest-TestStampPattern-418584557 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e51f47a8-2d40-49be-a0c0-2b3e1f16bbc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:24:04 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-bb64f009-ddde-449a-a171-0253c088aaf1 tempest-TestStampPattern-418584557 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e51f47a8-2d40-49be-a0c0-2b3e1f16bbc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:24:04 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-bb64f009-ddde-449a-a171-0253c088aaf1 tempest-TestStampPattern-418584557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e1d4d61-d9ae-4eb5-a23f-42ac3f190f86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:24:04 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-bb64f009-ddde-449a-a171-0253c088aaf1 tempest-TestStampPattern-418584557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e1d4d61-d9ae-4eb5-a23f-42ac3f190f86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0cea5331-ddf1-4068-bee4-c6518e039abc', 'volume_name': 'volume-0cea5331-ddf1-4068-bee4-c6518e039abc', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:24:04 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-bb64f009-ddde-449a-a171-0253c088aaf1 tempest-TestStampPattern-418584557 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f146a5a-5824-4d21-a691-5f26100906ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:24:04 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-bb64f009-ddde-449a-a171-0253c088aaf1 tempest-TestStampPattern-418584557 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f146a5a-5824-4d21-a691-5f26100906ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:24:04 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-bb64f009-ddde-449a-a171-0253c088aaf1 tempest-TestStampPattern-418584557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57a9912f-9715-45ed-963f-ea54aa6d456a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:24:04 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-bb64f009-ddde-449a-a171-0253c088aaf1 tempest-TestStampPattern-418584557 None] Volume 0cea5331-ddf1-4068-bee4-c6518e039abc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0cea5331-ddf1-4068-bee4-c6518e039abc', 'volume_size': 1} Jul 31 12:24:04 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-bb64f009-ddde-449a-a171-0253c088aaf1 tempest-TestStampPattern-418584557 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:24:04 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-bb64f009-ddde-449a-a171-0253c088aaf1 tempest-TestStampPattern-418584557 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:24:04 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-bb64f009-ddde-449a-a171-0253c088aaf1 tempest-TestStampPattern-418584557 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:24:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-181722112',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0cea5331-ddf1-4068-bee4-c6518e039abc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9125075c79d741faa9c3b15073a7c183',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:24:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:24:04Z,use_quota=True,user_id='382d36422a8847e3a570abe576efafc3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)}" {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 12:24:04 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-bb64f009-ddde-449a-a171-0253c088aaf1 tempest-TestStampPattern-418584557 None] Creating volume 0cea5331-ddf1-4068-bee4-c6518e039abc {{(pid=89182) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 12:24:04 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-bb64f009-ddde-449a-a171-0253c088aaf1 tempest-TestStampPattern-418584557 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:24:04 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-bb64f009-ddde-449a-a171-0253c088aaf1 tempest-TestStampPattern-418584557 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:24:04 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-bb64f009-ddde-449a-a171-0253c088aaf1 tempest-TestStampPattern-418584557 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:24:04 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-bb64f009-ddde-449a-a171-0253c088aaf1 tempest-TestStampPattern-418584557 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:24:04 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-bb64f009-ddde-449a-a171-0253c088aaf1 tempest-TestStampPattern-418584557 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:24:04 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-bb64f009-ddde-449a-a171-0253c088aaf1 tempest-TestStampPattern-418584557 None] Selected osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 as target Quobyte volume. {{(pid=89182) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 12:24:04 devstack cinder-volume[89182]: INFO cinder.volume.drivers.remotefs [None req-bb64f009-ddde-449a-a171-0253c088aaf1 tempest-TestStampPattern-418584557 None] casted to osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 Jul 31 12:24:04 devstack sudo[100720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-5b8e90fe-b242-4a6a-92ec-d5e2b4d567b6 Jul 31 12:24:04 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-bb64f009-ddde-449a-a171-0253c088aaf1 tempest-TestStampPattern-418584557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0cea5331-ddf1-4068-bee4-c6518e039abc 1073741824 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:24:04 devstack sudo[100720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:24:04 devstack sudo[100722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0cea5331-ddf1-4068-bee4-c6518e039abc 1073741824 Jul 31 12:24:04 devstack sudo[100722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:24:04 devstack sudo[100720]: pam_unix(sudo:session): session closed for user root Jul 31 12:24:04 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-0ff2b56f-434f-4159-a5fe-06f42ded9fde tempest-GroupSnapshotsTest-457900778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-5b8e90fe-b242-4a6a-92ec-d5e2b4d567b6" returned: 0 in 0.635s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:24:04 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-0ff2b56f-434f-4159-a5fe-06f42ded9fde tempest-GroupSnapshotsTest-457900778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-5b8e90fe-b242-4a6a-92ec-d5e2b4d567b6.7d50fd2c-0447-47e2-8357-c9e42b02f3cc {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:24:04 devstack sudo[100728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-5b8e90fe-b242-4a6a-92ec-d5e2b4d567b6.7d50fd2c-0447-47e2-8357-c9e42b02f3cc Jul 31 12:24:04 devstack sudo[100728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:24:05 devstack sudo[100722]: pam_unix(sudo:session): session closed for user root Jul 31 12:24:05 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-bb64f009-ddde-449a-a171-0253c088aaf1 tempest-TestStampPattern-418584557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0cea5331-ddf1-4068-bee4-c6518e039abc 1073741824" returned: 0 in 0.948s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:24:05 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-bb64f009-ddde-449a-a171-0253c088aaf1 tempest-TestStampPattern-418584557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0cea5331-ddf1-4068-bee4-c6518e039abc {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:24:05 devstack sudo[100728]: pam_unix(sudo:session): session closed for user root Jul 31 12:24:05 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-0ff2b56f-434f-4159-a5fe-06f42ded9fde tempest-GroupSnapshotsTest-457900778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-5b8e90fe-b242-4a6a-92ec-d5e2b4d567b6.7d50fd2c-0447-47e2-8357-c9e42b02f3cc" returned: 0 in 0.645s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:24:05 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-0ff2b56f-434f-4159-a5fe-06f42ded9fde tempest-GroupSnapshotsTest-457900778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-5b8e90fe-b242-4a6a-92ec-d5e2b4d567b6.7d50fd2c-0447-47e2-8357-c9e42b02f3cc {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:24:05 devstack sudo[100740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0cea5331-ddf1-4068-bee4-c6518e039abc Jul 31 12:24:05 devstack sudo[100740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:24:05 devstack sudo[100742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-5b8e90fe-b242-4a6a-92ec-d5e2b4d567b6.7d50fd2c-0447-47e2-8357-c9e42b02f3cc Jul 31 12:24:05 devstack sudo[100742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:24:05 devstack sudo[100742]: pam_unix(sudo:session): session closed for user root Jul 31 12:24:05 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-0ff2b56f-434f-4159-a5fe-06f42ded9fde tempest-GroupSnapshotsTest-457900778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-5b8e90fe-b242-4a6a-92ec-d5e2b4d567b6.7d50fd2c-0447-47e2-8357-c9e42b02f3cc" returned: 0 in 0.346s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:24:05 devstack sudo[100740]: pam_unix(sudo:session): session closed for user root Jul 31 12:24:05 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-bb64f009-ddde-449a-a171-0253c088aaf1 tempest-TestStampPattern-418584557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0cea5331-ddf1-4068-bee4-c6518e039abc" returned: 0 in 0.430s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:24:05 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-bb64f009-ddde-449a-a171-0253c088aaf1 tempest-TestStampPattern-418584557 None] <== create_volume: return (1442ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'} {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 12:24:05 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-bb64f009-ddde-449a-a171-0253c088aaf1 tempest-TestStampPattern-418584557 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.445s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:24:05 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-0ff2b56f-434f-4159-a5fe-06f42ded9fde tempest-GroupSnapshotsTest-457900778 None] Lock "cinder-quobyte-7d50fd2c-0447-47e2-8357-c9e42b02f3cc" released by "_delete_snapshot" :: held 2.484s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:24:06 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-0ff2b56f-434f-4159-a5fe-06f42ded9fde tempest-GroupSnapshotsTest-457900778 None] Lock "cinder-quobyte-5b8e90fe-b242-4a6a-92ec-d5e2b4d567b6" released by "delete_snapshot" :: held 2.532s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:24:06 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-bb64f009-ddde-449a-a171-0253c088aaf1 tempest-TestStampPattern-418584557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57a9912f-9715-45ed-963f-ea54aa6d456a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0cea5331-ddf1-4068-bee4-c6518e039abc', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:24:06 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-bb64f009-ddde-449a-a171-0253c088aaf1 tempest-TestStampPattern-418584557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (969f883d-89e6-4794-8840-02ef8e913606) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:24:06 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-bb64f009-ddde-449a-a171-0253c088aaf1 tempest-TestStampPattern-418584557 None] Volume volume-0cea5331-ddf1-4068-bee4-c6518e039abc (0cea5331-ddf1-4068-bee4-c6518e039abc): created successfully Jul 31 12:24:06 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-bb64f009-ddde-449a-a171-0253c088aaf1 tempest-TestStampPattern-418584557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (969f883d-89e6-4794-8840-02ef8e913606) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:24:06 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-bb64f009-ddde-449a-a171-0253c088aaf1 tempest-TestStampPattern-418584557 None] Flow 'volume_create_manager' (338633ff-229a-4e1f-a4aa-b36814539675) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:24:06 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-bb64f009-ddde-449a-a171-0253c088aaf1 tempest-TestStampPattern-418584557 None] Created volume successfully. Jul 31 12:24:06 devstack cinder-volume[89182]: WARNING cinder.quota [None req-0ff2b56f-434f-4159-a5fe-06f42ded9fde tempest-GroupSnapshotsTest-457900778 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-100604413 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-100604413, it is now deprecated. Please use the default quota class for default quota. Jul 31 12:24:06 devstack cinder-volume[89182]: WARNING cinder.quota [None req-0ff2b56f-434f-4159-a5fe-06f42ded9fde tempest-GroupSnapshotsTest-457900778 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-100604413 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-100604413, it is now deprecated. Please use the default quota class for default quota. Jul 31 12:24:06 devstack cinder-volume[89182]: DEBUG cinder.quota [None req-0ff2b56f-434f-4159-a5fe-06f42ded9fde tempest-GroupSnapshotsTest-457900778 None] Created reservations ['b2f26a94-c7b1-4492-869f-5391c346af96', '616368c2-e741-4f30-a392-9729b3e8e888', '5add292c-0104-4e58-ab9f-73568473c008', 'e2f0847d-92a4-425b-8608-e66a60ffbd21'] {{(pid=89182) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 12:24:06 devstack cinder-volume[89182]: DEBUG cinder.quota [None req-0ff2b56f-434f-4159-a5fe-06f42ded9fde tempest-GroupSnapshotsTest-457900778 None] Created reservations ['98285ab3-6dcb-4d03-a182-17f6f6827636', '516feca2-4721-48d4-aece-cf8c7a4d05a3', '6435e57a-d6aa-47b0-bb09-afcc56c9494c', '32e33fa3-d42e-4b6b-a38e-7c34827c2652'] {{(pid=89182) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 12:24:06 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-0ff2b56f-434f-4159-a5fe-06f42ded9fde tempest-GroupSnapshotsTest-457900778 None] group_snapshot a1d15379-13df-46fc-8218-94a701787041: deleted successfully Jul 31 12:24:07 devstack cinder-volume[89182]: DEBUG dbcounter [-] [89182] Writing DB stats cinder:SELECT=98,cinder:INSERT=20,cinder:UPDATE=85,cinder:DELETE=2 {{(pid=89182) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 12:24:07 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-2f24d1f6-1100-4922-9d3f-ef146d72d0fb tempest-GroupSnapshotsTest-457900778 None] Acquiring lock "cinder-quobyte-5b8e90fe-b242-4a6a-92ec-d5e2b4d567b6" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:24:07 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-2f24d1f6-1100-4922-9d3f-ef146d72d0fb tempest-GroupSnapshotsTest-457900778 None] Lock "cinder-quobyte-5b8e90fe-b242-4a6a-92ec-d5e2b4d567b6" acquired by "delete_volume" :: waited 0.039s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:24:07 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f2044e9-0684-432e-a3c8-050341ad1e11]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:24:07 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-2f24d1f6-1100-4922-9d3f-ef146d72d0fb tempest-GroupSnapshotsTest-457900778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-5b8e90fe-b242-4a6a-92ec-d5e2b4d567b6 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:24:08 devstack sudo[100773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-5b8e90fe-b242-4a6a-92ec-d5e2b4d567b6 Jul 31 12:24:08 devstack sudo[100773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:24:08 devstack sudo[100773]: pam_unix(sudo:session): session closed for user root Jul 31 12:24:08 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-2f24d1f6-1100-4922-9d3f-ef146d72d0fb tempest-GroupSnapshotsTest-457900778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-5b8e90fe-b242-4a6a-92ec-d5e2b4d567b6" returned: 0 in 0.623s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:24:08 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-2f24d1f6-1100-4922-9d3f-ef146d72d0fb tempest-GroupSnapshotsTest-457900778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-5b8e90fe-b242-4a6a-92ec-d5e2b4d567b6 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:24:08 devstack sudo[100788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-5b8e90fe-b242-4a6a-92ec-d5e2b4d567b6 Jul 31 12:24:08 devstack sudo[100788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:24:08 devstack sudo[100788]: pam_unix(sudo:session): session closed for user root Jul 31 12:24:08 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-2f24d1f6-1100-4922-9d3f-ef146d72d0fb tempest-GroupSnapshotsTest-457900778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-5b8e90fe-b242-4a6a-92ec-d5e2b4d567b6" returned: 0 in 0.334s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:24:08 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-2f24d1f6-1100-4922-9d3f-ef146d72d0fb tempest-GroupSnapshotsTest-457900778 None] Lock "cinder-quobyte-5b8e90fe-b242-4a6a-92ec-d5e2b4d567b6" released by "delete_volume" :: held 1.053s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:24:08 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-2f24d1f6-1100-4922-9d3f-ef146d72d0fb tempest-GroupSnapshotsTest-457900778 None] Acquiring lock "cinder-quobyte-f95811d7-f424-4f4b-8981-9437d7ba191c" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:24:09 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-2f24d1f6-1100-4922-9d3f-ef146d72d0fb tempest-GroupSnapshotsTest-457900778 None] Lock "cinder-quobyte-f95811d7-f424-4f4b-8981-9437d7ba191c" acquired by "delete_volume" :: waited 0.023s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:24:09 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[b56b2a77-0996-4958-8cc3-120b3b2ed0ad]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:24:09 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-2f24d1f6-1100-4922-9d3f-ef146d72d0fb tempest-GroupSnapshotsTest-457900778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-f95811d7-f424-4f4b-8981-9437d7ba191c {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:24:09 devstack sudo[100793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-f95811d7-f424-4f4b-8981-9437d7ba191c Jul 31 12:24:09 devstack sudo[100793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:24:09 devstack sudo[100793]: pam_unix(sudo:session): session closed for user root Jul 31 12:24:09 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-2f24d1f6-1100-4922-9d3f-ef146d72d0fb tempest-GroupSnapshotsTest-457900778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-f95811d7-f424-4f4b-8981-9437d7ba191c" returned: 0 in 0.538s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:24:09 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-2f24d1f6-1100-4922-9d3f-ef146d72d0fb tempest-GroupSnapshotsTest-457900778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-f95811d7-f424-4f4b-8981-9437d7ba191c {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:24:09 devstack sudo[100798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-f95811d7-f424-4f4b-8981-9437d7ba191c Jul 31 12:24:09 devstack sudo[100798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:24:09 devstack sudo[100798]: pam_unix(sudo:session): session closed for user root Jul 31 12:24:09 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-2f24d1f6-1100-4922-9d3f-ef146d72d0fb tempest-GroupSnapshotsTest-457900778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-f95811d7-f424-4f4b-8981-9437d7ba191c" returned: 0 in 0.349s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:24:09 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-2f24d1f6-1100-4922-9d3f-ef146d72d0fb tempest-GroupSnapshotsTest-457900778 None] Lock "cinder-quobyte-f95811d7-f424-4f4b-8981-9437d7ba191c" released by "delete_volume" :: held 0.983s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:24:10 devstack cinder-volume[89182]: DEBUG dbcounter [-] [89182] Writing DB stats cinder:SELECT=91,cinder:UPDATE=86,cinder:INSERT=19,cinder:DELETE=5 {{(pid=89182) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 12:24:10 devstack cinder-volume[89182]: DEBUG cinder.quota [None req-2f24d1f6-1100-4922-9d3f-ef146d72d0fb tempest-GroupSnapshotsTest-457900778 None] Created reservations ['b14f8f48-37cb-41ba-8a48-d86cacb9b3ca'] {{(pid=89182) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 12:24:10 devstack cinder-volume[89182]: WARNING cinder.quota [None req-2f24d1f6-1100-4922-9d3f-ef146d72d0fb tempest-GroupSnapshotsTest-457900778 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-100604413 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-100604413, it is now deprecated. Please use the default quota class for default quota. Jul 31 12:24:10 devstack cinder-volume[89182]: DEBUG cinder.quota [None req-2f24d1f6-1100-4922-9d3f-ef146d72d0fb tempest-GroupSnapshotsTest-457900778 None] Created reservations ['53ac2e5c-9919-4427-95ff-e5f07852a52d', '0f2f2d1a-688a-44c5-a1df-d867807f5637', '0ff4128e-fe68-4cdd-90a6-a211e7de4b57', '2445f609-e12d-4d79-b1b6-62f4db744c0b'] {{(pid=89182) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 12:24:10 devstack cinder-volume[89182]: DEBUG cinder.volume.flows.manager.create_volume [None req-83f69cb9-3d0e-46b9-ab44-9b6ea33afdfc tempest-TestVolumeBootPattern-1492021642 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89182) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 12:24:10 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-83f69cb9-3d0e-46b9-ab44-9b6ea33afdfc tempest-TestVolumeBootPattern-1492021642 None] Flow 'volume_create_manager' (b2538ba1-ccee-4b04-94ed-8d13b76b50df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:24:10 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-83f69cb9-3d0e-46b9-ab44-9b6ea33afdfc tempest-TestVolumeBootPattern-1492021642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (789e20af-18f7-41a5-b1b5-416de9f3a256) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:24:10 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-83f69cb9-3d0e-46b9-ab44-9b6ea33afdfc tempest-TestVolumeBootPattern-1492021642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (789e20af-18f7-41a5-b1b5-416de9f3a256) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:24:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBootPattern-volume-origin-1597789302',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=059c514e-3928-498a-9f8e-384f95a18a7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4668dd58ac9a4406a9e8376f0b499d83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:24:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:24:10Z,use_quota=True,user_id='9990e1c0be844340b618d408d28deefe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:24:10 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-83f69cb9-3d0e-46b9-ab44-9b6ea33afdfc tempest-TestVolumeBootPattern-1492021642 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (195b3a18-a05e-44da-9290-4e0132b62d93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:24:10 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-83f69cb9-3d0e-46b9-ab44-9b6ea33afdfc tempest-TestVolumeBootPattern-1492021642 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (195b3a18-a05e-44da-9290-4e0132b62d93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:24:10 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-83f69cb9-3d0e-46b9-ab44-9b6ea33afdfc tempest-TestVolumeBootPattern-1492021642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9eac79c8-b43e-4b32-80a8-c11c353fc9be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:24:10 devstack cinder-volume[89182]: DEBUG cinder.image.glance [None req-83f69cb9-3d0e-46b9-ab44-9b6ea33afdfc tempest-TestVolumeBootPattern-1492021642 None] Creating Keystone auth plugin from conf {{(pid=89182) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 31 12:24:10 devstack cinder-volume[89182]: DEBUG cinder.quota [None req-2f24d1f6-1100-4922-9d3f-ef146d72d0fb tempest-GroupSnapshotsTest-457900778 None] Created reservations ['eb7a2aa5-5204-4c08-a564-d08ba7d6f9d1', 'ebd73034-b581-49be-8cf4-3f5cca892e98', 'a84cb3ed-3b7c-471f-9552-f4edcda16c82', '0747ab34-78a2-4c6c-bf93-f9c087a1299b'] {{(pid=89182) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 12:24:10 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-2f24d1f6-1100-4922-9d3f-ef146d72d0fb tempest-GroupSnapshotsTest-457900778 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:24:10 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-2f24d1f6-1100-4922-9d3f-ef146d72d0fb tempest-GroupSnapshotsTest-457900778 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:24:10 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-2f24d1f6-1100-4922-9d3f-ef146d72d0fb tempest-GroupSnapshotsTest-457900778 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:24:10 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-2f24d1f6-1100-4922-9d3f-ef146d72d0fb tempest-GroupSnapshotsTest-457900778 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:24:10 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-2f24d1f6-1100-4922-9d3f-ef146d72d0fb tempest-GroupSnapshotsTest-457900778 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:24:10 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-2f24d1f6-1100-4922-9d3f-ef146d72d0fb tempest-GroupSnapshotsTest-457900778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:24:10 devstack sudo[100801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 Jul 31 12:24:10 devstack sudo[100801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:24:10 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-83f69cb9-3d0e-46b9-ab44-9b6ea33afdfc tempest-TestVolumeBootPattern-1492021642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9eac79c8-b43e-4b32-80a8-c11c353fc9be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '059c514e-3928-498a-9f8e-384f95a18a7c', 'volume_name': 'volume-059c514e-3928-498a-9f8e-384f95a18a7c', 'volume_size': 1, 'image_id': '4cbd0fd2-77a8-43ca-bc93-b0249d6daea0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4cbd0fd2-77a8-43ca-bc93-b0249d6daea0', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3f77cb0dad9a46948c9357c65b22aef5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4cbd0fd2-77a8-43ca-bc93-b0249d6daea0', 'created_at': datetime.datetime(2026, 7, 31, 10, 8, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 31, 10, 8, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4cbd0fd2-77a8-43ca-bc93-b0249d6daea0/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:24:10 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-83f69cb9-3d0e-46b9-ab44-9b6ea33afdfc tempest-TestVolumeBootPattern-1492021642 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5548f6d-406d-42d3-947a-6f360ee86ef1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:24:10 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-83f69cb9-3d0e-46b9-ab44-9b6ea33afdfc tempest-TestVolumeBootPattern-1492021642 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5548f6d-406d-42d3-947a-6f360ee86ef1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:24:10 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-83f69cb9-3d0e-46b9-ab44-9b6ea33afdfc tempest-TestVolumeBootPattern-1492021642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35de20a6-1e3d-4ca3-bb2e-4dc9de2c9136) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:24:10 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-83f69cb9-3d0e-46b9-ab44-9b6ea33afdfc tempest-TestVolumeBootPattern-1492021642 None] Volume 059c514e-3928-498a-9f8e-384f95a18a7c: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-059c514e-3928-498a-9f8e-384f95a18a7c', 'volume_size': 1, 'image_id': '4cbd0fd2-77a8-43ca-bc93-b0249d6daea0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4cbd0fd2-77a8-43ca-bc93-b0249d6daea0', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3f77cb0dad9a46948c9357c65b22aef5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4cbd0fd2-77a8-43ca-bc93-b0249d6daea0', 'created_at': datetime.datetime(2026, 7, 31, 10, 8, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 31, 10, 8, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4cbd0fd2-77a8-43ca-bc93-b0249d6daea0/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 31 12:24:10 devstack cinder-volume[89182]: DEBUG cinder.volume.flows.manager.create_volume [None req-83f69cb9-3d0e-46b9-ab44-9b6ea33afdfc tempest-TestVolumeBootPattern-1492021642 None] Trying to clone 059c514e-3928-498a-9f8e-384f95a18a7c from image 4cbd0fd2-77a8-43ca-bc93-b0249d6daea0 at location (None, [{'url': 'file:///opt/stack/data/glance/images/4cbd0fd2-77a8-43ca-bc93-b0249d6daea0', 'metadata': {}}]). {{(pid=89182) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 31 12:24:10 devstack sudo[100801]: pam_unix(sudo:session): session closed for user root Jul 31 12:24:10 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-2f24d1f6-1100-4922-9d3f-ef146d72d0fb tempest-GroupSnapshotsTest-457900778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2" returned: 0 in 0.305s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:24:10 devstack cinder-volume[89182]: DEBUG cinder.manager [None req-2f24d1f6-1100-4922-9d3f-ef146d72d0fb tempest-GroupSnapshotsTest-457900778 None] Notifying Schedulers of capabilities ... {{(pid=89182) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 12:24:10 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-2f24d1f6-1100-4922-9d3f-ef146d72d0fb tempest-GroupSnapshotsTest-457900778 None] Delete group completed successfully. Jul 31 12:24:11 devstack cinder-volume[89182]: DEBUG cinder.image.image_utils [None req-83f69cb9-3d0e-46b9-ab44-9b6ea33afdfc tempest-TestVolumeBootPattern-1492021642 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_4cbd0fd2-77a8-43ca-bc93-b0249d6daea0_otr__w2cdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=89182) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 31 12:24:11 devstack cinder-volume[89182]: INFO cinder.image.image_utils [None req-83f69cb9-3d0e-46b9-ab44-9b6ea33afdfc tempest-TestVolumeBootPattern-1492021642 None] Image download 20.69 MB at 20.69 MB/s Jul 31 12:24:11 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bbbfcab-01f5-48c4-b3b6-c52b8b75d020]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:24:11 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-83f69cb9-3d0e-46b9-ab44-9b6ea33afdfc tempest-TestVolumeBootPattern-1492021642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4cbd0fd2-77a8-43ca-bc93-b0249d6daea0_otr__w2cdevstack@QuobyteHD {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:24:11 devstack sudo[100806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4cbd0fd2-77a8-43ca-bc93-b0249d6daea0_otr__w2cdevstack@QuobyteHD Jul 31 12:24:11 devstack sudo[100806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:24:11 devstack sudo[100806]: pam_unix(sudo:session): session closed for user root Jul 31 12:24:12 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-83f69cb9-3d0e-46b9-ab44-9b6ea33afdfc tempest-TestVolumeBootPattern-1492021642 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4cbd0fd2-77a8-43ca-bc93-b0249d6daea0_otr__w2cdevstack@QuobyteHD" returned: 0 in 0.571s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:24:12 devstack cinder-volume[89182]: DEBUG cinder.image.image_utils [None req-83f69cb9-3d0e-46b9-ab44-9b6ea33afdfc tempest-TestVolumeBootPattern-1492021642 None] Temporary image 4cbd0fd2-77a8-43ca-bc93-b0249d6daea0 is fetched for user 9990e1c0be844340b618d408d28deefe. {{(pid=89182) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 31 12:24:12 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[33e0f317-441d-49d5-bbbd-7e0a1c2d9822]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:24:12 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-83f69cb9-3d0e-46b9-ab44-9b6ea33afdfc tempest-TestVolumeBootPattern-1492021642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4cbd0fd2-77a8-43ca-bc93-b0249d6daea0_otr__w2cdevstack@QuobyteHD {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:24:12 devstack sudo[100834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4cbd0fd2-77a8-43ca-bc93-b0249d6daea0_otr__w2cdevstack@QuobyteHD Jul 31 12:24:12 devstack sudo[100834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:24:12 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-2af8fa2c-adfc-4871-a84a-fcd7bfd94204 tempest-GroupSnapshotsTest-457900778 None] Group tempest-GroupSnapshotsTest-Group-928536020: creating Jul 31 12:24:12 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-2af8fa2c-adfc-4871-a84a-fcd7bfd94204 tempest-GroupSnapshotsTest-457900778 None] Group tempest-GroupSnapshotsTest-Group-928536020: created successfully Jul 31 12:24:12 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-2af8fa2c-adfc-4871-a84a-fcd7bfd94204 tempest-GroupSnapshotsTest-457900778 None] Create group completed successfully. Jul 31 12:24:12 devstack sudo[100834]: pam_unix(sudo:session): session closed for user root Jul 31 12:24:12 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-83f69cb9-3d0e-46b9-ab44-9b6ea33afdfc tempest-TestVolumeBootPattern-1492021642 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4cbd0fd2-77a8-43ca-bc93-b0249d6daea0_otr__w2cdevstack@QuobyteHD" returned: 0 in 0.758s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:24:12 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-83f69cb9-3d0e-46b9-ab44-9b6ea33afdfc tempest-TestVolumeBootPattern-1492021642 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:24:12 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-83f69cb9-3d0e-46b9-ab44-9b6ea33afdfc tempest-TestVolumeBootPattern-1492021642 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:24:12 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-83f69cb9-3d0e-46b9-ab44-9b6ea33afdfc tempest-TestVolumeBootPattern-1492021642 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:24:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBootPattern-volume-origin-1597789302',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=059c514e-3928-498a-9f8e-384f95a18a7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4668dd58ac9a4406a9e8376f0b499d83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:24:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:24:10Z,use_quota=True,user_id='9990e1c0be844340b618d408d28deefe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)}" {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 12:24:12 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-83f69cb9-3d0e-46b9-ab44-9b6ea33afdfc tempest-TestVolumeBootPattern-1492021642 None] Creating volume 059c514e-3928-498a-9f8e-384f95a18a7c {{(pid=89182) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 12:24:12 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-83f69cb9-3d0e-46b9-ab44-9b6ea33afdfc tempest-TestVolumeBootPattern-1492021642 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:24:12 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-83f69cb9-3d0e-46b9-ab44-9b6ea33afdfc tempest-TestVolumeBootPattern-1492021642 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:24:12 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-83f69cb9-3d0e-46b9-ab44-9b6ea33afdfc tempest-TestVolumeBootPattern-1492021642 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:24:12 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-83f69cb9-3d0e-46b9-ab44-9b6ea33afdfc tempest-TestVolumeBootPattern-1492021642 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:24:12 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-83f69cb9-3d0e-46b9-ab44-9b6ea33afdfc tempest-TestVolumeBootPattern-1492021642 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:24:12 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-83f69cb9-3d0e-46b9-ab44-9b6ea33afdfc tempest-TestVolumeBootPattern-1492021642 None] Selected osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 as target Quobyte volume. {{(pid=89182) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 12:24:12 devstack cinder-volume[89182]: INFO cinder.volume.drivers.remotefs [None req-83f69cb9-3d0e-46b9-ab44-9b6ea33afdfc tempest-TestVolumeBootPattern-1492021642 None] casted to osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 Jul 31 12:24:12 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-83f69cb9-3d0e-46b9-ab44-9b6ea33afdfc tempest-TestVolumeBootPattern-1492021642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-059c514e-3928-498a-9f8e-384f95a18a7c 1073741824 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:24:13 devstack sudo[100873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-059c514e-3928-498a-9f8e-384f95a18a7c 1073741824 Jul 31 12:24:13 devstack sudo[100873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:24:13 devstack sudo[100873]: pam_unix(sudo:session): session closed for user root Jul 31 12:24:13 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-83f69cb9-3d0e-46b9-ab44-9b6ea33afdfc tempest-TestVolumeBootPattern-1492021642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-059c514e-3928-498a-9f8e-384f95a18a7c 1073741824" returned: 0 in 0.980s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:24:13 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-83f69cb9-3d0e-46b9-ab44-9b6ea33afdfc tempest-TestVolumeBootPattern-1492021642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-059c514e-3928-498a-9f8e-384f95a18a7c {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:24:14 devstack sudo[100927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-059c514e-3928-498a-9f8e-384f95a18a7c Jul 31 12:24:14 devstack sudo[100927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:24:14 devstack sudo[100927]: pam_unix(sudo:session): session closed for user root Jul 31 12:24:14 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-83f69cb9-3d0e-46b9-ab44-9b6ea33afdfc tempest-TestVolumeBootPattern-1492021642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-059c514e-3928-498a-9f8e-384f95a18a7c" returned: 0 in 0.436s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:24:14 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-83f69cb9-3d0e-46b9-ab44-9b6ea33afdfc tempest-TestVolumeBootPattern-1492021642 None] <== create_volume: return (1498ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'} {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 12:24:14 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-83f69cb9-3d0e-46b9-ab44-9b6ea33afdfc tempest-TestVolumeBootPattern-1492021642 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.503s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:24:14 devstack cinder-volume[89182]: DEBUG cinder.volume.volume_utils [None req-83f69cb9-3d0e-46b9-ab44-9b6ea33afdfc tempest-TestVolumeBootPattern-1492021642 None] Attempting download of 4cbd0fd2-77a8-43ca-bc93-b0249d6daea0 ((None, [{'url': 'file:///opt/stack/data/glance/images/4cbd0fd2-77a8-43ca-bc93-b0249d6daea0', 'metadata': {}}])) to volume 059c514e-3928-498a-9f8e-384f95a18a7c. {{(pid=89182) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 31 12:24:14 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[53e66d44-778a-485e-926f-dc94ec4f6e92]: (4, 'raw') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:24:14 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-83f69cb9-3d0e-46b9-ab44-9b6ea33afdfc tempest-TestVolumeBootPattern-1492021642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4cbd0fd2-77a8-43ca-bc93-b0249d6daea0_am2hb37r {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:24:14 devstack sudo[100950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4cbd0fd2-77a8-43ca-bc93-b0249d6daea0_am2hb37r Jul 31 12:24:14 devstack sudo[100950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:24:14 devstack cinder-volume[89182]: DEBUG cinder.volume.flows.manager.create_volume [None req-56d7b716-4f3e-40e5-a32c-720c23ce81b1 tempest-GroupSnapshotsTest-457900778 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89182) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 12:24:15 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-56d7b716-4f3e-40e5-a32c-720c23ce81b1 tempest-GroupSnapshotsTest-457900778 None] Flow 'volume_create_manager' (e000a4dd-4f26-45ce-b359-cdf8fb2a86ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:24:15 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-56d7b716-4f3e-40e5-a32c-720c23ce81b1 tempest-GroupSnapshotsTest-457900778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3a8074c-e133-4870-9f8a-6d998914e751) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:24:15 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-56d7b716-4f3e-40e5-a32c-720c23ce81b1 tempest-GroupSnapshotsTest-457900778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3a8074c-e133-4870-9f8a-6d998914e751) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:24:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2147298214',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f7c90811-1b2f-4c43-8691-c9a53e4842a1,host='devstack@QuobyteHD#QuobyteHD',id=c76fdca7-16e2-433b-8533-fb44c118dda0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8aa57263ea6741369b82e3f2281a3cc8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:24:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:24:15Z,use_quota=True,user_id='b52e6a278ed04e49ba9db889fbd7715f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3012d82c-595e-4e81-bcb4-02ed9f08b76d),volume_type_id=3012d82c-595e-4e81-bcb4-02ed9f08b76d)' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:24:15 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-56d7b716-4f3e-40e5-a32c-720c23ce81b1 tempest-GroupSnapshotsTest-457900778 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82dca21b-38e9-4d93-b344-948ae938fe86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:24:15 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-56d7b716-4f3e-40e5-a32c-720c23ce81b1 tempest-GroupSnapshotsTest-457900778 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82dca21b-38e9-4d93-b344-948ae938fe86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:24:15 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-56d7b716-4f3e-40e5-a32c-720c23ce81b1 tempest-GroupSnapshotsTest-457900778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6342446-391b-4bd5-b629-13da09e4cb84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:24:15 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-56d7b716-4f3e-40e5-a32c-720c23ce81b1 tempest-GroupSnapshotsTest-457900778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6342446-391b-4bd5-b629-13da09e4cb84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c76fdca7-16e2-433b-8533-fb44c118dda0', 'volume_name': 'volume-c76fdca7-16e2-433b-8533-fb44c118dda0', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:24:15 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-56d7b716-4f3e-40e5-a32c-720c23ce81b1 tempest-GroupSnapshotsTest-457900778 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba5d8ef4-122a-41db-b25a-4e07a0621e42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:24:15 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-56d7b716-4f3e-40e5-a32c-720c23ce81b1 tempest-GroupSnapshotsTest-457900778 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba5d8ef4-122a-41db-b25a-4e07a0621e42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:24:15 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-56d7b716-4f3e-40e5-a32c-720c23ce81b1 tempest-GroupSnapshotsTest-457900778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b485e44c-f515-4add-8b62-203797a51a66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:24:15 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-56d7b716-4f3e-40e5-a32c-720c23ce81b1 tempest-GroupSnapshotsTest-457900778 None] Volume c76fdca7-16e2-433b-8533-fb44c118dda0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c76fdca7-16e2-433b-8533-fb44c118dda0', 'volume_size': 1} Jul 31 12:24:15 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-56d7b716-4f3e-40e5-a32c-720c23ce81b1 tempest-GroupSnapshotsTest-457900778 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:24:15 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-56d7b716-4f3e-40e5-a32c-720c23ce81b1 tempest-GroupSnapshotsTest-457900778 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:24:15 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-56d7b716-4f3e-40e5-a32c-720c23ce81b1 tempest-GroupSnapshotsTest-457900778 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=f7c90811-1b2f-4c43-8691-c9a53e4842a1,created_at=2026-07-31T10:24:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2147298214',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f7c90811-1b2f-4c43-8691-c9a53e4842a1,host='devstack@QuobyteHD#QuobyteHD',id=c76fdca7-16e2-433b-8533-fb44c118dda0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8aa57263ea6741369b82e3f2281a3cc8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:24:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:24:15Z,use_quota=True,user_id='b52e6a278ed04e49ba9db889fbd7715f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3012d82c-595e-4e81-bcb4-02ed9f08b76d),volume_type_id=3012d82c-595e-4e81-bcb4-02ed9f08b76d)}" {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 12:24:15 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-56d7b716-4f3e-40e5-a32c-720c23ce81b1 tempest-GroupSnapshotsTest-457900778 None] Creating volume c76fdca7-16e2-433b-8533-fb44c118dda0 {{(pid=89182) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 12:24:15 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-56d7b716-4f3e-40e5-a32c-720c23ce81b1 tempest-GroupSnapshotsTest-457900778 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:24:15 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-56d7b716-4f3e-40e5-a32c-720c23ce81b1 tempest-GroupSnapshotsTest-457900778 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:24:15 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-56d7b716-4f3e-40e5-a32c-720c23ce81b1 tempest-GroupSnapshotsTest-457900778 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:24:15 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-56d7b716-4f3e-40e5-a32c-720c23ce81b1 tempest-GroupSnapshotsTest-457900778 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:24:15 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-56d7b716-4f3e-40e5-a32c-720c23ce81b1 tempest-GroupSnapshotsTest-457900778 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:24:15 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-56d7b716-4f3e-40e5-a32c-720c23ce81b1 tempest-GroupSnapshotsTest-457900778 None] Selected osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 as target Quobyte volume. {{(pid=89182) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 12:24:15 devstack cinder-volume[89182]: INFO cinder.volume.drivers.remotefs [None req-56d7b716-4f3e-40e5-a32c-720c23ce81b1 tempest-GroupSnapshotsTest-457900778 None] casted to osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 Jul 31 12:24:15 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-56d7b716-4f3e-40e5-a32c-720c23ce81b1 tempest-GroupSnapshotsTest-457900778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-c76fdca7-16e2-433b-8533-fb44c118dda0 1073741824 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:24:15 devstack sudo[100977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-c76fdca7-16e2-433b-8533-fb44c118dda0 1073741824 Jul 31 12:24:15 devstack sudo[100977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:24:15 devstack sudo[100950]: pam_unix(sudo:session): session closed for user root Jul 31 12:24:15 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-83f69cb9-3d0e-46b9-ab44-9b6ea33afdfc tempest-TestVolumeBootPattern-1492021642 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4cbd0fd2-77a8-43ca-bc93-b0249d6daea0_am2hb37r" returned: 0 in 0.664s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:24:15 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-83f69cb9-3d0e-46b9-ab44-9b6ea33afdfc tempest-TestVolumeBootPattern-1492021642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4cbd0fd2-77a8-43ca-bc93-b0249d6daea0_am2hb37r {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:24:15 devstack sudo[100990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4cbd0fd2-77a8-43ca-bc93-b0249d6daea0_am2hb37r Jul 31 12:24:15 devstack sudo[100990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:24:15 devstack sudo[100990]: pam_unix(sudo:session): session closed for user root Jul 31 12:24:15 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-83f69cb9-3d0e-46b9-ab44-9b6ea33afdfc tempest-TestVolumeBootPattern-1492021642 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4cbd0fd2-77a8-43ca-bc93-b0249d6daea0_am2hb37r" returned: 1 in 0.489s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:24:15 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-83f69cb9-3d0e-46b9-ab44-9b6ea33afdfc tempest-TestVolumeBootPattern-1492021642 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4cbd0fd2-77a8-43ca-bc93-b0249d6daea0_am2hb37r' failed. Not Retrying. {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 31 12:24:15 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[f66aa61d-caba-4cc4-8a82-c45c3ed34ac8]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:24:15 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-83f69cb9-3d0e-46b9-ab44-9b6ea33afdfc tempest-TestVolumeBootPattern-1492021642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4cbd0fd2-77a8-43ca-bc93-b0249d6daea0_otr__w2cdevstack@QuobyteHD {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:24:15 devstack sudo[100977]: pam_unix(sudo:session): session closed for user root Jul 31 12:24:15 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-56d7b716-4f3e-40e5-a32c-720c23ce81b1 tempest-GroupSnapshotsTest-457900778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-c76fdca7-16e2-433b-8533-fb44c118dda0 1073741824" returned: 0 in 0.752s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:24:15 devstack sudo[100998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4cbd0fd2-77a8-43ca-bc93-b0249d6daea0_otr__w2cdevstack@QuobyteHD Jul 31 12:24:15 devstack sudo[100998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:24:15 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-56d7b716-4f3e-40e5-a32c-720c23ce81b1 tempest-GroupSnapshotsTest-457900778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-c76fdca7-16e2-433b-8533-fb44c118dda0 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:24:16 devstack sudo[101000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-c76fdca7-16e2-433b-8533-fb44c118dda0 Jul 31 12:24:16 devstack sudo[101000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:24:16 devstack sudo[100998]: pam_unix(sudo:session): session closed for user root Jul 31 12:24:16 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-83f69cb9-3d0e-46b9-ab44-9b6ea33afdfc tempest-TestVolumeBootPattern-1492021642 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4cbd0fd2-77a8-43ca-bc93-b0249d6daea0_otr__w2cdevstack@QuobyteHD" returned: 0 in 0.423s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:24:16 devstack cinder-volume[89182]: DEBUG cinder.image.image_utils [None req-83f69cb9-3d0e-46b9-ab44-9b6ea33afdfc tempest-TestVolumeBootPattern-1492021642 None] 4cbd0fd2-77a8-43ca-bc93-b0249d6daea0 was qcow2, converting to qcow2 {{(pid=89182) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 31 12:24:16 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-83f69cb9-3d0e-46b9-ab44-9b6ea33afdfc tempest-TestVolumeBootPattern-1492021642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4cbd0fd2-77a8-43ca-bc93-b0249d6daea0_otr__w2cdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-059c514e-3928-498a-9f8e-384f95a18a7c {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:24:16 devstack sudo[101000]: pam_unix(sudo:session): session closed for user root Jul 31 12:24:16 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-56d7b716-4f3e-40e5-a32c-720c23ce81b1 tempest-GroupSnapshotsTest-457900778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-c76fdca7-16e2-433b-8533-fb44c118dda0" returned: 0 in 0.363s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:24:16 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-56d7b716-4f3e-40e5-a32c-720c23ce81b1 tempest-GroupSnapshotsTest-457900778 None] <== create_volume: return (1188ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'} {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 12:24:16 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-56d7b716-4f3e-40e5-a32c-720c23ce81b1 tempest-GroupSnapshotsTest-457900778 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.196s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:24:16 devstack sudo[101009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4cbd0fd2-77a8-43ca-bc93-b0249d6daea0_otr__w2cdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-059c514e-3928-498a-9f8e-384f95a18a7c Jul 31 12:24:16 devstack sudo[101009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:24:16 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-56d7b716-4f3e-40e5-a32c-720c23ce81b1 tempest-GroupSnapshotsTest-457900778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b485e44c-f515-4add-8b62-203797a51a66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c76fdca7-16e2-433b-8533-fb44c118dda0', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:24:16 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-56d7b716-4f3e-40e5-a32c-720c23ce81b1 tempest-GroupSnapshotsTest-457900778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (310006d7-3b23-44ea-983c-9ff8dd512915) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:24:16 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-56d7b716-4f3e-40e5-a32c-720c23ce81b1 tempest-GroupSnapshotsTest-457900778 None] Volume volume-c76fdca7-16e2-433b-8533-fb44c118dda0 (c76fdca7-16e2-433b-8533-fb44c118dda0): created successfully Jul 31 12:24:16 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-56d7b716-4f3e-40e5-a32c-720c23ce81b1 tempest-GroupSnapshotsTest-457900778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (310006d7-3b23-44ea-983c-9ff8dd512915) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:24:16 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-56d7b716-4f3e-40e5-a32c-720c23ce81b1 tempest-GroupSnapshotsTest-457900778 None] Flow 'volume_create_manager' (e000a4dd-4f26-45ce-b359-cdf8fb2a86ff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:24:16 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-56d7b716-4f3e-40e5-a32c-720c23ce81b1 tempest-GroupSnapshotsTest-457900778 None] Created volume successfully. Jul 31 12:24:18 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-448751f9-0bdb-467e-82fc-ef7ad67f9b8d tempest-GroupSnapshotsTest-457900778 None] GroupSnapshot 476099bb-756a-4803-be94-ce229b91c667: creating. Jul 31 12:24:18 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-448751f9-0bdb-467e-82fc-ef7ad67f9b8d tempest-GroupSnapshotsTest-457900778 None] Group snapshot 476099bb-756a-4803-be94-ce229b91c667: creating. {{(pid=89182) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 31 12:24:18 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-448751f9-0bdb-467e-82fc-ef7ad67f9b8d tempest-GroupSnapshotsTest-457900778 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:24:18 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-448751f9-0bdb-467e-82fc-ef7ad67f9b8d tempest-GroupSnapshotsTest-457900778 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:24:18 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-448751f9-0bdb-467e-82fc-ef7ad67f9b8d tempest-GroupSnapshotsTest-457900778 None] Creating offline snapshot b1efc000-cb99-478f-b92e-374d5fa85f09 of volume c76fdca7-16e2-433b-8533-fb44c118dda0 {{(pid=89182) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 31 12:24:18 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9a4c927-198c-4cec-bce2-62c0696dee42]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:24:18 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-448751f9-0bdb-467e-82fc-ef7ad67f9b8d tempest-GroupSnapshotsTest-457900778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-c76fdca7-16e2-433b-8533-fb44c118dda0 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:24:18 devstack sudo[101020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-c76fdca7-16e2-433b-8533-fb44c118dda0 Jul 31 12:24:18 devstack sudo[101020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:24:19 devstack sudo[101020]: pam_unix(sudo:session): session closed for user root Jul 31 12:24:19 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-448751f9-0bdb-467e-82fc-ef7ad67f9b8d tempest-GroupSnapshotsTest-457900778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-c76fdca7-16e2-433b-8533-fb44c118dda0" returned: 0 in 0.835s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:24:19 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-448751f9-0bdb-467e-82fc-ef7ad67f9b8d tempest-GroupSnapshotsTest-457900778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-c76fdca7-16e2-433b-8533-fb44c118dda0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-c76fdca7-16e2-433b-8533-fb44c118dda0.b1efc000-cb99-478f-b92e-374d5fa85f09 1G {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:24:19 devstack sudo[101025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-c76fdca7-16e2-433b-8533-fb44c118dda0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-c76fdca7-16e2-433b-8533-fb44c118dda0.b1efc000-cb99-478f-b92e-374d5fa85f09 1G Jul 31 12:24:19 devstack sudo[101025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:24:19 devstack sudo[101009]: pam_unix(sudo:session): session closed for user root Jul 31 12:24:19 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-83f69cb9-3d0e-46b9-ab44-9b6ea33afdfc tempest-TestVolumeBootPattern-1492021642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4cbd0fd2-77a8-43ca-bc93-b0249d6daea0_otr__w2cdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-059c514e-3928-498a-9f8e-384f95a18a7c" returned: 0 in 3.300s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:24:19 devstack cinder-volume[89182]: DEBUG cinder.image.image_utils [None req-83f69cb9-3d0e-46b9-ab44-9b6ea33afdfc tempest-TestVolumeBootPattern-1492021642 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_4cbd0fd2-77a8-43ca-bc93-b0249d6daea0_otr__w2cdevstack@QuobyteHD, size 112.00 MB, duration 3.30 sec, destination /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-059c514e-3928-498a-9f8e-384f95a18a7c {{(pid=89182) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 31 12:24:19 devstack cinder-volume[89182]: INFO cinder.image.image_utils [None req-83f69cb9-3d0e-46b9-ab44-9b6ea33afdfc tempest-TestVolumeBootPattern-1492021642 None] Converted 112.00 MB image at 33.89 MB/s Jul 31 12:24:19 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-83f69cb9-3d0e-46b9-ab44-9b6ea33afdfc tempest-TestVolumeBootPattern-1492021642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-059c514e-3928-498a-9f8e-384f95a18a7c 1G {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:24:19 devstack sudo[101029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-059c514e-3928-498a-9f8e-384f95a18a7c 1G Jul 31 12:24:19 devstack sudo[101029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:24:20 devstack sudo[101025]: pam_unix(sudo:session): session closed for user root Jul 31 12:24:20 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-448751f9-0bdb-467e-82fc-ef7ad67f9b8d tempest-GroupSnapshotsTest-457900778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-c76fdca7-16e2-433b-8533-fb44c118dda0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-c76fdca7-16e2-433b-8533-fb44c118dda0.b1efc000-cb99-478f-b92e-374d5fa85f09 1G" returned: 0 in 0.837s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:24:20 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-448751f9-0bdb-467e-82fc-ef7ad67f9b8d tempest-GroupSnapshotsTest-457900778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c76fdca7-16e2-433b-8533-fb44c118dda0 -F qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-c76fdca7-16e2-433b-8533-fb44c118dda0.b1efc000-cb99-478f-b92e-374d5fa85f09 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:24:20 devstack sudo[101034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c76fdca7-16e2-433b-8533-fb44c118dda0 -F qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-c76fdca7-16e2-433b-8533-fb44c118dda0.b1efc000-cb99-478f-b92e-374d5fa85f09 Jul 31 12:24:20 devstack sudo[101034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:24:20 devstack sudo[101029]: pam_unix(sudo:session): session closed for user root Jul 31 12:24:20 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-83f69cb9-3d0e-46b9-ab44-9b6ea33afdfc tempest-TestVolumeBootPattern-1492021642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-059c514e-3928-498a-9f8e-384f95a18a7c 1G" returned: 0 in 0.863s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:24:20 devstack cinder-volume[89182]: DEBUG cinder.volume.volume_utils [None req-83f69cb9-3d0e-46b9-ab44-9b6ea33afdfc tempest-TestVolumeBootPattern-1492021642 None] Downloaded image 4cbd0fd2-77a8-43ca-bc93-b0249d6daea0 ((None, [{'url': 'file:///opt/stack/data/glance/images/4cbd0fd2-77a8-43ca-bc93-b0249d6daea0', 'metadata': {}}])) to volume 059c514e-3928-498a-9f8e-384f95a18a7c successfully. {{(pid=89182) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 31 12:24:20 devstack cinder-volume[89182]: DEBUG cinder.image.image_utils [None req-83f69cb9-3d0e-46b9-ab44-9b6ea33afdfc tempest-TestVolumeBootPattern-1492021642 None] Temporary image 4cbd0fd2-77a8-43ca-bc93-b0249d6daea0 for user 9990e1c0be844340b618d408d28deefe is deleted. {{(pid=89182) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 31 12:24:20 devstack cinder-volume[89182]: DEBUG cinder.volume.volume_utils [None req-83f69cb9-3d0e-46b9-ab44-9b6ea33afdfc tempest-TestVolumeBootPattern-1492021642 None] Marking volume 059c514e-3928-498a-9f8e-384f95a18a7c as bootable. {{(pid=89182) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 31 12:24:20 devstack cinder-volume[89182]: DEBUG cinder.volume.flows.manager.create_volume [None req-83f69cb9-3d0e-46b9-ab44-9b6ea33afdfc tempest-TestVolumeBootPattern-1492021642 None] Copying metadata from image 4cbd0fd2-77a8-43ca-bc93-b0249d6daea0 to 059c514e-3928-498a-9f8e-384f95a18a7c. {{(pid=89182) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 31 12:24:20 devstack cinder-volume[89182]: DEBUG cinder.volume.flows.manager.create_volume [None req-83f69cb9-3d0e-46b9-ab44-9b6ea33afdfc tempest-TestVolumeBootPattern-1492021642 None] Creating volume glance metadata for volume 059c514e-3928-498a-9f8e-384f95a18a7c backed by image 4cbd0fd2-77a8-43ca-bc93-b0249d6daea0 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '4cbd0fd2-77a8-43ca-bc93-b0249d6daea0', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=89182) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 31 12:24:20 devstack sudo[101034]: pam_unix(sudo:session): session closed for user root Jul 31 12:24:20 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-448751f9-0bdb-467e-82fc-ef7ad67f9b8d tempest-GroupSnapshotsTest-457900778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c76fdca7-16e2-433b-8533-fb44c118dda0 -F qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-c76fdca7-16e2-433b-8533-fb44c118dda0.b1efc000-cb99-478f-b92e-374d5fa85f09" returned: 0 in 0.669s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:24:20 devstack cinder-volume[89182]: WARNING cinder.volume.drivers.remotefs [None req-448751f9-0bdb-467e-82fc-ef7ad67f9b8d tempest-GroupSnapshotsTest-457900778 None] /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-c76fdca7-16e2-433b-8533-fb44c118dda0.b1efc000-cb99-478f-b92e-374d5fa85f09 is being set with open permissions: ugo+rw: NotImplementedError Jul 31 12:24:20 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-448751f9-0bdb-467e-82fc-ef7ad67f9b8d tempest-GroupSnapshotsTest-457900778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-c76fdca7-16e2-433b-8533-fb44c118dda0.b1efc000-cb99-478f-b92e-374d5fa85f09 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:24:20 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-83f69cb9-3d0e-46b9-ab44-9b6ea33afdfc tempest-TestVolumeBootPattern-1492021642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35de20a6-1e3d-4ca3-bb2e-4dc9de2c9136) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-059c514e-3928-498a-9f8e-384f95a18a7c', 'volume_size': 1, 'image_id': '4cbd0fd2-77a8-43ca-bc93-b0249d6daea0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4cbd0fd2-77a8-43ca-bc93-b0249d6daea0', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3f77cb0dad9a46948c9357c65b22aef5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4cbd0fd2-77a8-43ca-bc93-b0249d6daea0', 'created_at': datetime.datetime(2026, 7, 31, 10, 8, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 31, 10, 8, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4cbd0fd2-77a8-43ca-bc93-b0249d6daea0/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:24:20 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-83f69cb9-3d0e-46b9-ab44-9b6ea33afdfc tempest-TestVolumeBootPattern-1492021642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ece30876-4252-4cfd-ad85-bea9ae319631) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:24:20 devstack sudo[101042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-c76fdca7-16e2-433b-8533-fb44c118dda0.b1efc000-cb99-478f-b92e-374d5fa85f09 Jul 31 12:24:20 devstack sudo[101042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:24:20 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-83f69cb9-3d0e-46b9-ab44-9b6ea33afdfc tempest-TestVolumeBootPattern-1492021642 None] Volume volume-059c514e-3928-498a-9f8e-384f95a18a7c (059c514e-3928-498a-9f8e-384f95a18a7c): created successfully Jul 31 12:24:20 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-83f69cb9-3d0e-46b9-ab44-9b6ea33afdfc tempest-TestVolumeBootPattern-1492021642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ece30876-4252-4cfd-ad85-bea9ae319631) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:24:20 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-83f69cb9-3d0e-46b9-ab44-9b6ea33afdfc tempest-TestVolumeBootPattern-1492021642 None] Flow 'volume_create_manager' (b2538ba1-ccee-4b04-94ed-8d13b76b50df) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:24:20 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-83f69cb9-3d0e-46b9-ab44-9b6ea33afdfc tempest-TestVolumeBootPattern-1492021642 None] Created volume successfully. Jul 31 12:24:21 devstack sudo[101042]: pam_unix(sudo:session): session closed for user root Jul 31 12:24:21 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-448751f9-0bdb-467e-82fc-ef7ad67f9b8d tempest-GroupSnapshotsTest-457900778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-c76fdca7-16e2-433b-8533-fb44c118dda0.b1efc000-cb99-478f-b92e-374d5fa85f09" returned: 0 in 0.448s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:24:21 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-448751f9-0bdb-467e-82fc-ef7ad67f9b8d tempest-GroupSnapshotsTest-457900778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-c76fdca7-16e2-433b-8533-fb44c118dda0.info {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:24:21 devstack sudo[101046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-c76fdca7-16e2-433b-8533-fb44c118dda0.info Jul 31 12:24:21 devstack sudo[101046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:24:21 devstack sudo[101046]: pam_unix(sudo:session): session closed for user root Jul 31 12:24:21 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-448751f9-0bdb-467e-82fc-ef7ad67f9b8d tempest-GroupSnapshotsTest-457900778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-c76fdca7-16e2-433b-8533-fb44c118dda0.info" returned: 0 in 0.466s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:24:21 devstack cinder-volume[89182]: WARNING cinder.volume.drivers.remotefs [None req-448751f9-0bdb-467e-82fc-ef7ad67f9b8d tempest-GroupSnapshotsTest-457900778 None] /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-c76fdca7-16e2-433b-8533-fb44c118dda0.info is being set with open permissions: ugo+rw: NotImplementedError Jul 31 12:24:21 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-448751f9-0bdb-467e-82fc-ef7ad67f9b8d tempest-GroupSnapshotsTest-457900778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-c76fdca7-16e2-433b-8533-fb44c118dda0.info {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:24:21 devstack sudo[101049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-c76fdca7-16e2-433b-8533-fb44c118dda0.info Jul 31 12:24:21 devstack sudo[101049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:24:21 devstack cinder-volume[89182]: DEBUG oslo_service.periodic_task [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89182) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 31 12:24:21 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:24:21 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:24:21 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:24:21 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:24:21 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:24:21 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:24:22 devstack sudo[101051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 Jul 31 12:24:22 devstack sudo[101051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:24:22 devstack sudo[101049]: pam_unix(sudo:session): session closed for user root Jul 31 12:24:22 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-448751f9-0bdb-467e-82fc-ef7ad67f9b8d tempest-GroupSnapshotsTest-457900778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-c76fdca7-16e2-433b-8533-fb44c118dda0.info" returned: 0 in 0.519s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:24:22 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-448751f9-0bdb-467e-82fc-ef7ad67f9b8d tempest-GroupSnapshotsTest-457900778 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.964s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:24:22 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-448751f9-0bdb-467e-82fc-ef7ad67f9b8d tempest-GroupSnapshotsTest-457900778 None] group_snapshot 476099bb-756a-4803-be94-ce229b91c667: created successfully Jul 31 12:24:22 devstack sudo[101051]: pam_unix(sudo:session): session closed for user root Jul 31 12:24:22 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2" returned: 0 in 0.739s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:24:22 devstack cinder-volume[89182]: DEBUG cinder.manager [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] Notifying Schedulers of capabilities ... {{(pid=89182) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 12:24:22 devstack cinder-volume[89182]: DEBUG oslo_service.periodic_task [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] Running periodic task VolumeManager._thread_info {{(pid=89182) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 31 12:24:22 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] thread count: 28 {{(pid=89182) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 31 12:24:22 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] thread info: [<_MainThread(MainThread, started 136154603720832)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=89182) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 31 12:24:23 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-5d7540ce-f4ed-44e8-b8a9-47b90c18db6a tempest-GroupSnapshotsTest-457900778 None] group_snapshot 476099bb-756a-4803-be94-ce229b91c667: deleting Jul 31 12:24:23 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-5d7540ce-f4ed-44e8-b8a9-47b90c18db6a tempest-GroupSnapshotsTest-457900778 None] group_snapshot 476099bb-756a-4803-be94-ce229b91c667: deleting {{(pid=89182) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 31 12:24:23 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-5d7540ce-f4ed-44e8-b8a9-47b90c18db6a tempest-GroupSnapshotsTest-457900778 None] Acquiring lock "cinder-quobyte-c76fdca7-16e2-433b-8533-fb44c118dda0" by "delete_snapshot" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:24:23 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-5d7540ce-f4ed-44e8-b8a9-47b90c18db6a tempest-GroupSnapshotsTest-457900778 None] Lock "cinder-quobyte-c76fdca7-16e2-433b-8533-fb44c118dda0" acquired by "delete_snapshot" :: waited 0.027s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:24:23 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-5d7540ce-f4ed-44e8-b8a9-47b90c18db6a tempest-GroupSnapshotsTest-457900778 None] Acquiring lock "cinder-quobyte-b1efc000-cb99-478f-b92e-374d5fa85f09" by "_delete_snapshot" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:24:23 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-5d7540ce-f4ed-44e8-b8a9-47b90c18db6a tempest-GroupSnapshotsTest-457900778 None] Lock "cinder-quobyte-b1efc000-cb99-478f-b92e-374d5fa85f09" acquired by "_delete_snapshot" :: waited 0.042s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:24:23 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-5d7540ce-f4ed-44e8-b8a9-47b90c18db6a tempest-GroupSnapshotsTest-457900778 None] Deleting offline snapshot b1efc000-cb99-478f-b92e-374d5fa85f09 of volume c76fdca7-16e2-433b-8533-fb44c118dda0 {{(pid=89182) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 31 12:24:23 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-5d7540ce-f4ed-44e8-b8a9-47b90c18db6a tempest-GroupSnapshotsTest-457900778 None] snapshot_file for this snap is: volume-c76fdca7-16e2-433b-8533-fb44c118dda0.b1efc000-cb99-478f-b92e-374d5fa85f09 {{(pid=89182) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 31 12:24:23 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[78caa1b0-3855-416a-bf45-0e61772db9b3]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:24:23 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-5d7540ce-f4ed-44e8-b8a9-47b90c18db6a tempest-GroupSnapshotsTest-457900778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-c76fdca7-16e2-433b-8533-fb44c118dda0.b1efc000-cb99-478f-b92e-374d5fa85f09 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:24:23 devstack sudo[101056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-c76fdca7-16e2-433b-8533-fb44c118dda0.b1efc000-cb99-478f-b92e-374d5fa85f09 Jul 31 12:24:23 devstack sudo[101056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:24:23 devstack sudo[101056]: pam_unix(sudo:session): session closed for user root Jul 31 12:24:23 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-5d7540ce-f4ed-44e8-b8a9-47b90c18db6a tempest-GroupSnapshotsTest-457900778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-c76fdca7-16e2-433b-8533-fb44c118dda0.b1efc000-cb99-478f-b92e-374d5fa85f09" returned: 0 in 0.588s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:24:23 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-5d7540ce-f4ed-44e8-b8a9-47b90c18db6a tempest-GroupSnapshotsTest-457900778 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c76fdca7-16e2-433b-8533-fb44c118dda0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89182) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 12:24:23 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e0b0afd-2dde-4460-9353-a8aea9d779ac]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:24:23 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-5d7540ce-f4ed-44e8-b8a9-47b90c18db6a tempest-GroupSnapshotsTest-457900778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-c76fdca7-16e2-433b-8533-fb44c118dda0 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:24:24 devstack sudo[101062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-c76fdca7-16e2-433b-8533-fb44c118dda0 Jul 31 12:24:24 devstack sudo[101062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:24:24 devstack sudo[101062]: pam_unix(sudo:session): session closed for user root Jul 31 12:24:24 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-5d7540ce-f4ed-44e8-b8a9-47b90c18db6a tempest-GroupSnapshotsTest-457900778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-c76fdca7-16e2-433b-8533-fb44c118dda0" returned: 0 in 0.837s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:24:24 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-5d7540ce-f4ed-44e8-b8a9-47b90c18db6a tempest-GroupSnapshotsTest-457900778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-c76fdca7-16e2-433b-8533-fb44c118dda0.b1efc000-cb99-478f-b92e-374d5fa85f09 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:24:24 devstack sudo[101067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-c76fdca7-16e2-433b-8533-fb44c118dda0.b1efc000-cb99-478f-b92e-374d5fa85f09 Jul 31 12:24:24 devstack sudo[101067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:24:25 devstack sudo[101067]: pam_unix(sudo:session): session closed for user root Jul 31 12:24:25 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-5d7540ce-f4ed-44e8-b8a9-47b90c18db6a tempest-GroupSnapshotsTest-457900778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-c76fdca7-16e2-433b-8533-fb44c118dda0.b1efc000-cb99-478f-b92e-374d5fa85f09" returned: 0 in 0.464s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:24:25 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-5d7540ce-f4ed-44e8-b8a9-47b90c18db6a tempest-GroupSnapshotsTest-457900778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-c76fdca7-16e2-433b-8533-fb44c118dda0.b1efc000-cb99-478f-b92e-374d5fa85f09 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:24:25 devstack sudo[101072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-c76fdca7-16e2-433b-8533-fb44c118dda0.b1efc000-cb99-478f-b92e-374d5fa85f09 Jul 31 12:24:25 devstack sudo[101072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:24:25 devstack sudo[101072]: pam_unix(sudo:session): session closed for user root Jul 31 12:24:25 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-5d7540ce-f4ed-44e8-b8a9-47b90c18db6a tempest-GroupSnapshotsTest-457900778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-c76fdca7-16e2-433b-8533-fb44c118dda0.b1efc000-cb99-478f-b92e-374d5fa85f09" returned: 0 in 0.278s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:24:25 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-5d7540ce-f4ed-44e8-b8a9-47b90c18db6a tempest-GroupSnapshotsTest-457900778 None] Lock "cinder-quobyte-b1efc000-cb99-478f-b92e-374d5fa85f09" released by "_delete_snapshot" :: held 2.346s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:24:25 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-5d7540ce-f4ed-44e8-b8a9-47b90c18db6a tempest-GroupSnapshotsTest-457900778 None] Lock "cinder-quobyte-c76fdca7-16e2-433b-8533-fb44c118dda0" released by "delete_snapshot" :: held 2.410s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:24:25 devstack cinder-volume[89182]: WARNING cinder.quota [None req-5d7540ce-f4ed-44e8-b8a9-47b90c18db6a tempest-GroupSnapshotsTest-457900778 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1385882018 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1385882018, it is now deprecated. Please use the default quota class for default quota. Jul 31 12:24:25 devstack cinder-volume[89182]: WARNING cinder.quota [None req-5d7540ce-f4ed-44e8-b8a9-47b90c18db6a tempest-GroupSnapshotsTest-457900778 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1385882018 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1385882018, it is now deprecated. Please use the default quota class for default quota. Jul 31 12:24:25 devstack cinder-volume[89182]: DEBUG cinder.quota [None req-5d7540ce-f4ed-44e8-b8a9-47b90c18db6a tempest-GroupSnapshotsTest-457900778 None] Created reservations ['5512126f-53f3-465e-bb80-c72f4e5e4158', '307f5d5f-acc8-41a0-b5b6-f1627fa2a4ec', '8432c398-112d-494a-a76b-3c4130c74e93', '048a6cd5-6443-4b8d-a490-485d087b0fc2'] {{(pid=89182) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 12:24:25 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-5d7540ce-f4ed-44e8-b8a9-47b90c18db6a tempest-GroupSnapshotsTest-457900778 None] group_snapshot 476099bb-756a-4803-be94-ce229b91c667: deleted successfully Jul 31 12:24:27 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-070050f8-f41d-4590-822c-2031a17b819d tempest-GroupSnapshotsTest-457900778 None] Acquiring lock "cinder-quobyte-c76fdca7-16e2-433b-8533-fb44c118dda0" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:24:27 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-070050f8-f41d-4590-822c-2031a17b819d tempest-GroupSnapshotsTest-457900778 None] Lock "cinder-quobyte-c76fdca7-16e2-433b-8533-fb44c118dda0" acquired by "delete_volume" :: waited 0.026s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:24:27 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[0829620d-36c9-48ff-a6f8-a497a75674fb]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:24:27 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-070050f8-f41d-4590-822c-2031a17b819d tempest-GroupSnapshotsTest-457900778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-c76fdca7-16e2-433b-8533-fb44c118dda0 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:24:27 devstack sudo[101079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-c76fdca7-16e2-433b-8533-fb44c118dda0 Jul 31 12:24:27 devstack sudo[101079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:24:27 devstack sudo[101079]: pam_unix(sudo:session): session closed for user root Jul 31 12:24:27 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-070050f8-f41d-4590-822c-2031a17b819d tempest-GroupSnapshotsTest-457900778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-c76fdca7-16e2-433b-8533-fb44c118dda0" returned: 0 in 0.504s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:24:27 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-070050f8-f41d-4590-822c-2031a17b819d tempest-GroupSnapshotsTest-457900778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-c76fdca7-16e2-433b-8533-fb44c118dda0 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:24:27 devstack sudo[101084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-c76fdca7-16e2-433b-8533-fb44c118dda0 Jul 31 12:24:27 devstack sudo[101084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:24:28 devstack sudo[101084]: pam_unix(sudo:session): session closed for user root Jul 31 12:24:28 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-070050f8-f41d-4590-822c-2031a17b819d tempest-GroupSnapshotsTest-457900778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-c76fdca7-16e2-433b-8533-fb44c118dda0" returned: 0 in 0.321s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:24:28 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-070050f8-f41d-4590-822c-2031a17b819d tempest-GroupSnapshotsTest-457900778 None] Lock "cinder-quobyte-c76fdca7-16e2-433b-8533-fb44c118dda0" released by "delete_volume" :: held 1.040s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:24:28 devstack cinder-volume[89182]: DEBUG cinder.quota [None req-070050f8-f41d-4590-822c-2031a17b819d tempest-GroupSnapshotsTest-457900778 None] Created reservations ['a9c62ebd-fcf5-4543-a932-d152665408fb'] {{(pid=89182) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 12:24:28 devstack cinder-volume[89182]: WARNING cinder.quota [None req-070050f8-f41d-4590-822c-2031a17b819d tempest-GroupSnapshotsTest-457900778 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1385882018 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1385882018, it is now deprecated. Please use the default quota class for default quota. Jul 31 12:24:28 devstack cinder-volume[89182]: DEBUG cinder.quota [None req-070050f8-f41d-4590-822c-2031a17b819d tempest-GroupSnapshotsTest-457900778 None] Created reservations ['a807d681-80e6-43bd-9e5e-9763a07001af', 'a70b94fc-89ac-4193-a5af-f3e03cb99f37', '037ed5ea-0f24-4c61-91ec-20837d2e3471', '5b8791ac-e71e-4614-af0c-1390267b3896'] {{(pid=89182) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 12:24:28 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-070050f8-f41d-4590-822c-2031a17b819d tempest-GroupSnapshotsTest-457900778 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:24:28 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-070050f8-f41d-4590-822c-2031a17b819d tempest-GroupSnapshotsTest-457900778 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:24:28 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-070050f8-f41d-4590-822c-2031a17b819d tempest-GroupSnapshotsTest-457900778 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:24:28 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-070050f8-f41d-4590-822c-2031a17b819d tempest-GroupSnapshotsTest-457900778 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:24:28 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-070050f8-f41d-4590-822c-2031a17b819d tempest-GroupSnapshotsTest-457900778 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:24:28 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-070050f8-f41d-4590-822c-2031a17b819d tempest-GroupSnapshotsTest-457900778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:24:28 devstack sudo[101087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 Jul 31 12:24:28 devstack sudo[101087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:24:29 devstack sudo[101087]: pam_unix(sudo:session): session closed for user root Jul 31 12:24:29 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-070050f8-f41d-4590-822c-2031a17b819d tempest-GroupSnapshotsTest-457900778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2" returned: 0 in 0.609s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:24:29 devstack cinder-volume[89182]: DEBUG cinder.manager [None req-070050f8-f41d-4590-822c-2031a17b819d tempest-GroupSnapshotsTest-457900778 None] Notifying Schedulers of capabilities ... {{(pid=89182) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 12:24:29 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-070050f8-f41d-4590-822c-2031a17b819d tempest-GroupSnapshotsTest-457900778 None] Delete group completed successfully. Jul 31 12:24:29 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [req-9def2662-3515-463f-b903-f6b92d70e39a req-369f9256-f5a5-4172-a882-6be9558969d7 tempest-TestVolumeBootPattern-1492021642 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:24:29 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [req-9def2662-3515-463f-b903-f6b92d70e39a req-369f9256-f5a5-4172-a882-6be9558969d7 tempest-TestVolumeBootPattern-1492021642 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:24:29 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [req-9def2662-3515-463f-b903-f6b92d70e39a req-369f9256-f5a5-4172-a882-6be9558969d7 tempest-TestVolumeBootPattern-1492021642 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.047s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:24:29 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [req-9def2662-3515-463f-b903-f6b92d70e39a req-369f9256-f5a5-4172-a882-6be9558969d7 tempest-TestVolumeBootPattern-1492021642 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88', 'name': 'volume-059c514e-3928-498a-9f8e-384f95a18a7c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f98e5478-00ea-4b32-ad48-eee7352fc674', 'enforce_multipath': True} {{(pid=89182) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 31 12:24:29 devstack cinder-volume[89182]: INFO cinder.volume.manager [req-9def2662-3515-463f-b903-f6b92d70e39a req-369f9256-f5a5-4172-a882-6be9558969d7 tempest-TestVolumeBootPattern-1492021642 None] attachment_update completed successfully. Jul 31 12:24:36 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-23c5649a-98dd-43f4-a71b-1f19b6713a0d tempest-GroupsV320Test-2095445324 None] Group tempest-GroupsV320Test-Group-743705254: creating Jul 31 12:24:36 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-23c5649a-98dd-43f4-a71b-1f19b6713a0d tempest-GroupsV320Test-2095445324 None] Group tempest-GroupsV320Test-Group-743705254: created successfully Jul 31 12:24:36 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-23c5649a-98dd-43f4-a71b-1f19b6713a0d tempest-GroupsV320Test-2095445324 None] Create group completed successfully. Jul 31 12:24:39 devstack cinder-volume[89182]: DEBUG cinder.quota [None req-25501dd5-874c-4d0f-8668-b3efa9837c8b tempest-GroupsV320Test-2095445324 None] Created reservations ['675c4f7e-06fd-4b19-a6ff-4beab8abf110'] {{(pid=89182) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 12:24:39 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-25501dd5-874c-4d0f-8668-b3efa9837c8b tempest-GroupsV320Test-2095445324 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:24:39 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-25501dd5-874c-4d0f-8668-b3efa9837c8b tempest-GroupsV320Test-2095445324 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:24:39 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-25501dd5-874c-4d0f-8668-b3efa9837c8b tempest-GroupsV320Test-2095445324 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:24:39 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-25501dd5-874c-4d0f-8668-b3efa9837c8b tempest-GroupsV320Test-2095445324 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:24:39 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-25501dd5-874c-4d0f-8668-b3efa9837c8b tempest-GroupsV320Test-2095445324 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:24:39 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-25501dd5-874c-4d0f-8668-b3efa9837c8b tempest-GroupsV320Test-2095445324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:24:39 devstack sudo[101678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 Jul 31 12:24:39 devstack sudo[101678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:24:39 devstack sudo[101678]: pam_unix(sudo:session): session closed for user root Jul 31 12:24:39 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-25501dd5-874c-4d0f-8668-b3efa9837c8b tempest-GroupsV320Test-2095445324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2" returned: 0 in 0.316s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:24:39 devstack cinder-volume[89182]: DEBUG cinder.manager [None req-25501dd5-874c-4d0f-8668-b3efa9837c8b tempest-GroupsV320Test-2095445324 None] Notifying Schedulers of capabilities ... {{(pid=89182) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 12:24:39 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-25501dd5-874c-4d0f-8668-b3efa9837c8b tempest-GroupsV320Test-2095445324 None] Delete group completed successfully. Jul 31 12:24:41 devstack cinder-volume[89182]: DEBUG cinder.volume.flows.manager.create_volume [None req-86703b92-0db6-48f2-a769-e37b6fcd1dbe tempest-AttachVolumeNegativeTest-1979015609 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89182) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 12:24:41 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-86703b92-0db6-48f2-a769-e37b6fcd1dbe tempest-AttachVolumeNegativeTest-1979015609 None] Flow 'volume_create_manager' (755511cd-7757-4afd-ae61-1b37a853d2d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:24:41 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-86703b92-0db6-48f2-a769-e37b6fcd1dbe tempest-AttachVolumeNegativeTest-1979015609 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb4fc731-d9c9-425d-b75d-7aa6090ea086) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:24:41 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-86703b92-0db6-48f2-a769-e37b6fcd1dbe tempest-AttachVolumeNegativeTest-1979015609 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb4fc731-d9c9-425d-b75d-7aa6090ea086) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:24:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-758834073',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02c0315f-484c-434a-8918-cb90b9847f3f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9581615e2dc443ea56b640260015955',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:24:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:24:41Z,use_quota=True,user_id='1b0f4502906f47628207383e0140cd35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:24:41 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-86703b92-0db6-48f2-a769-e37b6fcd1dbe tempest-AttachVolumeNegativeTest-1979015609 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10c0e436-3cf2-47d5-8c95-2fa4285ab999) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:24:41 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-86703b92-0db6-48f2-a769-e37b6fcd1dbe tempest-AttachVolumeNegativeTest-1979015609 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10c0e436-3cf2-47d5-8c95-2fa4285ab999) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:24:41 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-86703b92-0db6-48f2-a769-e37b6fcd1dbe tempest-AttachVolumeNegativeTest-1979015609 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c306f2c9-8392-4a2f-8990-80953c645e02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:24:41 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-86703b92-0db6-48f2-a769-e37b6fcd1dbe tempest-AttachVolumeNegativeTest-1979015609 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c306f2c9-8392-4a2f-8990-80953c645e02) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '02c0315f-484c-434a-8918-cb90b9847f3f', 'volume_name': 'volume-02c0315f-484c-434a-8918-cb90b9847f3f', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:24:41 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-86703b92-0db6-48f2-a769-e37b6fcd1dbe tempest-AttachVolumeNegativeTest-1979015609 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (faaeda51-3e9e-4ee0-8485-66ad75cccda6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:24:41 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-86703b92-0db6-48f2-a769-e37b6fcd1dbe tempest-AttachVolumeNegativeTest-1979015609 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (faaeda51-3e9e-4ee0-8485-66ad75cccda6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:24:41 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-86703b92-0db6-48f2-a769-e37b6fcd1dbe tempest-AttachVolumeNegativeTest-1979015609 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3fd8ba4-86ae-43df-91ac-4c97c66f9849) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:24:41 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-86703b92-0db6-48f2-a769-e37b6fcd1dbe tempest-AttachVolumeNegativeTest-1979015609 None] Volume 02c0315f-484c-434a-8918-cb90b9847f3f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-02c0315f-484c-434a-8918-cb90b9847f3f', 'volume_size': 1} Jul 31 12:24:41 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-86703b92-0db6-48f2-a769-e37b6fcd1dbe tempest-AttachVolumeNegativeTest-1979015609 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:24:41 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-86703b92-0db6-48f2-a769-e37b6fcd1dbe tempest-AttachVolumeNegativeTest-1979015609 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:24:41 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-86703b92-0db6-48f2-a769-e37b6fcd1dbe tempest-AttachVolumeNegativeTest-1979015609 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:24:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-758834073',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02c0315f-484c-434a-8918-cb90b9847f3f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9581615e2dc443ea56b640260015955',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:24:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:24:41Z,use_quota=True,user_id='1b0f4502906f47628207383e0140cd35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)}" {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 12:24:41 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-86703b92-0db6-48f2-a769-e37b6fcd1dbe tempest-AttachVolumeNegativeTest-1979015609 None] Creating volume 02c0315f-484c-434a-8918-cb90b9847f3f {{(pid=89182) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 12:24:41 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-86703b92-0db6-48f2-a769-e37b6fcd1dbe tempest-AttachVolumeNegativeTest-1979015609 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:24:41 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-86703b92-0db6-48f2-a769-e37b6fcd1dbe tempest-AttachVolumeNegativeTest-1979015609 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:24:41 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-86703b92-0db6-48f2-a769-e37b6fcd1dbe tempest-AttachVolumeNegativeTest-1979015609 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:24:41 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-86703b92-0db6-48f2-a769-e37b6fcd1dbe tempest-AttachVolumeNegativeTest-1979015609 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:24:41 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-86703b92-0db6-48f2-a769-e37b6fcd1dbe tempest-AttachVolumeNegativeTest-1979015609 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:24:41 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-86703b92-0db6-48f2-a769-e37b6fcd1dbe tempest-AttachVolumeNegativeTest-1979015609 None] Selected osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 as target Quobyte volume. {{(pid=89182) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 12:24:41 devstack cinder-volume[89182]: INFO cinder.volume.drivers.remotefs [None req-86703b92-0db6-48f2-a769-e37b6fcd1dbe tempest-AttachVolumeNegativeTest-1979015609 None] casted to osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 Jul 31 12:24:41 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-86703b92-0db6-48f2-a769-e37b6fcd1dbe tempest-AttachVolumeNegativeTest-1979015609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-02c0315f-484c-434a-8918-cb90b9847f3f 1073741824 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:24:41 devstack sudo[101683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-02c0315f-484c-434a-8918-cb90b9847f3f 1073741824 Jul 31 12:24:41 devstack sudo[101683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:24:41 devstack sudo[101683]: pam_unix(sudo:session): session closed for user root Jul 31 12:24:41 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-86703b92-0db6-48f2-a769-e37b6fcd1dbe tempest-AttachVolumeNegativeTest-1979015609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-02c0315f-484c-434a-8918-cb90b9847f3f 1073741824" returned: 0 in 0.470s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:24:41 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-86703b92-0db6-48f2-a769-e37b6fcd1dbe tempest-AttachVolumeNegativeTest-1979015609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-02c0315f-484c-434a-8918-cb90b9847f3f {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:24:41 devstack sudo[101689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-02c0315f-484c-434a-8918-cb90b9847f3f Jul 31 12:24:41 devstack sudo[101689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:24:42 devstack sudo[101689]: pam_unix(sudo:session): session closed for user root Jul 31 12:24:42 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-86703b92-0db6-48f2-a769-e37b6fcd1dbe tempest-AttachVolumeNegativeTest-1979015609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-02c0315f-484c-434a-8918-cb90b9847f3f" returned: 0 in 0.300s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:24:42 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-86703b92-0db6-48f2-a769-e37b6fcd1dbe tempest-AttachVolumeNegativeTest-1979015609 None] <== create_volume: return (816ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'} {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 12:24:42 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-86703b92-0db6-48f2-a769-e37b6fcd1dbe tempest-AttachVolumeNegativeTest-1979015609 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.820s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:24:42 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-86703b92-0db6-48f2-a769-e37b6fcd1dbe tempest-AttachVolumeNegativeTest-1979015609 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3fd8ba4-86ae-43df-91ac-4c97c66f9849) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-02c0315f-484c-434a-8918-cb90b9847f3f', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:24:42 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-86703b92-0db6-48f2-a769-e37b6fcd1dbe tempest-AttachVolumeNegativeTest-1979015609 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ce63272-13b3-45a1-9eb6-72a46f87599b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:24:42 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-86703b92-0db6-48f2-a769-e37b6fcd1dbe tempest-AttachVolumeNegativeTest-1979015609 None] Volume volume-02c0315f-484c-434a-8918-cb90b9847f3f (02c0315f-484c-434a-8918-cb90b9847f3f): created successfully Jul 31 12:24:42 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-86703b92-0db6-48f2-a769-e37b6fcd1dbe tempest-AttachVolumeNegativeTest-1979015609 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ce63272-13b3-45a1-9eb6-72a46f87599b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:24:42 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-86703b92-0db6-48f2-a769-e37b6fcd1dbe tempest-AttachVolumeNegativeTest-1979015609 None] Flow 'volume_create_manager' (755511cd-7757-4afd-ae61-1b37a853d2d9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:24:42 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-86703b92-0db6-48f2-a769-e37b6fcd1dbe tempest-AttachVolumeNegativeTest-1979015609 None] Created volume successfully. Jul 31 12:24:44 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [req-a469a26e-4c4a-4406-830b-832ce0121bf1 req-462e363f-caa1-4667-9ad7-49c1b8a7536c tempest-AttachVolumeNegativeTest-1979015609 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:24:44 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [req-a469a26e-4c4a-4406-830b-832ce0121bf1 req-462e363f-caa1-4667-9ad7-49c1b8a7536c tempest-AttachVolumeNegativeTest-1979015609 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:24:44 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [req-a469a26e-4c4a-4406-830b-832ce0121bf1 req-462e363f-caa1-4667-9ad7-49c1b8a7536c tempest-AttachVolumeNegativeTest-1979015609 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.043s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:24:44 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [req-a469a26e-4c4a-4406-830b-832ce0121bf1 req-462e363f-caa1-4667-9ad7-49c1b8a7536c tempest-AttachVolumeNegativeTest-1979015609 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88', 'name': 'volume-02c0315f-484c-434a-8918-cb90b9847f3f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8b3fa4a2-bfec-4099-8f70-3db534815e91', 'enforce_multipath': True} {{(pid=89182) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 31 12:24:44 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [req-51584148-43ef-44b7-8e8f-3bd88e06fefe req-0b9f28da-e4c9-4727-b8a6-13c2862ac024 tempest-TestStampPattern-418584557 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:24:44 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [req-51584148-43ef-44b7-8e8f-3bd88e06fefe req-0b9f28da-e4c9-4727-b8a6-13c2862ac024 tempest-TestStampPattern-418584557 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:24:44 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [req-51584148-43ef-44b7-8e8f-3bd88e06fefe req-0b9f28da-e4c9-4727-b8a6-13c2862ac024 tempest-TestStampPattern-418584557 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.023s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:24:44 devstack cinder-volume[89182]: INFO cinder.volume.manager [req-a469a26e-4c4a-4406-830b-832ce0121bf1 req-462e363f-caa1-4667-9ad7-49c1b8a7536c tempest-AttachVolumeNegativeTest-1979015609 None] attachment_update completed successfully. Jul 31 12:24:44 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [req-51584148-43ef-44b7-8e8f-3bd88e06fefe req-0b9f28da-e4c9-4727-b8a6-13c2862ac024 tempest-TestStampPattern-418584557 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88', 'name': 'volume-0cea5331-ddf1-4068-bee4-c6518e039abc', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'cc8e1a94-372e-4a88-9562-a13f741054c8', 'enforce_multipath': True} {{(pid=89182) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 31 12:24:44 devstack cinder-volume[89182]: INFO cinder.volume.manager [req-51584148-43ef-44b7-8e8f-3bd88e06fefe req-0b9f28da-e4c9-4727-b8a6-13c2862ac024 tempest-TestStampPattern-418584557 None] attachment_update completed successfully. Jul 31 12:24:47 devstack cinder-volume[89182]: INFO cinder.volume.manager [req-c51d7488-f7d2-44ee-8b76-db648616d8b8 req-c3444082-db13-4566-8422-612282efabc8 tempest-AttachVolumeNegativeTest-1979015609 None] Terminate volume connection completed successfully. Jul 31 12:24:47 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [req-c51d7488-f7d2-44ee-8b76-db648616d8b8 req-c3444082-db13-4566-8422-612282efabc8 tempest-AttachVolumeNegativeTest-1979015609 None] Deleting attachment 8b3fa4a2-bfec-4099-8f70-3db534815e91. {{(pid=89182) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 31 12:24:51 devstack cinder-volume[89182]: INFO cinder.volume.manager [req-4cf9cd3f-9066-4f57-ac50-83b4b0570f43 req-8f787f80-551a-454d-abbf-757bad0d46a1 tempest-TestStampPattern-418584557 None] Terminate volume connection completed successfully. Jul 31 12:24:51 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [req-4cf9cd3f-9066-4f57-ac50-83b4b0570f43 req-8f787f80-551a-454d-abbf-757bad0d46a1 tempest-TestStampPattern-418584557 None] Deleting attachment cc8e1a94-372e-4a88-9562-a13f741054c8. {{(pid=89182) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 31 12:24:52 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-fe98807e-00ec-47cb-ada3-8e9c3de10689 tempest-TestStampPattern-418584557 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:24:52 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-fe98807e-00ec-47cb-ada3-8e9c3de10689 tempest-TestStampPattern-418584557 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:24:52 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-fe98807e-00ec-47cb-ada3-8e9c3de10689 tempest-TestStampPattern-418584557 None] Creating offline snapshot d22d4adf-234b-4a28-a12a-373a8bfa7db1 of volume 0cea5331-ddf1-4068-bee4-c6518e039abc {{(pid=89182) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 31 12:24:52 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[e55c937e-1791-446c-9c9a-7be43b52f234]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:24:52 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-fe98807e-00ec-47cb-ada3-8e9c3de10689 tempest-TestStampPattern-418584557 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0cea5331-ddf1-4068-bee4-c6518e039abc {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:24:52 devstack sudo[101799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0cea5331-ddf1-4068-bee4-c6518e039abc Jul 31 12:24:52 devstack sudo[101799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:24:52 devstack sudo[101799]: pam_unix(sudo:session): session closed for user root Jul 31 12:24:52 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-fe98807e-00ec-47cb-ada3-8e9c3de10689 tempest-TestStampPattern-418584557 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0cea5331-ddf1-4068-bee4-c6518e039abc" returned: 0 in 0.447s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:24:52 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-fe98807e-00ec-47cb-ada3-8e9c3de10689 tempest-TestStampPattern-418584557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0cea5331-ddf1-4068-bee4-c6518e039abc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0cea5331-ddf1-4068-bee4-c6518e039abc.d22d4adf-234b-4a28-a12a-373a8bfa7db1 1G {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:24:52 devstack sudo[101804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0cea5331-ddf1-4068-bee4-c6518e039abc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0cea5331-ddf1-4068-bee4-c6518e039abc.d22d4adf-234b-4a28-a12a-373a8bfa7db1 1G Jul 31 12:24:52 devstack sudo[101804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:24:53 devstack sudo[101804]: pam_unix(sudo:session): session closed for user root Jul 31 12:24:53 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-fe98807e-00ec-47cb-ada3-8e9c3de10689 tempest-TestStampPattern-418584557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0cea5331-ddf1-4068-bee4-c6518e039abc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0cea5331-ddf1-4068-bee4-c6518e039abc.d22d4adf-234b-4a28-a12a-373a8bfa7db1 1G" returned: 0 in 0.597s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:24:53 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-fe98807e-00ec-47cb-ada3-8e9c3de10689 tempest-TestStampPattern-418584557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0cea5331-ddf1-4068-bee4-c6518e039abc -F qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0cea5331-ddf1-4068-bee4-c6518e039abc.d22d4adf-234b-4a28-a12a-373a8bfa7db1 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:24:53 devstack sudo[101839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0cea5331-ddf1-4068-bee4-c6518e039abc -F qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0cea5331-ddf1-4068-bee4-c6518e039abc.d22d4adf-234b-4a28-a12a-373a8bfa7db1 Jul 31 12:24:53 devstack sudo[101839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:24:53 devstack sudo[101839]: pam_unix(sudo:session): session closed for user root Jul 31 12:24:53 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-fe98807e-00ec-47cb-ada3-8e9c3de10689 tempest-TestStampPattern-418584557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0cea5331-ddf1-4068-bee4-c6518e039abc -F qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0cea5331-ddf1-4068-bee4-c6518e039abc.d22d4adf-234b-4a28-a12a-373a8bfa7db1" returned: 0 in 0.396s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:24:53 devstack cinder-volume[89182]: WARNING cinder.volume.drivers.remotefs [None req-fe98807e-00ec-47cb-ada3-8e9c3de10689 tempest-TestStampPattern-418584557 None] /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0cea5331-ddf1-4068-bee4-c6518e039abc.d22d4adf-234b-4a28-a12a-373a8bfa7db1 is being set with open permissions: ugo+rw Jul 31 12:24:53 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-fe98807e-00ec-47cb-ada3-8e9c3de10689 tempest-TestStampPattern-418584557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0cea5331-ddf1-4068-bee4-c6518e039abc.d22d4adf-234b-4a28-a12a-373a8bfa7db1 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:24:53 devstack sudo[101845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0cea5331-ddf1-4068-bee4-c6518e039abc.d22d4adf-234b-4a28-a12a-373a8bfa7db1 Jul 31 12:24:53 devstack sudo[101845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:24:53 devstack sudo[101845]: pam_unix(sudo:session): session closed for user root Jul 31 12:24:53 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-fe98807e-00ec-47cb-ada3-8e9c3de10689 tempest-TestStampPattern-418584557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0cea5331-ddf1-4068-bee4-c6518e039abc.d22d4adf-234b-4a28-a12a-373a8bfa7db1" returned: 0 in 0.276s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:24:54 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-fe98807e-00ec-47cb-ada3-8e9c3de10689 tempest-TestStampPattern-418584557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0cea5331-ddf1-4068-bee4-c6518e039abc.info {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:24:54 devstack sudo[101848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0cea5331-ddf1-4068-bee4-c6518e039abc.info Jul 31 12:24:54 devstack sudo[101848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:24:54 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-7c694e1d-dd7f-43cb-9e80-ab821d0c6ef9 tempest-AttachVolumeNegativeTest-1979015609 None] Acquiring lock "cinder-02c0315f-484c-434a-8918-cb90b9847f3f-delete_volume" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:24:54 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-7c694e1d-dd7f-43cb-9e80-ab821d0c6ef9 tempest-AttachVolumeNegativeTest-1979015609 None] Lock "cinder-02c0315f-484c-434a-8918-cb90b9847f3f-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:24:54 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-7c694e1d-dd7f-43cb-9e80-ab821d0c6ef9 tempest-AttachVolumeNegativeTest-1979015609 None] Acquiring lock "cinder-quobyte-02c0315f-484c-434a-8918-cb90b9847f3f" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:24:54 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-7c694e1d-dd7f-43cb-9e80-ab821d0c6ef9 tempest-AttachVolumeNegativeTest-1979015609 None] Lock "cinder-quobyte-02c0315f-484c-434a-8918-cb90b9847f3f" acquired by "delete_volume" :: waited 0.022s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:24:54 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[12b67bbd-e6d9-4805-a132-411c7660b775]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:24:54 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-7c694e1d-dd7f-43cb-9e80-ab821d0c6ef9 tempest-AttachVolumeNegativeTest-1979015609 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-02c0315f-484c-434a-8918-cb90b9847f3f {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:24:54 devstack sudo[101850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-02c0315f-484c-434a-8918-cb90b9847f3f Jul 31 12:24:54 devstack sudo[101850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:24:54 devstack sudo[101848]: pam_unix(sudo:session): session closed for user root Jul 31 12:24:54 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-fe98807e-00ec-47cb-ada3-8e9c3de10689 tempest-TestStampPattern-418584557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0cea5331-ddf1-4068-bee4-c6518e039abc.info" returned: 0 in 0.356s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:24:54 devstack cinder-volume[89182]: WARNING cinder.volume.drivers.remotefs [None req-fe98807e-00ec-47cb-ada3-8e9c3de10689 tempest-TestStampPattern-418584557 None] /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0cea5331-ddf1-4068-bee4-c6518e039abc.info is being set with open permissions: ugo+rw Jul 31 12:24:54 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-fe98807e-00ec-47cb-ada3-8e9c3de10689 tempest-TestStampPattern-418584557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0cea5331-ddf1-4068-bee4-c6518e039abc.info {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:24:54 devstack sudo[101853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0cea5331-ddf1-4068-bee4-c6518e039abc.info Jul 31 12:24:54 devstack sudo[101853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:24:54 devstack sudo[101853]: pam_unix(sudo:session): session closed for user root Jul 31 12:24:54 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-fe98807e-00ec-47cb-ada3-8e9c3de10689 tempest-TestStampPattern-418584557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0cea5331-ddf1-4068-bee4-c6518e039abc.info" returned: 0 in 0.271s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:24:54 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-fe98807e-00ec-47cb-ada3-8e9c3de10689 tempest-TestStampPattern-418584557 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.467s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:24:54 devstack sudo[101850]: pam_unix(sudo:session): session closed for user root Jul 31 12:24:54 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-7c694e1d-dd7f-43cb-9e80-ab821d0c6ef9 tempest-AttachVolumeNegativeTest-1979015609 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-02c0315f-484c-434a-8918-cb90b9847f3f" returned: 0 in 0.443s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:24:54 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-7c694e1d-dd7f-43cb-9e80-ab821d0c6ef9 tempest-AttachVolumeNegativeTest-1979015609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-02c0315f-484c-434a-8918-cb90b9847f3f {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:24:54 devstack sudo[101859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-02c0315f-484c-434a-8918-cb90b9847f3f Jul 31 12:24:54 devstack sudo[101859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:24:54 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-fe98807e-00ec-47cb-ada3-8e9c3de10689 tempest-TestStampPattern-418584557 None] Create snapshot completed successfully Jul 31 12:24:54 devstack sudo[101859]: pam_unix(sudo:session): session closed for user root Jul 31 12:24:54 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-7c694e1d-dd7f-43cb-9e80-ab821d0c6ef9 tempest-AttachVolumeNegativeTest-1979015609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-02c0315f-484c-434a-8918-cb90b9847f3f" returned: 0 in 0.255s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:24:54 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-7c694e1d-dd7f-43cb-9e80-ab821d0c6ef9 tempest-AttachVolumeNegativeTest-1979015609 None] Lock "cinder-quobyte-02c0315f-484c-434a-8918-cb90b9847f3f" released by "delete_volume" :: held 0.758s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:24:54 devstack cinder-volume[89182]: DEBUG cinder.quota [None req-7c694e1d-dd7f-43cb-9e80-ab821d0c6ef9 tempest-AttachVolumeNegativeTest-1979015609 None] Created reservations ['dabc472c-e17b-47fd-a205-fe404a1961b2', '131e2f49-bf17-451f-a2fe-e6733cf14585', '2a145f59-d787-4e6a-b8b0-2eb3f49a1370', '32ba80c2-b76e-4c68-be01-dc6b1923c20a'] {{(pid=89182) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 12:24:55 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-7c694e1d-dd7f-43cb-9e80-ab821d0c6ef9 tempest-AttachVolumeNegativeTest-1979015609 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:24:55 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-7c694e1d-dd7f-43cb-9e80-ab821d0c6ef9 tempest-AttachVolumeNegativeTest-1979015609 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:24:55 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-7c694e1d-dd7f-43cb-9e80-ab821d0c6ef9 tempest-AttachVolumeNegativeTest-1979015609 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:24:55 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-7c694e1d-dd7f-43cb-9e80-ab821d0c6ef9 tempest-AttachVolumeNegativeTest-1979015609 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:24:55 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-7c694e1d-dd7f-43cb-9e80-ab821d0c6ef9 tempest-AttachVolumeNegativeTest-1979015609 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:24:55 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-7c694e1d-dd7f-43cb-9e80-ab821d0c6ef9 tempest-AttachVolumeNegativeTest-1979015609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:24:55 devstack sudo[101862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 Jul 31 12:24:55 devstack sudo[101862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:24:55 devstack sudo[101862]: pam_unix(sudo:session): session closed for user root Jul 31 12:24:55 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-3d2039d5-dae0-4d19-a4df-84a4d442a2bf tempest-AttachVolumeNegativeTest-1979015609 None] Acquiring lock "cinder-89590e7b-f45e-4e7d-b15f-0665cf621da6-delete_volume" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:24:55 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-7c694e1d-dd7f-43cb-9e80-ab821d0c6ef9 tempest-AttachVolumeNegativeTest-1979015609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2" returned: 0 in 0.313s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:24:55 devstack cinder-volume[89182]: DEBUG cinder.manager [None req-7c694e1d-dd7f-43cb-9e80-ab821d0c6ef9 tempest-AttachVolumeNegativeTest-1979015609 None] Notifying Schedulers of capabilities ... {{(pid=89182) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 12:24:55 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-7c694e1d-dd7f-43cb-9e80-ab821d0c6ef9 tempest-AttachVolumeNegativeTest-1979015609 None] Deleted volume successfully. Jul 31 12:24:55 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-3d2039d5-dae0-4d19-a4df-84a4d442a2bf tempest-AttachVolumeNegativeTest-1979015609 None] Lock "cinder-89590e7b-f45e-4e7d-b15f-0665cf621da6-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:24:55 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-7c694e1d-dd7f-43cb-9e80-ab821d0c6ef9 tempest-AttachVolumeNegativeTest-1979015609 None] Lock "cinder-02c0315f-484c-434a-8918-cb90b9847f3f-delete_volume" released by "delete_volume" :: held 1.348s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:24:55 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-3d2039d5-dae0-4d19-a4df-84a4d442a2bf tempest-AttachVolumeNegativeTest-1979015609 None] Acquiring lock "cinder-quobyte-89590e7b-f45e-4e7d-b15f-0665cf621da6" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:24:55 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-3d2039d5-dae0-4d19-a4df-84a4d442a2bf tempest-AttachVolumeNegativeTest-1979015609 None] Lock "cinder-quobyte-89590e7b-f45e-4e7d-b15f-0665cf621da6" acquired by "delete_volume" :: waited 0.037s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:24:55 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[51b2caef-9619-48fd-895e-8c81e6bf106f]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:24:55 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-3d2039d5-dae0-4d19-a4df-84a4d442a2bf tempest-AttachVolumeNegativeTest-1979015609 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-89590e7b-f45e-4e7d-b15f-0665cf621da6 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:24:55 devstack sudo[101865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-89590e7b-f45e-4e7d-b15f-0665cf621da6 Jul 31 12:24:55 devstack sudo[101865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:24:55 devstack sudo[101865]: pam_unix(sudo:session): session closed for user root Jul 31 12:24:55 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-3d2039d5-dae0-4d19-a4df-84a4d442a2bf tempest-AttachVolumeNegativeTest-1979015609 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-89590e7b-f45e-4e7d-b15f-0665cf621da6" returned: 0 in 0.378s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:24:55 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-3d2039d5-dae0-4d19-a4df-84a4d442a2bf tempest-AttachVolumeNegativeTest-1979015609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-89590e7b-f45e-4e7d-b15f-0665cf621da6 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:24:55 devstack sudo[101870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-89590e7b-f45e-4e7d-b15f-0665cf621da6 Jul 31 12:24:55 devstack sudo[101870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:24:56 devstack sudo[101870]: pam_unix(sudo:session): session closed for user root Jul 31 12:24:56 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-3d2039d5-dae0-4d19-a4df-84a4d442a2bf tempest-AttachVolumeNegativeTest-1979015609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-89590e7b-f45e-4e7d-b15f-0665cf621da6" returned: 0 in 0.295s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:24:56 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-3d2039d5-dae0-4d19-a4df-84a4d442a2bf tempest-AttachVolumeNegativeTest-1979015609 None] Lock "cinder-quobyte-89590e7b-f45e-4e7d-b15f-0665cf621da6" released by "delete_volume" :: held 0.739s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:24:56 devstack cinder-volume[89182]: DEBUG cinder.quota [None req-3d2039d5-dae0-4d19-a4df-84a4d442a2bf tempest-AttachVolumeNegativeTest-1979015609 None] Created reservations ['e0341ee8-7108-485d-b149-11f5502cb19a', 'de681bf5-41bc-42c3-898b-9e1adb1991fc', 'c148df48-974d-4f47-8269-cefeb6f645ec', '582d98ba-6e22-4e99-9b32-70ef1aa7b4b8'] {{(pid=89182) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 12:24:56 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-3d2039d5-dae0-4d19-a4df-84a4d442a2bf tempest-AttachVolumeNegativeTest-1979015609 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:24:56 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-3d2039d5-dae0-4d19-a4df-84a4d442a2bf tempest-AttachVolumeNegativeTest-1979015609 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:24:56 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-3d2039d5-dae0-4d19-a4df-84a4d442a2bf tempest-AttachVolumeNegativeTest-1979015609 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:24:56 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-3d2039d5-dae0-4d19-a4df-84a4d442a2bf tempest-AttachVolumeNegativeTest-1979015609 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:24:56 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-3d2039d5-dae0-4d19-a4df-84a4d442a2bf tempest-AttachVolumeNegativeTest-1979015609 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:24:56 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-3d2039d5-dae0-4d19-a4df-84a4d442a2bf tempest-AttachVolumeNegativeTest-1979015609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:24:56 devstack sudo[101874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 Jul 31 12:24:56 devstack sudo[101874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:24:56 devstack sudo[101874]: pam_unix(sudo:session): session closed for user root Jul 31 12:24:56 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-3d2039d5-dae0-4d19-a4df-84a4d442a2bf tempest-AttachVolumeNegativeTest-1979015609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2" returned: 0 in 0.309s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:24:56 devstack cinder-volume[89182]: DEBUG cinder.manager [None req-3d2039d5-dae0-4d19-a4df-84a4d442a2bf tempest-AttachVolumeNegativeTest-1979015609 None] Notifying Schedulers of capabilities ... {{(pid=89182) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 12:24:56 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-3d2039d5-dae0-4d19-a4df-84a4d442a2bf tempest-AttachVolumeNegativeTest-1979015609 None] Deleted volume successfully. Jul 31 12:24:56 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-3d2039d5-dae0-4d19-a4df-84a4d442a2bf tempest-AttachVolumeNegativeTest-1979015609 None] Lock "cinder-89590e7b-f45e-4e7d-b15f-0665cf621da6-delete_volume" released by "delete_volume" :: held 1.398s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:24:56 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-4e238a4b-b6d9-44bd-99f3-d77e04bf073a tempest-AttachVolumeNegativeTest-1979015609 None] Acquiring lock "cinder-91f3108b-2aea-4ab2-a662-f0f35c13f19d-delete_volume" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:24:56 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-4e238a4b-b6d9-44bd-99f3-d77e04bf073a tempest-AttachVolumeNegativeTest-1979015609 None] Lock "cinder-91f3108b-2aea-4ab2-a662-f0f35c13f19d-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:24:56 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-4e238a4b-b6d9-44bd-99f3-d77e04bf073a tempest-AttachVolumeNegativeTest-1979015609 None] Acquiring lock "cinder-quobyte-91f3108b-2aea-4ab2-a662-f0f35c13f19d" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:24:56 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-4e238a4b-b6d9-44bd-99f3-d77e04bf073a tempest-AttachVolumeNegativeTest-1979015609 None] Lock "cinder-quobyte-91f3108b-2aea-4ab2-a662-f0f35c13f19d" acquired by "delete_volume" :: waited 0.018s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:24:57 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[22b43234-fa46-44c0-b869-119507b697bf]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:24:57 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-4e238a4b-b6d9-44bd-99f3-d77e04bf073a tempest-AttachVolumeNegativeTest-1979015609 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-91f3108b-2aea-4ab2-a662-f0f35c13f19d {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:24:57 devstack sudo[101877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-91f3108b-2aea-4ab2-a662-f0f35c13f19d Jul 31 12:24:57 devstack sudo[101877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:24:57 devstack sudo[101877]: pam_unix(sudo:session): session closed for user root Jul 31 12:24:57 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-4e238a4b-b6d9-44bd-99f3-d77e04bf073a tempest-AttachVolumeNegativeTest-1979015609 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-91f3108b-2aea-4ab2-a662-f0f35c13f19d" returned: 0 in 0.408s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:24:57 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-4e238a4b-b6d9-44bd-99f3-d77e04bf073a tempest-AttachVolumeNegativeTest-1979015609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-91f3108b-2aea-4ab2-a662-f0f35c13f19d {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:24:57 devstack sudo[101889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-91f3108b-2aea-4ab2-a662-f0f35c13f19d Jul 31 12:24:57 devstack sudo[101889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:24:57 devstack sudo[101889]: pam_unix(sudo:session): session closed for user root Jul 31 12:24:57 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-4e238a4b-b6d9-44bd-99f3-d77e04bf073a tempest-AttachVolumeNegativeTest-1979015609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-91f3108b-2aea-4ab2-a662-f0f35c13f19d" returned: 0 in 0.293s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:24:57 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-4e238a4b-b6d9-44bd-99f3-d77e04bf073a tempest-AttachVolumeNegativeTest-1979015609 None] Lock "cinder-quobyte-91f3108b-2aea-4ab2-a662-f0f35c13f19d" released by "delete_volume" :: held 0.754s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:24:57 devstack cinder-volume[89182]: DEBUG cinder.quota [None req-4e238a4b-b6d9-44bd-99f3-d77e04bf073a tempest-AttachVolumeNegativeTest-1979015609 None] Created reservations ['e344cc52-fed3-4f22-8baf-dc66ad0ea375', '072d4ea4-8233-4705-8d01-62a9abdf3970', '9de72a58-437b-41c4-962c-2b293f779aa3', '7ad0ff38-2b5c-4a77-bca3-8a80ecdffa7d'] {{(pid=89182) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 12:24:57 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-4e238a4b-b6d9-44bd-99f3-d77e04bf073a tempest-AttachVolumeNegativeTest-1979015609 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:24:57 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-4e238a4b-b6d9-44bd-99f3-d77e04bf073a tempest-AttachVolumeNegativeTest-1979015609 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:24:57 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-4e238a4b-b6d9-44bd-99f3-d77e04bf073a tempest-AttachVolumeNegativeTest-1979015609 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:24:57 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-4e238a4b-b6d9-44bd-99f3-d77e04bf073a tempest-AttachVolumeNegativeTest-1979015609 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:24:57 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-4e238a4b-b6d9-44bd-99f3-d77e04bf073a tempest-AttachVolumeNegativeTest-1979015609 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:24:57 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-4e238a4b-b6d9-44bd-99f3-d77e04bf073a tempest-AttachVolumeNegativeTest-1979015609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:24:57 devstack sudo[101907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 Jul 31 12:24:57 devstack sudo[101907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:24:58 devstack sudo[101907]: pam_unix(sudo:session): session closed for user root Jul 31 12:24:58 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-4e238a4b-b6d9-44bd-99f3-d77e04bf073a tempest-AttachVolumeNegativeTest-1979015609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2" returned: 0 in 0.360s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:24:58 devstack cinder-volume[89182]: DEBUG cinder.manager [None req-4e238a4b-b6d9-44bd-99f3-d77e04bf073a tempest-AttachVolumeNegativeTest-1979015609 None] Notifying Schedulers of capabilities ... {{(pid=89182) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 12:24:58 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-4e238a4b-b6d9-44bd-99f3-d77e04bf073a tempest-AttachVolumeNegativeTest-1979015609 None] Deleted volume successfully. Jul 31 12:24:58 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-4e238a4b-b6d9-44bd-99f3-d77e04bf073a tempest-AttachVolumeNegativeTest-1979015609 None] Lock "cinder-91f3108b-2aea-4ab2-a662-f0f35c13f19d-delete_volume" released by "delete_volume" :: held 1.439s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:25:01 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-f6b433db-b9cb-4d16-af75-ccc64b8afea2 tempest-TestVolumeBootPattern-1492021642 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:25:01 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-f6b433db-b9cb-4d16-af75-ccc64b8afea2 tempest-TestVolumeBootPattern-1492021642 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:25:01 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-f6b433db-b9cb-4d16-af75-ccc64b8afea2 tempest-TestVolumeBootPattern-1492021642 None] Creating online snapshot 32d8c5b8-3d64-486d-b503-068001d9631e of volume 059c514e-3928-498a-9f8e-384f95a18a7c {{(pid=89182) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 31 12:25:02 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[df35a138-bcdb-486e-8812-053b9d4afa9c]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:25:02 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-f6b433db-b9cb-4d16-af75-ccc64b8afea2 tempest-TestVolumeBootPattern-1492021642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-059c514e-3928-498a-9f8e-384f95a18a7c {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:25:02 devstack sudo[101936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-059c514e-3928-498a-9f8e-384f95a18a7c Jul 31 12:25:02 devstack sudo[101936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:25:02 devstack sudo[101936]: pam_unix(sudo:session): session closed for user root Jul 31 12:25:02 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-f6b433db-b9cb-4d16-af75-ccc64b8afea2 tempest-TestVolumeBootPattern-1492021642 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-059c514e-3928-498a-9f8e-384f95a18a7c" returned: 0 in 0.666s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:25:02 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-f6b433db-b9cb-4d16-af75-ccc64b8afea2 tempest-TestVolumeBootPattern-1492021642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-059c514e-3928-498a-9f8e-384f95a18a7c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-059c514e-3928-498a-9f8e-384f95a18a7c.32d8c5b8-3d64-486d-b503-068001d9631e 1G {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:25:02 devstack sudo[101941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-059c514e-3928-498a-9f8e-384f95a18a7c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-059c514e-3928-498a-9f8e-384f95a18a7c.32d8c5b8-3d64-486d-b503-068001d9631e 1G Jul 31 12:25:02 devstack sudo[101941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:25:03 devstack sudo[101941]: pam_unix(sudo:session): session closed for user root Jul 31 12:25:03 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-f6b433db-b9cb-4d16-af75-ccc64b8afea2 tempest-TestVolumeBootPattern-1492021642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-059c514e-3928-498a-9f8e-384f95a18a7c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-059c514e-3928-498a-9f8e-384f95a18a7c.32d8c5b8-3d64-486d-b503-068001d9631e 1G" returned: 0 in 0.546s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:25:03 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-f6b433db-b9cb-4d16-af75-ccc64b8afea2 tempest-TestVolumeBootPattern-1492021642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-059c514e-3928-498a-9f8e-384f95a18a7c -F qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-059c514e-3928-498a-9f8e-384f95a18a7c.32d8c5b8-3d64-486d-b503-068001d9631e {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:25:03 devstack sudo[101948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-059c514e-3928-498a-9f8e-384f95a18a7c -F qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-059c514e-3928-498a-9f8e-384f95a18a7c.32d8c5b8-3d64-486d-b503-068001d9631e Jul 31 12:25:03 devstack sudo[101948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:25:03 devstack sudo[101948]: pam_unix(sudo:session): session closed for user root Jul 31 12:25:03 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-f6b433db-b9cb-4d16-af75-ccc64b8afea2 tempest-TestVolumeBootPattern-1492021642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-059c514e-3928-498a-9f8e-384f95a18a7c -F qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-059c514e-3928-498a-9f8e-384f95a18a7c.32d8c5b8-3d64-486d-b503-068001d9631e" returned: 0 in 0.568s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:25:03 devstack cinder-volume[89182]: WARNING cinder.volume.drivers.remotefs [None req-f6b433db-b9cb-4d16-af75-ccc64b8afea2 tempest-TestVolumeBootPattern-1492021642 None] /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-059c514e-3928-498a-9f8e-384f95a18a7c.32d8c5b8-3d64-486d-b503-068001d9631e is being set with open permissions: ugo+rw Jul 31 12:25:03 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-f6b433db-b9cb-4d16-af75-ccc64b8afea2 tempest-TestVolumeBootPattern-1492021642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-059c514e-3928-498a-9f8e-384f95a18a7c.32d8c5b8-3d64-486d-b503-068001d9631e {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:25:03 devstack sudo[101955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-059c514e-3928-498a-9f8e-384f95a18a7c.32d8c5b8-3d64-486d-b503-068001d9631e Jul 31 12:25:03 devstack sudo[101955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:25:04 devstack sudo[101955]: pam_unix(sudo:session): session closed for user root Jul 31 12:25:04 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-f6b433db-b9cb-4d16-af75-ccc64b8afea2 tempest-TestVolumeBootPattern-1492021642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-059c514e-3928-498a-9f8e-384f95a18a7c.32d8c5b8-3d64-486d-b503-068001d9631e" returned: 0 in 0.367s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:25:04 devstack cinder-volume[89182]: DEBUG cinder.compute.nova [None req-f6b433db-b9cb-4d16-af75-ccc64b8afea2 tempest-TestVolumeBootPattern-1492021642 None] Creating Keystone auth plugin from conf {{(pid=89182) novaclient /opt/stack/cinder/cinder/compute/nova.py:99}} Jul 31 12:25:04 devstack cinder-volume[89182]: DEBUG cinder.volume.flows.manager.create_volume [None req-9433a63f-4f24-45e0-902d-747ebf42752f tempest-TestStampPattern-418584557 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89182) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 12:25:04 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-9433a63f-4f24-45e0-902d-747ebf42752f tempest-TestStampPattern-418584557 None] Flow 'volume_create_manager' (edfc7172-68f4-44c5-b3c0-763a437f5a8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:25:04 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-9433a63f-4f24-45e0-902d-747ebf42752f tempest-TestStampPattern-418584557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da64c01e-ad2c-4c46-99b2-ef08071b44a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:25:04 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-9433a63f-4f24-45e0-902d-747ebf42752f tempest-TestStampPattern-418584557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da64c01e-ad2c-4c46-99b2-ef08071b44a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:25:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1550859916',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0066bfd-3e6d-48ac-83e6-ec47a100d768,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9125075c79d741faa9c3b15073a7c183',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:25:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=d22d4adf-234b-4a28-a12a-373a8bfa7db1,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:25:05Z,use_quota=True,user_id='382d36422a8847e3a570abe576efafc3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:25:04 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-9433a63f-4f24-45e0-902d-747ebf42752f tempest-TestStampPattern-418584557 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b41ec876-b15d-406b-910a-b086f0defea5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:25:04 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-9433a63f-4f24-45e0-902d-747ebf42752f tempest-TestStampPattern-418584557 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b41ec876-b15d-406b-910a-b086f0defea5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:25:04 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-9433a63f-4f24-45e0-902d-747ebf42752f tempest-TestStampPattern-418584557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07a1cbcb-ae04-4fa0-ad2f-a426f3143834) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:25:04 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-9433a63f-4f24-45e0-902d-747ebf42752f tempest-TestStampPattern-418584557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07a1cbcb-ae04-4fa0-ad2f-a426f3143834) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'd0066bfd-3e6d-48ac-83e6-ec47a100d768', 'volume_name': 'volume-d0066bfd-3e6d-48ac-83e6-ec47a100d768', 'volume_size': 1, 'snapshot_id': 'd22d4adf-234b-4a28-a12a-373a8bfa7db1'}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:25:04 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-9433a63f-4f24-45e0-902d-747ebf42752f tempest-TestStampPattern-418584557 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5bb7c96e-46d3-4bc5-92aa-4ff372f34016) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:25:04 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-9433a63f-4f24-45e0-902d-747ebf42752f tempest-TestStampPattern-418584557 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5bb7c96e-46d3-4bc5-92aa-4ff372f34016) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:25:04 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-9433a63f-4f24-45e0-902d-747ebf42752f tempest-TestStampPattern-418584557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (235f1620-a32f-43b4-936b-58d073c06f47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:25:04 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-9433a63f-4f24-45e0-902d-747ebf42752f tempest-TestStampPattern-418584557 None] Volume d0066bfd-3e6d-48ac-83e6-ec47a100d768: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-d0066bfd-3e6d-48ac-83e6-ec47a100d768', 'volume_size': 1, 'snapshot_id': 'd22d4adf-234b-4a28-a12a-373a8bfa7db1'} Jul 31 12:25:04 devstack cinder-volume[89182]: DEBUG novaclient.v2.client [None req-f6b433db-b9cb-4d16-af75-ccc64b8afea2 tempest-TestVolumeBootPattern-1492021642 None] REQ: curl -g -i -X POST http://192.168.122.21/compute/v2.1/os-assisted-volume-snapshots -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}5dd1608db050f1c17f2fe63a8787418a2b9648baf05558b76c1ce748f6993247" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-f6b433db-b9cb-4d16-af75-ccc64b8afea2" -H "X-Service-Token: {SHA256}02a8645ba5bc7d3f7d0a93a9d02f784466607492168e4b335483720fa1daddd6" -d '{"snapshot": {"volume_id": "059c514e-3928-498a-9f8e-384f95a18a7c", "create_info": {"type": "qcow2", "new_file": "volume-059c514e-3928-498a-9f8e-384f95a18a7c.32d8c5b8-3d64-486d-b503-068001d9631e", "snapshot_id": "32d8c5b8-3d64-486d-b503-068001d9631e"}}}' {{(pid=89182) _http_log_request /opt/stack/data/venv/lib/python3.12/site-packages/keystoneauth1/session.py:575}} Jul 31 12:25:04 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-9433a63f-4f24-45e0-902d-747ebf42752f tempest-TestStampPattern-418584557 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:25:05 devstack cinder-volume[89182]: DEBUG novaclient.v2.client [None req-f6b433db-b9cb-4d16-af75-ccc64b8afea2 tempest-TestVolumeBootPattern-1492021642 None] RESP: [200] Connection: close Content-Length: 78 Content-Type: application/json Date: Fri, 31 Jul 2026 10:25:04 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.58 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-ad098d4f-4510-4d2d-a11a-72b9a869f172 x-openstack-request-id: req-ad098d4f-4510-4d2d-a11a-72b9a869f172 {{(pid=89182) _http_log_response /opt/stack/data/venv/lib/python3.12/site-packages/keystoneauth1/session.py:616}} Jul 31 12:25:05 devstack cinder-volume[89182]: DEBUG novaclient.v2.client [None req-f6b433db-b9cb-4d16-af75-ccc64b8afea2 tempest-TestVolumeBootPattern-1492021642 None] RESP BODY: {"snapshot": {"id": null, "volumeId": "059c514e-3928-498a-9f8e-384f95a18a7c"}} {{(pid=89182) _http_log_response /opt/stack/data/venv/lib/python3.12/site-packages/keystoneauth1/session.py:651}} Jul 31 12:25:05 devstack cinder-volume[89182]: DEBUG novaclient.v2.client [None req-f6b433db-b9cb-4d16-af75-ccc64b8afea2 tempest-TestVolumeBootPattern-1492021642 None] POST call to compute for http://192.168.122.21/compute/v2.1/os-assisted-volume-snapshots used request id req-ad098d4f-4510-4d2d-a11a-72b9a869f172 {{(pid=89182) request /opt/stack/data/venv/lib/python3.12/site-packages/keystoneauth1/session.py:1076}} Jul 31 12:25:05 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-f6b433db-b9cb-4d16-af75-ccc64b8afea2 tempest-TestVolumeBootPattern-1492021642 None] nova call result: None {{(pid=89182) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1910}} Jul 31 12:25:05 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-f6b433db-b9cb-4d16-af75-ccc64b8afea2 tempest-TestVolumeBootPattern-1492021642 None] Status of snapshot 32d8c5b8-3d64-486d-b503-068001d9631e is now creating {{(pid=89182) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Jul 31 12:25:06 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-f6b433db-b9cb-4d16-af75-ccc64b8afea2 tempest-TestVolumeBootPattern-1492021642 None] Status of snapshot 32d8c5b8-3d64-486d-b503-068001d9631e is now creating {{(pid=89182) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Jul 31 12:25:06 devstack cinder-volume[89182]: DEBUG cinder.volume.flows.manager.create_volume [None req-04e0b4b2-626c-443e-b7fe-7ea801b756a5 tempest-VolumeQuotasAdminTestJSON-508449277 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89182) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 12:25:06 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-04e0b4b2-626c-443e-b7fe-7ea801b756a5 tempest-VolumeQuotasAdminTestJSON-508449277 None] Flow 'volume_create_manager' (817674e6-10b6-4142-a46c-b4a817e0b3e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:25:06 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-04e0b4b2-626c-443e-b7fe-7ea801b756a5 tempest-VolumeQuotasAdminTestJSON-508449277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d593a968-d9f3-4f59-810d-e38a1a42b7d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:25:06 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-04e0b4b2-626c-443e-b7fe-7ea801b756a5 tempest-VolumeQuotasAdminTestJSON-508449277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d593a968-d9f3-4f59-810d-e38a1a42b7d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:25:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1238285355',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85e0e018-946f-4232-884b-94f729aecf9e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42ee8c0b010b4716aedcaf404f635278',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:25:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:25:07Z,use_quota=True,user_id='714c41d7f98c4c18ae45c5bc7ccd9f46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:25:06 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-04e0b4b2-626c-443e-b7fe-7ea801b756a5 tempest-VolumeQuotasAdminTestJSON-508449277 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a804c6cb-d06b-473c-9b05-11e860c0776d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:25:06 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-04e0b4b2-626c-443e-b7fe-7ea801b756a5 tempest-VolumeQuotasAdminTestJSON-508449277 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a804c6cb-d06b-473c-9b05-11e860c0776d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:25:06 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-04e0b4b2-626c-443e-b7fe-7ea801b756a5 tempest-VolumeQuotasAdminTestJSON-508449277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71bfe858-97b2-4d82-a033-1c9206c4a663) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:25:06 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-04e0b4b2-626c-443e-b7fe-7ea801b756a5 tempest-VolumeQuotasAdminTestJSON-508449277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71bfe858-97b2-4d82-a033-1c9206c4a663) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '85e0e018-946f-4232-884b-94f729aecf9e', 'volume_name': 'volume-85e0e018-946f-4232-884b-94f729aecf9e', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:25:06 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-04e0b4b2-626c-443e-b7fe-7ea801b756a5 tempest-VolumeQuotasAdminTestJSON-508449277 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75d03228-4285-41f6-81a2-00164d9a07bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:25:06 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-04e0b4b2-626c-443e-b7fe-7ea801b756a5 tempest-VolumeQuotasAdminTestJSON-508449277 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75d03228-4285-41f6-81a2-00164d9a07bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:25:06 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-04e0b4b2-626c-443e-b7fe-7ea801b756a5 tempest-VolumeQuotasAdminTestJSON-508449277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0daf9ee7-5286-46ef-a4bb-ca543fb017c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:25:06 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-04e0b4b2-626c-443e-b7fe-7ea801b756a5 tempest-VolumeQuotasAdminTestJSON-508449277 None] Volume 85e0e018-946f-4232-884b-94f729aecf9e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-85e0e018-946f-4232-884b-94f729aecf9e', 'volume_size': 1} Jul 31 12:25:06 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-04e0b4b2-626c-443e-b7fe-7ea801b756a5 tempest-VolumeQuotasAdminTestJSON-508449277 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:25:07 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-f6b433db-b9cb-4d16-af75-ccc64b8afea2 tempest-TestVolumeBootPattern-1492021642 None] Status of snapshot 32d8c5b8-3d64-486d-b503-068001d9631e is now creating {{(pid=89182) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Jul 31 12:25:08 devstack cinder-volume[89182]: DEBUG dbcounter [-] [89182] Writing DB stats cinder:UPDATE=92,cinder:SELECT=99,cinder:INSERT=24,cinder:DELETE=5 {{(pid=89182) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 12:25:08 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-f6b433db-b9cb-4d16-af75-ccc64b8afea2 tempest-TestVolumeBootPattern-1492021642 None] Status of snapshot 32d8c5b8-3d64-486d-b503-068001d9631e is now creating {{(pid=89182) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Jul 31 12:25:08 devstack cinder-volume[89182]: DEBUG cinder.volume.flows.manager.create_volume [req-01052e05-b7b4-4278-8f77-3da636d3daf6 req-a24fce1c-bf41-4eda-8825-84d15513f1d8 tempest-VolumesGetTestJSON-1227126481 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89182) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 12:25:08 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [req-01052e05-b7b4-4278-8f77-3da636d3daf6 req-a24fce1c-bf41-4eda-8825-84d15513f1d8 tempest-VolumesGetTestJSON-1227126481 None] Flow 'volume_create_manager' (c4899ad0-c9a3-4364-a8f9-4677adb16377) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:25:08 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [req-01052e05-b7b4-4278-8f77-3da636d3daf6 req-a24fce1c-bf41-4eda-8825-84d15513f1d8 tempest-VolumesGetTestJSON-1227126481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6616ec25-c42f-40c1-9407-86b053e67077) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:25:08 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [req-01052e05-b7b4-4278-8f77-3da636d3daf6 req-a24fce1c-bf41-4eda-8825-84d15513f1d8 tempest-VolumesGetTestJSON-1227126481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6616ec25-c42f-40c1-9407-86b053e67077) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:25:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1166797676',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc0f039e-6f94-4ed8-ba0f-e016320a29e3,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8be98fcaa48d479f96e5f9fc71d73703',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:25:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:25:08Z,use_quota=True,user_id='880489cce911426eb92ffc8067f4760b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:25:08 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [req-01052e05-b7b4-4278-8f77-3da636d3daf6 req-a24fce1c-bf41-4eda-8825-84d15513f1d8 tempest-VolumesGetTestJSON-1227126481 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a555cc5-45c3-4078-bd9b-2396231499f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:25:08 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [req-01052e05-b7b4-4278-8f77-3da636d3daf6 req-a24fce1c-bf41-4eda-8825-84d15513f1d8 tempest-VolumesGetTestJSON-1227126481 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a555cc5-45c3-4078-bd9b-2396231499f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:25:08 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [req-01052e05-b7b4-4278-8f77-3da636d3daf6 req-a24fce1c-bf41-4eda-8825-84d15513f1d8 tempest-VolumesGetTestJSON-1227126481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4caf71a7-6524-475c-9b20-c27f3ce9cd06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:25:08 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [req-01052e05-b7b4-4278-8f77-3da636d3daf6 req-a24fce1c-bf41-4eda-8825-84d15513f1d8 tempest-VolumesGetTestJSON-1227126481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4caf71a7-6524-475c-9b20-c27f3ce9cd06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fc0f039e-6f94-4ed8-ba0f-e016320a29e3', 'volume_name': 'volume-fc0f039e-6f94-4ed8-ba0f-e016320a29e3', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:25:08 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [req-01052e05-b7b4-4278-8f77-3da636d3daf6 req-a24fce1c-bf41-4eda-8825-84d15513f1d8 tempest-VolumesGetTestJSON-1227126481 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78a1343e-9a58-4e87-a169-1be99dbb9f6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:25:08 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [req-01052e05-b7b4-4278-8f77-3da636d3daf6 req-a24fce1c-bf41-4eda-8825-84d15513f1d8 tempest-VolumesGetTestJSON-1227126481 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78a1343e-9a58-4e87-a169-1be99dbb9f6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:25:08 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [req-01052e05-b7b4-4278-8f77-3da636d3daf6 req-a24fce1c-bf41-4eda-8825-84d15513f1d8 tempest-VolumesGetTestJSON-1227126481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ce6e33c-5e2b-4369-9b85-84d3dbc1ead3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:25:08 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [req-01052e05-b7b4-4278-8f77-3da636d3daf6 req-a24fce1c-bf41-4eda-8825-84d15513f1d8 tempest-VolumesGetTestJSON-1227126481 None] Volume fc0f039e-6f94-4ed8-ba0f-e016320a29e3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fc0f039e-6f94-4ed8-ba0f-e016320a29e3', 'volume_size': 1} Jul 31 12:25:08 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [req-01052e05-b7b4-4278-8f77-3da636d3daf6 req-a24fce1c-bf41-4eda-8825-84d15513f1d8 tempest-VolumesGetTestJSON-1227126481 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:25:09 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-f6b433db-b9cb-4d16-af75-ccc64b8afea2 tempest-TestVolumeBootPattern-1492021642 None] Status of snapshot 32d8c5b8-3d64-486d-b503-068001d9631e is now creating {{(pid=89182) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Jul 31 12:25:10 devstack cinder-volume[89182]: DEBUG dbcounter [-] [89182] Writing DB stats cinder:SELECT=103,cinder:INSERT=25,cinder:UPDATE=77,cinder:DELETE=2 {{(pid=89182) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 12:25:10 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-f6b433db-b9cb-4d16-af75-ccc64b8afea2 tempest-TestVolumeBootPattern-1492021642 None] Status of snapshot 32d8c5b8-3d64-486d-b503-068001d9631e is now creating {{(pid=89182) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Jul 31 12:25:11 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-f6b433db-b9cb-4d16-af75-ccc64b8afea2 tempest-TestVolumeBootPattern-1492021642 None] Status of snapshot 32d8c5b8-3d64-486d-b503-068001d9631e is now creating {{(pid=89182) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Jul 31 12:25:12 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-f6b433db-b9cb-4d16-af75-ccc64b8afea2 tempest-TestVolumeBootPattern-1492021642 None] Status of snapshot 32d8c5b8-3d64-486d-b503-068001d9631e is now creating {{(pid=89182) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Jul 31 12:25:13 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-f6b433db-b9cb-4d16-af75-ccc64b8afea2 tempest-TestVolumeBootPattern-1492021642 None] Status of snapshot 32d8c5b8-3d64-486d-b503-068001d9631e is now creating {{(pid=89182) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Jul 31 12:25:14 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-f6b433db-b9cb-4d16-af75-ccc64b8afea2 tempest-TestVolumeBootPattern-1492021642 None] Status of snapshot 32d8c5b8-3d64-486d-b503-068001d9631e is now creating {{(pid=89182) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Jul 31 12:25:15 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-f6b433db-b9cb-4d16-af75-ccc64b8afea2 tempest-TestVolumeBootPattern-1492021642 None] Status of snapshot 32d8c5b8-3d64-486d-b503-068001d9631e is now creating {{(pid=89182) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Jul 31 12:25:16 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-f6b433db-b9cb-4d16-af75-ccc64b8afea2 tempest-TestVolumeBootPattern-1492021642 None] Status of snapshot 32d8c5b8-3d64-486d-b503-068001d9631e is now creating {{(pid=89182) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Jul 31 12:25:18 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-f6b433db-b9cb-4d16-af75-ccc64b8afea2 tempest-TestVolumeBootPattern-1492021642 None] Status of snapshot 32d8c5b8-3d64-486d-b503-068001d9631e is now creating {{(pid=89182) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Jul 31 12:25:20 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-f6b433db-b9cb-4d16-af75-ccc64b8afea2 tempest-TestVolumeBootPattern-1492021642 None] Status of snapshot 32d8c5b8-3d64-486d-b503-068001d9631e is now creating {{(pid=89182) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Jul 31 12:25:21 devstack cinder-volume[89182]: DEBUG oslo_service.periodic_task [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89182) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 31 12:25:21 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:25:21 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:25:21 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:25:21 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:25:21 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:25:21 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:25:22 devstack sudo[102436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 Jul 31 12:25:22 devstack sudo[102436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:25:22 devstack sudo[102436]: pam_unix(sudo:session): session closed for user root Jul 31 12:25:22 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2" returned: 0 in 0.258s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:25:22 devstack cinder-volume[89182]: DEBUG cinder.manager [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] Notifying Schedulers of capabilities ... {{(pid=89182) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 12:25:22 devstack cinder-volume[89182]: DEBUG oslo_service.periodic_task [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] Running periodic task VolumeManager._thread_info {{(pid=89182) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 31 12:25:22 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] thread count: 28 {{(pid=89182) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 31 12:25:22 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] thread info: [<_MainThread(MainThread, started 136154603720832)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=89182) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 31 12:25:22 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-f6b433db-b9cb-4d16-af75-ccc64b8afea2 tempest-TestVolumeBootPattern-1492021642 None] Status of snapshot 32d8c5b8-3d64-486d-b503-068001d9631e is now creating {{(pid=89182) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Jul 31 12:25:22 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-f6b433db-b9cb-4d16-af75-ccc64b8afea2 tempest-TestVolumeBootPattern-1492021642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-059c514e-3928-498a-9f8e-384f95a18a7c.info {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:25:22 devstack sudo[102457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-059c514e-3928-498a-9f8e-384f95a18a7c.info Jul 31 12:25:22 devstack sudo[102457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:25:22 devstack sudo[102457]: pam_unix(sudo:session): session closed for user root Jul 31 12:25:22 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-f6b433db-b9cb-4d16-af75-ccc64b8afea2 tempest-TestVolumeBootPattern-1492021642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-059c514e-3928-498a-9f8e-384f95a18a7c.info" returned: 0 in 0.277s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:25:22 devstack cinder-volume[89182]: WARNING cinder.volume.drivers.remotefs [None req-f6b433db-b9cb-4d16-af75-ccc64b8afea2 tempest-TestVolumeBootPattern-1492021642 None] /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-059c514e-3928-498a-9f8e-384f95a18a7c.info is being set with open permissions: ugo+rw Jul 31 12:25:22 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-f6b433db-b9cb-4d16-af75-ccc64b8afea2 tempest-TestVolumeBootPattern-1492021642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-059c514e-3928-498a-9f8e-384f95a18a7c.info {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:25:22 devstack sudo[102475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-059c514e-3928-498a-9f8e-384f95a18a7c.info Jul 31 12:25:22 devstack sudo[102475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:25:23 devstack sudo[102475]: pam_unix(sudo:session): session closed for user root Jul 31 12:25:23 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-f6b433db-b9cb-4d16-af75-ccc64b8afea2 tempest-TestVolumeBootPattern-1492021642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-059c514e-3928-498a-9f8e-384f95a18a7c.info" returned: 0 in 0.249s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:25:23 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-f6b433db-b9cb-4d16-af75-ccc64b8afea2 tempest-TestVolumeBootPattern-1492021642 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 21.136s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:25:23 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-9433a63f-4f24-45e0-902d-747ebf42752f tempest-TestStampPattern-418584557 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 18.153s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:25:23 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-9433a63f-4f24-45e0-902d-747ebf42752f tempest-TestStampPattern-418584557 None] Acquiring lock "cinder-quobyte-d22d4adf-234b-4a28-a12a-373a8bfa7db1-d0066bfd-3e6d-48ac-83e6-ec47a100d768" by "_create_volume_from_snapshot" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:25:23 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-9433a63f-4f24-45e0-902d-747ebf42752f tempest-TestStampPattern-418584557 None] Lock "cinder-quobyte-d22d4adf-234b-4a28-a12a-373a8bfa7db1-d0066bfd-3e6d-48ac-83e6-ec47a100d768" acquired by "_create_volume_from_snapshot" :: waited 0.021s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:25:23 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-9433a63f-4f24-45e0-902d-747ebf42752f tempest-TestStampPattern-418584557 None] Creating volume d0066bfd-3e6d-48ac-83e6-ec47a100d768 from snapshot d22d4adf-234b-4a28-a12a-373a8bfa7db1 {{(pid=89182) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 31 12:25:23 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-9433a63f-4f24-45e0-902d-747ebf42752f tempest-TestStampPattern-418584557 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:25:23 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-9433a63f-4f24-45e0-902d-747ebf42752f tempest-TestStampPattern-418584557 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:25:23 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-9433a63f-4f24-45e0-902d-747ebf42752f tempest-TestStampPattern-418584557 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:25:23 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-9433a63f-4f24-45e0-902d-747ebf42752f tempest-TestStampPattern-418584557 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:25:23 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-9433a63f-4f24-45e0-902d-747ebf42752f tempest-TestStampPattern-418584557 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:25:23 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-9433a63f-4f24-45e0-902d-747ebf42752f tempest-TestStampPattern-418584557 None] Selected osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 as target Quobyte volume. {{(pid=89182) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 12:25:23 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-9433a63f-4f24-45e0-902d-747ebf42752f tempest-TestStampPattern-418584557 None] Acquiring lock "cinder-quobyte-d0066bfd-3e6d-48ac-83e6-ec47a100d768" by "_copy_volume_from_snapshot" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:25:23 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-9433a63f-4f24-45e0-902d-747ebf42752f tempest-TestStampPattern-418584557 None] Lock "cinder-quobyte-d0066bfd-3e6d-48ac-83e6-ec47a100d768" acquired by "_copy_volume_from_snapshot" :: waited 0.024s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:25:23 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-9433a63f-4f24-45e0-902d-747ebf42752f tempest-TestStampPattern-418584557 None] snapshot: d22d4adf-234b-4a28-a12a-373a8bfa7db1, volume: d0066bfd-3e6d-48ac-83e6-ec47a100d768, {{(pid=89182) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Jul 31 12:25:23 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-9433a63f-4f24-45e0-902d-747ebf42752f tempest-TestStampPattern-418584557 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:25:23 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-9433a63f-4f24-45e0-902d-747ebf42752f tempest-TestStampPattern-418584557 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:25:23 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-9433a63f-4f24-45e0-902d-747ebf42752f tempest-TestStampPattern-418584557 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:25:23 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-9433a63f-4f24-45e0-902d-747ebf42752f tempest-TestStampPattern-418584557 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:25:23 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-9433a63f-4f24-45e0-902d-747ebf42752f tempest-TestStampPattern-418584557 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:25:23 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[e338ec6b-ef3f-48ee-a2db-13668d48353d]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:25:23 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-9433a63f-4f24-45e0-902d-747ebf42752f tempest-TestStampPattern-418584557 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0cea5331-ddf1-4068-bee4-c6518e039abc.d22d4adf-234b-4a28-a12a-373a8bfa7db1 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:25:23 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-f6b433db-b9cb-4d16-af75-ccc64b8afea2 tempest-TestVolumeBootPattern-1492021642 None] Create snapshot completed successfully Jul 31 12:25:23 devstack sudo[102478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0cea5331-ddf1-4068-bee4-c6518e039abc.d22d4adf-234b-4a28-a12a-373a8bfa7db1 Jul 31 12:25:23 devstack sudo[102478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:25:23 devstack sudo[102478]: pam_unix(sudo:session): session closed for user root Jul 31 12:25:23 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-9433a63f-4f24-45e0-902d-747ebf42752f tempest-TestStampPattern-418584557 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0cea5331-ddf1-4068-bee4-c6518e039abc.d22d4adf-234b-4a28-a12a-373a8bfa7db1" returned: 0 in 0.410s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:25:23 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-9433a63f-4f24-45e0-902d-747ebf42752f tempest-TestStampPattern-418584557 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0cea5331-ddf1-4068-bee4-c6518e039abc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89182) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 12:25:23 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[51b9a7dd-1190-4445-941c-e27751e450c9]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:25:23 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-9433a63f-4f24-45e0-902d-747ebf42752f tempest-TestStampPattern-418584557 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0cea5331-ddf1-4068-bee4-c6518e039abc {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:25:23 devstack sudo[102484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0cea5331-ddf1-4068-bee4-c6518e039abc Jul 31 12:25:23 devstack sudo[102484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:25:24 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-121ee917-f993-4610-81c0-4282f092bf94 tempest-TestVolumeBootPattern-1492021642 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:25:24 devstack sudo[102484]: pam_unix(sudo:session): session closed for user root Jul 31 12:25:24 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-9433a63f-4f24-45e0-902d-747ebf42752f tempest-TestStampPattern-418584557 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0cea5331-ddf1-4068-bee4-c6518e039abc" returned: 0 in 0.598s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:25:24 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-9433a63f-4f24-45e0-902d-747ebf42752f tempest-TestStampPattern-418584557 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0cea5331-ddf1-4068-bee4-c6518e039abc {{(pid=89182) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Jul 31 12:25:24 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-9433a63f-4f24-45e0-902d-747ebf42752f tempest-TestStampPattern-418584557 None] Creating direct copy from snapshot {{(pid=89182) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Jul 31 12:25:24 devstack cinder-volume[89182]: DEBUG cinder.utils [None req-9433a63f-4f24-45e0-902d-747ebf42752f tempest-TestStampPattern-418584557 None] Path /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-d0066bfd-3e6d-48ac-83e6-ec47a100d768 not found in is_blk_device check {{(pid=89182) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 31 12:25:24 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-9433a63f-4f24-45e0-902d-747ebf42752f tempest-TestStampPattern-418584557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0cea5331-ddf1-4068-bee4-c6518e039abc /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-d0066bfd-3e6d-48ac-83e6-ec47a100d768 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:25:24 devstack sudo[102492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0cea5331-ddf1-4068-bee4-c6518e039abc /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-d0066bfd-3e6d-48ac-83e6-ec47a100d768 Jul 31 12:25:24 devstack sudo[102492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:25:30 devstack sudo[102492]: pam_unix(sudo:session): session closed for user root Jul 31 12:25:30 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-9433a63f-4f24-45e0-902d-747ebf42752f tempest-TestStampPattern-418584557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0cea5331-ddf1-4068-bee4-c6518e039abc /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-d0066bfd-3e6d-48ac-83e6-ec47a100d768" returned: 0 in 6.329s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:25:30 devstack cinder-volume[89182]: DEBUG cinder.image.image_utils [None req-9433a63f-4f24-45e0-902d-747ebf42752f tempest-TestStampPattern-418584557 None] Image conversion details: src /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0cea5331-ddf1-4068-bee4-c6518e039abc, size 1024.00 MB, duration 6.33 sec, destination /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-d0066bfd-3e6d-48ac-83e6-ec47a100d768 {{(pid=89182) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 31 12:25:30 devstack cinder-volume[89182]: INFO cinder.image.image_utils [None req-9433a63f-4f24-45e0-902d-747ebf42752f tempest-TestStampPattern-418584557 None] Converted 1024.00 MB image at 161.77 MB/s Jul 31 12:25:30 devstack cinder-volume[89182]: WARNING cinder.volume.drivers.remotefs [None req-9433a63f-4f24-45e0-902d-747ebf42752f tempest-TestStampPattern-418584557 None] /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-d0066bfd-3e6d-48ac-83e6-ec47a100d768 is being set with open permissions: ugo+rw Jul 31 12:25:30 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-9433a63f-4f24-45e0-902d-747ebf42752f tempest-TestStampPattern-418584557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-d0066bfd-3e6d-48ac-83e6-ec47a100d768 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:25:30 devstack sudo[102522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-d0066bfd-3e6d-48ac-83e6-ec47a100d768 Jul 31 12:25:30 devstack sudo[102522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:25:30 devstack sudo[102522]: pam_unix(sudo:session): session closed for user root Jul 31 12:25:30 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-9433a63f-4f24-45e0-902d-747ebf42752f tempest-TestStampPattern-418584557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-d0066bfd-3e6d-48ac-83e6-ec47a100d768" returned: 0 in 0.316s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:25:30 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-9433a63f-4f24-45e0-902d-747ebf42752f tempest-TestStampPattern-418584557 None] Lock "cinder-quobyte-d0066bfd-3e6d-48ac-83e6-ec47a100d768" released by "_copy_volume_from_snapshot" :: held 7.750s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:25:30 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-9433a63f-4f24-45e0-902d-747ebf42752f tempest-TestStampPattern-418584557 None] Lock "cinder-quobyte-d22d4adf-234b-4a28-a12a-373a8bfa7db1-d0066bfd-3e6d-48ac-83e6-ec47a100d768" released by "_create_volume_from_snapshot" :: held 7.843s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:25:30 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-9433a63f-4f24-45e0-902d-747ebf42752f tempest-TestStampPattern-418584557 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.867s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:25:30 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-04e0b4b2-626c-443e-b7fe-7ea801b756a5 tempest-VolumeQuotasAdminTestJSON-508449277 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 24.248s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:25:30 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-04e0b4b2-626c-443e-b7fe-7ea801b756a5 tempest-VolumeQuotasAdminTestJSON-508449277 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:25:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1238285355',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85e0e018-946f-4232-884b-94f729aecf9e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42ee8c0b010b4716aedcaf404f635278',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:25:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:25:07Z,use_quota=True,user_id='714c41d7f98c4c18ae45c5bc7ccd9f46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)}" {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 12:25:30 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-04e0b4b2-626c-443e-b7fe-7ea801b756a5 tempest-VolumeQuotasAdminTestJSON-508449277 None] Creating volume 85e0e018-946f-4232-884b-94f729aecf9e {{(pid=89182) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 12:25:30 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-04e0b4b2-626c-443e-b7fe-7ea801b756a5 tempest-VolumeQuotasAdminTestJSON-508449277 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:25:30 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-04e0b4b2-626c-443e-b7fe-7ea801b756a5 tempest-VolumeQuotasAdminTestJSON-508449277 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:25:31 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-04e0b4b2-626c-443e-b7fe-7ea801b756a5 tempest-VolumeQuotasAdminTestJSON-508449277 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:25:31 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-04e0b4b2-626c-443e-b7fe-7ea801b756a5 tempest-VolumeQuotasAdminTestJSON-508449277 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:25:31 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-04e0b4b2-626c-443e-b7fe-7ea801b756a5 tempest-VolumeQuotasAdminTestJSON-508449277 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:25:31 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-04e0b4b2-626c-443e-b7fe-7ea801b756a5 tempest-VolumeQuotasAdminTestJSON-508449277 None] Selected osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 as target Quobyte volume. {{(pid=89182) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 12:25:31 devstack cinder-volume[89182]: INFO cinder.volume.drivers.remotefs [None req-04e0b4b2-626c-443e-b7fe-7ea801b756a5 tempest-VolumeQuotasAdminTestJSON-508449277 None] casted to osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 Jul 31 12:25:31 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-04e0b4b2-626c-443e-b7fe-7ea801b756a5 tempest-VolumeQuotasAdminTestJSON-508449277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-85e0e018-946f-4232-884b-94f729aecf9e 1073741824 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:25:31 devstack sudo[102526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-85e0e018-946f-4232-884b-94f729aecf9e 1073741824 Jul 31 12:25:31 devstack sudo[102526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:25:31 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-9433a63f-4f24-45e0-902d-747ebf42752f tempest-TestStampPattern-418584557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (235f1620-a32f-43b4-936b-58d073c06f47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d0066bfd-3e6d-48ac-83e6-ec47a100d768', 'volume_size': 1, 'snapshot_id': 'd22d4adf-234b-4a28-a12a-373a8bfa7db1'}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:25:31 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-9433a63f-4f24-45e0-902d-747ebf42752f tempest-TestStampPattern-418584557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52b2ce73-99c7-40f7-bbb6-802e794d3d52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:25:31 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-9433a63f-4f24-45e0-902d-747ebf42752f tempest-TestStampPattern-418584557 None] Volume volume-d0066bfd-3e6d-48ac-83e6-ec47a100d768 (d0066bfd-3e6d-48ac-83e6-ec47a100d768): created successfully Jul 31 12:25:31 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-9433a63f-4f24-45e0-902d-747ebf42752f tempest-TestStampPattern-418584557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52b2ce73-99c7-40f7-bbb6-802e794d3d52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:25:31 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-9433a63f-4f24-45e0-902d-747ebf42752f tempest-TestStampPattern-418584557 None] Flow 'volume_create_manager' (edfc7172-68f4-44c5-b3c0-763a437f5a8c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:25:31 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-9433a63f-4f24-45e0-902d-747ebf42752f tempest-TestStampPattern-418584557 None] Created volume successfully. Jul 31 12:25:31 devstack sudo[102526]: pam_unix(sudo:session): session closed for user root Jul 31 12:25:31 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-04e0b4b2-626c-443e-b7fe-7ea801b756a5 tempest-VolumeQuotasAdminTestJSON-508449277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-85e0e018-946f-4232-884b-94f729aecf9e 1073741824" returned: 0 in 0.607s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:25:31 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-04e0b4b2-626c-443e-b7fe-7ea801b756a5 tempest-VolumeQuotasAdminTestJSON-508449277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-85e0e018-946f-4232-884b-94f729aecf9e {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:25:31 devstack sudo[102532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-85e0e018-946f-4232-884b-94f729aecf9e Jul 31 12:25:31 devstack sudo[102532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:25:32 devstack sudo[102532]: pam_unix(sudo:session): session closed for user root Jul 31 12:25:32 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-04e0b4b2-626c-443e-b7fe-7ea801b756a5 tempest-VolumeQuotasAdminTestJSON-508449277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-85e0e018-946f-4232-884b-94f729aecf9e" returned: 0 in 0.357s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:25:32 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-04e0b4b2-626c-443e-b7fe-7ea801b756a5 tempest-VolumeQuotasAdminTestJSON-508449277 None] <== create_volume: return (1018ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'} {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 12:25:32 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-04e0b4b2-626c-443e-b7fe-7ea801b756a5 tempest-VolumeQuotasAdminTestJSON-508449277 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.023s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:25:32 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [req-01052e05-b7b4-4278-8f77-3da636d3daf6 req-a24fce1c-bf41-4eda-8825-84d15513f1d8 tempest-VolumesGetTestJSON-1227126481 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 23.537s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:25:32 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [req-01052e05-b7b4-4278-8f77-3da636d3daf6 req-a24fce1c-bf41-4eda-8825-84d15513f1d8 tempest-VolumesGetTestJSON-1227126481 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:25:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1166797676',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc0f039e-6f94-4ed8-ba0f-e016320a29e3,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8be98fcaa48d479f96e5f9fc71d73703',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:25:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:25:08Z,use_quota=True,user_id='880489cce911426eb92ffc8067f4760b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)}" {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 12:25:32 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [req-01052e05-b7b4-4278-8f77-3da636d3daf6 req-a24fce1c-bf41-4eda-8825-84d15513f1d8 tempest-VolumesGetTestJSON-1227126481 None] Creating volume fc0f039e-6f94-4ed8-ba0f-e016320a29e3 {{(pid=89182) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 12:25:32 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [req-01052e05-b7b4-4278-8f77-3da636d3daf6 req-a24fce1c-bf41-4eda-8825-84d15513f1d8 tempest-VolumesGetTestJSON-1227126481 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:25:32 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [req-01052e05-b7b4-4278-8f77-3da636d3daf6 req-a24fce1c-bf41-4eda-8825-84d15513f1d8 tempest-VolumesGetTestJSON-1227126481 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:25:32 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [req-01052e05-b7b4-4278-8f77-3da636d3daf6 req-a24fce1c-bf41-4eda-8825-84d15513f1d8 tempest-VolumesGetTestJSON-1227126481 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:25:32 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [req-01052e05-b7b4-4278-8f77-3da636d3daf6 req-a24fce1c-bf41-4eda-8825-84d15513f1d8 tempest-VolumesGetTestJSON-1227126481 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:25:32 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [req-01052e05-b7b4-4278-8f77-3da636d3daf6 req-a24fce1c-bf41-4eda-8825-84d15513f1d8 tempest-VolumesGetTestJSON-1227126481 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:25:32 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [req-01052e05-b7b4-4278-8f77-3da636d3daf6 req-a24fce1c-bf41-4eda-8825-84d15513f1d8 tempest-VolumesGetTestJSON-1227126481 None] Selected osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 as target Quobyte volume. {{(pid=89182) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 12:25:32 devstack cinder-volume[89182]: INFO cinder.volume.drivers.remotefs [req-01052e05-b7b4-4278-8f77-3da636d3daf6 req-a24fce1c-bf41-4eda-8825-84d15513f1d8 tempest-VolumesGetTestJSON-1227126481 None] casted to osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 Jul 31 12:25:32 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [req-01052e05-b7b4-4278-8f77-3da636d3daf6 req-a24fce1c-bf41-4eda-8825-84d15513f1d8 tempest-VolumesGetTestJSON-1227126481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-fc0f039e-6f94-4ed8-ba0f-e016320a29e3 1073741824 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:25:32 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-04e0b4b2-626c-443e-b7fe-7ea801b756a5 tempest-VolumeQuotasAdminTestJSON-508449277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0daf9ee7-5286-46ef-a4bb-ca543fb017c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-85e0e018-946f-4232-884b-94f729aecf9e', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:25:32 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-04e0b4b2-626c-443e-b7fe-7ea801b756a5 tempest-VolumeQuotasAdminTestJSON-508449277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb67f129-4d0c-476d-93e7-1042337fe6e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:25:32 devstack sudo[102536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-fc0f039e-6f94-4ed8-ba0f-e016320a29e3 1073741824 Jul 31 12:25:32 devstack sudo[102536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:25:32 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-04e0b4b2-626c-443e-b7fe-7ea801b756a5 tempest-VolumeQuotasAdminTestJSON-508449277 None] Volume volume-85e0e018-946f-4232-884b-94f729aecf9e (85e0e018-946f-4232-884b-94f729aecf9e): created successfully Jul 31 12:25:32 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-04e0b4b2-626c-443e-b7fe-7ea801b756a5 tempest-VolumeQuotasAdminTestJSON-508449277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb67f129-4d0c-476d-93e7-1042337fe6e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:25:32 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-04e0b4b2-626c-443e-b7fe-7ea801b756a5 tempest-VolumeQuotasAdminTestJSON-508449277 None] Flow 'volume_create_manager' (817674e6-10b6-4142-a46c-b4a817e0b3e6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:25:32 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-04e0b4b2-626c-443e-b7fe-7ea801b756a5 tempest-VolumeQuotasAdminTestJSON-508449277 None] Created volume successfully. Jul 31 12:25:32 devstack sudo[102536]: pam_unix(sudo:session): session closed for user root Jul 31 12:25:32 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [req-01052e05-b7b4-4278-8f77-3da636d3daf6 req-a24fce1c-bf41-4eda-8825-84d15513f1d8 tempest-VolumesGetTestJSON-1227126481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-fc0f039e-6f94-4ed8-ba0f-e016320a29e3 1073741824" returned: 0 in 0.486s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:25:32 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [req-01052e05-b7b4-4278-8f77-3da636d3daf6 req-a24fce1c-bf41-4eda-8825-84d15513f1d8 tempest-VolumesGetTestJSON-1227126481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-fc0f039e-6f94-4ed8-ba0f-e016320a29e3 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:25:32 devstack sudo[102542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-fc0f039e-6f94-4ed8-ba0f-e016320a29e3 Jul 31 12:25:32 devstack sudo[102542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:25:32 devstack sudo[102542]: pam_unix(sudo:session): session closed for user root Jul 31 12:25:32 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [req-01052e05-b7b4-4278-8f77-3da636d3daf6 req-a24fce1c-bf41-4eda-8825-84d15513f1d8 tempest-VolumesGetTestJSON-1227126481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-fc0f039e-6f94-4ed8-ba0f-e016320a29e3" returned: 0 in 0.257s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:25:32 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [req-01052e05-b7b4-4278-8f77-3da636d3daf6 req-a24fce1c-bf41-4eda-8825-84d15513f1d8 tempest-VolumesGetTestJSON-1227126481 None] <== create_volume: return (790ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'} {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 12:25:32 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [req-01052e05-b7b4-4278-8f77-3da636d3daf6 req-a24fce1c-bf41-4eda-8825-84d15513f1d8 tempest-VolumesGetTestJSON-1227126481 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.794s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:25:32 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-121ee917-f993-4610-81c0-4282f092bf94 tempest-TestVolumeBootPattern-1492021642 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 8.591s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:25:32 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [req-01052e05-b7b4-4278-8f77-3da636d3daf6 req-a24fce1c-bf41-4eda-8825-84d15513f1d8 tempest-VolumesGetTestJSON-1227126481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ce6e33c-5e2b-4369-9b85-84d3dbc1ead3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fc0f039e-6f94-4ed8-ba0f-e016320a29e3', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:25:32 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [req-01052e05-b7b4-4278-8f77-3da636d3daf6 req-a24fce1c-bf41-4eda-8825-84d15513f1d8 tempest-VolumesGetTestJSON-1227126481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc35cd7b-af2f-40b9-a096-9b84c7c6eceb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:25:32 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [req-01052e05-b7b4-4278-8f77-3da636d3daf6 req-a24fce1c-bf41-4eda-8825-84d15513f1d8 tempest-VolumesGetTestJSON-1227126481 None] Volume volume-fc0f039e-6f94-4ed8-ba0f-e016320a29e3 (fc0f039e-6f94-4ed8-ba0f-e016320a29e3): created successfully Jul 31 12:25:32 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [req-01052e05-b7b4-4278-8f77-3da636d3daf6 req-a24fce1c-bf41-4eda-8825-84d15513f1d8 tempest-VolumesGetTestJSON-1227126481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc35cd7b-af2f-40b9-a096-9b84c7c6eceb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:25:32 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [req-01052e05-b7b4-4278-8f77-3da636d3daf6 req-a24fce1c-bf41-4eda-8825-84d15513f1d8 tempest-VolumesGetTestJSON-1227126481 None] Flow 'volume_create_manager' (c4899ad0-c9a3-4364-a8f9-4677adb16377) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:25:32 devstack cinder-volume[89182]: INFO cinder.volume.manager [req-01052e05-b7b4-4278-8f77-3da636d3daf6 req-a24fce1c-bf41-4eda-8825-84d15513f1d8 tempest-VolumesGetTestJSON-1227126481 None] Created volume successfully. Jul 31 12:25:32 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-121ee917-f993-4610-81c0-4282f092bf94 tempest-TestVolumeBootPattern-1492021642 None] Creating online snapshot 94a7a129-d2b7-4383-b472-bf34f8cff987 of volume 059c514e-3928-498a-9f8e-384f95a18a7c {{(pid=89182) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 31 12:25:32 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-77c739cc-0c9e-4494-b3eb-c752c305b33c tempest-VolumeQuotasAdminTestJSON-508449277 None] Acquiring lock "cinder-85e0e018-946f-4232-884b-94f729aecf9e-delete_volume" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:25:32 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[eac8a046-0237-4599-b899-2756bd8c3a95]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:25:32 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-121ee917-f993-4610-81c0-4282f092bf94 tempest-TestVolumeBootPattern-1492021642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-059c514e-3928-498a-9f8e-384f95a18a7c.32d8c5b8-3d64-486d-b503-068001d9631e {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:25:33 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-77c739cc-0c9e-4494-b3eb-c752c305b33c tempest-VolumeQuotasAdminTestJSON-508449277 None] Lock "cinder-85e0e018-946f-4232-884b-94f729aecf9e-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:25:33 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-77c739cc-0c9e-4494-b3eb-c752c305b33c tempest-VolumeQuotasAdminTestJSON-508449277 None] Acquiring lock "cinder-quobyte-85e0e018-946f-4232-884b-94f729aecf9e" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:25:33 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-77c739cc-0c9e-4494-b3eb-c752c305b33c tempest-VolumeQuotasAdminTestJSON-508449277 None] Lock "cinder-quobyte-85e0e018-946f-4232-884b-94f729aecf9e" acquired by "delete_volume" :: waited 0.032s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:25:33 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c21e6e9-be9f-4490-801a-eefd0e37e526]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:25:33 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-77c739cc-0c9e-4494-b3eb-c752c305b33c tempest-VolumeQuotasAdminTestJSON-508449277 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-85e0e018-946f-4232-884b-94f729aecf9e {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:25:33 devstack sudo[102545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-059c514e-3928-498a-9f8e-384f95a18a7c.32d8c5b8-3d64-486d-b503-068001d9631e Jul 31 12:25:33 devstack sudo[102545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:25:33 devstack sudo[102546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-85e0e018-946f-4232-884b-94f729aecf9e Jul 31 12:25:33 devstack sudo[102546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:25:33 devstack cinder-volume[89182]: DEBUG cinder.coordination [req-46280321-3d2a-457a-ac8f-600d210291aa req-1beca48d-8e65-4f72-b821-d759de432969 tempest-VolumesGetTestJSON-1227126481 None] Acquiring lock "cinder-fc0f039e-6f94-4ed8-ba0f-e016320a29e3-delete_volume" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:25:33 devstack cinder-volume[89182]: DEBUG cinder.coordination [req-46280321-3d2a-457a-ac8f-600d210291aa req-1beca48d-8e65-4f72-b821-d759de432969 tempest-VolumesGetTestJSON-1227126481 None] Lock "cinder-fc0f039e-6f94-4ed8-ba0f-e016320a29e3-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:25:33 devstack cinder-volume[89182]: DEBUG cinder.coordination [req-46280321-3d2a-457a-ac8f-600d210291aa req-1beca48d-8e65-4f72-b821-d759de432969 tempest-VolumesGetTestJSON-1227126481 None] Acquiring lock "cinder-quobyte-fc0f039e-6f94-4ed8-ba0f-e016320a29e3" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:25:33 devstack cinder-volume[89182]: DEBUG cinder.coordination [req-46280321-3d2a-457a-ac8f-600d210291aa req-1beca48d-8e65-4f72-b821-d759de432969 tempest-VolumesGetTestJSON-1227126481 None] Lock "cinder-quobyte-fc0f039e-6f94-4ed8-ba0f-e016320a29e3" acquired by "delete_volume" :: waited 0.021s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:25:33 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8584d57-ef08-4464-8996-f11d2d74764b]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:25:33 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [req-46280321-3d2a-457a-ac8f-600d210291aa req-1beca48d-8e65-4f72-b821-d759de432969 tempest-VolumesGetTestJSON-1227126481 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-fc0f039e-6f94-4ed8-ba0f-e016320a29e3 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:25:33 devstack sudo[102545]: pam_unix(sudo:session): session closed for user root Jul 31 12:25:33 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-121ee917-f993-4610-81c0-4282f092bf94 tempest-TestVolumeBootPattern-1492021642 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-059c514e-3928-498a-9f8e-384f95a18a7c.32d8c5b8-3d64-486d-b503-068001d9631e" returned: 0 in 0.607s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:25:33 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-121ee917-f993-4610-81c0-4282f092bf94 tempest-TestVolumeBootPattern-1492021642 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-059c514e-3928-498a-9f8e-384f95a18a7c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89182) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 12:25:33 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-121ee917-f993-4610-81c0-4282f092bf94 tempest-TestVolumeBootPattern-1492021642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-059c514e-3928-498a-9f8e-384f95a18a7c.32d8c5b8-3d64-486d-b503-068001d9631e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-059c514e-3928-498a-9f8e-384f95a18a7c.94a7a129-d2b7-4383-b472-bf34f8cff987 1G {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:25:33 devstack sudo[102546]: pam_unix(sudo:session): session closed for user root Jul 31 12:25:33 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-77c739cc-0c9e-4494-b3eb-c752c305b33c tempest-VolumeQuotasAdminTestJSON-508449277 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-85e0e018-946f-4232-884b-94f729aecf9e" returned: 0 in 0.476s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:25:33 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-77c739cc-0c9e-4494-b3eb-c752c305b33c tempest-VolumeQuotasAdminTestJSON-508449277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-85e0e018-946f-4232-884b-94f729aecf9e {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:25:33 devstack sudo[102557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-059c514e-3928-498a-9f8e-384f95a18a7c.32d8c5b8-3d64-486d-b503-068001d9631e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-059c514e-3928-498a-9f8e-384f95a18a7c.94a7a129-d2b7-4383-b472-bf34f8cff987 1G Jul 31 12:25:33 devstack sudo[102557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:25:33 devstack sudo[102558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-85e0e018-946f-4232-884b-94f729aecf9e Jul 31 12:25:33 devstack sudo[102558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:25:33 devstack sudo[102551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-fc0f039e-6f94-4ed8-ba0f-e016320a29e3 Jul 31 12:25:33 devstack sudo[102551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:25:33 devstack sudo[102558]: pam_unix(sudo:session): session closed for user root Jul 31 12:25:33 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-77c739cc-0c9e-4494-b3eb-c752c305b33c tempest-VolumeQuotasAdminTestJSON-508449277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-85e0e018-946f-4232-884b-94f729aecf9e" returned: 0 in 0.294s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:25:33 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-77c739cc-0c9e-4494-b3eb-c752c305b33c tempest-VolumeQuotasAdminTestJSON-508449277 None] Lock "cinder-quobyte-85e0e018-946f-4232-884b-94f729aecf9e" released by "delete_volume" :: held 0.822s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:25:33 devstack sudo[102551]: pam_unix(sudo:session): session closed for user root Jul 31 12:25:33 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [req-46280321-3d2a-457a-ac8f-600d210291aa req-1beca48d-8e65-4f72-b821-d759de432969 tempest-VolumesGetTestJSON-1227126481 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-fc0f039e-6f94-4ed8-ba0f-e016320a29e3" returned: 0 in 0.508s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:25:33 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [req-46280321-3d2a-457a-ac8f-600d210291aa req-1beca48d-8e65-4f72-b821-d759de432969 tempest-VolumesGetTestJSON-1227126481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-fc0f039e-6f94-4ed8-ba0f-e016320a29e3 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:25:33 devstack sudo[102570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-fc0f039e-6f94-4ed8-ba0f-e016320a29e3 Jul 31 12:25:33 devstack sudo[102570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:25:34 devstack cinder-volume[89182]: DEBUG cinder.quota [None req-77c739cc-0c9e-4494-b3eb-c752c305b33c tempest-VolumeQuotasAdminTestJSON-508449277 None] Created reservations ['5b926b59-6917-4ace-a3d4-a524a2175a2f', '46d72592-ecbc-4190-8fe6-008fd342c768', 'c0c70582-6698-4cc3-823f-00af79c3da10', '0f2fbac9-3a24-4648-aeb4-3a67cd948894'] {{(pid=89182) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 12:25:34 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-77c739cc-0c9e-4494-b3eb-c752c305b33c tempest-VolumeQuotasAdminTestJSON-508449277 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:25:34 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-77c739cc-0c9e-4494-b3eb-c752c305b33c tempest-VolumeQuotasAdminTestJSON-508449277 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:25:34 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-77c739cc-0c9e-4494-b3eb-c752c305b33c tempest-VolumeQuotasAdminTestJSON-508449277 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:25:34 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-77c739cc-0c9e-4494-b3eb-c752c305b33c tempest-VolumeQuotasAdminTestJSON-508449277 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:25:34 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-77c739cc-0c9e-4494-b3eb-c752c305b33c tempest-VolumeQuotasAdminTestJSON-508449277 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:25:34 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-77c739cc-0c9e-4494-b3eb-c752c305b33c tempest-VolumeQuotasAdminTestJSON-508449277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:25:34 devstack sudo[102572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 Jul 31 12:25:34 devstack sudo[102572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:25:34 devstack sudo[102557]: pam_unix(sudo:session): session closed for user root Jul 31 12:25:34 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-121ee917-f993-4610-81c0-4282f092bf94 tempest-TestVolumeBootPattern-1492021642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-059c514e-3928-498a-9f8e-384f95a18a7c.32d8c5b8-3d64-486d-b503-068001d9631e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-059c514e-3928-498a-9f8e-384f95a18a7c.94a7a129-d2b7-4383-b472-bf34f8cff987 1G" returned: 0 in 0.662s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:25:34 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-121ee917-f993-4610-81c0-4282f092bf94 tempest-TestVolumeBootPattern-1492021642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-059c514e-3928-498a-9f8e-384f95a18a7c.32d8c5b8-3d64-486d-b503-068001d9631e -F qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-059c514e-3928-498a-9f8e-384f95a18a7c.94a7a129-d2b7-4383-b472-bf34f8cff987 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:25:34 devstack sudo[102574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-059c514e-3928-498a-9f8e-384f95a18a7c.32d8c5b8-3d64-486d-b503-068001d9631e -F qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-059c514e-3928-498a-9f8e-384f95a18a7c.94a7a129-d2b7-4383-b472-bf34f8cff987 Jul 31 12:25:34 devstack sudo[102574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:25:34 devstack sudo[102570]: pam_unix(sudo:session): session closed for user root Jul 31 12:25:34 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [req-46280321-3d2a-457a-ac8f-600d210291aa req-1beca48d-8e65-4f72-b821-d759de432969 tempest-VolumesGetTestJSON-1227126481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-fc0f039e-6f94-4ed8-ba0f-e016320a29e3" returned: 0 in 0.458s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:25:34 devstack cinder-volume[89182]: DEBUG cinder.coordination [req-46280321-3d2a-457a-ac8f-600d210291aa req-1beca48d-8e65-4f72-b821-d759de432969 tempest-VolumesGetTestJSON-1227126481 None] Lock "cinder-quobyte-fc0f039e-6f94-4ed8-ba0f-e016320a29e3" released by "delete_volume" :: held 1.027s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:25:34 devstack cinder-volume[89182]: DEBUG cinder.quota [req-46280321-3d2a-457a-ac8f-600d210291aa req-1beca48d-8e65-4f72-b821-d759de432969 tempest-VolumesGetTestJSON-1227126481 None] Created reservations ['b400803b-09ba-4b46-af2c-41fda9c70dea', '2d7b6a19-6202-4bdc-8374-f7329ac50591', '3c77667b-6539-4a0e-9028-3cc559cdd740', '1998cd85-c38b-4561-b8a1-faa40c004c34'] {{(pid=89182) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 12:25:34 devstack sudo[102572]: pam_unix(sudo:session): session closed for user root Jul 31 12:25:34 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-77c739cc-0c9e-4494-b3eb-c752c305b33c tempest-VolumeQuotasAdminTestJSON-508449277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2" returned: 0 in 0.466s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:25:34 devstack cinder-volume[89182]: DEBUG cinder.manager [None req-77c739cc-0c9e-4494-b3eb-c752c305b33c tempest-VolumeQuotasAdminTestJSON-508449277 None] Notifying Schedulers of capabilities ... {{(pid=89182) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 12:25:34 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-77c739cc-0c9e-4494-b3eb-c752c305b33c tempest-VolumeQuotasAdminTestJSON-508449277 None] Deleted volume successfully. Jul 31 12:25:34 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-77c739cc-0c9e-4494-b3eb-c752c305b33c tempest-VolumeQuotasAdminTestJSON-508449277 None] Lock "cinder-85e0e018-946f-4232-884b-94f729aecf9e-delete_volume" released by "delete_volume" :: held 1.678s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:25:34 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [req-46280321-3d2a-457a-ac8f-600d210291aa req-1beca48d-8e65-4f72-b821-d759de432969 tempest-VolumesGetTestJSON-1227126481 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:25:34 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [req-46280321-3d2a-457a-ac8f-600d210291aa req-1beca48d-8e65-4f72-b821-d759de432969 tempest-VolumesGetTestJSON-1227126481 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:25:34 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [req-46280321-3d2a-457a-ac8f-600d210291aa req-1beca48d-8e65-4f72-b821-d759de432969 tempest-VolumesGetTestJSON-1227126481 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:25:34 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [req-46280321-3d2a-457a-ac8f-600d210291aa req-1beca48d-8e65-4f72-b821-d759de432969 tempest-VolumesGetTestJSON-1227126481 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:25:34 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [req-46280321-3d2a-457a-ac8f-600d210291aa req-1beca48d-8e65-4f72-b821-d759de432969 tempest-VolumesGetTestJSON-1227126481 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:25:34 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [req-46280321-3d2a-457a-ac8f-600d210291aa req-1beca48d-8e65-4f72-b821-d759de432969 tempest-VolumesGetTestJSON-1227126481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:25:34 devstack sudo[102574]: pam_unix(sudo:session): session closed for user root Jul 31 12:25:34 devstack sudo[102582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 Jul 31 12:25:34 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-121ee917-f993-4610-81c0-4282f092bf94 tempest-TestVolumeBootPattern-1492021642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-059c514e-3928-498a-9f8e-384f95a18a7c.32d8c5b8-3d64-486d-b503-068001d9631e -F qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-059c514e-3928-498a-9f8e-384f95a18a7c.94a7a129-d2b7-4383-b472-bf34f8cff987" returned: 0 in 0.545s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:25:34 devstack cinder-volume[89182]: WARNING cinder.volume.drivers.remotefs [None req-121ee917-f993-4610-81c0-4282f092bf94 tempest-TestVolumeBootPattern-1492021642 None] /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-059c514e-3928-498a-9f8e-384f95a18a7c.94a7a129-d2b7-4383-b472-bf34f8cff987 is being set with open permissions: ugo+rw Jul 31 12:25:34 devstack sudo[102582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:25:34 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-121ee917-f993-4610-81c0-4282f092bf94 tempest-TestVolumeBootPattern-1492021642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-059c514e-3928-498a-9f8e-384f95a18a7c.94a7a129-d2b7-4383-b472-bf34f8cff987 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:25:34 devstack sudo[102584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-059c514e-3928-498a-9f8e-384f95a18a7c.94a7a129-d2b7-4383-b472-bf34f8cff987 Jul 31 12:25:34 devstack sudo[102584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:25:34 devstack cinder-volume[89182]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb5d8a3f-84e1-4924-b47b-f5dbf56ec037 tempest-VolumeQuotasAdminTestJSON-508449277 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89182) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 12:25:34 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-cb5d8a3f-84e1-4924-b47b-f5dbf56ec037 tempest-VolumeQuotasAdminTestJSON-508449277 None] Flow 'volume_create_manager' (f21aebd2-954c-4365-88be-9dd6c57a5b68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:25:35 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-cb5d8a3f-84e1-4924-b47b-f5dbf56ec037 tempest-VolumeQuotasAdminTestJSON-508449277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39961143-da54-444d-a357-a953ad7d484e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:25:35 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-cb5d8a3f-84e1-4924-b47b-f5dbf56ec037 tempest-VolumeQuotasAdminTestJSON-508449277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39961143-da54-444d-a357-a953ad7d484e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:25:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-2109953029',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9e97a32-e735-44de-b72f-25e869d3fb21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42ee8c0b010b4716aedcaf404f635278',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:25:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:25:35Z,use_quota=True,user_id='714c41d7f98c4c18ae45c5bc7ccd9f46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:25:35 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-cb5d8a3f-84e1-4924-b47b-f5dbf56ec037 tempest-VolumeQuotasAdminTestJSON-508449277 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae83f94e-50dd-4048-8a09-170580698b01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:25:35 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-cb5d8a3f-84e1-4924-b47b-f5dbf56ec037 tempest-VolumeQuotasAdminTestJSON-508449277 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae83f94e-50dd-4048-8a09-170580698b01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:25:35 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-cb5d8a3f-84e1-4924-b47b-f5dbf56ec037 tempest-VolumeQuotasAdminTestJSON-508449277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f662d68-ed43-4255-8493-a0d60f2dd183) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:25:35 devstack sudo[102582]: pam_unix(sudo:session): session closed for user root Jul 31 12:25:35 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-cb5d8a3f-84e1-4924-b47b-f5dbf56ec037 tempest-VolumeQuotasAdminTestJSON-508449277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f662d68-ed43-4255-8493-a0d60f2dd183) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e9e97a32-e735-44de-b72f-25e869d3fb21', 'volume_name': 'volume-e9e97a32-e735-44de-b72f-25e869d3fb21', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:25:35 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-cb5d8a3f-84e1-4924-b47b-f5dbf56ec037 tempest-VolumeQuotasAdminTestJSON-508449277 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1187899-0515-474c-9314-014473beecf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:25:35 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-cb5d8a3f-84e1-4924-b47b-f5dbf56ec037 tempest-VolumeQuotasAdminTestJSON-508449277 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1187899-0515-474c-9314-014473beecf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:25:35 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-cb5d8a3f-84e1-4924-b47b-f5dbf56ec037 tempest-VolumeQuotasAdminTestJSON-508449277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c616a426-8a40-4d7a-b18d-ef5148fd07cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:25:35 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-cb5d8a3f-84e1-4924-b47b-f5dbf56ec037 tempest-VolumeQuotasAdminTestJSON-508449277 None] Volume e9e97a32-e735-44de-b72f-25e869d3fb21: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e9e97a32-e735-44de-b72f-25e869d3fb21', 'volume_size': 1} Jul 31 12:25:35 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-cb5d8a3f-84e1-4924-b47b-f5dbf56ec037 tempest-VolumeQuotasAdminTestJSON-508449277 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:25:35 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [req-46280321-3d2a-457a-ac8f-600d210291aa req-1beca48d-8e65-4f72-b821-d759de432969 tempest-VolumesGetTestJSON-1227126481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2" returned: 0 in 0.332s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:25:35 devstack cinder-volume[89182]: DEBUG cinder.manager [req-46280321-3d2a-457a-ac8f-600d210291aa req-1beca48d-8e65-4f72-b821-d759de432969 tempest-VolumesGetTestJSON-1227126481 None] Notifying Schedulers of capabilities ... {{(pid=89182) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 12:25:35 devstack cinder-volume[89182]: INFO cinder.volume.manager [req-46280321-3d2a-457a-ac8f-600d210291aa req-1beca48d-8e65-4f72-b821-d759de432969 tempest-VolumesGetTestJSON-1227126481 None] Deleted volume successfully. Jul 31 12:25:35 devstack cinder-volume[89182]: DEBUG cinder.coordination [req-46280321-3d2a-457a-ac8f-600d210291aa req-1beca48d-8e65-4f72-b821-d759de432969 tempest-VolumesGetTestJSON-1227126481 None] Lock "cinder-fc0f039e-6f94-4ed8-ba0f-e016320a29e3-delete_volume" released by "delete_volume" :: held 1.754s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:25:35 devstack sudo[102584]: pam_unix(sudo:session): session closed for user root Jul 31 12:25:35 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-121ee917-f993-4610-81c0-4282f092bf94 tempest-TestVolumeBootPattern-1492021642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-059c514e-3928-498a-9f8e-384f95a18a7c.94a7a129-d2b7-4383-b472-bf34f8cff987" returned: 0 in 0.402s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:25:35 devstack cinder-volume[89182]: DEBUG cinder.compute.nova [None req-121ee917-f993-4610-81c0-4282f092bf94 tempest-TestVolumeBootPattern-1492021642 None] Creating Keystone auth plugin from conf {{(pid=89182) novaclient /opt/stack/cinder/cinder/compute/nova.py:99}} Jul 31 12:25:35 devstack cinder-volume[89182]: DEBUG novaclient.v2.client [None req-121ee917-f993-4610-81c0-4282f092bf94 tempest-TestVolumeBootPattern-1492021642 None] REQ: curl -g -i -X POST http://192.168.122.21/compute/v2.1/os-assisted-volume-snapshots -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}fc40964b95783d2a4392aae0083ad4e01b1e2ae50bbcbb571317cc8a4ca86861" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-121ee917-f993-4610-81c0-4282f092bf94" -H "X-Service-Token: {SHA256}02a8645ba5bc7d3f7d0a93a9d02f784466607492168e4b335483720fa1daddd6" -d '{"snapshot": {"volume_id": "059c514e-3928-498a-9f8e-384f95a18a7c", "create_info": {"type": "qcow2", "new_file": "volume-059c514e-3928-498a-9f8e-384f95a18a7c.94a7a129-d2b7-4383-b472-bf34f8cff987", "snapshot_id": "94a7a129-d2b7-4383-b472-bf34f8cff987"}}}' {{(pid=89182) _http_log_request /opt/stack/data/venv/lib/python3.12/site-packages/keystoneauth1/session.py:575}} Jul 31 12:25:35 devstack cinder-volume[89182]: DEBUG novaclient.v2.client [None req-121ee917-f993-4610-81c0-4282f092bf94 tempest-TestVolumeBootPattern-1492021642 None] RESP: [200] Connection: close Content-Length: 78 Content-Type: application/json Date: Fri, 31 Jul 2026 10:25:35 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.58 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-999dfe04-0f27-4966-b252-13ba30a82381 x-openstack-request-id: req-999dfe04-0f27-4966-b252-13ba30a82381 {{(pid=89182) _http_log_response /opt/stack/data/venv/lib/python3.12/site-packages/keystoneauth1/session.py:616}} Jul 31 12:25:35 devstack cinder-volume[89182]: DEBUG novaclient.v2.client [None req-121ee917-f993-4610-81c0-4282f092bf94 tempest-TestVolumeBootPattern-1492021642 None] RESP BODY: {"snapshot": {"id": null, "volumeId": "059c514e-3928-498a-9f8e-384f95a18a7c"}} {{(pid=89182) _http_log_response /opt/stack/data/venv/lib/python3.12/site-packages/keystoneauth1/session.py:651}} Jul 31 12:25:35 devstack cinder-volume[89182]: DEBUG novaclient.v2.client [None req-121ee917-f993-4610-81c0-4282f092bf94 tempest-TestVolumeBootPattern-1492021642 None] POST call to compute for http://192.168.122.21/compute/v2.1/os-assisted-volume-snapshots used request id req-999dfe04-0f27-4966-b252-13ba30a82381 {{(pid=89182) request /opt/stack/data/venv/lib/python3.12/site-packages/keystoneauth1/session.py:1076}} Jul 31 12:25:35 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-121ee917-f993-4610-81c0-4282f092bf94 tempest-TestVolumeBootPattern-1492021642 None] nova call result: None {{(pid=89182) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1910}} Jul 31 12:25:35 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-121ee917-f993-4610-81c0-4282f092bf94 tempest-TestVolumeBootPattern-1492021642 None] Status of snapshot 94a7a129-d2b7-4383-b472-bf34f8cff987 is now creating {{(pid=89182) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Jul 31 12:25:36 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-121ee917-f993-4610-81c0-4282f092bf94 tempest-TestVolumeBootPattern-1492021642 None] Status of snapshot 94a7a129-d2b7-4383-b472-bf34f8cff987 is now creating {{(pid=89182) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Jul 31 12:25:37 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-121ee917-f993-4610-81c0-4282f092bf94 tempest-TestVolumeBootPattern-1492021642 None] Status of snapshot 94a7a129-d2b7-4383-b472-bf34f8cff987 is now creating {{(pid=89182) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Jul 31 12:25:38 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-121ee917-f993-4610-81c0-4282f092bf94 tempest-TestVolumeBootPattern-1492021642 None] Status of snapshot 94a7a129-d2b7-4383-b472-bf34f8cff987 is now creating {{(pid=89182) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Jul 31 12:25:39 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-31d063f9-5670-47b2-87db-bfefb2d216c4 tempest-BackendsCapabilitiesAdminTestsJSON-1072648133 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.637077331543, 'free_capacity_gb': 1775.637077331543, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=89182) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 31 12:25:39 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-54c540d3-6fe4-4c05-b6bd-12ba3e65146f tempest-BackendsCapabilitiesAdminTestsJSON-1072648133 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.637077331543, 'free_capacity_gb': 1775.637077331543, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=89182) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 31 12:25:39 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-121ee917-f993-4610-81c0-4282f092bf94 tempest-TestVolumeBootPattern-1492021642 None] Status of snapshot 94a7a129-d2b7-4383-b472-bf34f8cff987 is now creating {{(pid=89182) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Jul 31 12:25:40 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-121ee917-f993-4610-81c0-4282f092bf94 tempest-TestVolumeBootPattern-1492021642 None] Status of snapshot 94a7a129-d2b7-4383-b472-bf34f8cff987 is now creating {{(pid=89182) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Jul 31 12:25:41 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-121ee917-f993-4610-81c0-4282f092bf94 tempest-TestVolumeBootPattern-1492021642 None] Status of snapshot 94a7a129-d2b7-4383-b472-bf34f8cff987 is now creating {{(pid=89182) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Jul 31 12:25:42 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-121ee917-f993-4610-81c0-4282f092bf94 tempest-TestVolumeBootPattern-1492021642 None] Status of snapshot 94a7a129-d2b7-4383-b472-bf34f8cff987 is now creating {{(pid=89182) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Jul 31 12:25:43 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-121ee917-f993-4610-81c0-4282f092bf94 tempest-TestVolumeBootPattern-1492021642 None] Status of snapshot 94a7a129-d2b7-4383-b472-bf34f8cff987 is now creating {{(pid=89182) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Jul 31 12:25:44 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-121ee917-f993-4610-81c0-4282f092bf94 tempest-TestVolumeBootPattern-1492021642 None] Status of snapshot 94a7a129-d2b7-4383-b472-bf34f8cff987 is now creating {{(pid=89182) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Jul 31 12:25:45 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-121ee917-f993-4610-81c0-4282f092bf94 tempest-TestVolumeBootPattern-1492021642 None] Status of snapshot 94a7a129-d2b7-4383-b472-bf34f8cff987 is now creating {{(pid=89182) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Jul 31 12:25:46 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-121ee917-f993-4610-81c0-4282f092bf94 tempest-TestVolumeBootPattern-1492021642 None] Status of snapshot 94a7a129-d2b7-4383-b472-bf34f8cff987 is now creating {{(pid=89182) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Jul 31 12:25:48 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-694e7d99-2489-4f00-a240-c35f0e7372ef tempest-GroupsV314Test-1921152939 None] Group tempest-GroupsV314Test-Group-1412959776: creating Jul 31 12:25:48 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-694e7d99-2489-4f00-a240-c35f0e7372ef tempest-GroupsV314Test-1921152939 None] Group tempest-GroupsV314Test-Group-1412959776: created successfully Jul 31 12:25:48 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-694e7d99-2489-4f00-a240-c35f0e7372ef tempest-GroupsV314Test-1921152939 None] Create group completed successfully. Jul 31 12:25:48 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-121ee917-f993-4610-81c0-4282f092bf94 tempest-TestVolumeBootPattern-1492021642 None] Status of snapshot 94a7a129-d2b7-4383-b472-bf34f8cff987 is now creating {{(pid=89182) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Jul 31 12:25:49 devstack cinder-volume[89182]: DEBUG cinder.volume.flows.manager.create_volume [None req-da5a5cb2-fa6e-479b-a702-37616483f81b tempest-GroupsV314Test-1921152939 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89182) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 12:25:50 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-da5a5cb2-fa6e-479b-a702-37616483f81b tempest-GroupsV314Test-1921152939 None] Flow 'volume_create_manager' (078b2c3f-5eae-4049-ba76-a1ef65fc8f31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:25:50 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-da5a5cb2-fa6e-479b-a702-37616483f81b tempest-GroupsV314Test-1921152939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (586eccdb-ec8c-4aed-8afe-717385291ed1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:25:50 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-da5a5cb2-fa6e-479b-a702-37616483f81b tempest-GroupsV314Test-1921152939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (586eccdb-ec8c-4aed-8afe-717385291ed1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:25:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-817614476',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3c6df1f8-2d84-4873-849b-23f8b9f5a884,host='devstack@QuobyteHD#QuobyteHD',id=1184ff71-d5d4-44aa-9aa3-96489716dc5b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4e5ae5a64f0476284a92ffb388f2036',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:25:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:25:50Z,use_quota=True,user_id='512cefc94386448a99d15cfd0be29878',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c125fc1-5af5-40d8-b019-a6568647dcd0),volume_type_id=5c125fc1-5af5-40d8-b019-a6568647dcd0)' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:25:50 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-da5a5cb2-fa6e-479b-a702-37616483f81b tempest-GroupsV314Test-1921152939 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d2f0567-bad8-442f-9449-fcb257a38695) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:25:50 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-da5a5cb2-fa6e-479b-a702-37616483f81b tempest-GroupsV314Test-1921152939 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d2f0567-bad8-442f-9449-fcb257a38695) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:25:50 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-da5a5cb2-fa6e-479b-a702-37616483f81b tempest-GroupsV314Test-1921152939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df87f2a6-f204-413a-b289-611d8f23f47c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:25:50 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-da5a5cb2-fa6e-479b-a702-37616483f81b tempest-GroupsV314Test-1921152939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df87f2a6-f204-413a-b289-611d8f23f47c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1184ff71-d5d4-44aa-9aa3-96489716dc5b', 'volume_name': 'volume-1184ff71-d5d4-44aa-9aa3-96489716dc5b', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:25:50 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-da5a5cb2-fa6e-479b-a702-37616483f81b tempest-GroupsV314Test-1921152939 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb1502f5-8ad7-49de-99db-1ca891d2ee6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:25:50 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-da5a5cb2-fa6e-479b-a702-37616483f81b tempest-GroupsV314Test-1921152939 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb1502f5-8ad7-49de-99db-1ca891d2ee6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:25:50 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-da5a5cb2-fa6e-479b-a702-37616483f81b tempest-GroupsV314Test-1921152939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91063546-bc89-4612-8880-d1a1c8699ec3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:25:50 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-da5a5cb2-fa6e-479b-a702-37616483f81b tempest-GroupsV314Test-1921152939 None] Volume 1184ff71-d5d4-44aa-9aa3-96489716dc5b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1184ff71-d5d4-44aa-9aa3-96489716dc5b', 'volume_size': 1} Jul 31 12:25:50 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-da5a5cb2-fa6e-479b-a702-37616483f81b tempest-GroupsV314Test-1921152939 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:25:50 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-121ee917-f993-4610-81c0-4282f092bf94 tempest-TestVolumeBootPattern-1492021642 None] Status of snapshot 94a7a129-d2b7-4383-b472-bf34f8cff987 is now creating {{(pid=89182) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Jul 31 12:25:52 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [req-a3726f7b-aa59-4188-aa46-5cb7983588d8 req-9c355d83-fcbe-4b90-afff-92a18650f831 tempest-TestStampPattern-418584557 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:25:52 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-121ee917-f993-4610-81c0-4282f092bf94 tempest-TestVolumeBootPattern-1492021642 None] Status of snapshot 94a7a129-d2b7-4383-b472-bf34f8cff987 is now creating {{(pid=89182) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Jul 31 12:25:52 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-121ee917-f993-4610-81c0-4282f092bf94 tempest-TestVolumeBootPattern-1492021642 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 19.795s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:25:52 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-cb5d8a3f-84e1-4924-b47b-f5dbf56ec037 tempest-VolumeQuotasAdminTestJSON-508449277 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 17.556s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:25:52 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-cb5d8a3f-84e1-4924-b47b-f5dbf56ec037 tempest-VolumeQuotasAdminTestJSON-508449277 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:25:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-2109953029',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9e97a32-e735-44de-b72f-25e869d3fb21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42ee8c0b010b4716aedcaf404f635278',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:25:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:25:35Z,use_quota=True,user_id='714c41d7f98c4c18ae45c5bc7ccd9f46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)}" {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 12:25:52 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-cb5d8a3f-84e1-4924-b47b-f5dbf56ec037 tempest-VolumeQuotasAdminTestJSON-508449277 None] Creating volume e9e97a32-e735-44de-b72f-25e869d3fb21 {{(pid=89182) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 12:25:52 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-cb5d8a3f-84e1-4924-b47b-f5dbf56ec037 tempest-VolumeQuotasAdminTestJSON-508449277 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:25:52 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-cb5d8a3f-84e1-4924-b47b-f5dbf56ec037 tempest-VolumeQuotasAdminTestJSON-508449277 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:25:52 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-cb5d8a3f-84e1-4924-b47b-f5dbf56ec037 tempest-VolumeQuotasAdminTestJSON-508449277 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:25:52 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-cb5d8a3f-84e1-4924-b47b-f5dbf56ec037 tempest-VolumeQuotasAdminTestJSON-508449277 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:25:52 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-cb5d8a3f-84e1-4924-b47b-f5dbf56ec037 tempest-VolumeQuotasAdminTestJSON-508449277 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:25:52 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-cb5d8a3f-84e1-4924-b47b-f5dbf56ec037 tempest-VolumeQuotasAdminTestJSON-508449277 None] Selected osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 as target Quobyte volume. {{(pid=89182) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 12:25:52 devstack cinder-volume[89182]: INFO cinder.volume.drivers.remotefs [None req-cb5d8a3f-84e1-4924-b47b-f5dbf56ec037 tempest-VolumeQuotasAdminTestJSON-508449277 None] casted to osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 Jul 31 12:25:52 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-cb5d8a3f-84e1-4924-b47b-f5dbf56ec037 tempest-VolumeQuotasAdminTestJSON-508449277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e9e97a32-e735-44de-b72f-25e869d3fb21 1073741824 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:25:52 devstack sudo[102662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e9e97a32-e735-44de-b72f-25e869d3fb21 1073741824 Jul 31 12:25:52 devstack sudo[102662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:25:52 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-121ee917-f993-4610-81c0-4282f092bf94 tempest-TestVolumeBootPattern-1492021642 None] Create snapshot completed successfully Jul 31 12:25:53 devstack sudo[102662]: pam_unix(sudo:session): session closed for user root Jul 31 12:25:53 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-cb5d8a3f-84e1-4924-b47b-f5dbf56ec037 tempest-VolumeQuotasAdminTestJSON-508449277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e9e97a32-e735-44de-b72f-25e869d3fb21 1073741824" returned: 0 in 0.408s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:25:53 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-cb5d8a3f-84e1-4924-b47b-f5dbf56ec037 tempest-VolumeQuotasAdminTestJSON-508449277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e9e97a32-e735-44de-b72f-25e869d3fb21 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:25:53 devstack sudo[102668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e9e97a32-e735-44de-b72f-25e869d3fb21 Jul 31 12:25:53 devstack sudo[102668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:25:53 devstack sudo[102668]: pam_unix(sudo:session): session closed for user root Jul 31 12:25:53 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-cb5d8a3f-84e1-4924-b47b-f5dbf56ec037 tempest-VolumeQuotasAdminTestJSON-508449277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e9e97a32-e735-44de-b72f-25e869d3fb21" returned: 0 in 0.264s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:25:53 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-cb5d8a3f-84e1-4924-b47b-f5dbf56ec037 tempest-VolumeQuotasAdminTestJSON-508449277 None] <== create_volume: return (709ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'} {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 12:25:53 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-cb5d8a3f-84e1-4924-b47b-f5dbf56ec037 tempest-VolumeQuotasAdminTestJSON-508449277 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.711s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:25:53 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-da5a5cb2-fa6e-479b-a702-37616483f81b tempest-GroupsV314Test-1921152939 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.257s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:25:53 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-da5a5cb2-fa6e-479b-a702-37616483f81b tempest-GroupsV314Test-1921152939 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=3c6df1f8-2d84-4873-849b-23f8b9f5a884,created_at=2026-07-31T10:25:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-817614476',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3c6df1f8-2d84-4873-849b-23f8b9f5a884,host='devstack@QuobyteHD#QuobyteHD',id=1184ff71-d5d4-44aa-9aa3-96489716dc5b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4e5ae5a64f0476284a92ffb388f2036',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:25:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:25:50Z,use_quota=True,user_id='512cefc94386448a99d15cfd0be29878',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c125fc1-5af5-40d8-b019-a6568647dcd0),volume_type_id=5c125fc1-5af5-40d8-b019-a6568647dcd0)}" {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 12:25:53 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-da5a5cb2-fa6e-479b-a702-37616483f81b tempest-GroupsV314Test-1921152939 None] Creating volume 1184ff71-d5d4-44aa-9aa3-96489716dc5b {{(pid=89182) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 12:25:53 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-da5a5cb2-fa6e-479b-a702-37616483f81b tempest-GroupsV314Test-1921152939 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:25:53 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-da5a5cb2-fa6e-479b-a702-37616483f81b tempest-GroupsV314Test-1921152939 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:25:53 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-da5a5cb2-fa6e-479b-a702-37616483f81b tempest-GroupsV314Test-1921152939 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:25:53 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-da5a5cb2-fa6e-479b-a702-37616483f81b tempest-GroupsV314Test-1921152939 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:25:53 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-da5a5cb2-fa6e-479b-a702-37616483f81b tempest-GroupsV314Test-1921152939 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:25:53 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-da5a5cb2-fa6e-479b-a702-37616483f81b tempest-GroupsV314Test-1921152939 None] Selected osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 as target Quobyte volume. {{(pid=89182) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 12:25:53 devstack cinder-volume[89182]: INFO cinder.volume.drivers.remotefs [None req-da5a5cb2-fa6e-479b-a702-37616483f81b tempest-GroupsV314Test-1921152939 None] casted to osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 Jul 31 12:25:53 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-da5a5cb2-fa6e-479b-a702-37616483f81b tempest-GroupsV314Test-1921152939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-1184ff71-d5d4-44aa-9aa3-96489716dc5b 1073741824 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:25:53 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-cb5d8a3f-84e1-4924-b47b-f5dbf56ec037 tempest-VolumeQuotasAdminTestJSON-508449277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c616a426-8a40-4d7a-b18d-ef5148fd07cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e9e97a32-e735-44de-b72f-25e869d3fb21', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:25:53 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-cb5d8a3f-84e1-4924-b47b-f5dbf56ec037 tempest-VolumeQuotasAdminTestJSON-508449277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c402d5be-da43-4858-b48d-edccf87ad8b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:25:53 devstack sudo[102671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-1184ff71-d5d4-44aa-9aa3-96489716dc5b 1073741824 Jul 31 12:25:53 devstack sudo[102671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:25:53 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-cb5d8a3f-84e1-4924-b47b-f5dbf56ec037 tempest-VolumeQuotasAdminTestJSON-508449277 None] Volume volume-e9e97a32-e735-44de-b72f-25e869d3fb21 (e9e97a32-e735-44de-b72f-25e869d3fb21): created successfully Jul 31 12:25:53 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-cb5d8a3f-84e1-4924-b47b-f5dbf56ec037 tempest-VolumeQuotasAdminTestJSON-508449277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c402d5be-da43-4858-b48d-edccf87ad8b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:25:53 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-cb5d8a3f-84e1-4924-b47b-f5dbf56ec037 tempest-VolumeQuotasAdminTestJSON-508449277 None] Flow 'volume_create_manager' (f21aebd2-954c-4365-88be-9dd6c57a5b68) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:25:53 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-cb5d8a3f-84e1-4924-b47b-f5dbf56ec037 tempest-VolumeQuotasAdminTestJSON-508449277 None] Created volume successfully. Jul 31 12:25:53 devstack sudo[102671]: pam_unix(sudo:session): session closed for user root Jul 31 12:25:53 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-da5a5cb2-fa6e-479b-a702-37616483f81b tempest-GroupsV314Test-1921152939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-1184ff71-d5d4-44aa-9aa3-96489716dc5b 1073741824" returned: 0 in 0.424s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:25:53 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-da5a5cb2-fa6e-479b-a702-37616483f81b tempest-GroupsV314Test-1921152939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-1184ff71-d5d4-44aa-9aa3-96489716dc5b {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:25:53 devstack sudo[102677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-1184ff71-d5d4-44aa-9aa3-96489716dc5b Jul 31 12:25:53 devstack sudo[102677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:25:53 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-80632428-f7b5-4a0c-b48d-9c93a9f61fb2 tempest-TestVolumeBootPattern-1492021642 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:25:54 devstack sudo[102677]: pam_unix(sudo:session): session closed for user root Jul 31 12:25:54 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-da5a5cb2-fa6e-479b-a702-37616483f81b tempest-GroupsV314Test-1921152939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-1184ff71-d5d4-44aa-9aa3-96489716dc5b" returned: 0 in 0.267s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:25:54 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-da5a5cb2-fa6e-479b-a702-37616483f81b tempest-GroupsV314Test-1921152939 None] <== create_volume: return (740ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'} {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 12:25:54 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-da5a5cb2-fa6e-479b-a702-37616483f81b tempest-GroupsV314Test-1921152939 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.743s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:25:54 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [req-a3726f7b-aa59-4188-aa46-5cb7983588d8 req-9c355d83-fcbe-4b90-afff-92a18650f831 tempest-TestStampPattern-418584557 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.918s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:25:54 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [req-a3726f7b-aa59-4188-aa46-5cb7983588d8 req-9c355d83-fcbe-4b90-afff-92a18650f831 tempest-TestStampPattern-418584557 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:25:54 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-80632428-f7b5-4a0c-b48d-9c93a9f61fb2 tempest-TestVolumeBootPattern-1492021642 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.238s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:25:54 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-da5a5cb2-fa6e-479b-a702-37616483f81b tempest-GroupsV314Test-1921152939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91063546-bc89-4612-8880-d1a1c8699ec3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1184ff71-d5d4-44aa-9aa3-96489716dc5b', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:25:54 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-da5a5cb2-fa6e-479b-a702-37616483f81b tempest-GroupsV314Test-1921152939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (829f4c83-4b24-4647-a416-2fc5d3a6361d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:25:54 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-da5a5cb2-fa6e-479b-a702-37616483f81b tempest-GroupsV314Test-1921152939 None] Volume volume-1184ff71-d5d4-44aa-9aa3-96489716dc5b (1184ff71-d5d4-44aa-9aa3-96489716dc5b): created successfully Jul 31 12:25:54 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-da5a5cb2-fa6e-479b-a702-37616483f81b tempest-GroupsV314Test-1921152939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (829f4c83-4b24-4647-a416-2fc5d3a6361d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:25:54 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-da5a5cb2-fa6e-479b-a702-37616483f81b tempest-GroupsV314Test-1921152939 None] Flow 'volume_create_manager' (078b2c3f-5eae-4049-ba76-a1ef65fc8f31) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:25:54 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-da5a5cb2-fa6e-479b-a702-37616483f81b tempest-GroupsV314Test-1921152939 None] Created volume successfully. Jul 31 12:25:54 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [req-a3726f7b-aa59-4188-aa46-5cb7983588d8 req-9c355d83-fcbe-4b90-afff-92a18650f831 tempest-TestStampPattern-418584557 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88', 'name': 'volume-d0066bfd-3e6d-48ac-83e6-ec47a100d768', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b81ed211-b1fd-47e9-807d-467b69cde3f1', 'enforce_multipath': True} {{(pid=89182) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 31 12:25:54 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-80632428-f7b5-4a0c-b48d-9c93a9f61fb2 tempest-TestVolumeBootPattern-1492021642 None] Creating online snapshot 9d450624-84ea-4f9a-9604-268386ba964a of volume 059c514e-3928-498a-9f8e-384f95a18a7c {{(pid=89182) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 31 12:25:54 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2ba72fa-fd3b-486b-8141-cebe4e77ead0]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:25:54 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-80632428-f7b5-4a0c-b48d-9c93a9f61fb2 tempest-TestVolumeBootPattern-1492021642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-059c514e-3928-498a-9f8e-384f95a18a7c.94a7a129-d2b7-4383-b472-bf34f8cff987 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:25:54 devstack cinder-volume[89182]: INFO cinder.volume.manager [req-a3726f7b-aa59-4188-aa46-5cb7983588d8 req-9c355d83-fcbe-4b90-afff-92a18650f831 tempest-TestStampPattern-418584557 None] attachment_update completed successfully. Jul 31 12:25:54 devstack sudo[102681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-059c514e-3928-498a-9f8e-384f95a18a7c.94a7a129-d2b7-4383-b472-bf34f8cff987 Jul 31 12:25:54 devstack sudo[102681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:25:54 devstack sudo[102681]: pam_unix(sudo:session): session closed for user root Jul 31 12:25:54 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-80632428-f7b5-4a0c-b48d-9c93a9f61fb2 tempest-TestVolumeBootPattern-1492021642 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-059c514e-3928-498a-9f8e-384f95a18a7c.94a7a129-d2b7-4383-b472-bf34f8cff987" returned: 0 in 0.444s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:25:54 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-80632428-f7b5-4a0c-b48d-9c93a9f61fb2 tempest-TestVolumeBootPattern-1492021642 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-059c514e-3928-498a-9f8e-384f95a18a7c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89182) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 12:25:54 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-80632428-f7b5-4a0c-b48d-9c93a9f61fb2 tempest-TestVolumeBootPattern-1492021642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-059c514e-3928-498a-9f8e-384f95a18a7c.94a7a129-d2b7-4383-b472-bf34f8cff987,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-059c514e-3928-498a-9f8e-384f95a18a7c.9d450624-84ea-4f9a-9604-268386ba964a 1G {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:25:54 devstack sudo[102692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-059c514e-3928-498a-9f8e-384f95a18a7c.94a7a129-d2b7-4383-b472-bf34f8cff987,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-059c514e-3928-498a-9f8e-384f95a18a7c.9d450624-84ea-4f9a-9604-268386ba964a 1G Jul 31 12:25:54 devstack sudo[102692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:25:54 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-672a6d1c-5a3d-4171-bfce-8191e575fd6f tempest-VolumeQuotasAdminTestJSON-1099672205 None] Transfer volume completed successfully. Jul 31 12:25:55 devstack sudo[102692]: pam_unix(sudo:session): session closed for user root Jul 31 12:25:55 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-80632428-f7b5-4a0c-b48d-9c93a9f61fb2 tempest-TestVolumeBootPattern-1492021642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-059c514e-3928-498a-9f8e-384f95a18a7c.94a7a129-d2b7-4383-b472-bf34f8cff987,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-059c514e-3928-498a-9f8e-384f95a18a7c.9d450624-84ea-4f9a-9604-268386ba964a 1G" returned: 0 in 0.682s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:25:55 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-80632428-f7b5-4a0c-b48d-9c93a9f61fb2 tempest-TestVolumeBootPattern-1492021642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-059c514e-3928-498a-9f8e-384f95a18a7c.94a7a129-d2b7-4383-b472-bf34f8cff987 -F qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-059c514e-3928-498a-9f8e-384f95a18a7c.9d450624-84ea-4f9a-9604-268386ba964a {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:25:55 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-6cb15fb0-de74-417b-a221-ee7a6d135d6d tempest-GroupsV314Test-1921152939 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:25:55 devstack sudo[102699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-059c514e-3928-498a-9f8e-384f95a18a7c.94a7a129-d2b7-4383-b472-bf34f8cff987 -F qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-059c514e-3928-498a-9f8e-384f95a18a7c.9d450624-84ea-4f9a-9604-268386ba964a Jul 31 12:25:55 devstack sudo[102699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:25:55 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-45b040e6-d7a4-49bf-a782-636f1281c32b tempest-VolumeQuotasAdminTestJSON-547926994 None] Acquiring lock "cinder-e9e97a32-e735-44de-b72f-25e869d3fb21-delete_volume" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:25:55 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-45b040e6-d7a4-49bf-a782-636f1281c32b tempest-VolumeQuotasAdminTestJSON-547926994 None] Lock "cinder-e9e97a32-e735-44de-b72f-25e869d3fb21-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:25:55 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-45b040e6-d7a4-49bf-a782-636f1281c32b tempest-VolumeQuotasAdminTestJSON-547926994 None] Acquiring lock "cinder-quobyte-e9e97a32-e735-44de-b72f-25e869d3fb21" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:25:55 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-45b040e6-d7a4-49bf-a782-636f1281c32b tempest-VolumeQuotasAdminTestJSON-547926994 None] Lock "cinder-quobyte-e9e97a32-e735-44de-b72f-25e869d3fb21" acquired by "delete_volume" :: waited 0.024s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:25:55 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[50daacfa-7dc2-4b6c-b7de-0ea6e20b0393]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:25:55 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-45b040e6-d7a4-49bf-a782-636f1281c32b tempest-VolumeQuotasAdminTestJSON-547926994 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e9e97a32-e735-44de-b72f-25e869d3fb21 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:25:55 devstack sudo[102699]: pam_unix(sudo:session): session closed for user root Jul 31 12:25:55 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-80632428-f7b5-4a0c-b48d-9c93a9f61fb2 tempest-TestVolumeBootPattern-1492021642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-059c514e-3928-498a-9f8e-384f95a18a7c.94a7a129-d2b7-4383-b472-bf34f8cff987 -F qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-059c514e-3928-498a-9f8e-384f95a18a7c.9d450624-84ea-4f9a-9604-268386ba964a" returned: 0 in 0.394s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:25:55 devstack cinder-volume[89182]: WARNING cinder.volume.drivers.remotefs [None req-80632428-f7b5-4a0c-b48d-9c93a9f61fb2 tempest-TestVolumeBootPattern-1492021642 None] /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-059c514e-3928-498a-9f8e-384f95a18a7c.9d450624-84ea-4f9a-9604-268386ba964a is being set with open permissions: ugo+rw Jul 31 12:25:55 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-80632428-f7b5-4a0c-b48d-9c93a9f61fb2 tempest-TestVolumeBootPattern-1492021642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-059c514e-3928-498a-9f8e-384f95a18a7c.9d450624-84ea-4f9a-9604-268386ba964a {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:25:55 devstack sudo[102716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-059c514e-3928-498a-9f8e-384f95a18a7c.9d450624-84ea-4f9a-9604-268386ba964a Jul 31 12:25:55 devstack sudo[102716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:25:55 devstack sudo[102713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e9e97a32-e735-44de-b72f-25e869d3fb21 Jul 31 12:25:55 devstack sudo[102713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:25:56 devstack sudo[102716]: pam_unix(sudo:session): session closed for user root Jul 31 12:25:56 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-80632428-f7b5-4a0c-b48d-9c93a9f61fb2 tempest-TestVolumeBootPattern-1492021642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-059c514e-3928-498a-9f8e-384f95a18a7c.9d450624-84ea-4f9a-9604-268386ba964a" returned: 0 in 0.264s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:25:56 devstack cinder-volume[89182]: DEBUG cinder.compute.nova [None req-80632428-f7b5-4a0c-b48d-9c93a9f61fb2 tempest-TestVolumeBootPattern-1492021642 None] Creating Keystone auth plugin from conf {{(pid=89182) novaclient /opt/stack/cinder/cinder/compute/nova.py:99}} Jul 31 12:25:56 devstack sudo[102713]: pam_unix(sudo:session): session closed for user root Jul 31 12:25:56 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-45b040e6-d7a4-49bf-a782-636f1281c32b tempest-VolumeQuotasAdminTestJSON-547926994 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e9e97a32-e735-44de-b72f-25e869d3fb21" returned: 0 in 0.388s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:25:56 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-45b040e6-d7a4-49bf-a782-636f1281c32b tempest-VolumeQuotasAdminTestJSON-547926994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e9e97a32-e735-44de-b72f-25e869d3fb21 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:25:56 devstack sudo[102727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e9e97a32-e735-44de-b72f-25e869d3fb21 Jul 31 12:25:56 devstack sudo[102727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:25:56 devstack cinder-volume[89182]: DEBUG novaclient.v2.client [None req-80632428-f7b5-4a0c-b48d-9c93a9f61fb2 tempest-TestVolumeBootPattern-1492021642 None] REQ: curl -g -i -X POST http://192.168.122.21/compute/v2.1/os-assisted-volume-snapshots -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}21ad61d30795b97e89eb4fb666a6d5b96763a43231e6e3b620c8f2c856750661" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-80632428-f7b5-4a0c-b48d-9c93a9f61fb2" -H "X-Service-Token: {SHA256}02a8645ba5bc7d3f7d0a93a9d02f784466607492168e4b335483720fa1daddd6" -d '{"snapshot": {"volume_id": "059c514e-3928-498a-9f8e-384f95a18a7c", "create_info": {"type": "qcow2", "new_file": "volume-059c514e-3928-498a-9f8e-384f95a18a7c.9d450624-84ea-4f9a-9604-268386ba964a", "snapshot_id": "9d450624-84ea-4f9a-9604-268386ba964a"}}}' {{(pid=89182) _http_log_request /opt/stack/data/venv/lib/python3.12/site-packages/keystoneauth1/session.py:575}} Jul 31 12:25:56 devstack sudo[102727]: pam_unix(sudo:session): session closed for user root Jul 31 12:25:56 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-45b040e6-d7a4-49bf-a782-636f1281c32b tempest-VolumeQuotasAdminTestJSON-547926994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e9e97a32-e735-44de-b72f-25e869d3fb21" returned: 0 in 0.290s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:25:56 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-45b040e6-d7a4-49bf-a782-636f1281c32b tempest-VolumeQuotasAdminTestJSON-547926994 None] Lock "cinder-quobyte-e9e97a32-e735-44de-b72f-25e869d3fb21" released by "delete_volume" :: held 0.730s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:25:56 devstack cinder-volume[89182]: DEBUG novaclient.v2.client [None req-80632428-f7b5-4a0c-b48d-9c93a9f61fb2 tempest-TestVolumeBootPattern-1492021642 None] RESP: [200] Connection: close Content-Length: 78 Content-Type: application/json Date: Fri, 31 Jul 2026 10:25:56 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.58 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-4bca8c80-e59c-4c08-ac54-5ffc8e9b11c4 x-openstack-request-id: req-4bca8c80-e59c-4c08-ac54-5ffc8e9b11c4 {{(pid=89182) _http_log_response /opt/stack/data/venv/lib/python3.12/site-packages/keystoneauth1/session.py:616}} Jul 31 12:25:56 devstack cinder-volume[89182]: DEBUG novaclient.v2.client [None req-80632428-f7b5-4a0c-b48d-9c93a9f61fb2 tempest-TestVolumeBootPattern-1492021642 None] RESP BODY: {"snapshot": {"id": null, "volumeId": "059c514e-3928-498a-9f8e-384f95a18a7c"}} {{(pid=89182) _http_log_response /opt/stack/data/venv/lib/python3.12/site-packages/keystoneauth1/session.py:651}} Jul 31 12:25:56 devstack cinder-volume[89182]: DEBUG novaclient.v2.client [None req-80632428-f7b5-4a0c-b48d-9c93a9f61fb2 tempest-TestVolumeBootPattern-1492021642 None] POST call to compute for http://192.168.122.21/compute/v2.1/os-assisted-volume-snapshots used request id req-4bca8c80-e59c-4c08-ac54-5ffc8e9b11c4 {{(pid=89182) request /opt/stack/data/venv/lib/python3.12/site-packages/keystoneauth1/session.py:1076}} Jul 31 12:25:56 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-80632428-f7b5-4a0c-b48d-9c93a9f61fb2 tempest-TestVolumeBootPattern-1492021642 None] nova call result: None {{(pid=89182) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1910}} Jul 31 12:25:56 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-80632428-f7b5-4a0c-b48d-9c93a9f61fb2 tempest-TestVolumeBootPattern-1492021642 None] Status of snapshot 9d450624-84ea-4f9a-9604-268386ba964a is now creating {{(pid=89182) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Jul 31 12:25:56 devstack cinder-volume[89182]: DEBUG cinder.quota [None req-45b040e6-d7a4-49bf-a782-636f1281c32b tempest-VolumeQuotasAdminTestJSON-547926994 None] Created reservations ['89e918e3-c30b-43b8-ad5c-bd33ac29479f', 'afd813ae-5c61-4b8c-9534-e3cc44d63026', 'f54054e1-45f6-48f7-93f2-a9476668628a', '88676b1c-c6d5-4040-a832-c1a9040eab35'] {{(pid=89182) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 12:25:56 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-45b040e6-d7a4-49bf-a782-636f1281c32b tempest-VolumeQuotasAdminTestJSON-547926994 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:25:56 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-45b040e6-d7a4-49bf-a782-636f1281c32b tempest-VolumeQuotasAdminTestJSON-547926994 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:25:56 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-45b040e6-d7a4-49bf-a782-636f1281c32b tempest-VolumeQuotasAdminTestJSON-547926994 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:25:56 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-45b040e6-d7a4-49bf-a782-636f1281c32b tempest-VolumeQuotasAdminTestJSON-547926994 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:25:56 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-45b040e6-d7a4-49bf-a782-636f1281c32b tempest-VolumeQuotasAdminTestJSON-547926994 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:25:56 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-45b040e6-d7a4-49bf-a782-636f1281c32b tempest-VolumeQuotasAdminTestJSON-547926994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:25:56 devstack sudo[102734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 Jul 31 12:25:56 devstack sudo[102734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:25:56 devstack sudo[102734]: pam_unix(sudo:session): session closed for user root Jul 31 12:25:56 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-45b040e6-d7a4-49bf-a782-636f1281c32b tempest-VolumeQuotasAdminTestJSON-547926994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2" returned: 0 in 0.277s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:25:56 devstack cinder-volume[89182]: DEBUG cinder.manager [None req-45b040e6-d7a4-49bf-a782-636f1281c32b tempest-VolumeQuotasAdminTestJSON-547926994 None] Notifying Schedulers of capabilities ... {{(pid=89182) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 12:25:56 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-45b040e6-d7a4-49bf-a782-636f1281c32b tempest-VolumeQuotasAdminTestJSON-547926994 None] Deleted volume successfully. Jul 31 12:25:56 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-45b040e6-d7a4-49bf-a782-636f1281c32b tempest-VolumeQuotasAdminTestJSON-547926994 None] Lock "cinder-e9e97a32-e735-44de-b72f-25e869d3fb21-delete_volume" released by "delete_volume" :: held 1.294s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:25:57 devstack cinder-volume[89182]: INFO cinder.volume.manager [req-515eb61b-3e5e-487d-bcb0-5ae31f4b3219 req-e975bf6a-5721-4a32-a5ec-d98eea4524c6 tempest-TestStampPattern-418584557 None] Terminate volume connection completed successfully. Jul 31 12:25:57 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [req-515eb61b-3e5e-487d-bcb0-5ae31f4b3219 req-e975bf6a-5721-4a32-a5ec-d98eea4524c6 tempest-TestStampPattern-418584557 None] Deleting attachment b81ed211-b1fd-47e9-807d-467b69cde3f1. {{(pid=89182) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 31 12:25:57 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-80632428-f7b5-4a0c-b48d-9c93a9f61fb2 tempest-TestVolumeBootPattern-1492021642 None] Status of snapshot 9d450624-84ea-4f9a-9604-268386ba964a is now creating {{(pid=89182) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Jul 31 12:25:58 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-80632428-f7b5-4a0c-b48d-9c93a9f61fb2 tempest-TestVolumeBootPattern-1492021642 None] Status of snapshot 9d450624-84ea-4f9a-9604-268386ba964a is now creating {{(pid=89182) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Jul 31 12:25:59 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-80632428-f7b5-4a0c-b48d-9c93a9f61fb2 tempest-TestVolumeBootPattern-1492021642 None] Status of snapshot 9d450624-84ea-4f9a-9604-268386ba964a is now creating {{(pid=89182) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Jul 31 12:26:00 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-80632428-f7b5-4a0c-b48d-9c93a9f61fb2 tempest-TestVolumeBootPattern-1492021642 None] Status of snapshot 9d450624-84ea-4f9a-9604-268386ba964a is now creating {{(pid=89182) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Jul 31 12:26:01 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-80632428-f7b5-4a0c-b48d-9c93a9f61fb2 tempest-TestVolumeBootPattern-1492021642 None] Status of snapshot 9d450624-84ea-4f9a-9604-268386ba964a is now creating {{(pid=89182) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Jul 31 12:26:02 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-80632428-f7b5-4a0c-b48d-9c93a9f61fb2 tempest-TestVolumeBootPattern-1492021642 None] Status of snapshot 9d450624-84ea-4f9a-9604-268386ba964a is now creating {{(pid=89182) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Jul 31 12:26:03 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-80632428-f7b5-4a0c-b48d-9c93a9f61fb2 tempest-TestVolumeBootPattern-1492021642 None] Status of snapshot 9d450624-84ea-4f9a-9604-268386ba964a is now creating {{(pid=89182) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Jul 31 12:26:04 devstack cinder-volume[89182]: DEBUG cinder.volume.flows.manager.create_volume [None req-bfa7571c-a94c-4b6d-804d-78e765c3837f tempest-VolumeQuotasNegativeTestJSON-895794810 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89182) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 12:26:04 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-bfa7571c-a94c-4b6d-804d-78e765c3837f tempest-VolumeQuotasNegativeTestJSON-895794810 None] Flow 'volume_create_manager' (7d19d521-19b6-4a71-a393-96ed72904bcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:26:04 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-bfa7571c-a94c-4b6d-804d-78e765c3837f tempest-VolumeQuotasNegativeTestJSON-895794810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf241812-aea3-4c08-a0d6-367cb40784d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:26:04 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-bfa7571c-a94c-4b6d-804d-78e765c3837f tempest-VolumeQuotasNegativeTestJSON-895794810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf241812-aea3-4c08-a0d6-367cb40784d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:26:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1642994058',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7bc4266e-e8e6-4ff8-94c4-487b7ae17535,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec16014a4d3f49739b8302a0b66cb496',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:26:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:26:04Z,use_quota=True,user_id='dafdfbb9a0974f658c9c700239ff5b0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:26:04 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-bfa7571c-a94c-4b6d-804d-78e765c3837f tempest-VolumeQuotasNegativeTestJSON-895794810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf857da0-72a7-4965-b6d2-78ea3b000ed7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:26:04 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-bfa7571c-a94c-4b6d-804d-78e765c3837f tempest-VolumeQuotasNegativeTestJSON-895794810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf857da0-72a7-4965-b6d2-78ea3b000ed7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:26:04 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-bfa7571c-a94c-4b6d-804d-78e765c3837f tempest-VolumeQuotasNegativeTestJSON-895794810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27dc8294-a695-4a7a-adf5-2d7bf4ac53b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:26:04 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-bfa7571c-a94c-4b6d-804d-78e765c3837f tempest-VolumeQuotasNegativeTestJSON-895794810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27dc8294-a695-4a7a-adf5-2d7bf4ac53b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7bc4266e-e8e6-4ff8-94c4-487b7ae17535', 'volume_name': 'volume-7bc4266e-e8e6-4ff8-94c4-487b7ae17535', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:26:04 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-bfa7571c-a94c-4b6d-804d-78e765c3837f tempest-VolumeQuotasNegativeTestJSON-895794810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (808ecfcc-bceb-47d6-b2be-6f2c3cb1821c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:26:04 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-bfa7571c-a94c-4b6d-804d-78e765c3837f tempest-VolumeQuotasNegativeTestJSON-895794810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (808ecfcc-bceb-47d6-b2be-6f2c3cb1821c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:26:04 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-bfa7571c-a94c-4b6d-804d-78e765c3837f tempest-VolumeQuotasNegativeTestJSON-895794810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1b13c3d-f35c-4133-b3f0-55910f89c3cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:26:04 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-bfa7571c-a94c-4b6d-804d-78e765c3837f tempest-VolumeQuotasNegativeTestJSON-895794810 None] Volume 7bc4266e-e8e6-4ff8-94c4-487b7ae17535: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7bc4266e-e8e6-4ff8-94c4-487b7ae17535', 'volume_size': 1} Jul 31 12:26:04 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-bfa7571c-a94c-4b6d-804d-78e765c3837f tempest-VolumeQuotasNegativeTestJSON-895794810 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:26:04 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-80632428-f7b5-4a0c-b48d-9c93a9f61fb2 tempest-TestVolumeBootPattern-1492021642 None] Status of snapshot 9d450624-84ea-4f9a-9604-268386ba964a is now creating {{(pid=89182) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Jul 31 12:26:05 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-80632428-f7b5-4a0c-b48d-9c93a9f61fb2 tempest-TestVolumeBootPattern-1492021642 None] Status of snapshot 9d450624-84ea-4f9a-9604-268386ba964a is now creating {{(pid=89182) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Jul 31 12:26:06 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-80632428-f7b5-4a0c-b48d-9c93a9f61fb2 tempest-TestVolumeBootPattern-1492021642 None] Status of snapshot 9d450624-84ea-4f9a-9604-268386ba964a is now creating {{(pid=89182) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Jul 31 12:26:07 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-80632428-f7b5-4a0c-b48d-9c93a9f61fb2 tempest-TestVolumeBootPattern-1492021642 None] Status of snapshot 9d450624-84ea-4f9a-9604-268386ba964a is now creating {{(pid=89182) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Jul 31 12:26:09 devstack cinder-volume[89182]: DEBUG dbcounter [-] [89182] Writing DB stats cinder:SELECT=66,cinder:INSERT=19,cinder:UPDATE=37,cinder:DELETE=4 {{(pid=89182) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 12:26:09 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-80632428-f7b5-4a0c-b48d-9c93a9f61fb2 tempest-TestVolumeBootPattern-1492021642 None] Status of snapshot 9d450624-84ea-4f9a-9604-268386ba964a is now creating {{(pid=89182) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Jul 31 12:26:11 devstack cinder-volume[89182]: DEBUG dbcounter [-] [89182] Writing DB stats cinder:SELECT=67,cinder:UPDATE=52,cinder:INSERT=25,cinder:DELETE=6 {{(pid=89182) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 12:26:11 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-80632428-f7b5-4a0c-b48d-9c93a9f61fb2 tempest-TestVolumeBootPattern-1492021642 None] Status of snapshot 9d450624-84ea-4f9a-9604-268386ba964a is now creating {{(pid=89182) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Jul 31 12:26:13 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-80632428-f7b5-4a0c-b48d-9c93a9f61fb2 tempest-TestVolumeBootPattern-1492021642 None] Status of snapshot 9d450624-84ea-4f9a-9604-268386ba964a is now creating {{(pid=89182) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Jul 31 12:26:13 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-80632428-f7b5-4a0c-b48d-9c93a9f61fb2 tempest-TestVolumeBootPattern-1492021642 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 19.635s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:26:13 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-6cb15fb0-de74-417b-a221-ee7a6d135d6d tempest-GroupsV314Test-1921152939 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 18.297s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:26:13 devstack cinder-volume[89182]: INFO cinder.volume.drivers.remotefs [None req-6cb15fb0-de74-417b-a221-ee7a6d135d6d tempest-GroupsV314Test-1921152939 None] Cloning volume 1184ff71-d5d4-44aa-9aa3-96489716dc5b to volume 68077ea4-46cf-441a-899b-b05dd907f336 Jul 31 12:26:13 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-6cb15fb0-de74-417b-a221-ee7a6d135d6d tempest-GroupsV314Test-1921152939 None] Creating offline snapshot dee640c7-4c05-4d4d-880e-55286e471b25 of volume 1184ff71-d5d4-44aa-9aa3-96489716dc5b {{(pid=89182) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 31 12:26:13 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[24723599-be4f-48fd-91ff-40b98b2f2036]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:26:13 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-6cb15fb0-de74-417b-a221-ee7a6d135d6d tempest-GroupsV314Test-1921152939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-1184ff71-d5d4-44aa-9aa3-96489716dc5b {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:26:13 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-80632428-f7b5-4a0c-b48d-9c93a9f61fb2 tempest-TestVolumeBootPattern-1492021642 None] Create snapshot completed successfully Jul 31 12:26:14 devstack sudo[102783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-1184ff71-d5d4-44aa-9aa3-96489716dc5b Jul 31 12:26:14 devstack sudo[102783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:26:14 devstack sudo[102783]: pam_unix(sudo:session): session closed for user root Jul 31 12:26:14 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-6cb15fb0-de74-417b-a221-ee7a6d135d6d tempest-GroupsV314Test-1921152939 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-1184ff71-d5d4-44aa-9aa3-96489716dc5b" returned: 0 in 0.511s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:26:14 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-6cb15fb0-de74-417b-a221-ee7a6d135d6d tempest-GroupsV314Test-1921152939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-1184ff71-d5d4-44aa-9aa3-96489716dc5b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-1184ff71-d5d4-44aa-9aa3-96489716dc5b.dee640c7-4c05-4d4d-880e-55286e471b25 1G {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:26:14 devstack sudo[102789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-1184ff71-d5d4-44aa-9aa3-96489716dc5b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-1184ff71-d5d4-44aa-9aa3-96489716dc5b.dee640c7-4c05-4d4d-880e-55286e471b25 1G Jul 31 12:26:14 devstack sudo[102789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:26:14 devstack sudo[102789]: pam_unix(sudo:session): session closed for user root Jul 31 12:26:14 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-6cb15fb0-de74-417b-a221-ee7a6d135d6d tempest-GroupsV314Test-1921152939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-1184ff71-d5d4-44aa-9aa3-96489716dc5b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-1184ff71-d5d4-44aa-9aa3-96489716dc5b.dee640c7-4c05-4d4d-880e-55286e471b25 1G" returned: 0 in 0.481s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:26:14 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-6cb15fb0-de74-417b-a221-ee7a6d135d6d tempest-GroupsV314Test-1921152939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1184ff71-d5d4-44aa-9aa3-96489716dc5b -F qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-1184ff71-d5d4-44aa-9aa3-96489716dc5b.dee640c7-4c05-4d4d-880e-55286e471b25 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:26:14 devstack sudo[102796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1184ff71-d5d4-44aa-9aa3-96489716dc5b -F qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-1184ff71-d5d4-44aa-9aa3-96489716dc5b.dee640c7-4c05-4d4d-880e-55286e471b25 Jul 31 12:26:14 devstack sudo[102796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:26:15 devstack sudo[102796]: pam_unix(sudo:session): session closed for user root Jul 31 12:26:15 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-6cb15fb0-de74-417b-a221-ee7a6d135d6d tempest-GroupsV314Test-1921152939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1184ff71-d5d4-44aa-9aa3-96489716dc5b -F qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-1184ff71-d5d4-44aa-9aa3-96489716dc5b.dee640c7-4c05-4d4d-880e-55286e471b25" returned: 0 in 0.407s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:26:15 devstack cinder-volume[89182]: WARNING cinder.volume.drivers.remotefs [None req-6cb15fb0-de74-417b-a221-ee7a6d135d6d tempest-GroupsV314Test-1921152939 None] /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-1184ff71-d5d4-44aa-9aa3-96489716dc5b.dee640c7-4c05-4d4d-880e-55286e471b25 is being set with open permissions: ugo+rw: NotImplementedError Jul 31 12:26:15 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-6cb15fb0-de74-417b-a221-ee7a6d135d6d tempest-GroupsV314Test-1921152939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-1184ff71-d5d4-44aa-9aa3-96489716dc5b.dee640c7-4c05-4d4d-880e-55286e471b25 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:26:15 devstack sudo[102801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-1184ff71-d5d4-44aa-9aa3-96489716dc5b.dee640c7-4c05-4d4d-880e-55286e471b25 Jul 31 12:26:15 devstack sudo[102801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:26:15 devstack sudo[102801]: pam_unix(sudo:session): session closed for user root Jul 31 12:26:15 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-6cb15fb0-de74-417b-a221-ee7a6d135d6d tempest-GroupsV314Test-1921152939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-1184ff71-d5d4-44aa-9aa3-96489716dc5b.dee640c7-4c05-4d4d-880e-55286e471b25" returned: 0 in 0.300s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:26:15 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-6cb15fb0-de74-417b-a221-ee7a6d135d6d tempest-GroupsV314Test-1921152939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-1184ff71-d5d4-44aa-9aa3-96489716dc5b.info {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:26:15 devstack sudo[102807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-1184ff71-d5d4-44aa-9aa3-96489716dc5b.info Jul 31 12:26:15 devstack sudo[102807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:26:15 devstack sudo[102807]: pam_unix(sudo:session): session closed for user root Jul 31 12:26:15 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-6cb15fb0-de74-417b-a221-ee7a6d135d6d tempest-GroupsV314Test-1921152939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-1184ff71-d5d4-44aa-9aa3-96489716dc5b.info" returned: 0 in 0.294s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:26:15 devstack cinder-volume[89182]: WARNING cinder.volume.drivers.remotefs [None req-6cb15fb0-de74-417b-a221-ee7a6d135d6d tempest-GroupsV314Test-1921152939 None] /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-1184ff71-d5d4-44aa-9aa3-96489716dc5b.info is being set with open permissions: ugo+rw: NotImplementedError Jul 31 12:26:15 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-6cb15fb0-de74-417b-a221-ee7a6d135d6d tempest-GroupsV314Test-1921152939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-1184ff71-d5d4-44aa-9aa3-96489716dc5b.info {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:26:15 devstack sudo[102816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-1184ff71-d5d4-44aa-9aa3-96489716dc5b.info Jul 31 12:26:15 devstack sudo[102816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:26:16 devstack sudo[102816]: pam_unix(sudo:session): session closed for user root Jul 31 12:26:16 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-6cb15fb0-de74-417b-a221-ee7a6d135d6d tempest-GroupsV314Test-1921152939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-1184ff71-d5d4-44aa-9aa3-96489716dc5b.info" returned: 0 in 0.274s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:26:16 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-6cb15fb0-de74-417b-a221-ee7a6d135d6d tempest-GroupsV314Test-1921152939 None] Acquiring lock "cinder-quobyte-68077ea4-46cf-441a-899b-b05dd907f336" by "_copy_volume_from_snapshot" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:26:16 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-6cb15fb0-de74-417b-a221-ee7a6d135d6d tempest-GroupsV314Test-1921152939 None] Lock "cinder-quobyte-68077ea4-46cf-441a-899b-b05dd907f336" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:26:16 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-6cb15fb0-de74-417b-a221-ee7a6d135d6d tempest-GroupsV314Test-1921152939 None] snapshot: dee640c7-4c05-4d4d-880e-55286e471b25, volume: 68077ea4-46cf-441a-899b-b05dd907f336, {{(pid=89182) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Jul 31 12:26:16 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-6cb15fb0-de74-417b-a221-ee7a6d135d6d tempest-GroupsV314Test-1921152939 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:26:16 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-6cb15fb0-de74-417b-a221-ee7a6d135d6d tempest-GroupsV314Test-1921152939 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:26:16 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-6cb15fb0-de74-417b-a221-ee7a6d135d6d tempest-GroupsV314Test-1921152939 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:26:16 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-6cb15fb0-de74-417b-a221-ee7a6d135d6d tempest-GroupsV314Test-1921152939 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:26:16 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-6cb15fb0-de74-417b-a221-ee7a6d135d6d tempest-GroupsV314Test-1921152939 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:26:16 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[661781ed-5859-4894-8068-3f0ef94f015b]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:26:16 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-6cb15fb0-de74-417b-a221-ee7a6d135d6d tempest-GroupsV314Test-1921152939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-1184ff71-d5d4-44aa-9aa3-96489716dc5b.dee640c7-4c05-4d4d-880e-55286e471b25 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:26:16 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-983d15f7-a5e4-46db-be72-46a3f823645d tempest-TestStampPattern-418584557 None] Acquiring lock "cinder-d0066bfd-3e6d-48ac-83e6-ec47a100d768-delete_volume" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:26:16 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-983d15f7-a5e4-46db-be72-46a3f823645d tempest-TestStampPattern-418584557 None] Lock "cinder-d0066bfd-3e6d-48ac-83e6-ec47a100d768-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:26:16 devstack sudo[102819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-1184ff71-d5d4-44aa-9aa3-96489716dc5b.dee640c7-4c05-4d4d-880e-55286e471b25 Jul 31 12:26:16 devstack sudo[102819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:26:16 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-983d15f7-a5e4-46db-be72-46a3f823645d tempest-TestStampPattern-418584557 None] Acquiring lock "cinder-quobyte-d0066bfd-3e6d-48ac-83e6-ec47a100d768" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:26:16 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-983d15f7-a5e4-46db-be72-46a3f823645d tempest-TestStampPattern-418584557 None] Lock "cinder-quobyte-d0066bfd-3e6d-48ac-83e6-ec47a100d768" acquired by "delete_volume" :: waited 0.015s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:26:16 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[88f3674d-4620-46ed-bd79-0768be314307]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:26:16 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-983d15f7-a5e4-46db-be72-46a3f823645d tempest-TestStampPattern-418584557 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-d0066bfd-3e6d-48ac-83e6-ec47a100d768 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:26:16 devstack sudo[102821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-d0066bfd-3e6d-48ac-83e6-ec47a100d768 Jul 31 12:26:16 devstack sudo[102821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:26:16 devstack sudo[102819]: pam_unix(sudo:session): session closed for user root Jul 31 12:26:16 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-6cb15fb0-de74-417b-a221-ee7a6d135d6d tempest-GroupsV314Test-1921152939 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-1184ff71-d5d4-44aa-9aa3-96489716dc5b.dee640c7-4c05-4d4d-880e-55286e471b25" returned: 0 in 0.407s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:26:16 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-6cb15fb0-de74-417b-a221-ee7a6d135d6d tempest-GroupsV314Test-1921152939 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1184ff71-d5d4-44aa-9aa3-96489716dc5b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89182) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 12:26:16 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[8698f4f8-fab6-4d97-88f5-a0488dc2fc08]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:26:16 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-6cb15fb0-de74-417b-a221-ee7a6d135d6d tempest-GroupsV314Test-1921152939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-1184ff71-d5d4-44aa-9aa3-96489716dc5b {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:26:16 devstack sudo[102828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-1184ff71-d5d4-44aa-9aa3-96489716dc5b Jul 31 12:26:16 devstack sudo[102828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:26:16 devstack sudo[102821]: pam_unix(sudo:session): session closed for user root Jul 31 12:26:16 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-983d15f7-a5e4-46db-be72-46a3f823645d tempest-TestStampPattern-418584557 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-d0066bfd-3e6d-48ac-83e6-ec47a100d768" returned: 0 in 0.428s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:26:16 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-983d15f7-a5e4-46db-be72-46a3f823645d tempest-TestStampPattern-418584557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-d0066bfd-3e6d-48ac-83e6-ec47a100d768 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:26:16 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-31f62111-c70e-4f78-aa63-f1c948deaafa tempest-TestVolumeBootPattern-1492021642 None] Acquiring lock "cinder-9d450624-84ea-4f9a-9604-268386ba964a-delete_snapshot" by "delete_snapshot" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:26:16 devstack sudo[102833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-d0066bfd-3e6d-48ac-83e6-ec47a100d768 Jul 31 12:26:16 devstack sudo[102833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:26:16 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-31f62111-c70e-4f78-aa63-f1c948deaafa tempest-TestVolumeBootPattern-1492021642 None] Lock "cinder-9d450624-84ea-4f9a-9604-268386ba964a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:26:16 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-31f62111-c70e-4f78-aa63-f1c948deaafa tempest-TestVolumeBootPattern-1492021642 None] Acquiring lock "cinder-quobyte-059c514e-3928-498a-9f8e-384f95a18a7c" by "delete_snapshot" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:26:16 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-31f62111-c70e-4f78-aa63-f1c948deaafa tempest-TestVolumeBootPattern-1492021642 None] Lock "cinder-quobyte-059c514e-3928-498a-9f8e-384f95a18a7c" acquired by "delete_snapshot" :: waited 0.017s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:26:16 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-31f62111-c70e-4f78-aa63-f1c948deaafa tempest-TestVolumeBootPattern-1492021642 None] Acquiring lock "cinder-quobyte-9d450624-84ea-4f9a-9604-268386ba964a" by "_delete_snapshot" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:26:16 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-31f62111-c70e-4f78-aa63-f1c948deaafa tempest-TestVolumeBootPattern-1492021642 None] Lock "cinder-quobyte-9d450624-84ea-4f9a-9604-268386ba964a" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:26:16 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-31f62111-c70e-4f78-aa63-f1c948deaafa tempest-TestVolumeBootPattern-1492021642 None] Deleting online snapshot 9d450624-84ea-4f9a-9604-268386ba964a of volume 059c514e-3928-498a-9f8e-384f95a18a7c {{(pid=89182) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 31 12:26:16 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-31f62111-c70e-4f78-aa63-f1c948deaafa tempest-TestVolumeBootPattern-1492021642 None] snapshot_file for this snap is: volume-059c514e-3928-498a-9f8e-384f95a18a7c.9d450624-84ea-4f9a-9604-268386ba964a {{(pid=89182) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 31 12:26:17 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[dac90cb0-7394-4754-b379-c0dd6a22c017]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:26:17 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-31f62111-c70e-4f78-aa63-f1c948deaafa tempest-TestVolumeBootPattern-1492021642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-059c514e-3928-498a-9f8e-384f95a18a7c.9d450624-84ea-4f9a-9604-268386ba964a {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:26:17 devstack sudo[102828]: pam_unix(sudo:session): session closed for user root Jul 31 12:26:17 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-6cb15fb0-de74-417b-a221-ee7a6d135d6d tempest-GroupsV314Test-1921152939 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-1184ff71-d5d4-44aa-9aa3-96489716dc5b" returned: 0 in 0.454s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:26:17 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-6cb15fb0-de74-417b-a221-ee7a6d135d6d tempest-GroupsV314Test-1921152939 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-1184ff71-d5d4-44aa-9aa3-96489716dc5b {{(pid=89182) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Jul 31 12:26:17 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-6cb15fb0-de74-417b-a221-ee7a6d135d6d tempest-GroupsV314Test-1921152939 None] Creating direct copy from snapshot {{(pid=89182) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Jul 31 12:26:17 devstack cinder-volume[89182]: DEBUG cinder.utils [None req-6cb15fb0-de74-417b-a221-ee7a6d135d6d tempest-GroupsV314Test-1921152939 None] Path /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-68077ea4-46cf-441a-899b-b05dd907f336 not found in is_blk_device check {{(pid=89182) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 31 12:26:17 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-6cb15fb0-de74-417b-a221-ee7a6d135d6d tempest-GroupsV314Test-1921152939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-1184ff71-d5d4-44aa-9aa3-96489716dc5b /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-68077ea4-46cf-441a-899b-b05dd907f336 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:26:17 devstack sudo[102835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-059c514e-3928-498a-9f8e-384f95a18a7c.9d450624-84ea-4f9a-9604-268386ba964a Jul 31 12:26:17 devstack sudo[102835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:26:17 devstack sudo[102840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-1184ff71-d5d4-44aa-9aa3-96489716dc5b /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-68077ea4-46cf-441a-899b-b05dd907f336 Jul 31 12:26:17 devstack sudo[102840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:26:17 devstack sudo[102833]: pam_unix(sudo:session): session closed for user root Jul 31 12:26:17 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-983d15f7-a5e4-46db-be72-46a3f823645d tempest-TestStampPattern-418584557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-d0066bfd-3e6d-48ac-83e6-ec47a100d768" returned: 0 in 0.282s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:26:17 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-983d15f7-a5e4-46db-be72-46a3f823645d tempest-TestStampPattern-418584557 None] Lock "cinder-quobyte-d0066bfd-3e6d-48ac-83e6-ec47a100d768" released by "delete_volume" :: held 0.755s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:26:17 devstack cinder-volume[89182]: DEBUG cinder.quota [None req-983d15f7-a5e4-46db-be72-46a3f823645d tempest-TestStampPattern-418584557 None] Created reservations ['f6427721-9dfb-4eff-84af-9b4209a025fb', 'a3951a7e-e795-443a-b948-0f073bccbae0', '045eec19-6854-458d-bf10-5917956766c8', '8e0ffdbb-ec5e-496b-aa06-08daab3b4601'] {{(pid=89182) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 12:26:17 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-983d15f7-a5e4-46db-be72-46a3f823645d tempest-TestStampPattern-418584557 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:26:17 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-983d15f7-a5e4-46db-be72-46a3f823645d tempest-TestStampPattern-418584557 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:26:17 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-983d15f7-a5e4-46db-be72-46a3f823645d tempest-TestStampPattern-418584557 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:26:17 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-983d15f7-a5e4-46db-be72-46a3f823645d tempest-TestStampPattern-418584557 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:26:17 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-983d15f7-a5e4-46db-be72-46a3f823645d tempest-TestStampPattern-418584557 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:26:17 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-983d15f7-a5e4-46db-be72-46a3f823645d tempest-TestStampPattern-418584557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:26:17 devstack sudo[102843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 Jul 31 12:26:17 devstack sudo[102843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:26:17 devstack sudo[102835]: pam_unix(sudo:session): session closed for user root Jul 31 12:26:17 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-31f62111-c70e-4f78-aa63-f1c948deaafa tempest-TestVolumeBootPattern-1492021642 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-059c514e-3928-498a-9f8e-384f95a18a7c.9d450624-84ea-4f9a-9604-268386ba964a" returned: 0 in 0.425s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:26:17 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-31f62111-c70e-4f78-aa63-f1c948deaafa tempest-TestVolumeBootPattern-1492021642 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-059c514e-3928-498a-9f8e-384f95a18a7c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89182) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 12:26:17 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[913678bf-7c72-4baa-8089-bb6f4728e335]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:26:17 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-31f62111-c70e-4f78-aa63-f1c948deaafa tempest-TestVolumeBootPattern-1492021642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-059c514e-3928-498a-9f8e-384f95a18a7c.94a7a129-d2b7-4383-b472-bf34f8cff987 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:26:17 devstack sudo[102851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-059c514e-3928-498a-9f8e-384f95a18a7c.94a7a129-d2b7-4383-b472-bf34f8cff987 Jul 31 12:26:17 devstack sudo[102851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:26:17 devstack sudo[102843]: pam_unix(sudo:session): session closed for user root Jul 31 12:26:17 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-983d15f7-a5e4-46db-be72-46a3f823645d tempest-TestStampPattern-418584557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2" returned: 0 in 0.319s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:26:17 devstack cinder-volume[89182]: DEBUG cinder.manager [None req-983d15f7-a5e4-46db-be72-46a3f823645d tempest-TestStampPattern-418584557 None] Notifying Schedulers of capabilities ... {{(pid=89182) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 12:26:17 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-983d15f7-a5e4-46db-be72-46a3f823645d tempest-TestStampPattern-418584557 None] Deleted volume successfully. Jul 31 12:26:17 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-983d15f7-a5e4-46db-be72-46a3f823645d tempest-TestStampPattern-418584557 None] Lock "cinder-d0066bfd-3e6d-48ac-83e6-ec47a100d768-delete_volume" released by "delete_volume" :: held 1.328s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:26:18 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-5c406bc5-435f-4c2a-9761-5c8b69b21ac5 tempest-TestStampPattern-418584557 None] Acquiring lock "cinder-d22d4adf-234b-4a28-a12a-373a8bfa7db1-delete_snapshot" by "delete_snapshot" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:26:18 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-5c406bc5-435f-4c2a-9761-5c8b69b21ac5 tempest-TestStampPattern-418584557 None] Lock "cinder-d22d4adf-234b-4a28-a12a-373a8bfa7db1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.041s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:26:18 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-5c406bc5-435f-4c2a-9761-5c8b69b21ac5 tempest-TestStampPattern-418584557 None] Acquiring lock "cinder-quobyte-0cea5331-ddf1-4068-bee4-c6518e039abc" by "delete_snapshot" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:26:18 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-5c406bc5-435f-4c2a-9761-5c8b69b21ac5 tempest-TestStampPattern-418584557 None] Lock "cinder-quobyte-0cea5331-ddf1-4068-bee4-c6518e039abc" acquired by "delete_snapshot" :: waited 0.037s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:26:18 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-5c406bc5-435f-4c2a-9761-5c8b69b21ac5 tempest-TestStampPattern-418584557 None] Acquiring lock "cinder-quobyte-d22d4adf-234b-4a28-a12a-373a8bfa7db1" by "_delete_snapshot" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:26:18 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-5c406bc5-435f-4c2a-9761-5c8b69b21ac5 tempest-TestStampPattern-418584557 None] Lock "cinder-quobyte-d22d4adf-234b-4a28-a12a-373a8bfa7db1" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:26:18 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-5c406bc5-435f-4c2a-9761-5c8b69b21ac5 tempest-TestStampPattern-418584557 None] Deleting offline snapshot d22d4adf-234b-4a28-a12a-373a8bfa7db1 of volume 0cea5331-ddf1-4068-bee4-c6518e039abc {{(pid=89182) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 31 12:26:18 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-5c406bc5-435f-4c2a-9761-5c8b69b21ac5 tempest-TestStampPattern-418584557 None] snapshot_file for this snap is: volume-0cea5331-ddf1-4068-bee4-c6518e039abc.d22d4adf-234b-4a28-a12a-373a8bfa7db1 {{(pid=89182) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 31 12:26:18 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[18019626-f542-4121-bd23-65501b3ed7ee]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:26:18 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-5c406bc5-435f-4c2a-9761-5c8b69b21ac5 tempest-TestStampPattern-418584557 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0cea5331-ddf1-4068-bee4-c6518e039abc.d22d4adf-234b-4a28-a12a-373a8bfa7db1 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:26:18 devstack sudo[102851]: pam_unix(sudo:session): session closed for user root Jul 31 12:26:18 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-31f62111-c70e-4f78-aa63-f1c948deaafa tempest-TestVolumeBootPattern-1492021642 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-059c514e-3928-498a-9f8e-384f95a18a7c.94a7a129-d2b7-4383-b472-bf34f8cff987" returned: 0 in 0.932s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:26:18 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-31f62111-c70e-4f78-aa63-f1c948deaafa tempest-TestVolumeBootPattern-1492021642 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-059c514e-3928-498a-9f8e-384f95a18a7c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89182) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 12:26:18 devstack cinder-volume[89182]: DEBUG cinder.compute.nova [None req-31f62111-c70e-4f78-aa63-f1c948deaafa tempest-TestVolumeBootPattern-1492021642 None] Creating Keystone auth plugin from conf {{(pid=89182) novaclient /opt/stack/cinder/cinder/compute/nova.py:99}} Jul 31 12:26:18 devstack sudo[102864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0cea5331-ddf1-4068-bee4-c6518e039abc.d22d4adf-234b-4a28-a12a-373a8bfa7db1 Jul 31 12:26:18 devstack sudo[102864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:26:18 devstack cinder-volume[89182]: DEBUG novaclient.v2.client [None req-31f62111-c70e-4f78-aa63-f1c948deaafa tempest-TestVolumeBootPattern-1492021642 None] REQ: curl -g -i -X DELETE http://192.168.122.21/compute/v2.1/os-assisted-volume-snapshots/9d450624-84ea-4f9a-9604-268386ba964a?delete_info={"file_to_merge": "volume-059c514e-3928-498a-9f8e-384f95a18a7c.32d8c5b8-3d64-486d-b503-068001d9631e", "merge_target_file": null, "type": "qcow2", "volume_id": "059c514e-3928-498a-9f8e-384f95a18a7c"} -H "Accept: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}7ab1b3b2e722608cc5c9ee191d0573dae506108d2bf1a6ab9fbd3a6f32ab2b63" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-31f62111-c70e-4f78-aa63-f1c948deaafa" -H "X-Service-Token: {SHA256}02a8645ba5bc7d3f7d0a93a9d02f784466607492168e4b335483720fa1daddd6" {{(pid=89182) _http_log_request /opt/stack/data/venv/lib/python3.12/site-packages/keystoneauth1/session.py:575}} Jul 31 12:26:19 devstack sudo[102864]: pam_unix(sudo:session): session closed for user root Jul 31 12:26:19 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-5c406bc5-435f-4c2a-9761-5c8b69b21ac5 tempest-TestStampPattern-418584557 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0cea5331-ddf1-4068-bee4-c6518e039abc.d22d4adf-234b-4a28-a12a-373a8bfa7db1" returned: 0 in 1.076s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:26:19 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-5c406bc5-435f-4c2a-9761-5c8b69b21ac5 tempest-TestStampPattern-418584557 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0cea5331-ddf1-4068-bee4-c6518e039abc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89182) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 12:26:19 devstack cinder-volume[89182]: DEBUG novaclient.v2.client [None req-31f62111-c70e-4f78-aa63-f1c948deaafa tempest-TestVolumeBootPattern-1492021642 None] RESP: [204] Connection: close Content-Type: application/json Date: Fri, 31 Jul 2026 10:26:18 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.58 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-7ae46d04-e0e8-4019-88fe-fa848c7d74e6 x-openstack-request-id: req-7ae46d04-e0e8-4019-88fe-fa848c7d74e6 {{(pid=89182) _http_log_response /opt/stack/data/venv/lib/python3.12/site-packages/keystoneauth1/session.py:616}} Jul 31 12:26:19 devstack cinder-volume[89182]: DEBUG novaclient.v2.client [None req-31f62111-c70e-4f78-aa63-f1c948deaafa tempest-TestVolumeBootPattern-1492021642 None] DELETE call to compute for http://192.168.122.21/compute/v2.1/os-assisted-volume-snapshots/9d450624-84ea-4f9a-9604-268386ba964a?delete_info=%7B%22file_to_merge%22:%20%22volume-059c514e-3928-498a-9f8e-384f95a18a7c.32d8c5b8-3d64-486d-b503-068001d9631e%22,%20%22merge_target_file%22:%20null,%20%22type%22:%20%22qcow2%22,%20%22volume_id%22:%20%22059c514e-3928-498a-9f8e-384f95a18a7c%22%7D used request id req-7ae46d04-e0e8-4019-88fe-fa848c7d74e6 {{(pid=89182) request /opt/stack/data/venv/lib/python3.12/site-packages/keystoneauth1/session.py:1076}} Jul 31 12:26:19 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[dee85c59-c26d-47b9-86b9-4be12e967cad]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:26:19 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-5c406bc5-435f-4c2a-9761-5c8b69b21ac5 tempest-TestStampPattern-418584557 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0cea5331-ddf1-4068-bee4-c6518e039abc {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:26:19 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-31f62111-c70e-4f78-aa63-f1c948deaafa tempest-TestVolumeBootPattern-1492021642 None] status of snapshot 9d450624-84ea-4f9a-9604-268386ba964a is still "deleting"... waiting {{(pid=89182) _nova_assisted_vol_snap_delete /opt/stack/cinder/cinder/volume/drivers/remotefs.py:2054}} Jul 31 12:26:19 devstack sudo[102871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0cea5331-ddf1-4068-bee4-c6518e039abc Jul 31 12:26:19 devstack sudo[102871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:26:20 devstack sudo[102871]: pam_unix(sudo:session): session closed for user root Jul 31 12:26:20 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-5c406bc5-435f-4c2a-9761-5c8b69b21ac5 tempest-TestStampPattern-418584557 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0cea5331-ddf1-4068-bee4-c6518e039abc" returned: 0 in 0.977s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:26:20 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-5c406bc5-435f-4c2a-9761-5c8b69b21ac5 tempest-TestStampPattern-418584557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0cea5331-ddf1-4068-bee4-c6518e039abc.d22d4adf-234b-4a28-a12a-373a8bfa7db1 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:26:20 devstack sudo[102883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0cea5331-ddf1-4068-bee4-c6518e039abc.d22d4adf-234b-4a28-a12a-373a8bfa7db1 Jul 31 12:26:20 devstack sudo[102883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:26:20 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-31f62111-c70e-4f78-aa63-f1c948deaafa tempest-TestVolumeBootPattern-1492021642 None] status of snapshot 9d450624-84ea-4f9a-9604-268386ba964a is still "deleting"... waiting {{(pid=89182) _nova_assisted_vol_snap_delete /opt/stack/cinder/cinder/volume/drivers/remotefs.py:2054}} Jul 31 12:26:21 devstack sudo[102883]: pam_unix(sudo:session): session closed for user root Jul 31 12:26:21 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-5c406bc5-435f-4c2a-9761-5c8b69b21ac5 tempest-TestStampPattern-418584557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0cea5331-ddf1-4068-bee4-c6518e039abc.d22d4adf-234b-4a28-a12a-373a8bfa7db1" returned: 0 in 0.806s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:26:21 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-5c406bc5-435f-4c2a-9761-5c8b69b21ac5 tempest-TestStampPattern-418584557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0cea5331-ddf1-4068-bee4-c6518e039abc.d22d4adf-234b-4a28-a12a-373a8bfa7db1 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:26:21 devstack sudo[102888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0cea5331-ddf1-4068-bee4-c6518e039abc.d22d4adf-234b-4a28-a12a-373a8bfa7db1 Jul 31 12:26:21 devstack sudo[102888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:26:21 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-31f62111-c70e-4f78-aa63-f1c948deaafa tempest-TestVolumeBootPattern-1492021642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-059c514e-3928-498a-9f8e-384f95a18a7c.94a7a129-d2b7-4383-b472-bf34f8cff987 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:26:21 devstack sudo[102888]: pam_unix(sudo:session): session closed for user root Jul 31 12:26:21 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-5c406bc5-435f-4c2a-9761-5c8b69b21ac5 tempest-TestStampPattern-418584557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0cea5331-ddf1-4068-bee4-c6518e039abc.d22d4adf-234b-4a28-a12a-373a8bfa7db1" returned: 0 in 0.498s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:26:21 devstack sudo[102891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-059c514e-3928-498a-9f8e-384f95a18a7c.94a7a129-d2b7-4383-b472-bf34f8cff987 Jul 31 12:26:21 devstack sudo[102891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:26:21 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-5c406bc5-435f-4c2a-9761-5c8b69b21ac5 tempest-TestStampPattern-418584557 None] Lock "cinder-quobyte-d22d4adf-234b-4a28-a12a-373a8bfa7db1" released by "_delete_snapshot" :: held 3.687s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:26:21 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-5c406bc5-435f-4c2a-9761-5c8b69b21ac5 tempest-TestStampPattern-418584557 None] Lock "cinder-quobyte-0cea5331-ddf1-4068-bee4-c6518e039abc" released by "delete_snapshot" :: held 3.733s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:26:21 devstack cinder-volume[89182]: DEBUG oslo_service.periodic_task [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89182) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 31 12:26:21 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:26:21 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:26:21 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:26:21 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:26:21 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:26:21 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:26:22 devstack sudo[102893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 Jul 31 12:26:22 devstack sudo[102893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:26:22 devstack cinder-volume[89182]: DEBUG cinder.quota [None req-5c406bc5-435f-4c2a-9761-5c8b69b21ac5 tempest-TestStampPattern-418584557 None] Created reservations ['c53cf6c1-aa01-4faf-84ca-341f1819c9ec', '1c897811-c97c-49fe-9378-1eadda8de7b0', '1fb31138-cc93-4896-a596-c6a3c023c920', 'e2340d7f-83b2-4d7f-92f9-b8d14ec2133f'] {{(pid=89182) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 12:26:22 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-5c406bc5-435f-4c2a-9761-5c8b69b21ac5 tempest-TestStampPattern-418584557 None] Delete snapshot completed successfully. Jul 31 12:26:22 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-5c406bc5-435f-4c2a-9761-5c8b69b21ac5 tempest-TestStampPattern-418584557 None] Lock "cinder-d22d4adf-234b-4a28-a12a-373a8bfa7db1-delete_snapshot" released by "delete_snapshot" :: held 4.234s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:26:22 devstack sudo[102891]: pam_unix(sudo:session): session closed for user root Jul 31 12:26:22 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-31f62111-c70e-4f78-aa63-f1c948deaafa tempest-TestVolumeBootPattern-1492021642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-059c514e-3928-498a-9f8e-384f95a18a7c.94a7a129-d2b7-4383-b472-bf34f8cff987" returned: 0 in 0.804s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:26:22 devstack sudo[102893]: pam_unix(sudo:session): session closed for user root Jul 31 12:26:22 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-31f62111-c70e-4f78-aa63-f1c948deaafa tempest-TestVolumeBootPattern-1492021642 None] Lock "cinder-quobyte-9d450624-84ea-4f9a-9604-268386ba964a" released by "_delete_snapshot" :: held 5.629s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:26:22 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-31f62111-c70e-4f78-aa63-f1c948deaafa tempest-TestVolumeBootPattern-1492021642 None] Lock "cinder-quobyte-059c514e-3928-498a-9f8e-384f95a18a7c" released by "delete_snapshot" :: held 5.676s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:26:22 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2" returned: 0 in 0.629s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:26:22 devstack cinder-volume[89182]: DEBUG cinder.manager [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] Notifying Schedulers of capabilities ... {{(pid=89182) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 12:26:22 devstack cinder-volume[89182]: DEBUG oslo_service.periodic_task [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] Running periodic task VolumeManager._thread_info {{(pid=89182) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 31 12:26:22 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] thread count: 28 {{(pid=89182) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 31 12:26:22 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] thread info: [<_MainThread(MainThread, started 136154603720832)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=89182) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 31 12:26:22 devstack sudo[102840]: pam_unix(sudo:session): session closed for user root Jul 31 12:26:22 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-6cb15fb0-de74-417b-a221-ee7a6d135d6d tempest-GroupsV314Test-1921152939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-1184ff71-d5d4-44aa-9aa3-96489716dc5b /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-68077ea4-46cf-441a-899b-b05dd907f336" returned: 0 in 5.558s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:26:22 devstack cinder-volume[89182]: DEBUG cinder.image.image_utils [None req-6cb15fb0-de74-417b-a221-ee7a6d135d6d tempest-GroupsV314Test-1921152939 None] Image conversion details: src /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-1184ff71-d5d4-44aa-9aa3-96489716dc5b, size 1024.00 MB, duration 5.56 sec, destination /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-68077ea4-46cf-441a-899b-b05dd907f336 {{(pid=89182) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 31 12:26:22 devstack cinder-volume[89182]: INFO cinder.image.image_utils [None req-6cb15fb0-de74-417b-a221-ee7a6d135d6d tempest-GroupsV314Test-1921152939 None] Converted 1024.00 MB image at 184.21 MB/s Jul 31 12:26:22 devstack cinder-volume[89182]: WARNING cinder.volume.drivers.remotefs [None req-6cb15fb0-de74-417b-a221-ee7a6d135d6d tempest-GroupsV314Test-1921152939 None] /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-68077ea4-46cf-441a-899b-b05dd907f336 is being set with open permissions: ugo+rw: NotImplementedError Jul 31 12:26:22 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-6cb15fb0-de74-417b-a221-ee7a6d135d6d tempest-GroupsV314Test-1921152939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-68077ea4-46cf-441a-899b-b05dd907f336 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:26:22 devstack cinder-volume[89182]: DEBUG cinder.quota [None req-31f62111-c70e-4f78-aa63-f1c948deaafa tempest-TestVolumeBootPattern-1492021642 None] Created reservations ['e16129e4-77b8-4749-8e24-c790cb1af65a', '5c4de56f-2077-4419-90eb-f03a0c63802a', '5d520b10-6cde-4b9b-a7a6-2b46ba6df317', '3a3aeff0-a9de-4766-8efe-5e6f34b1dd40'] {{(pid=89182) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 12:26:22 devstack sudo[102897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-68077ea4-46cf-441a-899b-b05dd907f336 Jul 31 12:26:22 devstack sudo[102897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:26:22 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-31f62111-c70e-4f78-aa63-f1c948deaafa tempest-TestVolumeBootPattern-1492021642 None] Delete snapshot completed successfully. Jul 31 12:26:22 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-31f62111-c70e-4f78-aa63-f1c948deaafa tempest-TestVolumeBootPattern-1492021642 None] Lock "cinder-9d450624-84ea-4f9a-9604-268386ba964a-delete_snapshot" released by "delete_snapshot" :: held 5.868s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:26:22 devstack sudo[102897]: pam_unix(sudo:session): session closed for user root Jul 31 12:26:22 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-6cb15fb0-de74-417b-a221-ee7a6d135d6d tempest-GroupsV314Test-1921152939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-68077ea4-46cf-441a-899b-b05dd907f336" returned: 0 in 0.249s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:26:22 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-6cb15fb0-de74-417b-a221-ee7a6d135d6d tempest-GroupsV314Test-1921152939 None] Lock "cinder-quobyte-68077ea4-46cf-441a-899b-b05dd907f336" released by "_copy_volume_from_snapshot" :: held 6.746s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:26:22 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-6cb15fb0-de74-417b-a221-ee7a6d135d6d tempest-GroupsV314Test-1921152939 None] Acquiring lock "cinder-quobyte-dee640c7-4c05-4d4d-880e-55286e471b25" by "_delete_snapshot" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:26:22 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-6cb15fb0-de74-417b-a221-ee7a6d135d6d tempest-GroupsV314Test-1921152939 None] Lock "cinder-quobyte-dee640c7-4c05-4d4d-880e-55286e471b25" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:26:22 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-6cb15fb0-de74-417b-a221-ee7a6d135d6d tempest-GroupsV314Test-1921152939 None] Deleting offline snapshot dee640c7-4c05-4d4d-880e-55286e471b25 of volume 1184ff71-d5d4-44aa-9aa3-96489716dc5b {{(pid=89182) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 31 12:26:22 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-6cb15fb0-de74-417b-a221-ee7a6d135d6d tempest-GroupsV314Test-1921152939 None] snapshot_file for this snap is: volume-1184ff71-d5d4-44aa-9aa3-96489716dc5b.dee640c7-4c05-4d4d-880e-55286e471b25 {{(pid=89182) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 31 12:26:23 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d2a7b3a-beb0-442b-9663-85355a367dc8]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:26:23 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-6cb15fb0-de74-417b-a221-ee7a6d135d6d tempest-GroupsV314Test-1921152939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-1184ff71-d5d4-44aa-9aa3-96489716dc5b.dee640c7-4c05-4d4d-880e-55286e471b25 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:26:23 devstack sudo[102900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-1184ff71-d5d4-44aa-9aa3-96489716dc5b.dee640c7-4c05-4d4d-880e-55286e471b25 Jul 31 12:26:23 devstack sudo[102900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:26:23 devstack sudo[102900]: pam_unix(sudo:session): session closed for user root Jul 31 12:26:23 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-6cb15fb0-de74-417b-a221-ee7a6d135d6d tempest-GroupsV314Test-1921152939 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-1184ff71-d5d4-44aa-9aa3-96489716dc5b.dee640c7-4c05-4d4d-880e-55286e471b25" returned: 0 in 0.400s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:26:23 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-6cb15fb0-de74-417b-a221-ee7a6d135d6d tempest-GroupsV314Test-1921152939 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1184ff71-d5d4-44aa-9aa3-96489716dc5b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89182) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 12:26:23 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[d215c599-55d0-491a-baa1-e72e9713592e]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:26:23 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-6cb15fb0-de74-417b-a221-ee7a6d135d6d tempest-GroupsV314Test-1921152939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-1184ff71-d5d4-44aa-9aa3-96489716dc5b {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:26:23 devstack sudo[102907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-1184ff71-d5d4-44aa-9aa3-96489716dc5b Jul 31 12:26:23 devstack sudo[102907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:26:23 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-57315f91-d4d0-4251-8392-0f59524efc6c tempest-TestVolumeBootPattern-1492021642 None] Acquiring lock "cinder-94a7a129-d2b7-4383-b472-bf34f8cff987-delete_snapshot" by "delete_snapshot" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:26:23 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-57315f91-d4d0-4251-8392-0f59524efc6c tempest-TestVolumeBootPattern-1492021642 None] Lock "cinder-94a7a129-d2b7-4383-b472-bf34f8cff987-delete_snapshot" acquired by "delete_snapshot" :: waited 0.051s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:26:23 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-57315f91-d4d0-4251-8392-0f59524efc6c tempest-TestVolumeBootPattern-1492021642 None] Acquiring lock "cinder-quobyte-059c514e-3928-498a-9f8e-384f95a18a7c" by "delete_snapshot" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:26:23 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-57315f91-d4d0-4251-8392-0f59524efc6c tempest-TestVolumeBootPattern-1492021642 None] Lock "cinder-quobyte-059c514e-3928-498a-9f8e-384f95a18a7c" acquired by "delete_snapshot" :: waited 0.027s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:26:23 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-57315f91-d4d0-4251-8392-0f59524efc6c tempest-TestVolumeBootPattern-1492021642 None] Acquiring lock "cinder-quobyte-94a7a129-d2b7-4383-b472-bf34f8cff987" by "_delete_snapshot" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:26:23 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-57315f91-d4d0-4251-8392-0f59524efc6c tempest-TestVolumeBootPattern-1492021642 None] Lock "cinder-quobyte-94a7a129-d2b7-4383-b472-bf34f8cff987" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:26:23 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-57315f91-d4d0-4251-8392-0f59524efc6c tempest-TestVolumeBootPattern-1492021642 None] Deleting online snapshot 94a7a129-d2b7-4383-b472-bf34f8cff987 of volume 059c514e-3928-498a-9f8e-384f95a18a7c {{(pid=89182) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 31 12:26:23 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-57315f91-d4d0-4251-8392-0f59524efc6c tempest-TestVolumeBootPattern-1492021642 None] snapshot_file for this snap is: volume-059c514e-3928-498a-9f8e-384f95a18a7c.9d450624-84ea-4f9a-9604-268386ba964a {{(pid=89182) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 31 12:26:23 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c7cf98e-bdb2-4658-8992-e2cad1f16ea9]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:26:23 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-57315f91-d4d0-4251-8392-0f59524efc6c tempest-TestVolumeBootPattern-1492021642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-059c514e-3928-498a-9f8e-384f95a18a7c.9d450624-84ea-4f9a-9604-268386ba964a {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:26:24 devstack sudo[102914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-059c514e-3928-498a-9f8e-384f95a18a7c.9d450624-84ea-4f9a-9604-268386ba964a Jul 31 12:26:24 devstack sudo[102914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:26:24 devstack sudo[102907]: pam_unix(sudo:session): session closed for user root Jul 31 12:26:24 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-6cb15fb0-de74-417b-a221-ee7a6d135d6d tempest-GroupsV314Test-1921152939 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-1184ff71-d5d4-44aa-9aa3-96489716dc5b" returned: 0 in 0.749s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:26:24 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-6cb15fb0-de74-417b-a221-ee7a6d135d6d tempest-GroupsV314Test-1921152939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-1184ff71-d5d4-44aa-9aa3-96489716dc5b.dee640c7-4c05-4d4d-880e-55286e471b25 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:26:24 devstack sudo[102920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-1184ff71-d5d4-44aa-9aa3-96489716dc5b.dee640c7-4c05-4d4d-880e-55286e471b25 Jul 31 12:26:24 devstack sudo[102920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:26:24 devstack sudo[102914]: pam_unix(sudo:session): session closed for user root Jul 31 12:26:24 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-57315f91-d4d0-4251-8392-0f59524efc6c tempest-TestVolumeBootPattern-1492021642 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-059c514e-3928-498a-9f8e-384f95a18a7c.9d450624-84ea-4f9a-9604-268386ba964a" returned: 0 in 0.625s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:26:24 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-57315f91-d4d0-4251-8392-0f59524efc6c tempest-TestVolumeBootPattern-1492021642 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-059c514e-3928-498a-9f8e-384f95a18a7c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89182) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 12:26:24 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[63589b26-24fd-4c7d-9320-ab5154d53dce]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:26:24 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-57315f91-d4d0-4251-8392-0f59524efc6c tempest-TestVolumeBootPattern-1492021642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-059c514e-3928-498a-9f8e-384f95a18a7c.32d8c5b8-3d64-486d-b503-068001d9631e {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:26:24 devstack sudo[102920]: pam_unix(sudo:session): session closed for user root Jul 31 12:26:24 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-6cb15fb0-de74-417b-a221-ee7a6d135d6d tempest-GroupsV314Test-1921152939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-1184ff71-d5d4-44aa-9aa3-96489716dc5b.dee640c7-4c05-4d4d-880e-55286e471b25" returned: 0 in 0.545s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:26:24 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-6cb15fb0-de74-417b-a221-ee7a6d135d6d tempest-GroupsV314Test-1921152939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-1184ff71-d5d4-44aa-9aa3-96489716dc5b.dee640c7-4c05-4d4d-880e-55286e471b25 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:26:24 devstack sudo[102948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-059c514e-3928-498a-9f8e-384f95a18a7c.32d8c5b8-3d64-486d-b503-068001d9631e Jul 31 12:26:24 devstack sudo[102948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:26:24 devstack sudo[102950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-1184ff71-d5d4-44aa-9aa3-96489716dc5b.dee640c7-4c05-4d4d-880e-55286e471b25 Jul 31 12:26:24 devstack sudo[102950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:26:25 devstack sudo[102950]: pam_unix(sudo:session): session closed for user root Jul 31 12:26:25 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-6cb15fb0-de74-417b-a221-ee7a6d135d6d tempest-GroupsV314Test-1921152939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-1184ff71-d5d4-44aa-9aa3-96489716dc5b.dee640c7-4c05-4d4d-880e-55286e471b25" returned: 0 in 0.289s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:26:25 devstack sudo[102948]: pam_unix(sudo:session): session closed for user root Jul 31 12:26:25 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-57315f91-d4d0-4251-8392-0f59524efc6c tempest-TestVolumeBootPattern-1492021642 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-059c514e-3928-498a-9f8e-384f95a18a7c.32d8c5b8-3d64-486d-b503-068001d9631e" returned: 0 in 0.441s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:26:25 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-57315f91-d4d0-4251-8392-0f59524efc6c tempest-TestVolumeBootPattern-1492021642 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-059c514e-3928-498a-9f8e-384f95a18a7c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89182) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 12:26:25 devstack cinder-volume[89182]: DEBUG cinder.compute.nova [None req-57315f91-d4d0-4251-8392-0f59524efc6c tempest-TestVolumeBootPattern-1492021642 None] Creating Keystone auth plugin from conf {{(pid=89182) novaclient /opt/stack/cinder/cinder/compute/nova.py:99}} Jul 31 12:26:25 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-6cb15fb0-de74-417b-a221-ee7a6d135d6d tempest-GroupsV314Test-1921152939 None] Lock "cinder-quobyte-dee640c7-4c05-4d4d-880e-55286e471b25" released by "_delete_snapshot" :: held 2.125s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:26:25 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-6cb15fb0-de74-417b-a221-ee7a6d135d6d tempest-GroupsV314Test-1921152939 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 11.401s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:26:25 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-bfa7571c-a94c-4b6d-804d-78e765c3837f tempest-VolumeQuotasNegativeTestJSON-895794810 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 20.695s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:26:25 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-bfa7571c-a94c-4b6d-804d-78e765c3837f tempest-VolumeQuotasNegativeTestJSON-895794810 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:26:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1642994058',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7bc4266e-e8e6-4ff8-94c4-487b7ae17535,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec16014a4d3f49739b8302a0b66cb496',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:26:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:26:04Z,use_quota=True,user_id='dafdfbb9a0974f658c9c700239ff5b0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)}" {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 12:26:25 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-bfa7571c-a94c-4b6d-804d-78e765c3837f tempest-VolumeQuotasNegativeTestJSON-895794810 None] Creating volume 7bc4266e-e8e6-4ff8-94c4-487b7ae17535 {{(pid=89182) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 12:26:25 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-bfa7571c-a94c-4b6d-804d-78e765c3837f tempest-VolumeQuotasNegativeTestJSON-895794810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:26:25 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-bfa7571c-a94c-4b6d-804d-78e765c3837f tempest-VolumeQuotasNegativeTestJSON-895794810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:26:25 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-bfa7571c-a94c-4b6d-804d-78e765c3837f tempest-VolumeQuotasNegativeTestJSON-895794810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:26:25 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-bfa7571c-a94c-4b6d-804d-78e765c3837f tempest-VolumeQuotasNegativeTestJSON-895794810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:26:25 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-bfa7571c-a94c-4b6d-804d-78e765c3837f tempest-VolumeQuotasNegativeTestJSON-895794810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:26:25 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-bfa7571c-a94c-4b6d-804d-78e765c3837f tempest-VolumeQuotasNegativeTestJSON-895794810 None] Selected osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 as target Quobyte volume. {{(pid=89182) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 12:26:25 devstack cinder-volume[89182]: INFO cinder.volume.drivers.remotefs [None req-bfa7571c-a94c-4b6d-804d-78e765c3837f tempest-VolumeQuotasNegativeTestJSON-895794810 None] casted to osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 Jul 31 12:26:25 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-bfa7571c-a94c-4b6d-804d-78e765c3837f tempest-VolumeQuotasNegativeTestJSON-895794810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-7bc4266e-e8e6-4ff8-94c4-487b7ae17535 1073741824 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:26:25 devstack cinder-volume[89182]: DEBUG novaclient.v2.client [None req-57315f91-d4d0-4251-8392-0f59524efc6c tempest-TestVolumeBootPattern-1492021642 None] REQ: curl -g -i -X DELETE http://192.168.122.21/compute/v2.1/os-assisted-volume-snapshots/94a7a129-d2b7-4383-b472-bf34f8cff987?delete_info={"file_to_merge": "volume-059c514e-3928-498a-9f8e-384f95a18a7c", "merge_target_file": null, "type": "qcow2", "volume_id": "059c514e-3928-498a-9f8e-384f95a18a7c"} -H "Accept: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}1c6f5411e3c1934cf9e7e2daefef4e5786e44e99279325db13e66f7652bd603d" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-57315f91-d4d0-4251-8392-0f59524efc6c" -H "X-Service-Token: {SHA256}02a8645ba5bc7d3f7d0a93a9d02f784466607492168e4b335483720fa1daddd6" {{(pid=89182) _http_log_request /opt/stack/data/venv/lib/python3.12/site-packages/keystoneauth1/session.py:575}} Jul 31 12:26:25 devstack sudo[102958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-7bc4266e-e8e6-4ff8-94c4-487b7ae17535 1073741824 Jul 31 12:26:25 devstack sudo[102958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:26:25 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-6cb15fb0-de74-417b-a221-ee7a6d135d6d tempest-GroupsV314Test-1921152939 None] Create group from source-group-3c6df1f8-2d84-4873-849b-23f8b9f5a884 completed successfully. Jul 31 12:26:25 devstack cinder-volume[89182]: DEBUG novaclient.v2.client [None req-57315f91-d4d0-4251-8392-0f59524efc6c tempest-TestVolumeBootPattern-1492021642 None] RESP: [204] Connection: close Content-Type: application/json Date: Fri, 31 Jul 2026 10:26:25 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.58 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-4d5d9895-a52a-4ac7-902e-9e5e7062e012 x-openstack-request-id: req-4d5d9895-a52a-4ac7-902e-9e5e7062e012 {{(pid=89182) _http_log_response /opt/stack/data/venv/lib/python3.12/site-packages/keystoneauth1/session.py:616}} Jul 31 12:26:25 devstack cinder-volume[89182]: DEBUG novaclient.v2.client [None req-57315f91-d4d0-4251-8392-0f59524efc6c tempest-TestVolumeBootPattern-1492021642 None] DELETE call to compute for http://192.168.122.21/compute/v2.1/os-assisted-volume-snapshots/94a7a129-d2b7-4383-b472-bf34f8cff987?delete_info=%7B%22file_to_merge%22:%20%22volume-059c514e-3928-498a-9f8e-384f95a18a7c%22,%20%22merge_target_file%22:%20null,%20%22type%22:%20%22qcow2%22,%20%22volume_id%22:%20%22059c514e-3928-498a-9f8e-384f95a18a7c%22%7D used request id req-4d5d9895-a52a-4ac7-902e-9e5e7062e012 {{(pid=89182) request /opt/stack/data/venv/lib/python3.12/site-packages/keystoneauth1/session.py:1076}} Jul 31 12:26:25 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-57315f91-d4d0-4251-8392-0f59524efc6c tempest-TestVolumeBootPattern-1492021642 None] status of snapshot 94a7a129-d2b7-4383-b472-bf34f8cff987 is still "deleting"... waiting {{(pid=89182) _nova_assisted_vol_snap_delete /opt/stack/cinder/cinder/volume/drivers/remotefs.py:2054}} Jul 31 12:26:25 devstack sudo[102958]: pam_unix(sudo:session): session closed for user root Jul 31 12:26:25 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-bfa7571c-a94c-4b6d-804d-78e765c3837f tempest-VolumeQuotasNegativeTestJSON-895794810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-7bc4266e-e8e6-4ff8-94c4-487b7ae17535 1073741824" returned: 0 in 0.643s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:26:25 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-bfa7571c-a94c-4b6d-804d-78e765c3837f tempest-VolumeQuotasNegativeTestJSON-895794810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-7bc4266e-e8e6-4ff8-94c4-487b7ae17535 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:26:25 devstack sudo[102972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-7bc4266e-e8e6-4ff8-94c4-487b7ae17535 Jul 31 12:26:25 devstack sudo[102972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:26:26 devstack sudo[102972]: pam_unix(sudo:session): session closed for user root Jul 31 12:26:26 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-bfa7571c-a94c-4b6d-804d-78e765c3837f tempest-VolumeQuotasNegativeTestJSON-895794810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-7bc4266e-e8e6-4ff8-94c4-487b7ae17535" returned: 0 in 0.294s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:26:26 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-bfa7571c-a94c-4b6d-804d-78e765c3837f tempest-VolumeQuotasNegativeTestJSON-895794810 None] <== create_volume: return (997ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'} {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 12:26:26 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-bfa7571c-a94c-4b6d-804d-78e765c3837f tempest-VolumeQuotasNegativeTestJSON-895794810 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.002s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:26:26 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-bfa7571c-a94c-4b6d-804d-78e765c3837f tempest-VolumeQuotasNegativeTestJSON-895794810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1b13c3d-f35c-4133-b3f0-55910f89c3cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7bc4266e-e8e6-4ff8-94c4-487b7ae17535', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:26:26 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-bfa7571c-a94c-4b6d-804d-78e765c3837f tempest-VolumeQuotasNegativeTestJSON-895794810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ee2e77b-8335-4796-9ce2-bac6d01bed24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:26:26 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-bfa7571c-a94c-4b6d-804d-78e765c3837f tempest-VolumeQuotasNegativeTestJSON-895794810 None] Volume volume-7bc4266e-e8e6-4ff8-94c4-487b7ae17535 (7bc4266e-e8e6-4ff8-94c4-487b7ae17535): created successfully Jul 31 12:26:26 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-bfa7571c-a94c-4b6d-804d-78e765c3837f tempest-VolumeQuotasNegativeTestJSON-895794810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ee2e77b-8335-4796-9ce2-bac6d01bed24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:26:26 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-bfa7571c-a94c-4b6d-804d-78e765c3837f tempest-VolumeQuotasNegativeTestJSON-895794810 None] Flow 'volume_create_manager' (7d19d521-19b6-4a71-a393-96ed72904bcd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:26:26 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-bfa7571c-a94c-4b6d-804d-78e765c3837f tempest-VolumeQuotasNegativeTestJSON-895794810 None] Created volume successfully. Jul 31 12:26:26 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-57315f91-d4d0-4251-8392-0f59524efc6c tempest-TestVolumeBootPattern-1492021642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-059c514e-3928-498a-9f8e-384f95a18a7c.32d8c5b8-3d64-486d-b503-068001d9631e {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:26:26 devstack sudo[102975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-059c514e-3928-498a-9f8e-384f95a18a7c.32d8c5b8-3d64-486d-b503-068001d9631e Jul 31 12:26:26 devstack sudo[102975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:26:26 devstack sudo[102975]: pam_unix(sudo:session): session closed for user root Jul 31 12:26:26 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-57315f91-d4d0-4251-8392-0f59524efc6c tempest-TestVolumeBootPattern-1492021642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-059c514e-3928-498a-9f8e-384f95a18a7c.32d8c5b8-3d64-486d-b503-068001d9631e" returned: 0 in 0.261s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:26:26 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-57315f91-d4d0-4251-8392-0f59524efc6c tempest-TestVolumeBootPattern-1492021642 None] Lock "cinder-quobyte-94a7a129-d2b7-4383-b472-bf34f8cff987" released by "_delete_snapshot" :: held 2.785s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:26:26 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-57315f91-d4d0-4251-8392-0f59524efc6c tempest-TestVolumeBootPattern-1492021642 None] Lock "cinder-quobyte-059c514e-3928-498a-9f8e-384f95a18a7c" released by "delete_snapshot" :: held 2.821s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:26:26 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-1227e313-3655-4bda-bde5-51b3cf13d953 tempest-TestStampPattern-418584557 None] Acquiring lock "cinder-0cea5331-ddf1-4068-bee4-c6518e039abc-delete_volume" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:26:26 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-1227e313-3655-4bda-bde5-51b3cf13d953 tempest-TestStampPattern-418584557 None] Lock "cinder-0cea5331-ddf1-4068-bee4-c6518e039abc-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:26:26 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-00599495-7457-4b5c-85c8-086a70f14e5c tempest-GroupsV314Test-1921152939 None] Acquiring lock "cinder-quobyte-68077ea4-46cf-441a-899b-b05dd907f336" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:26:26 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-00599495-7457-4b5c-85c8-086a70f14e5c tempest-GroupsV314Test-1921152939 None] Lock "cinder-quobyte-68077ea4-46cf-441a-899b-b05dd907f336" acquired by "delete_volume" :: waited 0.023s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:26:26 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-1227e313-3655-4bda-bde5-51b3cf13d953 tempest-TestStampPattern-418584557 None] Acquiring lock "cinder-quobyte-0cea5331-ddf1-4068-bee4-c6518e039abc" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:26:26 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[d745d110-1e4a-44db-af23-fc9b62414199]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:26:26 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-00599495-7457-4b5c-85c8-086a70f14e5c tempest-GroupsV314Test-1921152939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-68077ea4-46cf-441a-899b-b05dd907f336 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:26:26 devstack cinder-volume[89182]: DEBUG cinder.quota [None req-57315f91-d4d0-4251-8392-0f59524efc6c tempest-TestVolumeBootPattern-1492021642 None] Created reservations ['74be5f22-afcc-4968-903f-07aa83bf10fa', '51a2426e-10b3-4d88-8e1f-0397d7c2c6f2', 'ec423f60-7e2d-410d-8934-b528a4df69c2', 'b5808567-5897-4dcb-a016-4875277134a1'] {{(pid=89182) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 12:26:26 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-1227e313-3655-4bda-bde5-51b3cf13d953 tempest-TestStampPattern-418584557 None] Lock "cinder-quobyte-0cea5331-ddf1-4068-bee4-c6518e039abc" acquired by "delete_volume" :: waited 0.042s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:26:26 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7ec9383-41fb-4072-a06f-3f2540a8002a]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:26:26 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-1227e313-3655-4bda-bde5-51b3cf13d953 tempest-TestStampPattern-418584557 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0cea5331-ddf1-4068-bee4-c6518e039abc {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:26:26 devstack sudo[102979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-68077ea4-46cf-441a-899b-b05dd907f336 Jul 31 12:26:26 devstack sudo[102979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:26:26 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-57315f91-d4d0-4251-8392-0f59524efc6c tempest-TestVolumeBootPattern-1492021642 None] Delete snapshot completed successfully. Jul 31 12:26:27 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-57315f91-d4d0-4251-8392-0f59524efc6c tempest-TestVolumeBootPattern-1492021642 None] Lock "cinder-94a7a129-d2b7-4383-b472-bf34f8cff987-delete_snapshot" released by "delete_snapshot" :: held 3.171s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:26:27 devstack sudo[102980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0cea5331-ddf1-4068-bee4-c6518e039abc Jul 31 12:26:27 devstack sudo[102980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:26:27 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-1861a3a3-b632-4aee-97f4-40872ad6c45e tempest-TestVolumeBootPattern-1492021642 None] Acquiring lock "cinder-32d8c5b8-3d64-486d-b503-068001d9631e-delete_snapshot" by "delete_snapshot" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:26:27 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-1861a3a3-b632-4aee-97f4-40872ad6c45e tempest-TestVolumeBootPattern-1492021642 None] Lock "cinder-32d8c5b8-3d64-486d-b503-068001d9631e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:26:27 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-1861a3a3-b632-4aee-97f4-40872ad6c45e tempest-TestVolumeBootPattern-1492021642 None] Acquiring lock "cinder-quobyte-059c514e-3928-498a-9f8e-384f95a18a7c" by "delete_snapshot" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:26:27 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-1861a3a3-b632-4aee-97f4-40872ad6c45e tempest-TestVolumeBootPattern-1492021642 None] Lock "cinder-quobyte-059c514e-3928-498a-9f8e-384f95a18a7c" acquired by "delete_snapshot" :: waited 0.024s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:26:27 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-1861a3a3-b632-4aee-97f4-40872ad6c45e tempest-TestVolumeBootPattern-1492021642 None] Acquiring lock "cinder-quobyte-32d8c5b8-3d64-486d-b503-068001d9631e" by "_delete_snapshot" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:26:27 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-1861a3a3-b632-4aee-97f4-40872ad6c45e tempest-TestVolumeBootPattern-1492021642 None] Lock "cinder-quobyte-32d8c5b8-3d64-486d-b503-068001d9631e" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:26:27 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-1861a3a3-b632-4aee-97f4-40872ad6c45e tempest-TestVolumeBootPattern-1492021642 None] Deleting online snapshot 32d8c5b8-3d64-486d-b503-068001d9631e of volume 059c514e-3928-498a-9f8e-384f95a18a7c {{(pid=89182) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 31 12:26:27 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-1861a3a3-b632-4aee-97f4-40872ad6c45e tempest-TestVolumeBootPattern-1492021642 None] snapshot_file for this snap is: volume-059c514e-3928-498a-9f8e-384f95a18a7c.9d450624-84ea-4f9a-9604-268386ba964a {{(pid=89182) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 31 12:26:27 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfd50cc0-3bfe-4f20-9a2f-799a5a7c6687]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:26:27 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-1861a3a3-b632-4aee-97f4-40872ad6c45e tempest-TestVolumeBootPattern-1492021642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-059c514e-3928-498a-9f8e-384f95a18a7c.9d450624-84ea-4f9a-9604-268386ba964a {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:26:27 devstack sudo[102979]: pam_unix(sudo:session): session closed for user root Jul 31 12:26:27 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-00599495-7457-4b5c-85c8-086a70f14e5c tempest-GroupsV314Test-1921152939 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-68077ea4-46cf-441a-899b-b05dd907f336" returned: 0 in 0.414s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:26:27 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-00599495-7457-4b5c-85c8-086a70f14e5c tempest-GroupsV314Test-1921152939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-68077ea4-46cf-441a-899b-b05dd907f336 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:26:27 devstack sudo[102987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-68077ea4-46cf-441a-899b-b05dd907f336 Jul 31 12:26:27 devstack sudo[102987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:26:27 devstack sudo[102985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-059c514e-3928-498a-9f8e-384f95a18a7c.9d450624-84ea-4f9a-9604-268386ba964a Jul 31 12:26:27 devstack sudo[102985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:26:27 devstack sudo[102980]: pam_unix(sudo:session): session closed for user root Jul 31 12:26:27 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-1227e313-3655-4bda-bde5-51b3cf13d953 tempest-TestStampPattern-418584557 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0cea5331-ddf1-4068-bee4-c6518e039abc" returned: 0 in 0.455s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:26:27 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-1227e313-3655-4bda-bde5-51b3cf13d953 tempest-TestStampPattern-418584557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0cea5331-ddf1-4068-bee4-c6518e039abc {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:26:27 devstack sudo[102994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0cea5331-ddf1-4068-bee4-c6518e039abc Jul 31 12:26:27 devstack sudo[102994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:26:27 devstack sudo[102987]: pam_unix(sudo:session): session closed for user root Jul 31 12:26:27 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-00599495-7457-4b5c-85c8-086a70f14e5c tempest-GroupsV314Test-1921152939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-68077ea4-46cf-441a-899b-b05dd907f336" returned: 0 in 0.328s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:26:27 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-00599495-7457-4b5c-85c8-086a70f14e5c tempest-GroupsV314Test-1921152939 None] Lock "cinder-quobyte-68077ea4-46cf-441a-899b-b05dd907f336" released by "delete_volume" :: held 0.796s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:26:27 devstack sudo[102985]: pam_unix(sudo:session): session closed for user root Jul 31 12:26:27 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-1861a3a3-b632-4aee-97f4-40872ad6c45e tempest-TestVolumeBootPattern-1492021642 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-059c514e-3928-498a-9f8e-384f95a18a7c.9d450624-84ea-4f9a-9604-268386ba964a" returned: 0 in 0.441s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:26:27 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-1861a3a3-b632-4aee-97f4-40872ad6c45e tempest-TestVolumeBootPattern-1492021642 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-059c514e-3928-498a-9f8e-384f95a18a7c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89182) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 12:26:27 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d64865d-2a7d-4018-8cda-b72c9728b75e]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:26:27 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-1861a3a3-b632-4aee-97f4-40872ad6c45e tempest-TestVolumeBootPattern-1492021642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-059c514e-3928-498a-9f8e-384f95a18a7c {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:26:27 devstack sudo[102994]: pam_unix(sudo:session): session closed for user root Jul 31 12:26:27 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-1227e313-3655-4bda-bde5-51b3cf13d953 tempest-TestStampPattern-418584557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0cea5331-ddf1-4068-bee4-c6518e039abc" returned: 0 in 0.303s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:26:27 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-1227e313-3655-4bda-bde5-51b3cf13d953 tempest-TestStampPattern-418584557 None] Lock "cinder-quobyte-0cea5331-ddf1-4068-bee4-c6518e039abc" released by "delete_volume" :: held 0.851s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:26:27 devstack cinder-volume[89182]: DEBUG cinder.quota [None req-00599495-7457-4b5c-85c8-086a70f14e5c tempest-GroupsV314Test-1921152939 None] Created reservations ['ffc0d61b-280f-4f1f-8610-70011f806be8'] {{(pid=89182) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 12:26:27 devstack cinder-volume[89182]: DEBUG cinder.quota [None req-1227e313-3655-4bda-bde5-51b3cf13d953 tempest-TestStampPattern-418584557 None] Created reservations ['6baa54a9-7155-4cf9-9f3c-339f47d1bec6', '05dff411-9eee-47d0-846b-c3b7bb4bada6', '24891bfe-7469-47e9-9151-34e476e692de', '30a22e4b-a9c1-4fd8-8e9e-2a792abd6c17'] {{(pid=89182) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 12:26:27 devstack cinder-volume[89182]: WARNING cinder.quota [None req-00599495-7457-4b5c-85c8-086a70f14e5c tempest-GroupsV314Test-1921152939 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-962756779 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-962756779, it is now deprecated. Please use the default quota class for default quota. Jul 31 12:26:27 devstack cinder-volume[89182]: WARNING cinder.quota [None req-00599495-7457-4b5c-85c8-086a70f14e5c tempest-GroupsV314Test-1921152939 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-962756779 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-962756779, it is now deprecated. Please use the default quota class for default quota. Jul 31 12:26:27 devstack sudo[103002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-059c514e-3928-498a-9f8e-384f95a18a7c Jul 31 12:26:27 devstack sudo[103002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:26:27 devstack cinder-volume[89182]: DEBUG cinder.quota [None req-00599495-7457-4b5c-85c8-086a70f14e5c tempest-GroupsV314Test-1921152939 None] Created reservations ['430b6991-9761-41db-ae25-0f521639e51e', 'b3b5bad3-656d-4cba-8ecf-a551c527b606', '7ce00f30-a7a4-4bf9-a4cf-a9091a4f823f', '1e87dc69-ee4d-47df-9348-930e6f6b72c0'] {{(pid=89182) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 12:26:27 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-1227e313-3655-4bda-bde5-51b3cf13d953 tempest-TestStampPattern-418584557 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:26:27 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-1227e313-3655-4bda-bde5-51b3cf13d953 tempest-TestStampPattern-418584557 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:26:27 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-1227e313-3655-4bda-bde5-51b3cf13d953 tempest-TestStampPattern-418584557 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:26:27 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-1227e313-3655-4bda-bde5-51b3cf13d953 tempest-TestStampPattern-418584557 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:26:27 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-1227e313-3655-4bda-bde5-51b3cf13d953 tempest-TestStampPattern-418584557 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:26:27 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-1227e313-3655-4bda-bde5-51b3cf13d953 tempest-TestStampPattern-418584557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:26:28 devstack sudo[103004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 Jul 31 12:26:28 devstack sudo[103004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:26:28 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-00599495-7457-4b5c-85c8-086a70f14e5c tempest-GroupsV314Test-1921152939 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:26:28 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-00599495-7457-4b5c-85c8-086a70f14e5c tempest-GroupsV314Test-1921152939 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:26:28 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-00599495-7457-4b5c-85c8-086a70f14e5c tempest-GroupsV314Test-1921152939 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:26:28 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-00599495-7457-4b5c-85c8-086a70f14e5c tempest-GroupsV314Test-1921152939 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:26:28 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-00599495-7457-4b5c-85c8-086a70f14e5c tempest-GroupsV314Test-1921152939 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:26:28 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-00599495-7457-4b5c-85c8-086a70f14e5c tempest-GroupsV314Test-1921152939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:26:28 devstack sudo[103007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 Jul 31 12:26:28 devstack sudo[103007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:26:28 devstack sudo[103002]: pam_unix(sudo:session): session closed for user root Jul 31 12:26:28 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-1861a3a3-b632-4aee-97f4-40872ad6c45e tempest-TestVolumeBootPattern-1492021642 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-059c514e-3928-498a-9f8e-384f95a18a7c" returned: 0 in 0.527s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:26:28 devstack cinder-volume[89182]: DEBUG cinder.compute.nova [None req-1861a3a3-b632-4aee-97f4-40872ad6c45e tempest-TestVolumeBootPattern-1492021642 None] Creating Keystone auth plugin from conf {{(pid=89182) novaclient /opt/stack/cinder/cinder/compute/nova.py:99}} Jul 31 12:26:28 devstack sudo[103004]: pam_unix(sudo:session): session closed for user root Jul 31 12:26:28 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-1227e313-3655-4bda-bde5-51b3cf13d953 tempest-TestStampPattern-418584557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2" returned: 0 in 0.356s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:26:28 devstack cinder-volume[89182]: DEBUG cinder.manager [None req-1227e313-3655-4bda-bde5-51b3cf13d953 tempest-TestStampPattern-418584557 None] Notifying Schedulers of capabilities ... {{(pid=89182) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 12:26:28 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-1227e313-3655-4bda-bde5-51b3cf13d953 tempest-TestStampPattern-418584557 None] Deleted volume successfully. Jul 31 12:26:28 devstack cinder-volume[89182]: DEBUG novaclient.v2.client [None req-1861a3a3-b632-4aee-97f4-40872ad6c45e tempest-TestVolumeBootPattern-1492021642 None] REQ: curl -g -i -X DELETE http://192.168.122.21/compute/v2.1/os-assisted-volume-snapshots/32d8c5b8-3d64-486d-b503-068001d9631e?delete_info={"file_to_merge": null, "merge_target_file": null, "type": "qcow2", "volume_id": "059c514e-3928-498a-9f8e-384f95a18a7c"} -H "Accept: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}f992e138287196c067f1ae356cb6b362da95e909cf0bf13834265e3d4fcf0245" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-1861a3a3-b632-4aee-97f4-40872ad6c45e" -H "X-Service-Token: {SHA256}02a8645ba5bc7d3f7d0a93a9d02f784466607492168e4b335483720fa1daddd6" {{(pid=89182) _http_log_request /opt/stack/data/venv/lib/python3.12/site-packages/keystoneauth1/session.py:575}} Jul 31 12:26:28 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-1227e313-3655-4bda-bde5-51b3cf13d953 tempest-TestStampPattern-418584557 None] Lock "cinder-0cea5331-ddf1-4068-bee4-c6518e039abc-delete_volume" released by "delete_volume" :: held 1.627s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:26:28 devstack sudo[103007]: pam_unix(sudo:session): session closed for user root Jul 31 12:26:28 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-00599495-7457-4b5c-85c8-086a70f14e5c tempest-GroupsV314Test-1921152939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2" returned: 0 in 0.348s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:26:28 devstack cinder-volume[89182]: DEBUG cinder.manager [None req-00599495-7457-4b5c-85c8-086a70f14e5c tempest-GroupsV314Test-1921152939 None] Notifying Schedulers of capabilities ... {{(pid=89182) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 12:26:28 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-00599495-7457-4b5c-85c8-086a70f14e5c tempest-GroupsV314Test-1921152939 None] Delete group completed successfully. Jul 31 12:26:28 devstack cinder-volume[89182]: DEBUG novaclient.v2.client [None req-1861a3a3-b632-4aee-97f4-40872ad6c45e tempest-TestVolumeBootPattern-1492021642 None] RESP: [204] Connection: close Content-Type: application/json Date: Fri, 31 Jul 2026 10:26:28 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.58 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-cea8f61b-fcc0-4602-9980-5e69e20a6171 x-openstack-request-id: req-cea8f61b-fcc0-4602-9980-5e69e20a6171 {{(pid=89182) _http_log_response /opt/stack/data/venv/lib/python3.12/site-packages/keystoneauth1/session.py:616}} Jul 31 12:26:28 devstack cinder-volume[89182]: DEBUG novaclient.v2.client [None req-1861a3a3-b632-4aee-97f4-40872ad6c45e tempest-TestVolumeBootPattern-1492021642 None] DELETE call to compute for http://192.168.122.21/compute/v2.1/os-assisted-volume-snapshots/32d8c5b8-3d64-486d-b503-068001d9631e?delete_info=%7B%22file_to_merge%22:%20null,%20%22merge_target_file%22:%20null,%20%22type%22:%20%22qcow2%22,%20%22volume_id%22:%20%22059c514e-3928-498a-9f8e-384f95a18a7c%22%7D used request id req-cea8f61b-fcc0-4602-9980-5e69e20a6171 {{(pid=89182) request /opt/stack/data/venv/lib/python3.12/site-packages/keystoneauth1/session.py:1076}} Jul 31 12:26:28 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-1861a3a3-b632-4aee-97f4-40872ad6c45e tempest-TestVolumeBootPattern-1492021642 None] status of snapshot 32d8c5b8-3d64-486d-b503-068001d9631e is still "deleting"... waiting {{(pid=89182) _nova_assisted_vol_snap_delete /opt/stack/cinder/cinder/volume/drivers/remotefs.py:2054}} Jul 31 12:26:28 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-0a381422-431d-405a-8d2f-529028b46f8b tempest-VolumeQuotasNegativeTestJSON-895794810 None] Acquiring lock "cinder-7bc4266e-e8e6-4ff8-94c4-487b7ae17535-delete_volume" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:26:28 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-0a381422-431d-405a-8d2f-529028b46f8b tempest-VolumeQuotasNegativeTestJSON-895794810 None] Lock "cinder-7bc4266e-e8e6-4ff8-94c4-487b7ae17535-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:26:28 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-0a381422-431d-405a-8d2f-529028b46f8b tempest-VolumeQuotasNegativeTestJSON-895794810 None] Acquiring lock "cinder-quobyte-7bc4266e-e8e6-4ff8-94c4-487b7ae17535" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:26:28 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-0a381422-431d-405a-8d2f-529028b46f8b tempest-VolumeQuotasNegativeTestJSON-895794810 None] Lock "cinder-quobyte-7bc4266e-e8e6-4ff8-94c4-487b7ae17535" acquired by "delete_volume" :: waited 0.020s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:26:28 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dba39be-89f8-434a-8915-0d590921066f]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:26:28 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-0a381422-431d-405a-8d2f-529028b46f8b tempest-VolumeQuotasNegativeTestJSON-895794810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-7bc4266e-e8e6-4ff8-94c4-487b7ae17535 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:26:28 devstack sudo[103018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-7bc4266e-e8e6-4ff8-94c4-487b7ae17535 Jul 31 12:26:28 devstack sudo[103018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:26:29 devstack sudo[103018]: pam_unix(sudo:session): session closed for user root Jul 31 12:26:29 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-0a381422-431d-405a-8d2f-529028b46f8b tempest-VolumeQuotasNegativeTestJSON-895794810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-7bc4266e-e8e6-4ff8-94c4-487b7ae17535" returned: 0 in 0.493s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:26:29 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-0a381422-431d-405a-8d2f-529028b46f8b tempest-VolumeQuotasNegativeTestJSON-895794810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-7bc4266e-e8e6-4ff8-94c4-487b7ae17535 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:26:29 devstack sudo[103028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-7bc4266e-e8e6-4ff8-94c4-487b7ae17535 Jul 31 12:26:29 devstack sudo[103028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:26:29 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-39c98021-114b-4de2-838b-119d9d12d26a tempest-GroupsV314Test-1921152939 None] Acquiring lock "cinder-quobyte-1184ff71-d5d4-44aa-9aa3-96489716dc5b" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:26:29 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-39c98021-114b-4de2-838b-119d9d12d26a tempest-GroupsV314Test-1921152939 None] Lock "cinder-quobyte-1184ff71-d5d4-44aa-9aa3-96489716dc5b" acquired by "delete_volume" :: waited 0.020s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:26:29 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba6139c2-4b9d-4569-927d-198b7df27d1c]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:26:29 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-39c98021-114b-4de2-838b-119d9d12d26a tempest-GroupsV314Test-1921152939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-1184ff71-d5d4-44aa-9aa3-96489716dc5b {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:26:29 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-1861a3a3-b632-4aee-97f4-40872ad6c45e tempest-TestVolumeBootPattern-1492021642 None] status of snapshot 32d8c5b8-3d64-486d-b503-068001d9631e is still "deleting"... waiting {{(pid=89182) _nova_assisted_vol_snap_delete /opt/stack/cinder/cinder/volume/drivers/remotefs.py:2054}} Jul 31 12:26:29 devstack sudo[103030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-1184ff71-d5d4-44aa-9aa3-96489716dc5b Jul 31 12:26:29 devstack sudo[103030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:26:29 devstack sudo[103028]: pam_unix(sudo:session): session closed for user root Jul 31 12:26:29 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-0a381422-431d-405a-8d2f-529028b46f8b tempest-VolumeQuotasNegativeTestJSON-895794810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-7bc4266e-e8e6-4ff8-94c4-487b7ae17535" returned: 0 in 0.506s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:26:29 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-0a381422-431d-405a-8d2f-529028b46f8b tempest-VolumeQuotasNegativeTestJSON-895794810 None] Lock "cinder-quobyte-7bc4266e-e8e6-4ff8-94c4-487b7ae17535" released by "delete_volume" :: held 1.047s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:26:29 devstack cinder-volume[89182]: DEBUG cinder.quota [None req-0a381422-431d-405a-8d2f-529028b46f8b tempest-VolumeQuotasNegativeTestJSON-895794810 None] Created reservations ['d975d5e7-daea-4ced-9f2c-7439aeeaa856', '338dcb49-be10-4104-ab9a-46b5fa4757fa', '2e2298d0-7986-4dde-b4e2-437f73ac4faf', 'a59b4e87-1fa7-4c0a-9175-4ce48fd19931'] {{(pid=89182) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 12:26:29 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-0a381422-431d-405a-8d2f-529028b46f8b tempest-VolumeQuotasNegativeTestJSON-895794810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:26:29 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-0a381422-431d-405a-8d2f-529028b46f8b tempest-VolumeQuotasNegativeTestJSON-895794810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:26:29 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-0a381422-431d-405a-8d2f-529028b46f8b tempest-VolumeQuotasNegativeTestJSON-895794810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:26:29 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-0a381422-431d-405a-8d2f-529028b46f8b tempest-VolumeQuotasNegativeTestJSON-895794810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:26:29 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-0a381422-431d-405a-8d2f-529028b46f8b tempest-VolumeQuotasNegativeTestJSON-895794810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:26:29 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-0a381422-431d-405a-8d2f-529028b46f8b tempest-VolumeQuotasNegativeTestJSON-895794810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:26:30 devstack sudo[103035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 Jul 31 12:26:30 devstack sudo[103035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:26:30 devstack sudo[103030]: pam_unix(sudo:session): session closed for user root Jul 31 12:26:30 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-39c98021-114b-4de2-838b-119d9d12d26a tempest-GroupsV314Test-1921152939 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-1184ff71-d5d4-44aa-9aa3-96489716dc5b" returned: 0 in 0.505s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:26:30 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-39c98021-114b-4de2-838b-119d9d12d26a tempest-GroupsV314Test-1921152939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-1184ff71-d5d4-44aa-9aa3-96489716dc5b {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:26:30 devstack sudo[103038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-1184ff71-d5d4-44aa-9aa3-96489716dc5b Jul 31 12:26:30 devstack sudo[103038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:26:30 devstack sudo[103035]: pam_unix(sudo:session): session closed for user root Jul 31 12:26:30 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-0a381422-431d-405a-8d2f-529028b46f8b tempest-VolumeQuotasNegativeTestJSON-895794810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2" returned: 0 in 0.312s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:26:30 devstack cinder-volume[89182]: DEBUG cinder.manager [None req-0a381422-431d-405a-8d2f-529028b46f8b tempest-VolumeQuotasNegativeTestJSON-895794810 None] Notifying Schedulers of capabilities ... {{(pid=89182) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 12:26:30 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-0a381422-431d-405a-8d2f-529028b46f8b tempest-VolumeQuotasNegativeTestJSON-895794810 None] Deleted volume successfully. Jul 31 12:26:30 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-0a381422-431d-405a-8d2f-529028b46f8b tempest-VolumeQuotasNegativeTestJSON-895794810 None] Lock "cinder-7bc4266e-e8e6-4ff8-94c4-487b7ae17535-delete_volume" released by "delete_volume" :: held 1.687s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:26:30 devstack sudo[103038]: pam_unix(sudo:session): session closed for user root Jul 31 12:26:30 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-39c98021-114b-4de2-838b-119d9d12d26a tempest-GroupsV314Test-1921152939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-1184ff71-d5d4-44aa-9aa3-96489716dc5b" returned: 0 in 0.308s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:26:30 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-39c98021-114b-4de2-838b-119d9d12d26a tempest-GroupsV314Test-1921152939 None] Lock "cinder-quobyte-1184ff71-d5d4-44aa-9aa3-96489716dc5b" released by "delete_volume" :: held 0.920s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:26:30 devstack cinder-volume[89182]: DEBUG cinder.quota [None req-39c98021-114b-4de2-838b-119d9d12d26a tempest-GroupsV314Test-1921152939 None] Created reservations ['e2a8710f-2a31-44d6-940a-afb2ef2097e0'] {{(pid=89182) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 12:26:30 devstack cinder-volume[89182]: DEBUG cinder.quota [None req-39c98021-114b-4de2-838b-119d9d12d26a tempest-GroupsV314Test-1921152939 None] Created reservations ['daa911a3-b809-428a-8806-6b53cacc9fc1', 'a081e5f8-00a2-426b-b3ba-5697f0ca11cf', '3a50624e-2464-4437-8329-3128e86b8b00', '731475e4-3c7b-417d-a62a-827d59bc8176'] {{(pid=89182) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 12:26:30 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-1861a3a3-b632-4aee-97f4-40872ad6c45e tempest-TestVolumeBootPattern-1492021642 None] status of snapshot 32d8c5b8-3d64-486d-b503-068001d9631e is still "deleting"... waiting {{(pid=89182) _nova_assisted_vol_snap_delete /opt/stack/cinder/cinder/volume/drivers/remotefs.py:2054}} Jul 31 12:26:30 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-39c98021-114b-4de2-838b-119d9d12d26a tempest-GroupsV314Test-1921152939 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:26:30 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-39c98021-114b-4de2-838b-119d9d12d26a tempest-GroupsV314Test-1921152939 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:26:30 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-39c98021-114b-4de2-838b-119d9d12d26a tempest-GroupsV314Test-1921152939 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:26:30 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-39c98021-114b-4de2-838b-119d9d12d26a tempest-GroupsV314Test-1921152939 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:26:30 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-39c98021-114b-4de2-838b-119d9d12d26a tempest-GroupsV314Test-1921152939 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:26:30 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-39c98021-114b-4de2-838b-119d9d12d26a tempest-GroupsV314Test-1921152939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:26:30 devstack sudo[103044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 Jul 31 12:26:30 devstack sudo[103044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:26:31 devstack sudo[103044]: pam_unix(sudo:session): session closed for user root Jul 31 12:26:31 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-39c98021-114b-4de2-838b-119d9d12d26a tempest-GroupsV314Test-1921152939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2" returned: 0 in 0.375s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:26:31 devstack cinder-volume[89182]: DEBUG cinder.manager [None req-39c98021-114b-4de2-838b-119d9d12d26a tempest-GroupsV314Test-1921152939 None] Notifying Schedulers of capabilities ... {{(pid=89182) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 12:26:31 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-39c98021-114b-4de2-838b-119d9d12d26a tempest-GroupsV314Test-1921152939 None] Delete group completed successfully. Jul 31 12:26:31 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-1861a3a3-b632-4aee-97f4-40872ad6c45e tempest-TestVolumeBootPattern-1492021642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-059c514e-3928-498a-9f8e-384f95a18a7c {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:26:31 devstack sudo[103048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-059c514e-3928-498a-9f8e-384f95a18a7c Jul 31 12:26:31 devstack sudo[103048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:26:32 devstack sudo[103048]: pam_unix(sudo:session): session closed for user root Jul 31 12:26:32 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-1861a3a3-b632-4aee-97f4-40872ad6c45e tempest-TestVolumeBootPattern-1492021642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-059c514e-3928-498a-9f8e-384f95a18a7c" returned: 0 in 0.292s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:26:32 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-1861a3a3-b632-4aee-97f4-40872ad6c45e tempest-TestVolumeBootPattern-1492021642 None] Lock "cinder-quobyte-32d8c5b8-3d64-486d-b503-068001d9631e" released by "_delete_snapshot" :: held 4.889s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:26:32 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-1861a3a3-b632-4aee-97f4-40872ad6c45e tempest-TestVolumeBootPattern-1492021642 None] Lock "cinder-quobyte-059c514e-3928-498a-9f8e-384f95a18a7c" released by "delete_snapshot" :: held 4.920s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:26:32 devstack cinder-volume[89182]: DEBUG cinder.quota [None req-1861a3a3-b632-4aee-97f4-40872ad6c45e tempest-TestVolumeBootPattern-1492021642 None] Created reservations ['f5442e04-f6f9-42f6-a830-2a7b9555e854', 'eda033bd-ca27-498c-9685-f012ae4741f7', 'c0b3c3d3-77b2-4ea6-b744-e71ef490e3f4', '4fd468c7-838c-49ee-be8e-2fd2bb0e5810'] {{(pid=89182) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 12:26:32 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-1861a3a3-b632-4aee-97f4-40872ad6c45e tempest-TestVolumeBootPattern-1492021642 None] Delete snapshot completed successfully. Jul 31 12:26:32 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-1861a3a3-b632-4aee-97f4-40872ad6c45e tempest-TestVolumeBootPattern-1492021642 None] Lock "cinder-32d8c5b8-3d64-486d-b503-068001d9631e-delete_snapshot" released by "delete_snapshot" :: held 5.149s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:26:35 devstack cinder-volume[89182]: INFO cinder.volume.manager [req-5ba92a96-b9b2-4f06-82e1-2bd27eb4a37c req-e5937140-8172-4032-ba39-421eee3e3220 tempest-TestVolumeBootPattern-1492021642 None] Terminate volume connection completed successfully. Jul 31 12:26:35 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [req-5ba92a96-b9b2-4f06-82e1-2bd27eb4a37c req-e5937140-8172-4032-ba39-421eee3e3220 tempest-TestVolumeBootPattern-1492021642 None] Deleting attachment f98e5478-00ea-4b32-ad48-eee7352fc674. {{(pid=89182) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 31 12:26:38 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-1f12e1cc-c6b7-4f49-a1db-637bc03ba576 tempest-TestVolumeBootPattern-1492021642 None] Acquiring lock "cinder-059c514e-3928-498a-9f8e-384f95a18a7c-delete_volume" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:26:38 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-1f12e1cc-c6b7-4f49-a1db-637bc03ba576 tempest-TestVolumeBootPattern-1492021642 None] Lock "cinder-059c514e-3928-498a-9f8e-384f95a18a7c-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:26:38 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-1f12e1cc-c6b7-4f49-a1db-637bc03ba576 tempest-TestVolumeBootPattern-1492021642 None] Acquiring lock "cinder-quobyte-059c514e-3928-498a-9f8e-384f95a18a7c" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:26:38 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-1f12e1cc-c6b7-4f49-a1db-637bc03ba576 tempest-TestVolumeBootPattern-1492021642 None] Lock "cinder-quobyte-059c514e-3928-498a-9f8e-384f95a18a7c" acquired by "delete_volume" :: waited 0.030s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:26:38 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-1f12e1cc-c6b7-4f49-a1db-637bc03ba576 tempest-TestVolumeBootPattern-1492021642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-059c514e-3928-498a-9f8e-384f95a18a7c.9d450624-84ea-4f9a-9604-268386ba964a {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:26:38 devstack sudo[103112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-059c514e-3928-498a-9f8e-384f95a18a7c.9d450624-84ea-4f9a-9604-268386ba964a Jul 31 12:26:38 devstack sudo[103112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:26:39 devstack sudo[103112]: pam_unix(sudo:session): session closed for user root Jul 31 12:26:39 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-1f12e1cc-c6b7-4f49-a1db-637bc03ba576 tempest-TestVolumeBootPattern-1492021642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-059c514e-3928-498a-9f8e-384f95a18a7c.9d450624-84ea-4f9a-9604-268386ba964a" returned: 0 in 0.299s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:26:39 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-1f12e1cc-c6b7-4f49-a1db-637bc03ba576 tempest-TestVolumeBootPattern-1492021642 None] Lock "cinder-quobyte-059c514e-3928-498a-9f8e-384f95a18a7c" released by "delete_volume" :: held 0.357s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:26:39 devstack cinder-volume[89182]: DEBUG cinder.quota [None req-1f12e1cc-c6b7-4f49-a1db-637bc03ba576 tempest-TestVolumeBootPattern-1492021642 None] Created reservations ['8b52f076-e766-4377-9750-f3e39f60d7e9', '90c65618-41bc-4255-9b02-d11c6e1f5ad6', 'ca889c8f-7aab-4886-9643-da393dba3c63', '4b9cb064-bf33-48d4-893e-f45124d7c05a'] {{(pid=89182) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 12:26:39 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-1f12e1cc-c6b7-4f49-a1db-637bc03ba576 tempest-TestVolumeBootPattern-1492021642 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:26:39 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-1f12e1cc-c6b7-4f49-a1db-637bc03ba576 tempest-TestVolumeBootPattern-1492021642 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:26:39 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-1f12e1cc-c6b7-4f49-a1db-637bc03ba576 tempest-TestVolumeBootPattern-1492021642 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:26:39 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-1f12e1cc-c6b7-4f49-a1db-637bc03ba576 tempest-TestVolumeBootPattern-1492021642 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:26:39 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-1f12e1cc-c6b7-4f49-a1db-637bc03ba576 tempest-TestVolumeBootPattern-1492021642 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:26:39 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-1f12e1cc-c6b7-4f49-a1db-637bc03ba576 tempest-TestVolumeBootPattern-1492021642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:26:39 devstack sudo[103115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 Jul 31 12:26:39 devstack sudo[103115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:26:39 devstack sudo[103115]: pam_unix(sudo:session): session closed for user root Jul 31 12:26:39 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-1f12e1cc-c6b7-4f49-a1db-637bc03ba576 tempest-TestVolumeBootPattern-1492021642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2" returned: 0 in 0.353s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:26:39 devstack cinder-volume[89182]: DEBUG cinder.manager [None req-1f12e1cc-c6b7-4f49-a1db-637bc03ba576 tempest-TestVolumeBootPattern-1492021642 None] Notifying Schedulers of capabilities ... {{(pid=89182) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 12:26:39 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-1f12e1cc-c6b7-4f49-a1db-637bc03ba576 tempest-TestVolumeBootPattern-1492021642 None] Deleted volume successfully. Jul 31 12:26:39 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-1f12e1cc-c6b7-4f49-a1db-637bc03ba576 tempest-TestVolumeBootPattern-1492021642 None] Lock "cinder-059c514e-3928-498a-9f8e-384f95a18a7c-delete_volume" released by "delete_volume" :: held 1.035s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:26:40 devstack cinder-volume[89182]: DEBUG cinder.volume.flows.manager.create_volume [None req-4374d529-cd84-45f2-a2cd-d56ce5a95811 tempest-SnapshotsActionsTest-2046780578 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89182) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 12:26:40 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-4374d529-cd84-45f2-a2cd-d56ce5a95811 tempest-SnapshotsActionsTest-2046780578 None] Flow 'volume_create_manager' (a41bc8cc-1584-4541-917d-d1b4c3ba0313) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:26:40 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-4374d529-cd84-45f2-a2cd-d56ce5a95811 tempest-SnapshotsActionsTest-2046780578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c71d467d-fa4b-4576-ad89-f382e161b0a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:26:40 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-4374d529-cd84-45f2-a2cd-d56ce5a95811 tempest-SnapshotsActionsTest-2046780578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c71d467d-fa4b-4576-ad89-f382e161b0a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:26:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1111201916',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85b99b20-af4d-4dbb-a203-5a890c846394,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc226bf146be4320b4b9479ce7041df0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:26:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:26:40Z,use_quota=True,user_id='68fb6fdd98204f2ea91040c7939cfa9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:26:40 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-4374d529-cd84-45f2-a2cd-d56ce5a95811 tempest-SnapshotsActionsTest-2046780578 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8dfbc167-ece3-4bf1-a96d-7ce93db1495f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:26:40 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-4374d529-cd84-45f2-a2cd-d56ce5a95811 tempest-SnapshotsActionsTest-2046780578 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8dfbc167-ece3-4bf1-a96d-7ce93db1495f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:26:40 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-4374d529-cd84-45f2-a2cd-d56ce5a95811 tempest-SnapshotsActionsTest-2046780578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43974759-0131-482f-b242-a4347a47b255) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:26:40 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-4374d529-cd84-45f2-a2cd-d56ce5a95811 tempest-SnapshotsActionsTest-2046780578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43974759-0131-482f-b242-a4347a47b255) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '85b99b20-af4d-4dbb-a203-5a890c846394', 'volume_name': 'volume-85b99b20-af4d-4dbb-a203-5a890c846394', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:26:40 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-4374d529-cd84-45f2-a2cd-d56ce5a95811 tempest-SnapshotsActionsTest-2046780578 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18a719e2-eae5-47ea-a0da-d27bcf29d877) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:26:40 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-4374d529-cd84-45f2-a2cd-d56ce5a95811 tempest-SnapshotsActionsTest-2046780578 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18a719e2-eae5-47ea-a0da-d27bcf29d877) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:26:40 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-4374d529-cd84-45f2-a2cd-d56ce5a95811 tempest-SnapshotsActionsTest-2046780578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f382dfb-3fbb-4919-bdf7-9ffc030d662b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:26:40 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-4374d529-cd84-45f2-a2cd-d56ce5a95811 tempest-SnapshotsActionsTest-2046780578 None] Volume 85b99b20-af4d-4dbb-a203-5a890c846394: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-85b99b20-af4d-4dbb-a203-5a890c846394', 'volume_size': 1} Jul 31 12:26:40 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-4374d529-cd84-45f2-a2cd-d56ce5a95811 tempest-SnapshotsActionsTest-2046780578 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:26:40 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-4374d529-cd84-45f2-a2cd-d56ce5a95811 tempest-SnapshotsActionsTest-2046780578 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:26:40 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-4374d529-cd84-45f2-a2cd-d56ce5a95811 tempest-SnapshotsActionsTest-2046780578 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:26:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1111201916',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85b99b20-af4d-4dbb-a203-5a890c846394,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc226bf146be4320b4b9479ce7041df0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:26:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:26:40Z,use_quota=True,user_id='68fb6fdd98204f2ea91040c7939cfa9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)}" {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 12:26:40 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-4374d529-cd84-45f2-a2cd-d56ce5a95811 tempest-SnapshotsActionsTest-2046780578 None] Creating volume 85b99b20-af4d-4dbb-a203-5a890c846394 {{(pid=89182) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 12:26:40 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-4374d529-cd84-45f2-a2cd-d56ce5a95811 tempest-SnapshotsActionsTest-2046780578 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:26:40 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-4374d529-cd84-45f2-a2cd-d56ce5a95811 tempest-SnapshotsActionsTest-2046780578 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:26:40 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-4374d529-cd84-45f2-a2cd-d56ce5a95811 tempest-SnapshotsActionsTest-2046780578 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:26:40 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-4374d529-cd84-45f2-a2cd-d56ce5a95811 tempest-SnapshotsActionsTest-2046780578 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:26:40 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-4374d529-cd84-45f2-a2cd-d56ce5a95811 tempest-SnapshotsActionsTest-2046780578 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:26:40 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-4374d529-cd84-45f2-a2cd-d56ce5a95811 tempest-SnapshotsActionsTest-2046780578 None] Selected osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 as target Quobyte volume. {{(pid=89182) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 12:26:40 devstack cinder-volume[89182]: INFO cinder.volume.drivers.remotefs [None req-4374d529-cd84-45f2-a2cd-d56ce5a95811 tempest-SnapshotsActionsTest-2046780578 None] casted to osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 Jul 31 12:26:40 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-4374d529-cd84-45f2-a2cd-d56ce5a95811 tempest-SnapshotsActionsTest-2046780578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-85b99b20-af4d-4dbb-a203-5a890c846394 1073741824 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:26:40 devstack sudo[103118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-85b99b20-af4d-4dbb-a203-5a890c846394 1073741824 Jul 31 12:26:40 devstack sudo[103118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:26:40 devstack sudo[103118]: pam_unix(sudo:session): session closed for user root Jul 31 12:26:41 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-4374d529-cd84-45f2-a2cd-d56ce5a95811 tempest-SnapshotsActionsTest-2046780578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-85b99b20-af4d-4dbb-a203-5a890c846394 1073741824" returned: 0 in 0.734s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:26:41 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-4374d529-cd84-45f2-a2cd-d56ce5a95811 tempest-SnapshotsActionsTest-2046780578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-85b99b20-af4d-4dbb-a203-5a890c846394 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:26:41 devstack sudo[103124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-85b99b20-af4d-4dbb-a203-5a890c846394 Jul 31 12:26:41 devstack sudo[103124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:26:41 devstack cinder-volume[89182]: DEBUG cinder.volume.flows.manager.create_volume [None req-f536ecd8-7bab-4795-973f-0a738797a1bb tempest-TestVolumeBootPattern-1492021642 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89182) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 12:26:41 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-f536ecd8-7bab-4795-973f-0a738797a1bb tempest-TestVolumeBootPattern-1492021642 None] Flow 'volume_create_manager' (5a0dab62-e9d9-4bd3-9635-02f68d81c6e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:26:41 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-f536ecd8-7bab-4795-973f-0a738797a1bb tempest-TestVolumeBootPattern-1492021642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9f35457-b14a-4673-a390-099356d18dd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:26:41 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-f536ecd8-7bab-4795-973f-0a738797a1bb tempest-TestVolumeBootPattern-1492021642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9f35457-b14a-4673-a390-099356d18dd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:26:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBootPattern-volume-origin-2134891579',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cce4d436-dd54-48f7-96a5-6746d683a50a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4668dd58ac9a4406a9e8376f0b499d83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:26:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:26:41Z,use_quota=True,user_id='9990e1c0be844340b618d408d28deefe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:26:41 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-f536ecd8-7bab-4795-973f-0a738797a1bb tempest-TestVolumeBootPattern-1492021642 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (786ee10f-c60e-444f-bdac-bb370d069da7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:26:41 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-f536ecd8-7bab-4795-973f-0a738797a1bb tempest-TestVolumeBootPattern-1492021642 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (786ee10f-c60e-444f-bdac-bb370d069da7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:26:41 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-f536ecd8-7bab-4795-973f-0a738797a1bb tempest-TestVolumeBootPattern-1492021642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f129160f-4075-4e46-b942-f61fce81d250) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:26:41 devstack cinder-volume[89182]: DEBUG cinder.image.glance [None req-f536ecd8-7bab-4795-973f-0a738797a1bb tempest-TestVolumeBootPattern-1492021642 None] Creating Keystone auth plugin from conf {{(pid=89182) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 31 12:26:41 devstack sudo[103124]: pam_unix(sudo:session): session closed for user root Jul 31 12:26:41 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-4374d529-cd84-45f2-a2cd-d56ce5a95811 tempest-SnapshotsActionsTest-2046780578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-85b99b20-af4d-4dbb-a203-5a890c846394" returned: 0 in 0.461s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:26:41 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-4374d529-cd84-45f2-a2cd-d56ce5a95811 tempest-SnapshotsActionsTest-2046780578 None] <== create_volume: return (1268ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'} {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 12:26:41 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-4374d529-cd84-45f2-a2cd-d56ce5a95811 tempest-SnapshotsActionsTest-2046780578 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.279s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:26:41 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-4374d529-cd84-45f2-a2cd-d56ce5a95811 tempest-SnapshotsActionsTest-2046780578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f382dfb-3fbb-4919-bdf7-9ffc030d662b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-85b99b20-af4d-4dbb-a203-5a890c846394', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:26:41 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-4374d529-cd84-45f2-a2cd-d56ce5a95811 tempest-SnapshotsActionsTest-2046780578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2572c58-4f7e-4f26-b8db-5551e4cc748a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:26:41 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-4374d529-cd84-45f2-a2cd-d56ce5a95811 tempest-SnapshotsActionsTest-2046780578 None] Volume volume-85b99b20-af4d-4dbb-a203-5a890c846394 (85b99b20-af4d-4dbb-a203-5a890c846394): created successfully Jul 31 12:26:41 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-4374d529-cd84-45f2-a2cd-d56ce5a95811 tempest-SnapshotsActionsTest-2046780578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2572c58-4f7e-4f26-b8db-5551e4cc748a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:26:41 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-4374d529-cd84-45f2-a2cd-d56ce5a95811 tempest-SnapshotsActionsTest-2046780578 None] Flow 'volume_create_manager' (a41bc8cc-1584-4541-917d-d1b4c3ba0313) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:26:41 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-4374d529-cd84-45f2-a2cd-d56ce5a95811 tempest-SnapshotsActionsTest-2046780578 None] Created volume successfully. Jul 31 12:26:41 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-f536ecd8-7bab-4795-973f-0a738797a1bb tempest-TestVolumeBootPattern-1492021642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f129160f-4075-4e46-b942-f61fce81d250) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'cce4d436-dd54-48f7-96a5-6746d683a50a', 'volume_name': 'volume-cce4d436-dd54-48f7-96a5-6746d683a50a', 'volume_size': 1, 'image_id': '4cbd0fd2-77a8-43ca-bc93-b0249d6daea0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4cbd0fd2-77a8-43ca-bc93-b0249d6daea0', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3f77cb0dad9a46948c9357c65b22aef5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4cbd0fd2-77a8-43ca-bc93-b0249d6daea0', 'created_at': datetime.datetime(2026, 7, 31, 10, 8, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 31, 10, 8, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4cbd0fd2-77a8-43ca-bc93-b0249d6daea0/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:26:41 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-f536ecd8-7bab-4795-973f-0a738797a1bb tempest-TestVolumeBootPattern-1492021642 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (532b78da-7579-42b9-9152-070e66d5a891) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:26:41 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-f536ecd8-7bab-4795-973f-0a738797a1bb tempest-TestVolumeBootPattern-1492021642 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (532b78da-7579-42b9-9152-070e66d5a891) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:26:41 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-f536ecd8-7bab-4795-973f-0a738797a1bb tempest-TestVolumeBootPattern-1492021642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5bbc3b08-d392-46de-9dc1-5600da9c247f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:26:41 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-f536ecd8-7bab-4795-973f-0a738797a1bb tempest-TestVolumeBootPattern-1492021642 None] Volume cce4d436-dd54-48f7-96a5-6746d683a50a: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-cce4d436-dd54-48f7-96a5-6746d683a50a', 'volume_size': 1, 'image_id': '4cbd0fd2-77a8-43ca-bc93-b0249d6daea0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4cbd0fd2-77a8-43ca-bc93-b0249d6daea0', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3f77cb0dad9a46948c9357c65b22aef5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4cbd0fd2-77a8-43ca-bc93-b0249d6daea0', 'created_at': datetime.datetime(2026, 7, 31, 10, 8, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 31, 10, 8, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4cbd0fd2-77a8-43ca-bc93-b0249d6daea0/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 31 12:26:41 devstack cinder-volume[89182]: DEBUG cinder.volume.flows.manager.create_volume [None req-f536ecd8-7bab-4795-973f-0a738797a1bb tempest-TestVolumeBootPattern-1492021642 None] Trying to clone cce4d436-dd54-48f7-96a5-6746d683a50a from image 4cbd0fd2-77a8-43ca-bc93-b0249d6daea0 at location (None, [{'url': 'file:///opt/stack/data/glance/images/4cbd0fd2-77a8-43ca-bc93-b0249d6daea0', 'metadata': {}}]). {{(pid=89182) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 31 12:26:42 devstack cinder-volume[89182]: DEBUG cinder.image.image_utils [None req-f536ecd8-7bab-4795-973f-0a738797a1bb tempest-TestVolumeBootPattern-1492021642 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_4cbd0fd2-77a8-43ca-bc93-b0249d6daea0_m9zobv_qdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=89182) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 31 12:26:42 devstack cinder-volume[89182]: INFO cinder.image.image_utils [None req-f536ecd8-7bab-4795-973f-0a738797a1bb tempest-TestVolumeBootPattern-1492021642 None] Image download 20.69 MB at 20.69 MB/s Jul 31 12:26:42 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[056d7cc1-44f2-402a-8acc-9b68029f8a53]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:26:42 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-f536ecd8-7bab-4795-973f-0a738797a1bb tempest-TestVolumeBootPattern-1492021642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4cbd0fd2-77a8-43ca-bc93-b0249d6daea0_m9zobv_qdevstack@QuobyteHD {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:26:42 devstack sudo[103128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4cbd0fd2-77a8-43ca-bc93-b0249d6daea0_m9zobv_qdevstack@QuobyteHD Jul 31 12:26:42 devstack sudo[103128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:26:42 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-2067d1f3-78c9-4b27-a2cd-412d137cb467 tempest-SnapshotsActionsTest-2046780578 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:26:42 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-2067d1f3-78c9-4b27-a2cd-412d137cb467 tempest-SnapshotsActionsTest-2046780578 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:26:42 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-2067d1f3-78c9-4b27-a2cd-412d137cb467 tempest-SnapshotsActionsTest-2046780578 None] Creating offline snapshot df57d977-ee95-40d0-acbc-7a5f10d0db85 of volume 85b99b20-af4d-4dbb-a203-5a890c846394 {{(pid=89182) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 31 12:26:42 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[702ea8dc-d868-4369-8e6a-06b4b462da1e]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:26:42 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-2067d1f3-78c9-4b27-a2cd-412d137cb467 tempest-SnapshotsActionsTest-2046780578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-85b99b20-af4d-4dbb-a203-5a890c846394 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:26:43 devstack sudo[103128]: pam_unix(sudo:session): session closed for user root Jul 31 12:26:43 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-f536ecd8-7bab-4795-973f-0a738797a1bb tempest-TestVolumeBootPattern-1492021642 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4cbd0fd2-77a8-43ca-bc93-b0249d6daea0_m9zobv_qdevstack@QuobyteHD" returned: 0 in 0.568s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:26:43 devstack cinder-volume[89182]: DEBUG cinder.image.image_utils [None req-f536ecd8-7bab-4795-973f-0a738797a1bb tempest-TestVolumeBootPattern-1492021642 None] Temporary image 4cbd0fd2-77a8-43ca-bc93-b0249d6daea0 is fetched for user 9990e1c0be844340b618d408d28deefe. {{(pid=89182) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 31 12:26:43 devstack sudo[103131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-85b99b20-af4d-4dbb-a203-5a890c846394 Jul 31 12:26:43 devstack sudo[103131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:26:43 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[58fa5884-f636-4302-b3cd-78394bca1124]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:26:43 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-f536ecd8-7bab-4795-973f-0a738797a1bb tempest-TestVolumeBootPattern-1492021642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4cbd0fd2-77a8-43ca-bc93-b0249d6daea0_m9zobv_qdevstack@QuobyteHD {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:26:43 devstack sudo[103136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4cbd0fd2-77a8-43ca-bc93-b0249d6daea0_m9zobv_qdevstack@QuobyteHD Jul 31 12:26:43 devstack sudo[103136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:26:43 devstack sudo[103131]: pam_unix(sudo:session): session closed for user root Jul 31 12:26:43 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-2067d1f3-78c9-4b27-a2cd-412d137cb467 tempest-SnapshotsActionsTest-2046780578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-85b99b20-af4d-4dbb-a203-5a890c846394" returned: 0 in 0.570s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:26:43 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-2067d1f3-78c9-4b27-a2cd-412d137cb467 tempest-SnapshotsActionsTest-2046780578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-85b99b20-af4d-4dbb-a203-5a890c846394,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-85b99b20-af4d-4dbb-a203-5a890c846394.df57d977-ee95-40d0-acbc-7a5f10d0db85 1G {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:26:43 devstack sudo[103141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-85b99b20-af4d-4dbb-a203-5a890c846394,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-85b99b20-af4d-4dbb-a203-5a890c846394.df57d977-ee95-40d0-acbc-7a5f10d0db85 1G Jul 31 12:26:43 devstack sudo[103141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:26:43 devstack sudo[103136]: pam_unix(sudo:session): session closed for user root Jul 31 12:26:43 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-f536ecd8-7bab-4795-973f-0a738797a1bb tempest-TestVolumeBootPattern-1492021642 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4cbd0fd2-77a8-43ca-bc93-b0249d6daea0_m9zobv_qdevstack@QuobyteHD" returned: 0 in 0.412s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:26:43 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-f536ecd8-7bab-4795-973f-0a738797a1bb tempest-TestVolumeBootPattern-1492021642 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:26:44 devstack sudo[103141]: pam_unix(sudo:session): session closed for user root Jul 31 12:26:44 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-2067d1f3-78c9-4b27-a2cd-412d137cb467 tempest-SnapshotsActionsTest-2046780578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-85b99b20-af4d-4dbb-a203-5a890c846394,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-85b99b20-af4d-4dbb-a203-5a890c846394.df57d977-ee95-40d0-acbc-7a5f10d0db85 1G" returned: 0 in 0.487s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:26:44 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-2067d1f3-78c9-4b27-a2cd-412d137cb467 tempest-SnapshotsActionsTest-2046780578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-85b99b20-af4d-4dbb-a203-5a890c846394 -F qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-85b99b20-af4d-4dbb-a203-5a890c846394.df57d977-ee95-40d0-acbc-7a5f10d0db85 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:26:44 devstack sudo[103151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-85b99b20-af4d-4dbb-a203-5a890c846394 -F qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-85b99b20-af4d-4dbb-a203-5a890c846394.df57d977-ee95-40d0-acbc-7a5f10d0db85 Jul 31 12:26:44 devstack sudo[103151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:26:44 devstack sudo[103151]: pam_unix(sudo:session): session closed for user root Jul 31 12:26:44 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-2067d1f3-78c9-4b27-a2cd-412d137cb467 tempest-SnapshotsActionsTest-2046780578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-85b99b20-af4d-4dbb-a203-5a890c846394 -F qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-85b99b20-af4d-4dbb-a203-5a890c846394.df57d977-ee95-40d0-acbc-7a5f10d0db85" returned: 0 in 0.355s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:26:44 devstack cinder-volume[89182]: WARNING cinder.volume.drivers.remotefs [None req-2067d1f3-78c9-4b27-a2cd-412d137cb467 tempest-SnapshotsActionsTest-2046780578 None] /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-85b99b20-af4d-4dbb-a203-5a890c846394.df57d977-ee95-40d0-acbc-7a5f10d0db85 is being set with open permissions: ugo+rw Jul 31 12:26:44 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-2067d1f3-78c9-4b27-a2cd-412d137cb467 tempest-SnapshotsActionsTest-2046780578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-85b99b20-af4d-4dbb-a203-5a890c846394.df57d977-ee95-40d0-acbc-7a5f10d0db85 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:26:44 devstack sudo[103156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-85b99b20-af4d-4dbb-a203-5a890c846394.df57d977-ee95-40d0-acbc-7a5f10d0db85 Jul 31 12:26:44 devstack sudo[103156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:26:44 devstack sudo[103156]: pam_unix(sudo:session): session closed for user root Jul 31 12:26:44 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-2067d1f3-78c9-4b27-a2cd-412d137cb467 tempest-SnapshotsActionsTest-2046780578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-85b99b20-af4d-4dbb-a203-5a890c846394.df57d977-ee95-40d0-acbc-7a5f10d0db85" returned: 0 in 0.289s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:26:44 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-2067d1f3-78c9-4b27-a2cd-412d137cb467 tempest-SnapshotsActionsTest-2046780578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-85b99b20-af4d-4dbb-a203-5a890c846394.info {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:26:44 devstack sudo[103160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-85b99b20-af4d-4dbb-a203-5a890c846394.info Jul 31 12:26:44 devstack sudo[103160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:26:44 devstack sudo[103160]: pam_unix(sudo:session): session closed for user root Jul 31 12:26:44 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-2067d1f3-78c9-4b27-a2cd-412d137cb467 tempest-SnapshotsActionsTest-2046780578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-85b99b20-af4d-4dbb-a203-5a890c846394.info" returned: 0 in 0.268s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:26:44 devstack cinder-volume[89182]: WARNING cinder.volume.drivers.remotefs [None req-2067d1f3-78c9-4b27-a2cd-412d137cb467 tempest-SnapshotsActionsTest-2046780578 None] /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-85b99b20-af4d-4dbb-a203-5a890c846394.info is being set with open permissions: ugo+rw Jul 31 12:26:44 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-2067d1f3-78c9-4b27-a2cd-412d137cb467 tempest-SnapshotsActionsTest-2046780578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-85b99b20-af4d-4dbb-a203-5a890c846394.info {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:26:44 devstack sudo[103163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-85b99b20-af4d-4dbb-a203-5a890c846394.info Jul 31 12:26:44 devstack sudo[103163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:26:45 devstack sudo[103163]: pam_unix(sudo:session): session closed for user root Jul 31 12:26:45 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-2067d1f3-78c9-4b27-a2cd-412d137cb467 tempest-SnapshotsActionsTest-2046780578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-85b99b20-af4d-4dbb-a203-5a890c846394.info" returned: 0 in 0.292s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:26:45 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-2067d1f3-78c9-4b27-a2cd-412d137cb467 tempest-SnapshotsActionsTest-2046780578 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.398s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:26:45 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-f536ecd8-7bab-4795-973f-0a738797a1bb tempest-TestVolumeBootPattern-1492021642 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.600s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:26:45 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-f536ecd8-7bab-4795-973f-0a738797a1bb tempest-TestVolumeBootPattern-1492021642 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:26:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBootPattern-volume-origin-2134891579',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cce4d436-dd54-48f7-96a5-6746d683a50a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4668dd58ac9a4406a9e8376f0b499d83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:26:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:26:41Z,use_quota=True,user_id='9990e1c0be844340b618d408d28deefe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)}" {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 12:26:45 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-f536ecd8-7bab-4795-973f-0a738797a1bb tempest-TestVolumeBootPattern-1492021642 None] Creating volume cce4d436-dd54-48f7-96a5-6746d683a50a {{(pid=89182) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 12:26:45 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-f536ecd8-7bab-4795-973f-0a738797a1bb tempest-TestVolumeBootPattern-1492021642 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:26:45 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-f536ecd8-7bab-4795-973f-0a738797a1bb tempest-TestVolumeBootPattern-1492021642 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:26:45 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-f536ecd8-7bab-4795-973f-0a738797a1bb tempest-TestVolumeBootPattern-1492021642 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:26:45 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-f536ecd8-7bab-4795-973f-0a738797a1bb tempest-TestVolumeBootPattern-1492021642 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:26:45 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-f536ecd8-7bab-4795-973f-0a738797a1bb tempest-TestVolumeBootPattern-1492021642 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:26:45 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-f536ecd8-7bab-4795-973f-0a738797a1bb tempest-TestVolumeBootPattern-1492021642 None] Selected osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 as target Quobyte volume. {{(pid=89182) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 12:26:45 devstack cinder-volume[89182]: INFO cinder.volume.drivers.remotefs [None req-f536ecd8-7bab-4795-973f-0a738797a1bb tempest-TestVolumeBootPattern-1492021642 None] casted to osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 Jul 31 12:26:45 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-f536ecd8-7bab-4795-973f-0a738797a1bb tempest-TestVolumeBootPattern-1492021642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-cce4d436-dd54-48f7-96a5-6746d683a50a 1073741824 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:26:45 devstack sudo[103166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-cce4d436-dd54-48f7-96a5-6746d683a50a 1073741824 Jul 31 12:26:45 devstack sudo[103166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:26:45 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-2067d1f3-78c9-4b27-a2cd-412d137cb467 tempest-SnapshotsActionsTest-2046780578 None] Create snapshot completed successfully Jul 31 12:26:45 devstack sudo[103166]: pam_unix(sudo:session): session closed for user root Jul 31 12:26:45 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-f536ecd8-7bab-4795-973f-0a738797a1bb tempest-TestVolumeBootPattern-1492021642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-cce4d436-dd54-48f7-96a5-6746d683a50a 1073741824" returned: 0 in 0.501s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:26:45 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-f536ecd8-7bab-4795-973f-0a738797a1bb tempest-TestVolumeBootPattern-1492021642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-cce4d436-dd54-48f7-96a5-6746d683a50a {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:26:45 devstack sudo[103173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-cce4d436-dd54-48f7-96a5-6746d683a50a Jul 31 12:26:45 devstack sudo[103173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:26:46 devstack sudo[103173]: pam_unix(sudo:session): session closed for user root Jul 31 12:26:46 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-f536ecd8-7bab-4795-973f-0a738797a1bb tempest-TestVolumeBootPattern-1492021642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-cce4d436-dd54-48f7-96a5-6746d683a50a" returned: 0 in 0.270s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:26:46 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-f536ecd8-7bab-4795-973f-0a738797a1bb tempest-TestVolumeBootPattern-1492021642 None] <== create_volume: return (816ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'} {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 12:26:46 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-f536ecd8-7bab-4795-973f-0a738797a1bb tempest-TestVolumeBootPattern-1492021642 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.821s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:26:46 devstack cinder-volume[89182]: DEBUG cinder.volume.volume_utils [None req-f536ecd8-7bab-4795-973f-0a738797a1bb tempest-TestVolumeBootPattern-1492021642 None] Attempting download of 4cbd0fd2-77a8-43ca-bc93-b0249d6daea0 ((None, [{'url': 'file:///opt/stack/data/glance/images/4cbd0fd2-77a8-43ca-bc93-b0249d6daea0', 'metadata': {}}])) to volume cce4d436-dd54-48f7-96a5-6746d683a50a. {{(pid=89182) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 31 12:26:46 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[138b371e-b520-4227-9192-6a939e05f4a1]: (4, 'raw') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:26:46 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-f536ecd8-7bab-4795-973f-0a738797a1bb tempest-TestVolumeBootPattern-1492021642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4cbd0fd2-77a8-43ca-bc93-b0249d6daea0_m3uadz0n {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:26:46 devstack sudo[103176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4cbd0fd2-77a8-43ca-bc93-b0249d6daea0_m3uadz0n Jul 31 12:26:46 devstack sudo[103176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:26:46 devstack sudo[103176]: pam_unix(sudo:session): session closed for user root Jul 31 12:26:46 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-f536ecd8-7bab-4795-973f-0a738797a1bb tempest-TestVolumeBootPattern-1492021642 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4cbd0fd2-77a8-43ca-bc93-b0249d6daea0_m3uadz0n" returned: 0 in 0.348s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:26:46 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-f536ecd8-7bab-4795-973f-0a738797a1bb tempest-TestVolumeBootPattern-1492021642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4cbd0fd2-77a8-43ca-bc93-b0249d6daea0_m3uadz0n {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:26:46 devstack sudo[103181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4cbd0fd2-77a8-43ca-bc93-b0249d6daea0_m3uadz0n Jul 31 12:26:46 devstack sudo[103181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:26:46 devstack sudo[103181]: pam_unix(sudo:session): session closed for user root Jul 31 12:26:46 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-f536ecd8-7bab-4795-973f-0a738797a1bb tempest-TestVolumeBootPattern-1492021642 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4cbd0fd2-77a8-43ca-bc93-b0249d6daea0_m3uadz0n" returned: 1 in 0.420s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:26:46 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-f536ecd8-7bab-4795-973f-0a738797a1bb tempest-TestVolumeBootPattern-1492021642 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4cbd0fd2-77a8-43ca-bc93-b0249d6daea0_m3uadz0n' failed. Not Retrying. {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 31 12:26:46 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee0f1b97-8d75-45aa-be5f-9807614bda40]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:26:46 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-f536ecd8-7bab-4795-973f-0a738797a1bb tempest-TestVolumeBootPattern-1492021642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4cbd0fd2-77a8-43ca-bc93-b0249d6daea0_m9zobv_qdevstack@QuobyteHD {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:26:47 devstack cinder-volume[89182]: DEBUG cinder.volume.flows.manager.create_volume [None req-caa9752e-4d49-4e38-ab49-3eb18a87e040 tempest-CreateVolumesFromSnapshotTest-168995481 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89182) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 12:26:47 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-caa9752e-4d49-4e38-ab49-3eb18a87e040 tempest-CreateVolumesFromSnapshotTest-168995481 None] Flow 'volume_create_manager' (02f0c20c-c872-455c-8434-1284a3240bb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:26:47 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-caa9752e-4d49-4e38-ab49-3eb18a87e040 tempest-CreateVolumesFromSnapshotTest-168995481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98b725bd-c35d-4b5f-b999-03767ae05f2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:26:47 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-7c8f235e-2314-4896-bb83-99e39a791497 tempest-SnapshotsActionsTest-2046780578 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:26:47 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-7c8f235e-2314-4896-bb83-99e39a791497 tempest-SnapshotsActionsTest-2046780578 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:26:47 devstack sudo[103186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4cbd0fd2-77a8-43ca-bc93-b0249d6daea0_m9zobv_qdevstack@QuobyteHD Jul 31 12:26:47 devstack sudo[103186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:26:47 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-caa9752e-4d49-4e38-ab49-3eb18a87e040 tempest-CreateVolumesFromSnapshotTest-168995481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98b725bd-c35d-4b5f-b999-03767ae05f2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:26:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1222189654',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1a009ea-dd7e-4085-8b56-a184a7feceb6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4fbb56b870e4e63b039b6fd15327bfb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:26:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:26:47Z,use_quota=True,user_id='e9773ece88724a66adcb155ee4097493',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:26:47 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-caa9752e-4d49-4e38-ab49-3eb18a87e040 tempest-CreateVolumesFromSnapshotTest-168995481 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (696b06fe-9a3c-44b1-b114-3462e6e0c5df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:26:47 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-caa9752e-4d49-4e38-ab49-3eb18a87e040 tempest-CreateVolumesFromSnapshotTest-168995481 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (696b06fe-9a3c-44b1-b114-3462e6e0c5df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:26:47 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-caa9752e-4d49-4e38-ab49-3eb18a87e040 tempest-CreateVolumesFromSnapshotTest-168995481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f9425fd-113f-40ee-bdde-bbab353e1232) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:26:47 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-caa9752e-4d49-4e38-ab49-3eb18a87e040 tempest-CreateVolumesFromSnapshotTest-168995481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f9425fd-113f-40ee-bdde-bbab353e1232) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd1a009ea-dd7e-4085-8b56-a184a7feceb6', 'volume_name': 'volume-d1a009ea-dd7e-4085-8b56-a184a7feceb6', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:26:47 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-caa9752e-4d49-4e38-ab49-3eb18a87e040 tempest-CreateVolumesFromSnapshotTest-168995481 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49522cf5-499e-4462-aff8-2eb8616a4532) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:26:47 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-caa9752e-4d49-4e38-ab49-3eb18a87e040 tempest-CreateVolumesFromSnapshotTest-168995481 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49522cf5-499e-4462-aff8-2eb8616a4532) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:26:47 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-caa9752e-4d49-4e38-ab49-3eb18a87e040 tempest-CreateVolumesFromSnapshotTest-168995481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0d32570-599e-4478-a458-c5df9d606cd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:26:47 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-caa9752e-4d49-4e38-ab49-3eb18a87e040 tempest-CreateVolumesFromSnapshotTest-168995481 None] Volume d1a009ea-dd7e-4085-8b56-a184a7feceb6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d1a009ea-dd7e-4085-8b56-a184a7feceb6', 'volume_size': 1} Jul 31 12:26:47 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-caa9752e-4d49-4e38-ab49-3eb18a87e040 tempest-CreateVolumesFromSnapshotTest-168995481 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:26:47 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-7c8f235e-2314-4896-bb83-99e39a791497 tempest-SnapshotsActionsTest-2046780578 None] Creating offline snapshot 7b821e61-f22b-4a78-a7b7-483229fd3971 of volume 85b99b20-af4d-4dbb-a203-5a890c846394 {{(pid=89182) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 31 12:26:47 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed6d0fac-f890-44a1-8372-88f18bbdbaf1]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:26:47 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-7c8f235e-2314-4896-bb83-99e39a791497 tempest-SnapshotsActionsTest-2046780578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-85b99b20-af4d-4dbb-a203-5a890c846394.df57d977-ee95-40d0-acbc-7a5f10d0db85 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:26:47 devstack sudo[103188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-85b99b20-af4d-4dbb-a203-5a890c846394.df57d977-ee95-40d0-acbc-7a5f10d0db85 Jul 31 12:26:47 devstack sudo[103188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:26:47 devstack sudo[103186]: pam_unix(sudo:session): session closed for user root Jul 31 12:26:47 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-f536ecd8-7bab-4795-973f-0a738797a1bb tempest-TestVolumeBootPattern-1492021642 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4cbd0fd2-77a8-43ca-bc93-b0249d6daea0_m9zobv_qdevstack@QuobyteHD" returned: 0 in 0.409s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:26:47 devstack cinder-volume[89182]: DEBUG cinder.image.image_utils [None req-f536ecd8-7bab-4795-973f-0a738797a1bb tempest-TestVolumeBootPattern-1492021642 None] 4cbd0fd2-77a8-43ca-bc93-b0249d6daea0 was qcow2, converting to qcow2 {{(pid=89182) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 31 12:26:47 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-f536ecd8-7bab-4795-973f-0a738797a1bb tempest-TestVolumeBootPattern-1492021642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4cbd0fd2-77a8-43ca-bc93-b0249d6daea0_m9zobv_qdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-cce4d436-dd54-48f7-96a5-6746d683a50a {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:26:47 devstack sudo[103193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4cbd0fd2-77a8-43ca-bc93-b0249d6daea0_m9zobv_qdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-cce4d436-dd54-48f7-96a5-6746d683a50a Jul 31 12:26:47 devstack sudo[103193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:26:47 devstack sudo[103188]: pam_unix(sudo:session): session closed for user root Jul 31 12:26:47 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-7c8f235e-2314-4896-bb83-99e39a791497 tempest-SnapshotsActionsTest-2046780578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-85b99b20-af4d-4dbb-a203-5a890c846394.df57d977-ee95-40d0-acbc-7a5f10d0db85" returned: 0 in 0.470s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:26:47 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-7c8f235e-2314-4896-bb83-99e39a791497 tempest-SnapshotsActionsTest-2046780578 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-85b99b20-af4d-4dbb-a203-5a890c846394(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89182) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 12:26:47 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-7c8f235e-2314-4896-bb83-99e39a791497 tempest-SnapshotsActionsTest-2046780578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-85b99b20-af4d-4dbb-a203-5a890c846394.df57d977-ee95-40d0-acbc-7a5f10d0db85,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-85b99b20-af4d-4dbb-a203-5a890c846394.7b821e61-f22b-4a78-a7b7-483229fd3971 1G {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:26:47 devstack sudo[103201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-85b99b20-af4d-4dbb-a203-5a890c846394.df57d977-ee95-40d0-acbc-7a5f10d0db85,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-85b99b20-af4d-4dbb-a203-5a890c846394.7b821e61-f22b-4a78-a7b7-483229fd3971 1G Jul 31 12:26:47 devstack sudo[103201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:26:48 devstack sudo[103201]: pam_unix(sudo:session): session closed for user root Jul 31 12:26:48 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-7c8f235e-2314-4896-bb83-99e39a791497 tempest-SnapshotsActionsTest-2046780578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-85b99b20-af4d-4dbb-a203-5a890c846394.df57d977-ee95-40d0-acbc-7a5f10d0db85,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-85b99b20-af4d-4dbb-a203-5a890c846394.7b821e61-f22b-4a78-a7b7-483229fd3971 1G" returned: 0 in 0.498s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:26:48 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-7c8f235e-2314-4896-bb83-99e39a791497 tempest-SnapshotsActionsTest-2046780578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-85b99b20-af4d-4dbb-a203-5a890c846394.df57d977-ee95-40d0-acbc-7a5f10d0db85 -F qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-85b99b20-af4d-4dbb-a203-5a890c846394.7b821e61-f22b-4a78-a7b7-483229fd3971 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:26:48 devstack sudo[103209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-85b99b20-af4d-4dbb-a203-5a890c846394.df57d977-ee95-40d0-acbc-7a5f10d0db85 -F qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-85b99b20-af4d-4dbb-a203-5a890c846394.7b821e61-f22b-4a78-a7b7-483229fd3971 Jul 31 12:26:48 devstack sudo[103209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:26:48 devstack sudo[103209]: pam_unix(sudo:session): session closed for user root Jul 31 12:26:48 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-7c8f235e-2314-4896-bb83-99e39a791497 tempest-SnapshotsActionsTest-2046780578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-85b99b20-af4d-4dbb-a203-5a890c846394.df57d977-ee95-40d0-acbc-7a5f10d0db85 -F qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-85b99b20-af4d-4dbb-a203-5a890c846394.7b821e61-f22b-4a78-a7b7-483229fd3971" returned: 0 in 0.412s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:26:48 devstack cinder-volume[89182]: WARNING cinder.volume.drivers.remotefs [None req-7c8f235e-2314-4896-bb83-99e39a791497 tempest-SnapshotsActionsTest-2046780578 None] /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-85b99b20-af4d-4dbb-a203-5a890c846394.7b821e61-f22b-4a78-a7b7-483229fd3971 is being set with open permissions: ugo+rw Jul 31 12:26:48 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-7c8f235e-2314-4896-bb83-99e39a791497 tempest-SnapshotsActionsTest-2046780578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-85b99b20-af4d-4dbb-a203-5a890c846394.7b821e61-f22b-4a78-a7b7-483229fd3971 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:26:48 devstack sudo[103216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-85b99b20-af4d-4dbb-a203-5a890c846394.7b821e61-f22b-4a78-a7b7-483229fd3971 Jul 31 12:26:48 devstack sudo[103216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:26:48 devstack sudo[103216]: pam_unix(sudo:session): session closed for user root Jul 31 12:26:48 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-7c8f235e-2314-4896-bb83-99e39a791497 tempest-SnapshotsActionsTest-2046780578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-85b99b20-af4d-4dbb-a203-5a890c846394.7b821e61-f22b-4a78-a7b7-483229fd3971" returned: 0 in 0.339s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:26:49 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-7c8f235e-2314-4896-bb83-99e39a791497 tempest-SnapshotsActionsTest-2046780578 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.921s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:26:49 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-caa9752e-4d49-4e38-ab49-3eb18a87e040 tempest-CreateVolumesFromSnapshotTest-168995481 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.846s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:26:49 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-caa9752e-4d49-4e38-ab49-3eb18a87e040 tempest-CreateVolumesFromSnapshotTest-168995481 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:26:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1222189654',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1a009ea-dd7e-4085-8b56-a184a7feceb6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4fbb56b870e4e63b039b6fd15327bfb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:26:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:26:47Z,use_quota=True,user_id='e9773ece88724a66adcb155ee4097493',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)}" {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 12:26:49 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-caa9752e-4d49-4e38-ab49-3eb18a87e040 tempest-CreateVolumesFromSnapshotTest-168995481 None] Creating volume d1a009ea-dd7e-4085-8b56-a184a7feceb6 {{(pid=89182) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 12:26:49 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-caa9752e-4d49-4e38-ab49-3eb18a87e040 tempest-CreateVolumesFromSnapshotTest-168995481 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:26:49 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-caa9752e-4d49-4e38-ab49-3eb18a87e040 tempest-CreateVolumesFromSnapshotTest-168995481 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:26:49 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-caa9752e-4d49-4e38-ab49-3eb18a87e040 tempest-CreateVolumesFromSnapshotTest-168995481 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:26:49 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-caa9752e-4d49-4e38-ab49-3eb18a87e040 tempest-CreateVolumesFromSnapshotTest-168995481 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:26:49 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-caa9752e-4d49-4e38-ab49-3eb18a87e040 tempest-CreateVolumesFromSnapshotTest-168995481 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:26:49 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-caa9752e-4d49-4e38-ab49-3eb18a87e040 tempest-CreateVolumesFromSnapshotTest-168995481 None] Selected osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 as target Quobyte volume. {{(pid=89182) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 12:26:49 devstack cinder-volume[89182]: INFO cinder.volume.drivers.remotefs [None req-caa9752e-4d49-4e38-ab49-3eb18a87e040 tempest-CreateVolumesFromSnapshotTest-168995481 None] casted to osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 Jul 31 12:26:49 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-caa9752e-4d49-4e38-ab49-3eb18a87e040 tempest-CreateVolumesFromSnapshotTest-168995481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-d1a009ea-dd7e-4085-8b56-a184a7feceb6 1073741824 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:26:49 devstack sudo[103225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-d1a009ea-dd7e-4085-8b56-a184a7feceb6 1073741824 Jul 31 12:26:49 devstack sudo[103225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:26:49 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-7c8f235e-2314-4896-bb83-99e39a791497 tempest-SnapshotsActionsTest-2046780578 None] Create snapshot completed successfully Jul 31 12:26:49 devstack sudo[103193]: pam_unix(sudo:session): session closed for user root Jul 31 12:26:49 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-f536ecd8-7bab-4795-973f-0a738797a1bb tempest-TestVolumeBootPattern-1492021642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4cbd0fd2-77a8-43ca-bc93-b0249d6daea0_m9zobv_qdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-cce4d436-dd54-48f7-96a5-6746d683a50a" returned: 0 in 2.077s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:26:49 devstack cinder-volume[89182]: DEBUG cinder.image.image_utils [None req-f536ecd8-7bab-4795-973f-0a738797a1bb tempest-TestVolumeBootPattern-1492021642 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_4cbd0fd2-77a8-43ca-bc93-b0249d6daea0_m9zobv_qdevstack@QuobyteHD, size 112.00 MB, duration 2.08 sec, destination /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-cce4d436-dd54-48f7-96a5-6746d683a50a {{(pid=89182) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 31 12:26:49 devstack cinder-volume[89182]: INFO cinder.image.image_utils [None req-f536ecd8-7bab-4795-973f-0a738797a1bb tempest-TestVolumeBootPattern-1492021642 None] Converted 112.00 MB image at 53.90 MB/s Jul 31 12:26:49 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-f536ecd8-7bab-4795-973f-0a738797a1bb tempest-TestVolumeBootPattern-1492021642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-cce4d436-dd54-48f7-96a5-6746d683a50a 1G {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:26:49 devstack sudo[103230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-cce4d436-dd54-48f7-96a5-6746d683a50a 1G Jul 31 12:26:49 devstack sudo[103230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:26:49 devstack sudo[103225]: pam_unix(sudo:session): session closed for user root Jul 31 12:26:49 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-caa9752e-4d49-4e38-ab49-3eb18a87e040 tempest-CreateVolumesFromSnapshotTest-168995481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-d1a009ea-dd7e-4085-8b56-a184a7feceb6 1073741824" returned: 0 in 0.541s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:26:49 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-caa9752e-4d49-4e38-ab49-3eb18a87e040 tempest-CreateVolumesFromSnapshotTest-168995481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-d1a009ea-dd7e-4085-8b56-a184a7feceb6 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:26:49 devstack sudo[103232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-d1a009ea-dd7e-4085-8b56-a184a7feceb6 Jul 31 12:26:49 devstack sudo[103232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:26:49 devstack sudo[103230]: pam_unix(sudo:session): session closed for user root Jul 31 12:26:49 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-f536ecd8-7bab-4795-973f-0a738797a1bb tempest-TestVolumeBootPattern-1492021642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-cce4d436-dd54-48f7-96a5-6746d683a50a 1G" returned: 0 in 0.398s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:26:49 devstack cinder-volume[89182]: DEBUG cinder.volume.volume_utils [None req-f536ecd8-7bab-4795-973f-0a738797a1bb tempest-TestVolumeBootPattern-1492021642 None] Downloaded image 4cbd0fd2-77a8-43ca-bc93-b0249d6daea0 ((None, [{'url': 'file:///opt/stack/data/glance/images/4cbd0fd2-77a8-43ca-bc93-b0249d6daea0', 'metadata': {}}])) to volume cce4d436-dd54-48f7-96a5-6746d683a50a successfully. {{(pid=89182) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 31 12:26:49 devstack cinder-volume[89182]: DEBUG cinder.image.image_utils [None req-f536ecd8-7bab-4795-973f-0a738797a1bb tempest-TestVolumeBootPattern-1492021642 None] Temporary image 4cbd0fd2-77a8-43ca-bc93-b0249d6daea0 for user 9990e1c0be844340b618d408d28deefe is deleted. {{(pid=89182) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 31 12:26:49 devstack cinder-volume[89182]: DEBUG cinder.volume.volume_utils [None req-f536ecd8-7bab-4795-973f-0a738797a1bb tempest-TestVolumeBootPattern-1492021642 None] Marking volume cce4d436-dd54-48f7-96a5-6746d683a50a as bootable. {{(pid=89182) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 31 12:26:49 devstack cinder-volume[89182]: DEBUG cinder.volume.flows.manager.create_volume [None req-f536ecd8-7bab-4795-973f-0a738797a1bb tempest-TestVolumeBootPattern-1492021642 None] Copying metadata from image 4cbd0fd2-77a8-43ca-bc93-b0249d6daea0 to cce4d436-dd54-48f7-96a5-6746d683a50a. {{(pid=89182) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 31 12:26:49 devstack cinder-volume[89182]: DEBUG cinder.volume.flows.manager.create_volume [None req-f536ecd8-7bab-4795-973f-0a738797a1bb tempest-TestVolumeBootPattern-1492021642 None] Creating volume glance metadata for volume cce4d436-dd54-48f7-96a5-6746d683a50a backed by image 4cbd0fd2-77a8-43ca-bc93-b0249d6daea0 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '4cbd0fd2-77a8-43ca-bc93-b0249d6daea0', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=89182) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 31 12:26:49 devstack sudo[103232]: pam_unix(sudo:session): session closed for user root Jul 31 12:26:49 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-caa9752e-4d49-4e38-ab49-3eb18a87e040 tempest-CreateVolumesFromSnapshotTest-168995481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-d1a009ea-dd7e-4085-8b56-a184a7feceb6" returned: 0 in 0.282s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:26:49 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-caa9752e-4d49-4e38-ab49-3eb18a87e040 tempest-CreateVolumesFromSnapshotTest-168995481 None] <== create_volume: return (874ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'} {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 12:26:49 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-caa9752e-4d49-4e38-ab49-3eb18a87e040 tempest-CreateVolumesFromSnapshotTest-168995481 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.876s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:26:49 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-caa9752e-4d49-4e38-ab49-3eb18a87e040 tempest-CreateVolumesFromSnapshotTest-168995481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0d32570-599e-4478-a458-c5df9d606cd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d1a009ea-dd7e-4085-8b56-a184a7feceb6', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:26:49 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-caa9752e-4d49-4e38-ab49-3eb18a87e040 tempest-CreateVolumesFromSnapshotTest-168995481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (210e8e20-3f93-4737-872f-31a28bfc9ac2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:26:49 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-caa9752e-4d49-4e38-ab49-3eb18a87e040 tempest-CreateVolumesFromSnapshotTest-168995481 None] Volume volume-d1a009ea-dd7e-4085-8b56-a184a7feceb6 (d1a009ea-dd7e-4085-8b56-a184a7feceb6): created successfully Jul 31 12:26:49 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-caa9752e-4d49-4e38-ab49-3eb18a87e040 tempest-CreateVolumesFromSnapshotTest-168995481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (210e8e20-3f93-4737-872f-31a28bfc9ac2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:26:49 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-caa9752e-4d49-4e38-ab49-3eb18a87e040 tempest-CreateVolumesFromSnapshotTest-168995481 None] Flow 'volume_create_manager' (02f0c20c-c872-455c-8434-1284a3240bb9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:26:49 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-caa9752e-4d49-4e38-ab49-3eb18a87e040 tempest-CreateVolumesFromSnapshotTest-168995481 None] Created volume successfully. Jul 31 12:26:50 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-f536ecd8-7bab-4795-973f-0a738797a1bb tempest-TestVolumeBootPattern-1492021642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5bbc3b08-d392-46de-9dc1-5600da9c247f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cce4d436-dd54-48f7-96a5-6746d683a50a', 'volume_size': 1, 'image_id': '4cbd0fd2-77a8-43ca-bc93-b0249d6daea0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4cbd0fd2-77a8-43ca-bc93-b0249d6daea0', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3f77cb0dad9a46948c9357c65b22aef5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4cbd0fd2-77a8-43ca-bc93-b0249d6daea0', 'created_at': datetime.datetime(2026, 7, 31, 10, 8, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 31, 10, 8, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4cbd0fd2-77a8-43ca-bc93-b0249d6daea0/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:26:50 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-f536ecd8-7bab-4795-973f-0a738797a1bb tempest-TestVolumeBootPattern-1492021642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf19d973-2ee6-4ee1-bed7-ebe9dc62957e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:26:50 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-f536ecd8-7bab-4795-973f-0a738797a1bb tempest-TestVolumeBootPattern-1492021642 None] Volume volume-cce4d436-dd54-48f7-96a5-6746d683a50a (cce4d436-dd54-48f7-96a5-6746d683a50a): created successfully Jul 31 12:26:50 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-f536ecd8-7bab-4795-973f-0a738797a1bb tempest-TestVolumeBootPattern-1492021642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf19d973-2ee6-4ee1-bed7-ebe9dc62957e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:26:50 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-f536ecd8-7bab-4795-973f-0a738797a1bb tempest-TestVolumeBootPattern-1492021642 None] Flow 'volume_create_manager' (5a0dab62-e9d9-4bd3-9635-02f68d81c6e6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:26:50 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-f536ecd8-7bab-4795-973f-0a738797a1bb tempest-TestVolumeBootPattern-1492021642 None] Created volume successfully. Jul 31 12:26:50 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-4a02ceca-2eb3-4de6-81ae-ee12ab3b7cc8 tempest-SnapshotsActionsTest-789062798 None] Acquiring lock "cinder-7b821e61-f22b-4a78-a7b7-483229fd3971-delete_snapshot" by "delete_snapshot" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:26:50 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-4a02ceca-2eb3-4de6-81ae-ee12ab3b7cc8 tempest-SnapshotsActionsTest-789062798 None] Lock "cinder-7b821e61-f22b-4a78-a7b7-483229fd3971-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:26:50 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-4a02ceca-2eb3-4de6-81ae-ee12ab3b7cc8 tempest-SnapshotsActionsTest-789062798 None] Acquiring lock "cinder-quobyte-85b99b20-af4d-4dbb-a203-5a890c846394" by "delete_snapshot" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:26:50 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-4a02ceca-2eb3-4de6-81ae-ee12ab3b7cc8 tempest-SnapshotsActionsTest-789062798 None] Lock "cinder-quobyte-85b99b20-af4d-4dbb-a203-5a890c846394" acquired by "delete_snapshot" :: waited 0.024s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:26:50 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-4a02ceca-2eb3-4de6-81ae-ee12ab3b7cc8 tempest-SnapshotsActionsTest-789062798 None] Acquiring lock "cinder-quobyte-7b821e61-f22b-4a78-a7b7-483229fd3971" by "_delete_snapshot" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:26:50 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-4a02ceca-2eb3-4de6-81ae-ee12ab3b7cc8 tempest-SnapshotsActionsTest-789062798 None] Lock "cinder-quobyte-7b821e61-f22b-4a78-a7b7-483229fd3971" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:26:50 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-4a02ceca-2eb3-4de6-81ae-ee12ab3b7cc8 tempest-SnapshotsActionsTest-789062798 None] Deleting offline snapshot 7b821e61-f22b-4a78-a7b7-483229fd3971 of volume 85b99b20-af4d-4dbb-a203-5a890c846394 {{(pid=89182) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 31 12:26:50 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-4a02ceca-2eb3-4de6-81ae-ee12ab3b7cc8 tempest-SnapshotsActionsTest-789062798 None] snapshot_file for this snap is: volume-85b99b20-af4d-4dbb-a203-5a890c846394.7b821e61-f22b-4a78-a7b7-483229fd3971 {{(pid=89182) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 31 12:26:50 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[c64a0b5a-927a-4140-a344-508f5556d3e6]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:26:50 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-4a02ceca-2eb3-4de6-81ae-ee12ab3b7cc8 tempest-SnapshotsActionsTest-789062798 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-85b99b20-af4d-4dbb-a203-5a890c846394.7b821e61-f22b-4a78-a7b7-483229fd3971 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:26:50 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-1569d0d8-02ae-46a1-9e8c-9bb5ab685903 tempest-CreateVolumesFromSnapshotTest-168995481 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:26:50 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-1569d0d8-02ae-46a1-9e8c-9bb5ab685903 tempest-CreateVolumesFromSnapshotTest-168995481 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:26:50 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-1569d0d8-02ae-46a1-9e8c-9bb5ab685903 tempest-CreateVolumesFromSnapshotTest-168995481 None] Creating offline snapshot 58be61a7-74e7-4f2e-8215-e44ac57ef48f of volume d1a009ea-dd7e-4085-8b56-a184a7feceb6 {{(pid=89182) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 31 12:26:50 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[b004fa05-e65b-4391-8871-0a0ebf2d6633]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:26:50 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-1569d0d8-02ae-46a1-9e8c-9bb5ab685903 tempest-CreateVolumesFromSnapshotTest-168995481 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-d1a009ea-dd7e-4085-8b56-a184a7feceb6 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:26:50 devstack sudo[103238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-85b99b20-af4d-4dbb-a203-5a890c846394.7b821e61-f22b-4a78-a7b7-483229fd3971 Jul 31 12:26:50 devstack sudo[103238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:26:50 devstack sudo[103239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-d1a009ea-dd7e-4085-8b56-a184a7feceb6 Jul 31 12:26:50 devstack sudo[103239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:26:50 devstack sudo[103238]: pam_unix(sudo:session): session closed for user root Jul 31 12:26:50 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-4a02ceca-2eb3-4de6-81ae-ee12ab3b7cc8 tempest-SnapshotsActionsTest-789062798 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-85b99b20-af4d-4dbb-a203-5a890c846394.7b821e61-f22b-4a78-a7b7-483229fd3971" returned: 0 in 0.417s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:26:50 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-4a02ceca-2eb3-4de6-81ae-ee12ab3b7cc8 tempest-SnapshotsActionsTest-789062798 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-85b99b20-af4d-4dbb-a203-5a890c846394(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89182) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 12:26:50 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[8970e656-3da5-4ff7-9f81-1f5ac6fe4fd6]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:26:50 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-4a02ceca-2eb3-4de6-81ae-ee12ab3b7cc8 tempest-SnapshotsActionsTest-789062798 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-85b99b20-af4d-4dbb-a203-5a890c846394.df57d977-ee95-40d0-acbc-7a5f10d0db85 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:26:50 devstack sudo[103239]: pam_unix(sudo:session): session closed for user root Jul 31 12:26:50 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-1569d0d8-02ae-46a1-9e8c-9bb5ab685903 tempest-CreateVolumesFromSnapshotTest-168995481 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-d1a009ea-dd7e-4085-8b56-a184a7feceb6" returned: 0 in 0.397s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:26:50 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-1569d0d8-02ae-46a1-9e8c-9bb5ab685903 tempest-CreateVolumesFromSnapshotTest-168995481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-d1a009ea-dd7e-4085-8b56-a184a7feceb6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-d1a009ea-dd7e-4085-8b56-a184a7feceb6.58be61a7-74e7-4f2e-8215-e44ac57ef48f 1G {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:26:50 devstack sudo[103249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-d1a009ea-dd7e-4085-8b56-a184a7feceb6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-d1a009ea-dd7e-4085-8b56-a184a7feceb6.58be61a7-74e7-4f2e-8215-e44ac57ef48f 1G Jul 31 12:26:50 devstack sudo[103249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:26:50 devstack sudo[103248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-85b99b20-af4d-4dbb-a203-5a890c846394.df57d977-ee95-40d0-acbc-7a5f10d0db85 Jul 31 12:26:50 devstack sudo[103248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:26:51 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-186b1d5c-1252-4126-bbf5-592677c0c1c2 tempest-TestVolumeBootPattern-1492021642 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:26:51 devstack sudo[103248]: pam_unix(sudo:session): session closed for user root Jul 31 12:26:51 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-4a02ceca-2eb3-4de6-81ae-ee12ab3b7cc8 tempest-SnapshotsActionsTest-789062798 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-85b99b20-af4d-4dbb-a203-5a890c846394.df57d977-ee95-40d0-acbc-7a5f10d0db85" returned: 0 in 0.410s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:26:51 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-4a02ceca-2eb3-4de6-81ae-ee12ab3b7cc8 tempest-SnapshotsActionsTest-789062798 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-85b99b20-af4d-4dbb-a203-5a890c846394(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89182) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 12:26:51 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-4a02ceca-2eb3-4de6-81ae-ee12ab3b7cc8 tempest-SnapshotsActionsTest-789062798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-85b99b20-af4d-4dbb-a203-5a890c846394.7b821e61-f22b-4a78-a7b7-483229fd3971 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:26:51 devstack sudo[103258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-85b99b20-af4d-4dbb-a203-5a890c846394.7b821e61-f22b-4a78-a7b7-483229fd3971 Jul 31 12:26:51 devstack sudo[103258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:26:51 devstack sudo[103249]: pam_unix(sudo:session): session closed for user root Jul 31 12:26:51 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-1569d0d8-02ae-46a1-9e8c-9bb5ab685903 tempest-CreateVolumesFromSnapshotTest-168995481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-d1a009ea-dd7e-4085-8b56-a184a7feceb6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-d1a009ea-dd7e-4085-8b56-a184a7feceb6.58be61a7-74e7-4f2e-8215-e44ac57ef48f 1G" returned: 0 in 0.572s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:26:51 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-1569d0d8-02ae-46a1-9e8c-9bb5ab685903 tempest-CreateVolumesFromSnapshotTest-168995481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d1a009ea-dd7e-4085-8b56-a184a7feceb6 -F qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-d1a009ea-dd7e-4085-8b56-a184a7feceb6.58be61a7-74e7-4f2e-8215-e44ac57ef48f {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:26:51 devstack sudo[103262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d1a009ea-dd7e-4085-8b56-a184a7feceb6 -F qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-d1a009ea-dd7e-4085-8b56-a184a7feceb6.58be61a7-74e7-4f2e-8215-e44ac57ef48f Jul 31 12:26:51 devstack sudo[103262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:26:51 devstack sudo[103258]: pam_unix(sudo:session): session closed for user root Jul 31 12:26:51 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-4a02ceca-2eb3-4de6-81ae-ee12ab3b7cc8 tempest-SnapshotsActionsTest-789062798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-85b99b20-af4d-4dbb-a203-5a890c846394.7b821e61-f22b-4a78-a7b7-483229fd3971" returned: 0 in 0.427s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:26:51 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-4a02ceca-2eb3-4de6-81ae-ee12ab3b7cc8 tempest-SnapshotsActionsTest-789062798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-85b99b20-af4d-4dbb-a203-5a890c846394.7b821e61-f22b-4a78-a7b7-483229fd3971 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:26:51 devstack sudo[103270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-85b99b20-af4d-4dbb-a203-5a890c846394.7b821e61-f22b-4a78-a7b7-483229fd3971 Jul 31 12:26:51 devstack sudo[103270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:26:51 devstack sudo[103262]: pam_unix(sudo:session): session closed for user root Jul 31 12:26:51 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-1569d0d8-02ae-46a1-9e8c-9bb5ab685903 tempest-CreateVolumesFromSnapshotTest-168995481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d1a009ea-dd7e-4085-8b56-a184a7feceb6 -F qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-d1a009ea-dd7e-4085-8b56-a184a7feceb6.58be61a7-74e7-4f2e-8215-e44ac57ef48f" returned: 0 in 0.345s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:26:51 devstack cinder-volume[89182]: WARNING cinder.volume.drivers.remotefs [None req-1569d0d8-02ae-46a1-9e8c-9bb5ab685903 tempest-CreateVolumesFromSnapshotTest-168995481 None] /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-d1a009ea-dd7e-4085-8b56-a184a7feceb6.58be61a7-74e7-4f2e-8215-e44ac57ef48f is being set with open permissions: ugo+rw Jul 31 12:26:51 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-1569d0d8-02ae-46a1-9e8c-9bb5ab685903 tempest-CreateVolumesFromSnapshotTest-168995481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-d1a009ea-dd7e-4085-8b56-a184a7feceb6.58be61a7-74e7-4f2e-8215-e44ac57ef48f {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:26:51 devstack sudo[103273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-d1a009ea-dd7e-4085-8b56-a184a7feceb6.58be61a7-74e7-4f2e-8215-e44ac57ef48f Jul 31 12:26:51 devstack sudo[103273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:26:51 devstack sudo[103270]: pam_unix(sudo:session): session closed for user root Jul 31 12:26:51 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-4a02ceca-2eb3-4de6-81ae-ee12ab3b7cc8 tempest-SnapshotsActionsTest-789062798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-85b99b20-af4d-4dbb-a203-5a890c846394.7b821e61-f22b-4a78-a7b7-483229fd3971" returned: 0 in 0.281s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:26:52 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-4a02ceca-2eb3-4de6-81ae-ee12ab3b7cc8 tempest-SnapshotsActionsTest-789062798 None] Lock "cinder-quobyte-7b821e61-f22b-4a78-a7b7-483229fd3971" released by "_delete_snapshot" :: held 1.680s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:26:52 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-4a02ceca-2eb3-4de6-81ae-ee12ab3b7cc8 tempest-SnapshotsActionsTest-789062798 None] Lock "cinder-quobyte-85b99b20-af4d-4dbb-a203-5a890c846394" released by "delete_snapshot" :: held 1.711s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:26:52 devstack sudo[103273]: pam_unix(sudo:session): session closed for user root Jul 31 12:26:52 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-1569d0d8-02ae-46a1-9e8c-9bb5ab685903 tempest-CreateVolumesFromSnapshotTest-168995481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-d1a009ea-dd7e-4085-8b56-a184a7feceb6.58be61a7-74e7-4f2e-8215-e44ac57ef48f" returned: 0 in 0.262s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:26:52 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-1569d0d8-02ae-46a1-9e8c-9bb5ab685903 tempest-CreateVolumesFromSnapshotTest-168995481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-d1a009ea-dd7e-4085-8b56-a184a7feceb6.info {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:26:52 devstack cinder-volume[89182]: DEBUG cinder.quota [None req-4a02ceca-2eb3-4de6-81ae-ee12ab3b7cc8 tempest-SnapshotsActionsTest-789062798 None] Created reservations ['7404a173-bb4d-473a-894a-1388891c0140', 'cc767089-7ec5-4d8e-ad75-51940f529da1', 'ba988361-64a7-4576-baf6-9d3e7fde45d7', '726d44be-d974-4657-883b-850f59227000'] {{(pid=89182) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 12:26:52 devstack sudo[103277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-d1a009ea-dd7e-4085-8b56-a184a7feceb6.info Jul 31 12:26:52 devstack sudo[103277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:26:52 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-4a02ceca-2eb3-4de6-81ae-ee12ab3b7cc8 tempest-SnapshotsActionsTest-789062798 None] Delete snapshot completed successfully. Jul 31 12:26:52 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-4a02ceca-2eb3-4de6-81ae-ee12ab3b7cc8 tempest-SnapshotsActionsTest-789062798 None] Lock "cinder-7b821e61-f22b-4a78-a7b7-483229fd3971-delete_snapshot" released by "delete_snapshot" :: held 1.921s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:26:52 devstack sudo[103277]: pam_unix(sudo:session): session closed for user root Jul 31 12:26:52 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-1569d0d8-02ae-46a1-9e8c-9bb5ab685903 tempest-CreateVolumesFromSnapshotTest-168995481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-d1a009ea-dd7e-4085-8b56-a184a7feceb6.info" returned: 0 in 0.296s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:26:52 devstack cinder-volume[89182]: WARNING cinder.volume.drivers.remotefs [None req-1569d0d8-02ae-46a1-9e8c-9bb5ab685903 tempest-CreateVolumesFromSnapshotTest-168995481 None] /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-d1a009ea-dd7e-4085-8b56-a184a7feceb6.info is being set with open permissions: ugo+rw Jul 31 12:26:52 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-1569d0d8-02ae-46a1-9e8c-9bb5ab685903 tempest-CreateVolumesFromSnapshotTest-168995481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-d1a009ea-dd7e-4085-8b56-a184a7feceb6.info {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:26:52 devstack sudo[103280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-d1a009ea-dd7e-4085-8b56-a184a7feceb6.info Jul 31 12:26:52 devstack sudo[103280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:26:52 devstack sudo[103280]: pam_unix(sudo:session): session closed for user root Jul 31 12:26:52 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-1569d0d8-02ae-46a1-9e8c-9bb5ab685903 tempest-CreateVolumesFromSnapshotTest-168995481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-d1a009ea-dd7e-4085-8b56-a184a7feceb6.info" returned: 0 in 0.293s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:26:52 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-1569d0d8-02ae-46a1-9e8c-9bb5ab685903 tempest-CreateVolumesFromSnapshotTest-168995481 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.294s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:26:52 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-186b1d5c-1252-4126-bbf5-592677c0c1c2 tempest-TestVolumeBootPattern-1492021642 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.506s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:26:52 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-186b1d5c-1252-4126-bbf5-592677c0c1c2 tempest-TestVolumeBootPattern-1492021642 None] Creating offline snapshot 57aa151f-800a-418b-8ea1-c82856fc341d of volume cce4d436-dd54-48f7-96a5-6746d683a50a {{(pid=89182) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 31 12:26:52 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-1569d0d8-02ae-46a1-9e8c-9bb5ab685903 tempest-CreateVolumesFromSnapshotTest-168995481 None] Create snapshot completed successfully Jul 31 12:26:52 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-7de0c14c-e3c7-41b7-b45b-51ce2af39898 tempest-SnapshotsActionsTest-2046780578 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:26:52 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[9080b261-2dbb-4efa-a73b-4896a440ce17]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:26:52 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-186b1d5c-1252-4126-bbf5-592677c0c1c2 tempest-TestVolumeBootPattern-1492021642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-cce4d436-dd54-48f7-96a5-6746d683a50a {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:26:52 devstack sudo[103283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-cce4d436-dd54-48f7-96a5-6746d683a50a Jul 31 12:26:52 devstack sudo[103283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:26:53 devstack cinder-volume[89182]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d52ab33-fbb0-432b-8f00-06f25d6ee0a4 tempest-VolumesListAdminTestJSON-1581256828 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89182) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 12:26:53 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-5d52ab33-fbb0-432b-8f00-06f25d6ee0a4 tempest-VolumesListAdminTestJSON-1581256828 None] Flow 'volume_create_manager' (569ca3e1-4d9a-4fef-a258-3531bc4a67a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:26:53 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-5d52ab33-fbb0-432b-8f00-06f25d6ee0a4 tempest-VolumesListAdminTestJSON-1581256828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2327b250-fd41-4839-b026-b73f1cf45fa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:26:53 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-5d52ab33-fbb0-432b-8f00-06f25d6ee0a4 tempest-VolumesListAdminTestJSON-1581256828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2327b250-fd41-4839-b026-b73f1cf45fa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:26:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1544270242',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b408f9f4-4109-4257-948c-c326a7de6ab4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e9c36764168e42c0996c692b5fa36f0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:26:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:26:53Z,use_quota=True,user_id='88dcfa388301478c8ac4e44d0ae139b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:26:53 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-5d52ab33-fbb0-432b-8f00-06f25d6ee0a4 tempest-VolumesListAdminTestJSON-1581256828 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f975fdfc-8a6d-4535-a1a5-5186406fc427) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:26:53 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-5d52ab33-fbb0-432b-8f00-06f25d6ee0a4 tempest-VolumesListAdminTestJSON-1581256828 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f975fdfc-8a6d-4535-a1a5-5186406fc427) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:26:53 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-5d52ab33-fbb0-432b-8f00-06f25d6ee0a4 tempest-VolumesListAdminTestJSON-1581256828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6db9a3e6-cfca-4f6d-bebc-dea91d6e869b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:26:53 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-5d52ab33-fbb0-432b-8f00-06f25d6ee0a4 tempest-VolumesListAdminTestJSON-1581256828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6db9a3e6-cfca-4f6d-bebc-dea91d6e869b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b408f9f4-4109-4257-948c-c326a7de6ab4', 'volume_name': 'volume-b408f9f4-4109-4257-948c-c326a7de6ab4', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:26:53 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-5d52ab33-fbb0-432b-8f00-06f25d6ee0a4 tempest-VolumesListAdminTestJSON-1581256828 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (debf20d2-5c4a-451f-a3cb-ecc349d29927) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:26:53 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-5d52ab33-fbb0-432b-8f00-06f25d6ee0a4 tempest-VolumesListAdminTestJSON-1581256828 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (debf20d2-5c4a-451f-a3cb-ecc349d29927) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:26:53 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-5d52ab33-fbb0-432b-8f00-06f25d6ee0a4 tempest-VolumesListAdminTestJSON-1581256828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (741b764b-600e-4a5d-9a51-a730ebd1d7e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:26:53 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-5d52ab33-fbb0-432b-8f00-06f25d6ee0a4 tempest-VolumesListAdminTestJSON-1581256828 None] Volume b408f9f4-4109-4257-948c-c326a7de6ab4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b408f9f4-4109-4257-948c-c326a7de6ab4', 'volume_size': 1} Jul 31 12:26:53 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-5d52ab33-fbb0-432b-8f00-06f25d6ee0a4 tempest-VolumesListAdminTestJSON-1581256828 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:26:53 devstack sudo[103283]: pam_unix(sudo:session): session closed for user root Jul 31 12:26:53 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-186b1d5c-1252-4126-bbf5-592677c0c1c2 tempest-TestVolumeBootPattern-1492021642 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-cce4d436-dd54-48f7-96a5-6746d683a50a" returned: 0 in 0.385s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:26:53 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-186b1d5c-1252-4126-bbf5-592677c0c1c2 tempest-TestVolumeBootPattern-1492021642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-cce4d436-dd54-48f7-96a5-6746d683a50a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-cce4d436-dd54-48f7-96a5-6746d683a50a.57aa151f-800a-418b-8ea1-c82856fc341d 1G {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:26:53 devstack sudo[103288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-cce4d436-dd54-48f7-96a5-6746d683a50a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-cce4d436-dd54-48f7-96a5-6746d683a50a.57aa151f-800a-418b-8ea1-c82856fc341d 1G Jul 31 12:26:53 devstack sudo[103288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:26:53 devstack sudo[103288]: pam_unix(sudo:session): session closed for user root Jul 31 12:26:53 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-186b1d5c-1252-4126-bbf5-592677c0c1c2 tempest-TestVolumeBootPattern-1492021642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-cce4d436-dd54-48f7-96a5-6746d683a50a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-cce4d436-dd54-48f7-96a5-6746d683a50a.57aa151f-800a-418b-8ea1-c82856fc341d 1G" returned: 0 in 0.417s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:26:53 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-186b1d5c-1252-4126-bbf5-592677c0c1c2 tempest-TestVolumeBootPattern-1492021642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cce4d436-dd54-48f7-96a5-6746d683a50a -F qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-cce4d436-dd54-48f7-96a5-6746d683a50a.57aa151f-800a-418b-8ea1-c82856fc341d {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:26:53 devstack sudo[103293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cce4d436-dd54-48f7-96a5-6746d683a50a -F qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-cce4d436-dd54-48f7-96a5-6746d683a50a.57aa151f-800a-418b-8ea1-c82856fc341d Jul 31 12:26:53 devstack sudo[103293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:26:53 devstack sudo[103293]: pam_unix(sudo:session): session closed for user root Jul 31 12:26:53 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-186b1d5c-1252-4126-bbf5-592677c0c1c2 tempest-TestVolumeBootPattern-1492021642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cce4d436-dd54-48f7-96a5-6746d683a50a -F qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-cce4d436-dd54-48f7-96a5-6746d683a50a.57aa151f-800a-418b-8ea1-c82856fc341d" returned: 0 in 0.307s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:26:53 devstack cinder-volume[89182]: WARNING cinder.volume.drivers.remotefs [None req-186b1d5c-1252-4126-bbf5-592677c0c1c2 tempest-TestVolumeBootPattern-1492021642 None] /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-cce4d436-dd54-48f7-96a5-6746d683a50a.57aa151f-800a-418b-8ea1-c82856fc341d is being set with open permissions: ugo+rw Jul 31 12:26:53 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-186b1d5c-1252-4126-bbf5-592677c0c1c2 tempest-TestVolumeBootPattern-1492021642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-cce4d436-dd54-48f7-96a5-6746d683a50a.57aa151f-800a-418b-8ea1-c82856fc341d {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:26:53 devstack sudo[103298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-cce4d436-dd54-48f7-96a5-6746d683a50a.57aa151f-800a-418b-8ea1-c82856fc341d Jul 31 12:26:53 devstack sudo[103298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:26:54 devstack cinder-volume[89182]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b373a01-66b1-4380-a9a3-0e8c096e89af tempest-CreateVolumesFromSnapshotTest-168995481 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89182) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 12:26:54 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-1b373a01-66b1-4380-a9a3-0e8c096e89af tempest-CreateVolumesFromSnapshotTest-168995481 None] Flow 'volume_create_manager' (fe8bc52f-3322-4523-8d91-24b4fdb2b2b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:26:54 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-1b373a01-66b1-4380-a9a3-0e8c096e89af tempest-CreateVolumesFromSnapshotTest-168995481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c0d763c-5749-4e2b-b6d1-84bf3d3f24a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:26:54 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-1b373a01-66b1-4380-a9a3-0e8c096e89af tempest-CreateVolumesFromSnapshotTest-168995481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c0d763c-5749-4e2b-b6d1-84bf3d3f24a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:26:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-524418934',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2684e1f9-574e-4241-8885-f394fb33552e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4fbb56b870e4e63b039b6fd15327bfb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:26:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:26:54Z,use_quota=True,user_id='e9773ece88724a66adcb155ee4097493',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:26:54 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-1b373a01-66b1-4380-a9a3-0e8c096e89af tempest-CreateVolumesFromSnapshotTest-168995481 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (174e9182-01f4-4d09-88b5-59da18034267) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:26:54 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-1b373a01-66b1-4380-a9a3-0e8c096e89af tempest-CreateVolumesFromSnapshotTest-168995481 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (174e9182-01f4-4d09-88b5-59da18034267) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:26:54 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-1b373a01-66b1-4380-a9a3-0e8c096e89af tempest-CreateVolumesFromSnapshotTest-168995481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62eb9929-8aa4-45d4-a61d-acc281e3069c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:26:54 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-1b373a01-66b1-4380-a9a3-0e8c096e89af tempest-CreateVolumesFromSnapshotTest-168995481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62eb9929-8aa4-45d4-a61d-acc281e3069c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2684e1f9-574e-4241-8885-f394fb33552e', 'volume_name': 'volume-2684e1f9-574e-4241-8885-f394fb33552e', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:26:54 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-1b373a01-66b1-4380-a9a3-0e8c096e89af tempest-CreateVolumesFromSnapshotTest-168995481 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3263c315-92e0-4566-8613-844d539d3579) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:26:54 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-1b373a01-66b1-4380-a9a3-0e8c096e89af tempest-CreateVolumesFromSnapshotTest-168995481 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3263c315-92e0-4566-8613-844d539d3579) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:26:54 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-1b373a01-66b1-4380-a9a3-0e8c096e89af tempest-CreateVolumesFromSnapshotTest-168995481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22d3c724-2ef9-43bf-8fa8-71c46d72345a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:26:54 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-1b373a01-66b1-4380-a9a3-0e8c096e89af tempest-CreateVolumesFromSnapshotTest-168995481 None] Volume 2684e1f9-574e-4241-8885-f394fb33552e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2684e1f9-574e-4241-8885-f394fb33552e', 'volume_size': 1} Jul 31 12:26:54 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-1b373a01-66b1-4380-a9a3-0e8c096e89af tempest-CreateVolumesFromSnapshotTest-168995481 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:26:54 devstack sudo[103298]: pam_unix(sudo:session): session closed for user root Jul 31 12:26:54 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-186b1d5c-1252-4126-bbf5-592677c0c1c2 tempest-TestVolumeBootPattern-1492021642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-cce4d436-dd54-48f7-96a5-6746d683a50a.57aa151f-800a-418b-8ea1-c82856fc341d" returned: 0 in 0.284s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:26:54 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-186b1d5c-1252-4126-bbf5-592677c0c1c2 tempest-TestVolumeBootPattern-1492021642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-cce4d436-dd54-48f7-96a5-6746d683a50a.info {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:26:54 devstack sudo[103301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-cce4d436-dd54-48f7-96a5-6746d683a50a.info Jul 31 12:26:54 devstack sudo[103301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:26:54 devstack cinder-volume[89182]: DEBUG cinder.volume.flows.manager.create_volume [None req-d293ba4a-34ae-4c39-a8e9-37b249c322af tempest-CreateVolumesFromSnapshotTest-168995481 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89182) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 12:26:54 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-d293ba4a-34ae-4c39-a8e9-37b249c322af tempest-CreateVolumesFromSnapshotTest-168995481 None] Flow 'volume_create_manager' (e0306af2-8bb8-4aa3-a632-593b68841b1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:26:54 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-d293ba4a-34ae-4c39-a8e9-37b249c322af tempest-CreateVolumesFromSnapshotTest-168995481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b9d566f-82ea-42ae-9649-042b10974710) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:26:54 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-d293ba4a-34ae-4c39-a8e9-37b249c322af tempest-CreateVolumesFromSnapshotTest-168995481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b9d566f-82ea-42ae-9649-042b10974710) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:26:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1728241604',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84a55734-08b1-4a47-b662-06a7fd45573e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4fbb56b870e4e63b039b6fd15327bfb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:26:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:26:54Z,use_quota=True,user_id='e9773ece88724a66adcb155ee4097493',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:26:54 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-d293ba4a-34ae-4c39-a8e9-37b249c322af tempest-CreateVolumesFromSnapshotTest-168995481 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca806383-c0c5-41f8-b891-372331ba5d51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:26:54 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-d293ba4a-34ae-4c39-a8e9-37b249c322af tempest-CreateVolumesFromSnapshotTest-168995481 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca806383-c0c5-41f8-b891-372331ba5d51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:26:54 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-d293ba4a-34ae-4c39-a8e9-37b249c322af tempest-CreateVolumesFromSnapshotTest-168995481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e40af7b5-ad85-4c6a-819d-c5b271a811f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:26:54 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-d293ba4a-34ae-4c39-a8e9-37b249c322af tempest-CreateVolumesFromSnapshotTest-168995481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e40af7b5-ad85-4c6a-819d-c5b271a811f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '84a55734-08b1-4a47-b662-06a7fd45573e', 'volume_name': 'volume-84a55734-08b1-4a47-b662-06a7fd45573e', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:26:54 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-d293ba4a-34ae-4c39-a8e9-37b249c322af tempest-CreateVolumesFromSnapshotTest-168995481 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05fa78b9-5485-427d-be1c-0abc61d65872) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:26:54 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-d293ba4a-34ae-4c39-a8e9-37b249c322af tempest-CreateVolumesFromSnapshotTest-168995481 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05fa78b9-5485-427d-be1c-0abc61d65872) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:26:54 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-d293ba4a-34ae-4c39-a8e9-37b249c322af tempest-CreateVolumesFromSnapshotTest-168995481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1a605c6-af46-48b1-a76a-c5301ef8cda8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:26:54 devstack sudo[103301]: pam_unix(sudo:session): session closed for user root Jul 31 12:26:54 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-d293ba4a-34ae-4c39-a8e9-37b249c322af tempest-CreateVolumesFromSnapshotTest-168995481 None] Volume 84a55734-08b1-4a47-b662-06a7fd45573e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-84a55734-08b1-4a47-b662-06a7fd45573e', 'volume_size': 1} Jul 31 12:26:54 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-d293ba4a-34ae-4c39-a8e9-37b249c322af tempest-CreateVolumesFromSnapshotTest-168995481 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:26:54 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-186b1d5c-1252-4126-bbf5-592677c0c1c2 tempest-TestVolumeBootPattern-1492021642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-cce4d436-dd54-48f7-96a5-6746d683a50a.info" returned: 0 in 0.277s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:26:54 devstack cinder-volume[89182]: WARNING cinder.volume.drivers.remotefs [None req-186b1d5c-1252-4126-bbf5-592677c0c1c2 tempest-TestVolumeBootPattern-1492021642 None] /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-cce4d436-dd54-48f7-96a5-6746d683a50a.info is being set with open permissions: ugo+rw Jul 31 12:26:54 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-186b1d5c-1252-4126-bbf5-592677c0c1c2 tempest-TestVolumeBootPattern-1492021642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-cce4d436-dd54-48f7-96a5-6746d683a50a.info {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:26:54 devstack sudo[103304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-cce4d436-dd54-48f7-96a5-6746d683a50a.info Jul 31 12:26:54 devstack sudo[103304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:26:54 devstack cinder-volume[89182]: DEBUG cinder.volume.flows.manager.create_volume [None req-e28f6d7a-0f5d-4a22-b81a-881a9127edd0 tempest-CreateVolumesFromSnapshotTest-168995481 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89182) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 12:26:54 devstack sudo[103304]: pam_unix(sudo:session): session closed for user root Jul 31 12:26:54 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-e28f6d7a-0f5d-4a22-b81a-881a9127edd0 tempest-CreateVolumesFromSnapshotTest-168995481 None] Flow 'volume_create_manager' (169c5392-54d4-4633-96fa-8dd291d7dde9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:26:54 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-e28f6d7a-0f5d-4a22-b81a-881a9127edd0 tempest-CreateVolumesFromSnapshotTest-168995481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e0b87f9-e5ba-4ff6-8cc5-3fddb9b434cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:26:54 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-186b1d5c-1252-4126-bbf5-592677c0c1c2 tempest-TestVolumeBootPattern-1492021642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-cce4d436-dd54-48f7-96a5-6746d683a50a.info" returned: 0 in 0.286s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:26:54 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-186b1d5c-1252-4126-bbf5-592677c0c1c2 tempest-TestVolumeBootPattern-1492021642 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.082s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:26:54 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-e28f6d7a-0f5d-4a22-b81a-881a9127edd0 tempest-CreateVolumesFromSnapshotTest-168995481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e0b87f9-e5ba-4ff6-8cc5-3fddb9b434cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:26:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-138132442',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44eb8ba9-1878-4e4b-a9d7-7a345792c58e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4fbb56b870e4e63b039b6fd15327bfb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:26:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:26:55Z,use_quota=True,user_id='e9773ece88724a66adcb155ee4097493',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:26:54 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-e28f6d7a-0f5d-4a22-b81a-881a9127edd0 tempest-CreateVolumesFromSnapshotTest-168995481 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ba27c6d-d936-4f71-9d5d-adbb485f1f9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:26:54 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-e28f6d7a-0f5d-4a22-b81a-881a9127edd0 tempest-CreateVolumesFromSnapshotTest-168995481 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ba27c6d-d936-4f71-9d5d-adbb485f1f9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:26:54 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-e28f6d7a-0f5d-4a22-b81a-881a9127edd0 tempest-CreateVolumesFromSnapshotTest-168995481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f1e63f9-689d-4dc1-bdbe-23e8569f9cfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:26:54 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-e28f6d7a-0f5d-4a22-b81a-881a9127edd0 tempest-CreateVolumesFromSnapshotTest-168995481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f1e63f9-689d-4dc1-bdbe-23e8569f9cfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '44eb8ba9-1878-4e4b-a9d7-7a345792c58e', 'volume_name': 'volume-44eb8ba9-1878-4e4b-a9d7-7a345792c58e', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:26:54 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-e28f6d7a-0f5d-4a22-b81a-881a9127edd0 tempest-CreateVolumesFromSnapshotTest-168995481 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32ae668c-a5c0-4877-8531-3f6c21adf1eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:26:54 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-e28f6d7a-0f5d-4a22-b81a-881a9127edd0 tempest-CreateVolumesFromSnapshotTest-168995481 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32ae668c-a5c0-4877-8531-3f6c21adf1eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:26:54 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-e28f6d7a-0f5d-4a22-b81a-881a9127edd0 tempest-CreateVolumesFromSnapshotTest-168995481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e73496f8-b906-47c1-bbe4-eae89ab28332) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:26:54 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-e28f6d7a-0f5d-4a22-b81a-881a9127edd0 tempest-CreateVolumesFromSnapshotTest-168995481 None] Volume 44eb8ba9-1878-4e4b-a9d7-7a345792c58e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-44eb8ba9-1878-4e4b-a9d7-7a345792c58e', 'volume_size': 1} Jul 31 12:26:54 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-e28f6d7a-0f5d-4a22-b81a-881a9127edd0 tempest-CreateVolumesFromSnapshotTest-168995481 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:26:54 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-e28f6d7a-0f5d-4a22-b81a-881a9127edd0 tempest-CreateVolumesFromSnapshotTest-168995481 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:26:54 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-e28f6d7a-0f5d-4a22-b81a-881a9127edd0 tempest-CreateVolumesFromSnapshotTest-168995481 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:26:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-138132442',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44eb8ba9-1878-4e4b-a9d7-7a345792c58e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4fbb56b870e4e63b039b6fd15327bfb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:26:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:26:55Z,use_quota=True,user_id='e9773ece88724a66adcb155ee4097493',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)}" {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 12:26:54 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-e28f6d7a-0f5d-4a22-b81a-881a9127edd0 tempest-CreateVolumesFromSnapshotTest-168995481 None] Creating volume 44eb8ba9-1878-4e4b-a9d7-7a345792c58e {{(pid=89182) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 12:26:54 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-e28f6d7a-0f5d-4a22-b81a-881a9127edd0 tempest-CreateVolumesFromSnapshotTest-168995481 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:26:54 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-e28f6d7a-0f5d-4a22-b81a-881a9127edd0 tempest-CreateVolumesFromSnapshotTest-168995481 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:26:54 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-e28f6d7a-0f5d-4a22-b81a-881a9127edd0 tempest-CreateVolumesFromSnapshotTest-168995481 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:26:54 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-e28f6d7a-0f5d-4a22-b81a-881a9127edd0 tempest-CreateVolumesFromSnapshotTest-168995481 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:26:54 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-e28f6d7a-0f5d-4a22-b81a-881a9127edd0 tempest-CreateVolumesFromSnapshotTest-168995481 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:26:54 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-e28f6d7a-0f5d-4a22-b81a-881a9127edd0 tempest-CreateVolumesFromSnapshotTest-168995481 None] Selected osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 as target Quobyte volume. {{(pid=89182) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 12:26:54 devstack cinder-volume[89182]: INFO cinder.volume.drivers.remotefs [None req-e28f6d7a-0f5d-4a22-b81a-881a9127edd0 tempest-CreateVolumesFromSnapshotTest-168995481 None] casted to osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 Jul 31 12:26:54 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-e28f6d7a-0f5d-4a22-b81a-881a9127edd0 tempest-CreateVolumesFromSnapshotTest-168995481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-44eb8ba9-1878-4e4b-a9d7-7a345792c58e 1073741824 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:26:54 devstack sudo[103307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-44eb8ba9-1878-4e4b-a9d7-7a345792c58e 1073741824 Jul 31 12:26:54 devstack sudo[103307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:26:54 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-186b1d5c-1252-4126-bbf5-592677c0c1c2 tempest-TestVolumeBootPattern-1492021642 None] Create snapshot completed successfully Jul 31 12:26:55 devstack cinder-volume[89182]: DEBUG cinder.volume.flows.manager.create_volume [None req-f8911310-cd2c-4f98-98c4-99c7d6359904 tempest-CreateVolumesFromSnapshotTest-168995481 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89182) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 12:26:55 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-f8911310-cd2c-4f98-98c4-99c7d6359904 tempest-CreateVolumesFromSnapshotTest-168995481 None] Flow 'volume_create_manager' (3f573a51-946d-4435-9c27-ec3b9097cf96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:26:55 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-f8911310-cd2c-4f98-98c4-99c7d6359904 tempest-CreateVolumesFromSnapshotTest-168995481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b241b5d-fbbf-4f12-aa5c-33deda1b1082) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:26:55 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-f8911310-cd2c-4f98-98c4-99c7d6359904 tempest-CreateVolumesFromSnapshotTest-168995481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b241b5d-fbbf-4f12-aa5c-33deda1b1082) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:26:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1545042786',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f0c6b53-6ce8-4467-bbb7-36158dd1dc8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4fbb56b870e4e63b039b6fd15327bfb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:26:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:26:55Z,use_quota=True,user_id='e9773ece88724a66adcb155ee4097493',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:26:55 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-f8911310-cd2c-4f98-98c4-99c7d6359904 tempest-CreateVolumesFromSnapshotTest-168995481 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bcfacada-ffc2-419a-a0d7-730703e442d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:26:55 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-f8911310-cd2c-4f98-98c4-99c7d6359904 tempest-CreateVolumesFromSnapshotTest-168995481 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bcfacada-ffc2-419a-a0d7-730703e442d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:26:55 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-f8911310-cd2c-4f98-98c4-99c7d6359904 tempest-CreateVolumesFromSnapshotTest-168995481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5965232-b740-459a-9231-de229b899dfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:26:55 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-f8911310-cd2c-4f98-98c4-99c7d6359904 tempest-CreateVolumesFromSnapshotTest-168995481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5965232-b740-459a-9231-de229b899dfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1f0c6b53-6ce8-4467-bbb7-36158dd1dc8c', 'volume_name': 'volume-1f0c6b53-6ce8-4467-bbb7-36158dd1dc8c', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:26:55 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-f8911310-cd2c-4f98-98c4-99c7d6359904 tempest-CreateVolumesFromSnapshotTest-168995481 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa360f3f-bb19-4c22-9f6b-3ebaf49092b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:26:55 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-f8911310-cd2c-4f98-98c4-99c7d6359904 tempest-CreateVolumesFromSnapshotTest-168995481 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa360f3f-bb19-4c22-9f6b-3ebaf49092b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:26:55 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-f8911310-cd2c-4f98-98c4-99c7d6359904 tempest-CreateVolumesFromSnapshotTest-168995481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31f0c524-4566-452a-aeda-55db7ab62448) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:26:55 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-f8911310-cd2c-4f98-98c4-99c7d6359904 tempest-CreateVolumesFromSnapshotTest-168995481 None] Volume 1f0c6b53-6ce8-4467-bbb7-36158dd1dc8c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1f0c6b53-6ce8-4467-bbb7-36158dd1dc8c', 'volume_size': 1} Jul 31 12:26:55 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-f8911310-cd2c-4f98-98c4-99c7d6359904 tempest-CreateVolumesFromSnapshotTest-168995481 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:26:55 devstack sudo[103307]: pam_unix(sudo:session): session closed for user root Jul 31 12:26:55 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-e28f6d7a-0f5d-4a22-b81a-881a9127edd0 tempest-CreateVolumesFromSnapshotTest-168995481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-44eb8ba9-1878-4e4b-a9d7-7a345792c58e 1073741824" returned: 0 in 0.536s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:26:55 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-e28f6d7a-0f5d-4a22-b81a-881a9127edd0 tempest-CreateVolumesFromSnapshotTest-168995481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-44eb8ba9-1878-4e4b-a9d7-7a345792c58e {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:26:55 devstack sudo[103313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-44eb8ba9-1878-4e4b-a9d7-7a345792c58e Jul 31 12:26:55 devstack sudo[103313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:26:55 devstack cinder-volume[89182]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa60ee8c-9923-474f-8d36-04e4ce55a72e tempest-CreateVolumesFromSnapshotTest-168995481 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89182) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 12:26:55 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-fa60ee8c-9923-474f-8d36-04e4ce55a72e tempest-CreateVolumesFromSnapshotTest-168995481 None] Flow 'volume_create_manager' (3771cd1f-2e2b-4e9b-bbd1-c1ed342878eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:26:55 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-fa60ee8c-9923-474f-8d36-04e4ce55a72e tempest-CreateVolumesFromSnapshotTest-168995481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (890bd9b6-bab0-4d5b-9664-029170bb7bd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:26:55 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-fa60ee8c-9923-474f-8d36-04e4ce55a72e tempest-CreateVolumesFromSnapshotTest-168995481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (890bd9b6-bab0-4d5b-9664-029170bb7bd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:26:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1719879445',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0414ad6-02b7-4a2c-b8cd-86fafc7a5de6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4fbb56b870e4e63b039b6fd15327bfb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:26:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:26:56Z,use_quota=True,user_id='e9773ece88724a66adcb155ee4097493',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:26:55 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-fa60ee8c-9923-474f-8d36-04e4ce55a72e tempest-CreateVolumesFromSnapshotTest-168995481 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f42d2524-73f2-4d6e-a3f0-b2ccee494fa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:26:55 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-fa60ee8c-9923-474f-8d36-04e4ce55a72e tempest-CreateVolumesFromSnapshotTest-168995481 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f42d2524-73f2-4d6e-a3f0-b2ccee494fa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:26:55 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-fa60ee8c-9923-474f-8d36-04e4ce55a72e tempest-CreateVolumesFromSnapshotTest-168995481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ac28e5b-d97e-4423-929b-8a51e58ba8ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:26:55 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-fa60ee8c-9923-474f-8d36-04e4ce55a72e tempest-CreateVolumesFromSnapshotTest-168995481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ac28e5b-d97e-4423-929b-8a51e58ba8ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f0414ad6-02b7-4a2c-b8cd-86fafc7a5de6', 'volume_name': 'volume-f0414ad6-02b7-4a2c-b8cd-86fafc7a5de6', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:26:55 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-fa60ee8c-9923-474f-8d36-04e4ce55a72e tempest-CreateVolumesFromSnapshotTest-168995481 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (575cdea3-3c7b-4c79-b812-6fbd870d669d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:26:55 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-fa60ee8c-9923-474f-8d36-04e4ce55a72e tempest-CreateVolumesFromSnapshotTest-168995481 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (575cdea3-3c7b-4c79-b812-6fbd870d669d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:26:55 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-fa60ee8c-9923-474f-8d36-04e4ce55a72e tempest-CreateVolumesFromSnapshotTest-168995481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1600c4f7-baaf-46cd-9bdf-06e27d715122) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:26:55 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-fa60ee8c-9923-474f-8d36-04e4ce55a72e tempest-CreateVolumesFromSnapshotTest-168995481 None] Volume f0414ad6-02b7-4a2c-b8cd-86fafc7a5de6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f0414ad6-02b7-4a2c-b8cd-86fafc7a5de6', 'volume_size': 1} Jul 31 12:26:55 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-fa60ee8c-9923-474f-8d36-04e4ce55a72e tempest-CreateVolumesFromSnapshotTest-168995481 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:26:55 devstack sudo[103313]: pam_unix(sudo:session): session closed for user root Jul 31 12:26:55 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-e28f6d7a-0f5d-4a22-b81a-881a9127edd0 tempest-CreateVolumesFromSnapshotTest-168995481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-44eb8ba9-1878-4e4b-a9d7-7a345792c58e" returned: 0 in 0.286s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:26:55 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-e28f6d7a-0f5d-4a22-b81a-881a9127edd0 tempest-CreateVolumesFromSnapshotTest-168995481 None] <== create_volume: return (871ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'} {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 12:26:55 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-e28f6d7a-0f5d-4a22-b81a-881a9127edd0 tempest-CreateVolumesFromSnapshotTest-168995481 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.873s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:26:55 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-5d52ab33-fbb0-432b-8f00-06f25d6ee0a4 tempest-VolumesListAdminTestJSON-1581256828 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.615s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:26:55 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-5d52ab33-fbb0-432b-8f00-06f25d6ee0a4 tempest-VolumesListAdminTestJSON-1581256828 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:26:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1544270242',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b408f9f4-4109-4257-948c-c326a7de6ab4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e9c36764168e42c0996c692b5fa36f0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:26:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:26:53Z,use_quota=True,user_id='88dcfa388301478c8ac4e44d0ae139b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)}" {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 12:26:55 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-5d52ab33-fbb0-432b-8f00-06f25d6ee0a4 tempest-VolumesListAdminTestJSON-1581256828 None] Creating volume b408f9f4-4109-4257-948c-c326a7de6ab4 {{(pid=89182) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 12:26:55 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-5d52ab33-fbb0-432b-8f00-06f25d6ee0a4 tempest-VolumesListAdminTestJSON-1581256828 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:26:55 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-5d52ab33-fbb0-432b-8f00-06f25d6ee0a4 tempest-VolumesListAdminTestJSON-1581256828 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:26:55 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-5d52ab33-fbb0-432b-8f00-06f25d6ee0a4 tempest-VolumesListAdminTestJSON-1581256828 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:26:55 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-5d52ab33-fbb0-432b-8f00-06f25d6ee0a4 tempest-VolumesListAdminTestJSON-1581256828 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:26:55 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-5d52ab33-fbb0-432b-8f00-06f25d6ee0a4 tempest-VolumesListAdminTestJSON-1581256828 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:26:55 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-5d52ab33-fbb0-432b-8f00-06f25d6ee0a4 tempest-VolumesListAdminTestJSON-1581256828 None] Selected osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 as target Quobyte volume. {{(pid=89182) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 12:26:55 devstack cinder-volume[89182]: INFO cinder.volume.drivers.remotefs [None req-5d52ab33-fbb0-432b-8f00-06f25d6ee0a4 tempest-VolumesListAdminTestJSON-1581256828 None] casted to osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 Jul 31 12:26:55 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-5d52ab33-fbb0-432b-8f00-06f25d6ee0a4 tempest-VolumesListAdminTestJSON-1581256828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-b408f9f4-4109-4257-948c-c326a7de6ab4 1073741824 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:26:55 devstack sudo[103316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-b408f9f4-4109-4257-948c-c326a7de6ab4 1073741824 Jul 31 12:26:55 devstack sudo[103316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:26:55 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-e28f6d7a-0f5d-4a22-b81a-881a9127edd0 tempest-CreateVolumesFromSnapshotTest-168995481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e73496f8-b906-47c1-bbe4-eae89ab28332) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-44eb8ba9-1878-4e4b-a9d7-7a345792c58e', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:26:55 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-e28f6d7a-0f5d-4a22-b81a-881a9127edd0 tempest-CreateVolumesFromSnapshotTest-168995481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34426dd3-e063-4a7a-8a85-07d7f94ed333) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:26:55 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-e28f6d7a-0f5d-4a22-b81a-881a9127edd0 tempest-CreateVolumesFromSnapshotTest-168995481 None] Volume volume-44eb8ba9-1878-4e4b-a9d7-7a345792c58e (44eb8ba9-1878-4e4b-a9d7-7a345792c58e): created successfully Jul 31 12:26:55 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-e28f6d7a-0f5d-4a22-b81a-881a9127edd0 tempest-CreateVolumesFromSnapshotTest-168995481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34426dd3-e063-4a7a-8a85-07d7f94ed333) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:26:55 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-e28f6d7a-0f5d-4a22-b81a-881a9127edd0 tempest-CreateVolumesFromSnapshotTest-168995481 None] Flow 'volume_create_manager' (169c5392-54d4-4633-96fa-8dd291d7dde9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:26:55 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-e28f6d7a-0f5d-4a22-b81a-881a9127edd0 tempest-CreateVolumesFromSnapshotTest-168995481 None] Created volume successfully. Jul 31 12:26:56 devstack sudo[103316]: pam_unix(sudo:session): session closed for user root Jul 31 12:26:56 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-5d52ab33-fbb0-432b-8f00-06f25d6ee0a4 tempest-VolumesListAdminTestJSON-1581256828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-b408f9f4-4109-4257-948c-c326a7de6ab4 1073741824" returned: 0 in 0.467s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:26:56 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-5d52ab33-fbb0-432b-8f00-06f25d6ee0a4 tempest-VolumesListAdminTestJSON-1581256828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-b408f9f4-4109-4257-948c-c326a7de6ab4 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:26:56 devstack sudo[103323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-b408f9f4-4109-4257-948c-c326a7de6ab4 Jul 31 12:26:56 devstack sudo[103323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:26:56 devstack sudo[103323]: pam_unix(sudo:session): session closed for user root Jul 31 12:26:56 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-5d52ab33-fbb0-432b-8f00-06f25d6ee0a4 tempest-VolumesListAdminTestJSON-1581256828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-b408f9f4-4109-4257-948c-c326a7de6ab4" returned: 0 in 0.281s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:26:56 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-5d52ab33-fbb0-432b-8f00-06f25d6ee0a4 tempest-VolumesListAdminTestJSON-1581256828 None] <== create_volume: return (798ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'} {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 12:26:56 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-5d52ab33-fbb0-432b-8f00-06f25d6ee0a4 tempest-VolumesListAdminTestJSON-1581256828 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.801s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:26:56 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-1b373a01-66b1-4380-a9a3-0e8c096e89af tempest-CreateVolumesFromSnapshotTest-168995481 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.384s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:26:56 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-1b373a01-66b1-4380-a9a3-0e8c096e89af tempest-CreateVolumesFromSnapshotTest-168995481 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:26:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-524418934',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2684e1f9-574e-4241-8885-f394fb33552e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4fbb56b870e4e63b039b6fd15327bfb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:26:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:26:54Z,use_quota=True,user_id='e9773ece88724a66adcb155ee4097493',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)}" {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 12:26:56 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-1b373a01-66b1-4380-a9a3-0e8c096e89af tempest-CreateVolumesFromSnapshotTest-168995481 None] Creating volume 2684e1f9-574e-4241-8885-f394fb33552e {{(pid=89182) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 12:26:56 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-1b373a01-66b1-4380-a9a3-0e8c096e89af tempest-CreateVolumesFromSnapshotTest-168995481 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:26:56 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-1b373a01-66b1-4380-a9a3-0e8c096e89af tempest-CreateVolumesFromSnapshotTest-168995481 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:26:56 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-1b373a01-66b1-4380-a9a3-0e8c096e89af tempest-CreateVolumesFromSnapshotTest-168995481 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:26:56 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-1b373a01-66b1-4380-a9a3-0e8c096e89af tempest-CreateVolumesFromSnapshotTest-168995481 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:26:56 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-1b373a01-66b1-4380-a9a3-0e8c096e89af tempest-CreateVolumesFromSnapshotTest-168995481 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:26:56 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-1b373a01-66b1-4380-a9a3-0e8c096e89af tempest-CreateVolumesFromSnapshotTest-168995481 None] Selected osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 as target Quobyte volume. {{(pid=89182) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 12:26:56 devstack cinder-volume[89182]: INFO cinder.volume.drivers.remotefs [None req-1b373a01-66b1-4380-a9a3-0e8c096e89af tempest-CreateVolumesFromSnapshotTest-168995481 None] casted to osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 Jul 31 12:26:56 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-1b373a01-66b1-4380-a9a3-0e8c096e89af tempest-CreateVolumesFromSnapshotTest-168995481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-2684e1f9-574e-4241-8885-f394fb33552e 1073741824 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:26:56 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-5d52ab33-fbb0-432b-8f00-06f25d6ee0a4 tempest-VolumesListAdminTestJSON-1581256828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (741b764b-600e-4a5d-9a51-a730ebd1d7e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b408f9f4-4109-4257-948c-c326a7de6ab4', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:26:56 devstack sudo[103329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-2684e1f9-574e-4241-8885-f394fb33552e 1073741824 Jul 31 12:26:56 devstack sudo[103329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:26:56 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-5d52ab33-fbb0-432b-8f00-06f25d6ee0a4 tempest-VolumesListAdminTestJSON-1581256828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c41c424-536b-42da-9d0a-a55fa0d0d807) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:26:56 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-5d52ab33-fbb0-432b-8f00-06f25d6ee0a4 tempest-VolumesListAdminTestJSON-1581256828 None] Volume volume-b408f9f4-4109-4257-948c-c326a7de6ab4 (b408f9f4-4109-4257-948c-c326a7de6ab4): created successfully Jul 31 12:26:56 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-5d52ab33-fbb0-432b-8f00-06f25d6ee0a4 tempest-VolumesListAdminTestJSON-1581256828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c41c424-536b-42da-9d0a-a55fa0d0d807) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:26:56 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-5d52ab33-fbb0-432b-8f00-06f25d6ee0a4 tempest-VolumesListAdminTestJSON-1581256828 None] Flow 'volume_create_manager' (569ca3e1-4d9a-4fef-a258-3531bc4a67a3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:26:56 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-5d52ab33-fbb0-432b-8f00-06f25d6ee0a4 tempest-VolumesListAdminTestJSON-1581256828 None] Created volume successfully. Jul 31 12:26:57 devstack sudo[103329]: pam_unix(sudo:session): session closed for user root Jul 31 12:26:57 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-1b373a01-66b1-4380-a9a3-0e8c096e89af tempest-CreateVolumesFromSnapshotTest-168995481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-2684e1f9-574e-4241-8885-f394fb33552e 1073741824" returned: 0 in 0.477s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:26:57 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-1b373a01-66b1-4380-a9a3-0e8c096e89af tempest-CreateVolumesFromSnapshotTest-168995481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-2684e1f9-574e-4241-8885-f394fb33552e {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:26:57 devstack sudo[103334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-2684e1f9-574e-4241-8885-f394fb33552e Jul 31 12:26:57 devstack sudo[103334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:26:57 devstack sudo[103334]: pam_unix(sudo:session): session closed for user root Jul 31 12:26:57 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-1b373a01-66b1-4380-a9a3-0e8c096e89af tempest-CreateVolumesFromSnapshotTest-168995481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-2684e1f9-574e-4241-8885-f394fb33552e" returned: 0 in 0.273s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:26:57 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-1b373a01-66b1-4380-a9a3-0e8c096e89af tempest-CreateVolumesFromSnapshotTest-168995481 None] <== create_volume: return (793ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'} {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 12:26:57 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-1b373a01-66b1-4380-a9a3-0e8c096e89af tempest-CreateVolumesFromSnapshotTest-168995481 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.797s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:26:57 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-d293ba4a-34ae-4c39-a8e9-37b249c322af tempest-CreateVolumesFromSnapshotTest-168995481 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.848s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:26:57 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-d293ba4a-34ae-4c39-a8e9-37b249c322af tempest-CreateVolumesFromSnapshotTest-168995481 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:26:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1728241604',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84a55734-08b1-4a47-b662-06a7fd45573e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4fbb56b870e4e63b039b6fd15327bfb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:26:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:26:54Z,use_quota=True,user_id='e9773ece88724a66adcb155ee4097493',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)}" {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 12:26:57 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-d293ba4a-34ae-4c39-a8e9-37b249c322af tempest-CreateVolumesFromSnapshotTest-168995481 None] Creating volume 84a55734-08b1-4a47-b662-06a7fd45573e {{(pid=89182) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 12:26:57 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-d293ba4a-34ae-4c39-a8e9-37b249c322af tempest-CreateVolumesFromSnapshotTest-168995481 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:26:57 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-d293ba4a-34ae-4c39-a8e9-37b249c322af tempest-CreateVolumesFromSnapshotTest-168995481 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:26:57 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-d293ba4a-34ae-4c39-a8e9-37b249c322af tempest-CreateVolumesFromSnapshotTest-168995481 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:26:57 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-d293ba4a-34ae-4c39-a8e9-37b249c322af tempest-CreateVolumesFromSnapshotTest-168995481 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:26:57 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-d293ba4a-34ae-4c39-a8e9-37b249c322af tempest-CreateVolumesFromSnapshotTest-168995481 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:26:57 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-d293ba4a-34ae-4c39-a8e9-37b249c322af tempest-CreateVolumesFromSnapshotTest-168995481 None] Selected osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 as target Quobyte volume. {{(pid=89182) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 12:26:57 devstack cinder-volume[89182]: INFO cinder.volume.drivers.remotefs [None req-d293ba4a-34ae-4c39-a8e9-37b249c322af tempest-CreateVolumesFromSnapshotTest-168995481 None] casted to osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 Jul 31 12:26:57 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-d293ba4a-34ae-4c39-a8e9-37b249c322af tempest-CreateVolumesFromSnapshotTest-168995481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-84a55734-08b1-4a47-b662-06a7fd45573e 1073741824 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:26:57 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-1b373a01-66b1-4380-a9a3-0e8c096e89af tempest-CreateVolumesFromSnapshotTest-168995481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22d3c724-2ef9-43bf-8fa8-71c46d72345a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2684e1f9-574e-4241-8885-f394fb33552e', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:26:57 devstack sudo[103337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-84a55734-08b1-4a47-b662-06a7fd45573e 1073741824 Jul 31 12:26:57 devstack sudo[103337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:26:57 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-1b373a01-66b1-4380-a9a3-0e8c096e89af tempest-CreateVolumesFromSnapshotTest-168995481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e7d3922-ccf2-4482-af11-5d02ec04dcf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:26:57 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-1b373a01-66b1-4380-a9a3-0e8c096e89af tempest-CreateVolumesFromSnapshotTest-168995481 None] Volume volume-2684e1f9-574e-4241-8885-f394fb33552e (2684e1f9-574e-4241-8885-f394fb33552e): created successfully Jul 31 12:26:57 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-1b373a01-66b1-4380-a9a3-0e8c096e89af tempest-CreateVolumesFromSnapshotTest-168995481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e7d3922-ccf2-4482-af11-5d02ec04dcf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:26:57 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-1b373a01-66b1-4380-a9a3-0e8c096e89af tempest-CreateVolumesFromSnapshotTest-168995481 None] Flow 'volume_create_manager' (fe8bc52f-3322-4523-8d91-24b4fdb2b2b6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:26:57 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-1b373a01-66b1-4380-a9a3-0e8c096e89af tempest-CreateVolumesFromSnapshotTest-168995481 None] Created volume successfully. Jul 31 12:26:57 devstack sudo[103337]: pam_unix(sudo:session): session closed for user root Jul 31 12:26:57 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-d293ba4a-34ae-4c39-a8e9-37b249c322af tempest-CreateVolumesFromSnapshotTest-168995481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-84a55734-08b1-4a47-b662-06a7fd45573e 1073741824" returned: 0 in 0.631s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:26:58 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-d293ba4a-34ae-4c39-a8e9-37b249c322af tempest-CreateVolumesFromSnapshotTest-168995481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-84a55734-08b1-4a47-b662-06a7fd45573e {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:26:58 devstack cinder-volume[89182]: DEBUG cinder.volume.flows.manager.create_volume [None req-bdb69aa5-59e9-4152-89d9-321baa285463 tempest-VolumesListAdminTestJSON-1581256828 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89182) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 12:26:58 devstack sudo[103343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-84a55734-08b1-4a47-b662-06a7fd45573e Jul 31 12:26:58 devstack sudo[103343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:26:58 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-bdb69aa5-59e9-4152-89d9-321baa285463 tempest-VolumesListAdminTestJSON-1581256828 None] Flow 'volume_create_manager' (677b89d1-7074-42bc-87ba-de26fd28c304) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:26:58 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-bdb69aa5-59e9-4152-89d9-321baa285463 tempest-VolumesListAdminTestJSON-1581256828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba1c7a54-d4fc-4577-bb3e-c3525af71c50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:26:58 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-bdb69aa5-59e9-4152-89d9-321baa285463 tempest-VolumesListAdminTestJSON-1581256828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba1c7a54-d4fc-4577-bb3e-c3525af71c50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:26:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-798724692',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60d7279b-c6a4-4d64-ab12-32fc3573b79d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e9c36764168e42c0996c692b5fa36f0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:26:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:26:58Z,use_quota=True,user_id='88dcfa388301478c8ac4e44d0ae139b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:26:58 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-bdb69aa5-59e9-4152-89d9-321baa285463 tempest-VolumesListAdminTestJSON-1581256828 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b8b1d00-5ab9-4368-9657-c5e890e126bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:26:58 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-bdb69aa5-59e9-4152-89d9-321baa285463 tempest-VolumesListAdminTestJSON-1581256828 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b8b1d00-5ab9-4368-9657-c5e890e126bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:26:58 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-bdb69aa5-59e9-4152-89d9-321baa285463 tempest-VolumesListAdminTestJSON-1581256828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b7d60b4-6677-4802-b406-837436ab6d02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:26:58 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-bdb69aa5-59e9-4152-89d9-321baa285463 tempest-VolumesListAdminTestJSON-1581256828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b7d60b4-6677-4802-b406-837436ab6d02) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '60d7279b-c6a4-4d64-ab12-32fc3573b79d', 'volume_name': 'volume-60d7279b-c6a4-4d64-ab12-32fc3573b79d', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:26:58 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-bdb69aa5-59e9-4152-89d9-321baa285463 tempest-VolumesListAdminTestJSON-1581256828 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f91c67f-c018-42bd-87a6-30f7d185881e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:26:58 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-bdb69aa5-59e9-4152-89d9-321baa285463 tempest-VolumesListAdminTestJSON-1581256828 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f91c67f-c018-42bd-87a6-30f7d185881e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:26:58 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-bdb69aa5-59e9-4152-89d9-321baa285463 tempest-VolumesListAdminTestJSON-1581256828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b30233af-e548-4d6c-9af9-77e6e7157a19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:26:58 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-bdb69aa5-59e9-4152-89d9-321baa285463 tempest-VolumesListAdminTestJSON-1581256828 None] Volume 60d7279b-c6a4-4d64-ab12-32fc3573b79d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-60d7279b-c6a4-4d64-ab12-32fc3573b79d', 'volume_size': 1} Jul 31 12:26:58 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-bdb69aa5-59e9-4152-89d9-321baa285463 tempest-VolumesListAdminTestJSON-1581256828 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:26:58 devstack sudo[103343]: pam_unix(sudo:session): session closed for user root Jul 31 12:26:58 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-d293ba4a-34ae-4c39-a8e9-37b249c322af tempest-CreateVolumesFromSnapshotTest-168995481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-84a55734-08b1-4a47-b662-06a7fd45573e" returned: 0 in 0.531s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:26:58 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-d293ba4a-34ae-4c39-a8e9-37b249c322af tempest-CreateVolumesFromSnapshotTest-168995481 None] <== create_volume: return (1238ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'} {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 12:26:58 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-d293ba4a-34ae-4c39-a8e9-37b249c322af tempest-CreateVolumesFromSnapshotTest-168995481 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.243s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:26:58 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-7de0c14c-e3c7-41b7-b45b-51ce2af39898 tempest-SnapshotsActionsTest-2046780578 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.814s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:26:58 devstack cinder-volume[89182]: DEBUG cinder.volume.flows.manager.create_volume [req-02b2ca03-a174-4c98-ad71-3bb04d5f0db5 req-13174c4a-4961-41ea-bd58-5ced0a5eec91 tempest-TestVolumeBootPattern-1492021642 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89182) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 12:26:58 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-7de0c14c-e3c7-41b7-b45b-51ce2af39898 tempest-SnapshotsActionsTest-2046780578 None] Creating offline snapshot e0a7d5df-01a3-4c5c-9efb-f532fd9bbf9e of volume 85b99b20-af4d-4dbb-a203-5a890c846394 {{(pid=89182) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 31 12:26:58 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [req-02b2ca03-a174-4c98-ad71-3bb04d5f0db5 req-13174c4a-4961-41ea-bd58-5ced0a5eec91 tempest-TestVolumeBootPattern-1492021642 None] Flow 'volume_create_manager' (79040b63-9031-4201-a6b6-9cfd0cbfefb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:26:58 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [req-02b2ca03-a174-4c98-ad71-3bb04d5f0db5 req-13174c4a-4961-41ea-bd58-5ced0a5eec91 tempest-TestVolumeBootPattern-1492021642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2068af20-8a18-41b2-ae4a-fab2b46f95ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:26:58 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-d293ba4a-34ae-4c39-a8e9-37b249c322af tempest-CreateVolumesFromSnapshotTest-168995481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1a605c6-af46-48b1-a76a-c5301ef8cda8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-84a55734-08b1-4a47-b662-06a7fd45573e', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:26:58 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-d293ba4a-34ae-4c39-a8e9-37b249c322af tempest-CreateVolumesFromSnapshotTest-168995481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c147c4eb-156b-4da3-88fd-d02c6aa02b8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:26:58 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6e0cec4-c2bd-4de4-83c5-e31ea1a272f3]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:26:58 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-7de0c14c-e3c7-41b7-b45b-51ce2af39898 tempest-SnapshotsActionsTest-2046780578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-85b99b20-af4d-4dbb-a203-5a890c846394.df57d977-ee95-40d0-acbc-7a5f10d0db85 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:26:58 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [req-02b2ca03-a174-4c98-ad71-3bb04d5f0db5 req-13174c4a-4961-41ea-bd58-5ced0a5eec91 tempest-TestVolumeBootPattern-1492021642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2068af20-8a18-41b2-ae4a-fab2b46f95ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=True,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:26:58Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed54b024-d4ee-4263-a6c4-d3bb670e9b34,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4668dd58ac9a4406a9e8376f0b499d83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:26:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=57aa151f-800a-418b-8ea1-c82856fc341d,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:26:59Z,use_quota=True,user_id='9990e1c0be844340b618d408d28deefe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:26:58 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [req-02b2ca03-a174-4c98-ad71-3bb04d5f0db5 req-13174c4a-4961-41ea-bd58-5ced0a5eec91 tempest-TestVolumeBootPattern-1492021642 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea0b12d5-14df-4d88-855d-9575445f191e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:26:58 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [req-02b2ca03-a174-4c98-ad71-3bb04d5f0db5 req-13174c4a-4961-41ea-bd58-5ced0a5eec91 tempest-TestVolumeBootPattern-1492021642 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea0b12d5-14df-4d88-855d-9575445f191e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:26:58 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [req-02b2ca03-a174-4c98-ad71-3bb04d5f0db5 req-13174c4a-4961-41ea-bd58-5ced0a5eec91 tempest-TestVolumeBootPattern-1492021642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (859746e9-3e1d-43dc-8130-3b9319e7e1a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:26:58 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [req-02b2ca03-a174-4c98-ad71-3bb04d5f0db5 req-13174c4a-4961-41ea-bd58-5ced0a5eec91 tempest-TestVolumeBootPattern-1492021642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (859746e9-3e1d-43dc-8130-3b9319e7e1a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'ed54b024-d4ee-4263-a6c4-d3bb670e9b34', 'volume_name': 'volume-ed54b024-d4ee-4263-a6c4-d3bb670e9b34', 'volume_size': 1, 'snapshot_id': '57aa151f-800a-418b-8ea1-c82856fc341d'}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:26:58 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [req-02b2ca03-a174-4c98-ad71-3bb04d5f0db5 req-13174c4a-4961-41ea-bd58-5ced0a5eec91 tempest-TestVolumeBootPattern-1492021642 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9114976-18e5-470b-92bd-9e7d53673f8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:26:58 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [req-02b2ca03-a174-4c98-ad71-3bb04d5f0db5 req-13174c4a-4961-41ea-bd58-5ced0a5eec91 tempest-TestVolumeBootPattern-1492021642 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9114976-18e5-470b-92bd-9e7d53673f8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:26:58 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [req-02b2ca03-a174-4c98-ad71-3bb04d5f0db5 req-13174c4a-4961-41ea-bd58-5ced0a5eec91 tempest-TestVolumeBootPattern-1492021642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c14d9f20-8044-420d-b1ca-0dfa84dfe6c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:26:58 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [req-02b2ca03-a174-4c98-ad71-3bb04d5f0db5 req-13174c4a-4961-41ea-bd58-5ced0a5eec91 tempest-TestVolumeBootPattern-1492021642 None] Volume ed54b024-d4ee-4263-a6c4-d3bb670e9b34: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-ed54b024-d4ee-4263-a6c4-d3bb670e9b34', 'volume_size': 1, 'snapshot_id': '57aa151f-800a-418b-8ea1-c82856fc341d'} Jul 31 12:26:58 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-d293ba4a-34ae-4c39-a8e9-37b249c322af tempest-CreateVolumesFromSnapshotTest-168995481 None] Volume volume-84a55734-08b1-4a47-b662-06a7fd45573e (84a55734-08b1-4a47-b662-06a7fd45573e): created successfully Jul 31 12:26:58 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-d293ba4a-34ae-4c39-a8e9-37b249c322af tempest-CreateVolumesFromSnapshotTest-168995481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c147c4eb-156b-4da3-88fd-d02c6aa02b8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:26:58 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-d293ba4a-34ae-4c39-a8e9-37b249c322af tempest-CreateVolumesFromSnapshotTest-168995481 None] Flow 'volume_create_manager' (e0306af2-8bb8-4aa3-a632-593b68841b1f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:26:58 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-d293ba4a-34ae-4c39-a8e9-37b249c322af tempest-CreateVolumesFromSnapshotTest-168995481 None] Created volume successfully. Jul 31 12:26:58 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [req-02b2ca03-a174-4c98-ad71-3bb04d5f0db5 req-13174c4a-4961-41ea-bd58-5ced0a5eec91 tempest-TestVolumeBootPattern-1492021642 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:26:58 devstack sudo[103346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-85b99b20-af4d-4dbb-a203-5a890c846394.df57d977-ee95-40d0-acbc-7a5f10d0db85 Jul 31 12:26:58 devstack sudo[103346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:26:59 devstack sudo[103346]: pam_unix(sudo:session): session closed for user root Jul 31 12:26:59 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-7de0c14c-e3c7-41b7-b45b-51ce2af39898 tempest-SnapshotsActionsTest-2046780578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-85b99b20-af4d-4dbb-a203-5a890c846394.df57d977-ee95-40d0-acbc-7a5f10d0db85" returned: 0 in 0.434s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:26:59 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-7de0c14c-e3c7-41b7-b45b-51ce2af39898 tempest-SnapshotsActionsTest-2046780578 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-85b99b20-af4d-4dbb-a203-5a890c846394(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89182) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 12:26:59 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-7de0c14c-e3c7-41b7-b45b-51ce2af39898 tempest-SnapshotsActionsTest-2046780578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-85b99b20-af4d-4dbb-a203-5a890c846394.df57d977-ee95-40d0-acbc-7a5f10d0db85,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-85b99b20-af4d-4dbb-a203-5a890c846394.e0a7d5df-01a3-4c5c-9efb-f532fd9bbf9e 1G {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:26:59 devstack sudo[103352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-85b99b20-af4d-4dbb-a203-5a890c846394.df57d977-ee95-40d0-acbc-7a5f10d0db85,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-85b99b20-af4d-4dbb-a203-5a890c846394.e0a7d5df-01a3-4c5c-9efb-f532fd9bbf9e 1G Jul 31 12:26:59 devstack sudo[103352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:26:59 devstack sudo[103352]: pam_unix(sudo:session): session closed for user root Jul 31 12:26:59 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-7de0c14c-e3c7-41b7-b45b-51ce2af39898 tempest-SnapshotsActionsTest-2046780578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-85b99b20-af4d-4dbb-a203-5a890c846394.df57d977-ee95-40d0-acbc-7a5f10d0db85,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-85b99b20-af4d-4dbb-a203-5a890c846394.e0a7d5df-01a3-4c5c-9efb-f532fd9bbf9e 1G" returned: 0 in 0.502s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:26:59 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-7de0c14c-e3c7-41b7-b45b-51ce2af39898 tempest-SnapshotsActionsTest-2046780578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-85b99b20-af4d-4dbb-a203-5a890c846394.df57d977-ee95-40d0-acbc-7a5f10d0db85 -F qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-85b99b20-af4d-4dbb-a203-5a890c846394.e0a7d5df-01a3-4c5c-9efb-f532fd9bbf9e {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:26:59 devstack sudo[103359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-85b99b20-af4d-4dbb-a203-5a890c846394.df57d977-ee95-40d0-acbc-7a5f10d0db85 -F qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-85b99b20-af4d-4dbb-a203-5a890c846394.e0a7d5df-01a3-4c5c-9efb-f532fd9bbf9e Jul 31 12:26:59 devstack sudo[103359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:27:00 devstack sudo[103359]: pam_unix(sudo:session): session closed for user root Jul 31 12:27:00 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-7de0c14c-e3c7-41b7-b45b-51ce2af39898 tempest-SnapshotsActionsTest-2046780578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-85b99b20-af4d-4dbb-a203-5a890c846394.df57d977-ee95-40d0-acbc-7a5f10d0db85 -F qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-85b99b20-af4d-4dbb-a203-5a890c846394.e0a7d5df-01a3-4c5c-9efb-f532fd9bbf9e" returned: 0 in 0.344s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:27:00 devstack cinder-volume[89182]: WARNING cinder.volume.drivers.remotefs [None req-7de0c14c-e3c7-41b7-b45b-51ce2af39898 tempest-SnapshotsActionsTest-2046780578 None] /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-85b99b20-af4d-4dbb-a203-5a890c846394.e0a7d5df-01a3-4c5c-9efb-f532fd9bbf9e is being set with open permissions: ugo+rw Jul 31 12:27:00 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-7de0c14c-e3c7-41b7-b45b-51ce2af39898 tempest-SnapshotsActionsTest-2046780578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-85b99b20-af4d-4dbb-a203-5a890c846394.e0a7d5df-01a3-4c5c-9efb-f532fd9bbf9e {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:27:00 devstack sudo[103364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-85b99b20-af4d-4dbb-a203-5a890c846394.e0a7d5df-01a3-4c5c-9efb-f532fd9bbf9e Jul 31 12:27:00 devstack sudo[103364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:27:00 devstack sudo[103364]: pam_unix(sudo:session): session closed for user root Jul 31 12:27:00 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-7de0c14c-e3c7-41b7-b45b-51ce2af39898 tempest-SnapshotsActionsTest-2046780578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-85b99b20-af4d-4dbb-a203-5a890c846394.e0a7d5df-01a3-4c5c-9efb-f532fd9bbf9e" returned: 0 in 0.253s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:27:00 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-7de0c14c-e3c7-41b7-b45b-51ce2af39898 tempest-SnapshotsActionsTest-2046780578 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.717s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:27:00 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-f8911310-cd2c-4f98-98c4-99c7d6359904 tempest-CreateVolumesFromSnapshotTest-168995481 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.095s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:27:00 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-f8911310-cd2c-4f98-98c4-99c7d6359904 tempest-CreateVolumesFromSnapshotTest-168995481 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:26:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1545042786',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f0c6b53-6ce8-4467-bbb7-36158dd1dc8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4fbb56b870e4e63b039b6fd15327bfb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:26:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:26:55Z,use_quota=True,user_id='e9773ece88724a66adcb155ee4097493',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)}" {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 12:27:00 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-f8911310-cd2c-4f98-98c4-99c7d6359904 tempest-CreateVolumesFromSnapshotTest-168995481 None] Creating volume 1f0c6b53-6ce8-4467-bbb7-36158dd1dc8c {{(pid=89182) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 12:27:00 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-f8911310-cd2c-4f98-98c4-99c7d6359904 tempest-CreateVolumesFromSnapshotTest-168995481 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:27:00 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-f8911310-cd2c-4f98-98c4-99c7d6359904 tempest-CreateVolumesFromSnapshotTest-168995481 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:27:00 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-f8911310-cd2c-4f98-98c4-99c7d6359904 tempest-CreateVolumesFromSnapshotTest-168995481 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:27:00 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-f8911310-cd2c-4f98-98c4-99c7d6359904 tempest-CreateVolumesFromSnapshotTest-168995481 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:27:00 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-f8911310-cd2c-4f98-98c4-99c7d6359904 tempest-CreateVolumesFromSnapshotTest-168995481 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:27:00 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-f8911310-cd2c-4f98-98c4-99c7d6359904 tempest-CreateVolumesFromSnapshotTest-168995481 None] Selected osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 as target Quobyte volume. {{(pid=89182) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 12:27:00 devstack cinder-volume[89182]: INFO cinder.volume.drivers.remotefs [None req-f8911310-cd2c-4f98-98c4-99c7d6359904 tempest-CreateVolumesFromSnapshotTest-168995481 None] casted to osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 Jul 31 12:27:00 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-f8911310-cd2c-4f98-98c4-99c7d6359904 tempest-CreateVolumesFromSnapshotTest-168995481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-1f0c6b53-6ce8-4467-bbb7-36158dd1dc8c 1073741824 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:27:00 devstack sudo[103367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-1f0c6b53-6ce8-4467-bbb7-36158dd1dc8c 1073741824 Jul 31 12:27:00 devstack sudo[103367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:27:00 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-7de0c14c-e3c7-41b7-b45b-51ce2af39898 tempest-SnapshotsActionsTest-2046780578 None] Create snapshot completed successfully Jul 31 12:27:00 devstack sudo[103367]: pam_unix(sudo:session): session closed for user root Jul 31 12:27:00 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-f8911310-cd2c-4f98-98c4-99c7d6359904 tempest-CreateVolumesFromSnapshotTest-168995481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-1f0c6b53-6ce8-4467-bbb7-36158dd1dc8c 1073741824" returned: 0 in 0.411s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:27:00 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-f8911310-cd2c-4f98-98c4-99c7d6359904 tempest-CreateVolumesFromSnapshotTest-168995481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-1f0c6b53-6ce8-4467-bbb7-36158dd1dc8c {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:27:00 devstack sudo[103372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-1f0c6b53-6ce8-4467-bbb7-36158dd1dc8c Jul 31 12:27:00 devstack sudo[103372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:27:01 devstack sudo[103372]: pam_unix(sudo:session): session closed for user root Jul 31 12:27:01 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-f8911310-cd2c-4f98-98c4-99c7d6359904 tempest-CreateVolumesFromSnapshotTest-168995481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-1f0c6b53-6ce8-4467-bbb7-36158dd1dc8c" returned: 0 in 0.249s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:27:01 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-f8911310-cd2c-4f98-98c4-99c7d6359904 tempest-CreateVolumesFromSnapshotTest-168995481 None] <== create_volume: return (698ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'} {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 12:27:01 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-f8911310-cd2c-4f98-98c4-99c7d6359904 tempest-CreateVolumesFromSnapshotTest-168995481 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.701s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:27:01 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-fa60ee8c-9923-474f-8d36-04e4ce55a72e tempest-CreateVolumesFromSnapshotTest-168995481 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.347s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:27:01 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-fa60ee8c-9923-474f-8d36-04e4ce55a72e tempest-CreateVolumesFromSnapshotTest-168995481 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:26:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1719879445',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0414ad6-02b7-4a2c-b8cd-86fafc7a5de6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4fbb56b870e4e63b039b6fd15327bfb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:26:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:26:56Z,use_quota=True,user_id='e9773ece88724a66adcb155ee4097493',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)}" {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 12:27:01 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-fa60ee8c-9923-474f-8d36-04e4ce55a72e tempest-CreateVolumesFromSnapshotTest-168995481 None] Creating volume f0414ad6-02b7-4a2c-b8cd-86fafc7a5de6 {{(pid=89182) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 12:27:01 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-fa60ee8c-9923-474f-8d36-04e4ce55a72e tempest-CreateVolumesFromSnapshotTest-168995481 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:27:01 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-fa60ee8c-9923-474f-8d36-04e4ce55a72e tempest-CreateVolumesFromSnapshotTest-168995481 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:27:01 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-fa60ee8c-9923-474f-8d36-04e4ce55a72e tempest-CreateVolumesFromSnapshotTest-168995481 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:27:01 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-fa60ee8c-9923-474f-8d36-04e4ce55a72e tempest-CreateVolumesFromSnapshotTest-168995481 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:27:01 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-fa60ee8c-9923-474f-8d36-04e4ce55a72e tempest-CreateVolumesFromSnapshotTest-168995481 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:27:01 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-fa60ee8c-9923-474f-8d36-04e4ce55a72e tempest-CreateVolumesFromSnapshotTest-168995481 None] Selected osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 as target Quobyte volume. {{(pid=89182) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 12:27:01 devstack cinder-volume[89182]: INFO cinder.volume.drivers.remotefs [None req-fa60ee8c-9923-474f-8d36-04e4ce55a72e tempest-CreateVolumesFromSnapshotTest-168995481 None] casted to osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 Jul 31 12:27:01 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-fa60ee8c-9923-474f-8d36-04e4ce55a72e tempest-CreateVolumesFromSnapshotTest-168995481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-f0414ad6-02b7-4a2c-b8cd-86fafc7a5de6 1073741824 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:27:01 devstack sudo[103375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-f0414ad6-02b7-4a2c-b8cd-86fafc7a5de6 1073741824 Jul 31 12:27:01 devstack sudo[103375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:27:01 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-f8911310-cd2c-4f98-98c4-99c7d6359904 tempest-CreateVolumesFromSnapshotTest-168995481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31f0c524-4566-452a-aeda-55db7ab62448) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1f0c6b53-6ce8-4467-bbb7-36158dd1dc8c', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:27:01 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-f8911310-cd2c-4f98-98c4-99c7d6359904 tempest-CreateVolumesFromSnapshotTest-168995481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4218c661-11eb-430c-bdf1-5ec9306d3d9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:27:01 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-f8911310-cd2c-4f98-98c4-99c7d6359904 tempest-CreateVolumesFromSnapshotTest-168995481 None] Volume volume-1f0c6b53-6ce8-4467-bbb7-36158dd1dc8c (1f0c6b53-6ce8-4467-bbb7-36158dd1dc8c): created successfully Jul 31 12:27:01 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-f8911310-cd2c-4f98-98c4-99c7d6359904 tempest-CreateVolumesFromSnapshotTest-168995481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4218c661-11eb-430c-bdf1-5ec9306d3d9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:27:01 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-f8911310-cd2c-4f98-98c4-99c7d6359904 tempest-CreateVolumesFromSnapshotTest-168995481 None] Flow 'volume_create_manager' (3f573a51-946d-4435-9c27-ec3b9097cf96) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:27:01 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-f8911310-cd2c-4f98-98c4-99c7d6359904 tempest-CreateVolumesFromSnapshotTest-168995481 None] Created volume successfully. Jul 31 12:27:01 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-c3861662-90f8-457f-ae1e-1a14f46f9be9 tempest-SnapshotsActionsTest-789062798 None] Acquiring lock "cinder-e0a7d5df-01a3-4c5c-9efb-f532fd9bbf9e-delete_snapshot" by "delete_snapshot" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:27:01 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-c3861662-90f8-457f-ae1e-1a14f46f9be9 tempest-SnapshotsActionsTest-789062798 None] Lock "cinder-e0a7d5df-01a3-4c5c-9efb-f532fd9bbf9e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:27:01 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-c3861662-90f8-457f-ae1e-1a14f46f9be9 tempest-SnapshotsActionsTest-789062798 None] Acquiring lock "cinder-quobyte-85b99b20-af4d-4dbb-a203-5a890c846394" by "delete_snapshot" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:27:01 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-c3861662-90f8-457f-ae1e-1a14f46f9be9 tempest-SnapshotsActionsTest-789062798 None] Lock "cinder-quobyte-85b99b20-af4d-4dbb-a203-5a890c846394" acquired by "delete_snapshot" :: waited 0.022s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:27:01 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-c3861662-90f8-457f-ae1e-1a14f46f9be9 tempest-SnapshotsActionsTest-789062798 None] Acquiring lock "cinder-quobyte-e0a7d5df-01a3-4c5c-9efb-f532fd9bbf9e" by "_delete_snapshot" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:27:01 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-c3861662-90f8-457f-ae1e-1a14f46f9be9 tempest-SnapshotsActionsTest-789062798 None] Lock "cinder-quobyte-e0a7d5df-01a3-4c5c-9efb-f532fd9bbf9e" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:27:01 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-c3861662-90f8-457f-ae1e-1a14f46f9be9 tempest-SnapshotsActionsTest-789062798 None] Deleting offline snapshot e0a7d5df-01a3-4c5c-9efb-f532fd9bbf9e of volume 85b99b20-af4d-4dbb-a203-5a890c846394 {{(pid=89182) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 31 12:27:01 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-c3861662-90f8-457f-ae1e-1a14f46f9be9 tempest-SnapshotsActionsTest-789062798 None] snapshot_file for this snap is: volume-85b99b20-af4d-4dbb-a203-5a890c846394.e0a7d5df-01a3-4c5c-9efb-f532fd9bbf9e {{(pid=89182) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 31 12:27:01 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[5311ffde-7158-4584-aa6a-8205de4d4ee6]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:27:01 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-c3861662-90f8-457f-ae1e-1a14f46f9be9 tempest-SnapshotsActionsTest-789062798 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-85b99b20-af4d-4dbb-a203-5a890c846394.e0a7d5df-01a3-4c5c-9efb-f532fd9bbf9e {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:27:01 devstack sudo[103380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-85b99b20-af4d-4dbb-a203-5a890c846394.e0a7d5df-01a3-4c5c-9efb-f532fd9bbf9e Jul 31 12:27:01 devstack sudo[103380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:27:01 devstack sudo[103375]: pam_unix(sudo:session): session closed for user root Jul 31 12:27:01 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-fa60ee8c-9923-474f-8d36-04e4ce55a72e tempest-CreateVolumesFromSnapshotTest-168995481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-f0414ad6-02b7-4a2c-b8cd-86fafc7a5de6 1073741824" returned: 0 in 0.477s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:27:01 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-fa60ee8c-9923-474f-8d36-04e4ce55a72e tempest-CreateVolumesFromSnapshotTest-168995481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-f0414ad6-02b7-4a2c-b8cd-86fafc7a5de6 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:27:01 devstack sudo[103383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-f0414ad6-02b7-4a2c-b8cd-86fafc7a5de6 Jul 31 12:27:01 devstack sudo[103383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:27:01 devstack sudo[103380]: pam_unix(sudo:session): session closed for user root Jul 31 12:27:01 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-c3861662-90f8-457f-ae1e-1a14f46f9be9 tempest-SnapshotsActionsTest-789062798 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-85b99b20-af4d-4dbb-a203-5a890c846394.e0a7d5df-01a3-4c5c-9efb-f532fd9bbf9e" returned: 0 in 0.378s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:27:01 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-c3861662-90f8-457f-ae1e-1a14f46f9be9 tempest-SnapshotsActionsTest-789062798 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-85b99b20-af4d-4dbb-a203-5a890c846394(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89182) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 12:27:01 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e73fead-a767-49c3-bf82-c3236861a7c1]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:27:01 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-c3861662-90f8-457f-ae1e-1a14f46f9be9 tempest-SnapshotsActionsTest-789062798 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-85b99b20-af4d-4dbb-a203-5a890c846394.df57d977-ee95-40d0-acbc-7a5f10d0db85 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:27:01 devstack sudo[103383]: pam_unix(sudo:session): session closed for user root Jul 31 12:27:01 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-fa60ee8c-9923-474f-8d36-04e4ce55a72e tempest-CreateVolumesFromSnapshotTest-168995481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-f0414ad6-02b7-4a2c-b8cd-86fafc7a5de6" returned: 0 in 0.253s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:27:01 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-fa60ee8c-9923-474f-8d36-04e4ce55a72e tempest-CreateVolumesFromSnapshotTest-168995481 None] <== create_volume: return (772ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'} {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 12:27:01 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-fa60ee8c-9923-474f-8d36-04e4ce55a72e tempest-CreateVolumesFromSnapshotTest-168995481 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.775s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:27:01 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-bdb69aa5-59e9-4152-89d9-321baa285463 tempest-VolumesListAdminTestJSON-1581256828 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.550s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:27:01 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-bdb69aa5-59e9-4152-89d9-321baa285463 tempest-VolumesListAdminTestJSON-1581256828 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:26:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-798724692',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60d7279b-c6a4-4d64-ab12-32fc3573b79d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e9c36764168e42c0996c692b5fa36f0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:26:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:26:58Z,use_quota=True,user_id='88dcfa388301478c8ac4e44d0ae139b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)}" {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 12:27:01 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-bdb69aa5-59e9-4152-89d9-321baa285463 tempest-VolumesListAdminTestJSON-1581256828 None] Creating volume 60d7279b-c6a4-4d64-ab12-32fc3573b79d {{(pid=89182) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 12:27:01 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-bdb69aa5-59e9-4152-89d9-321baa285463 tempest-VolumesListAdminTestJSON-1581256828 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:27:01 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-bdb69aa5-59e9-4152-89d9-321baa285463 tempest-VolumesListAdminTestJSON-1581256828 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:27:01 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-bdb69aa5-59e9-4152-89d9-321baa285463 tempest-VolumesListAdminTestJSON-1581256828 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:27:01 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-bdb69aa5-59e9-4152-89d9-321baa285463 tempest-VolumesListAdminTestJSON-1581256828 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:27:01 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-bdb69aa5-59e9-4152-89d9-321baa285463 tempest-VolumesListAdminTestJSON-1581256828 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:27:01 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-bdb69aa5-59e9-4152-89d9-321baa285463 tempest-VolumesListAdminTestJSON-1581256828 None] Selected osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 as target Quobyte volume. {{(pid=89182) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 12:27:01 devstack cinder-volume[89182]: INFO cinder.volume.drivers.remotefs [None req-bdb69aa5-59e9-4152-89d9-321baa285463 tempest-VolumesListAdminTestJSON-1581256828 None] casted to osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 Jul 31 12:27:01 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-bdb69aa5-59e9-4152-89d9-321baa285463 tempest-VolumesListAdminTestJSON-1581256828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-60d7279b-c6a4-4d64-ab12-32fc3573b79d 1073741824 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:27:01 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-fa60ee8c-9923-474f-8d36-04e4ce55a72e tempest-CreateVolumesFromSnapshotTest-168995481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1600c4f7-baaf-46cd-9bdf-06e27d715122) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f0414ad6-02b7-4a2c-b8cd-86fafc7a5de6', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:27:01 devstack sudo[103390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-60d7279b-c6a4-4d64-ab12-32fc3573b79d 1073741824 Jul 31 12:27:01 devstack sudo[103390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:27:01 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-fa60ee8c-9923-474f-8d36-04e4ce55a72e tempest-CreateVolumesFromSnapshotTest-168995481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e8838a1-ab83-4e15-895f-d0e9ce787c70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:27:01 devstack sudo[103388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-85b99b20-af4d-4dbb-a203-5a890c846394.df57d977-ee95-40d0-acbc-7a5f10d0db85 Jul 31 12:27:01 devstack sudo[103388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:27:01 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-fa60ee8c-9923-474f-8d36-04e4ce55a72e tempest-CreateVolumesFromSnapshotTest-168995481 None] Volume volume-f0414ad6-02b7-4a2c-b8cd-86fafc7a5de6 (f0414ad6-02b7-4a2c-b8cd-86fafc7a5de6): created successfully Jul 31 12:27:01 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-fa60ee8c-9923-474f-8d36-04e4ce55a72e tempest-CreateVolumesFromSnapshotTest-168995481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e8838a1-ab83-4e15-895f-d0e9ce787c70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:27:01 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-fa60ee8c-9923-474f-8d36-04e4ce55a72e tempest-CreateVolumesFromSnapshotTest-168995481 None] Flow 'volume_create_manager' (3771cd1f-2e2b-4e9b-bbd1-c1ed342878eb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:27:01 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-fa60ee8c-9923-474f-8d36-04e4ce55a72e tempest-CreateVolumesFromSnapshotTest-168995481 None] Created volume successfully. Jul 31 12:27:02 devstack sudo[103388]: pam_unix(sudo:session): session closed for user root Jul 31 12:27:02 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-c3861662-90f8-457f-ae1e-1a14f46f9be9 tempest-SnapshotsActionsTest-789062798 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-85b99b20-af4d-4dbb-a203-5a890c846394.df57d977-ee95-40d0-acbc-7a5f10d0db85" returned: 0 in 0.357s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:27:02 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-c3861662-90f8-457f-ae1e-1a14f46f9be9 tempest-SnapshotsActionsTest-789062798 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-85b99b20-af4d-4dbb-a203-5a890c846394(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89182) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 12:27:02 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-c3861662-90f8-457f-ae1e-1a14f46f9be9 tempest-SnapshotsActionsTest-789062798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-85b99b20-af4d-4dbb-a203-5a890c846394.e0a7d5df-01a3-4c5c-9efb-f532fd9bbf9e {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:27:02 devstack sudo[103399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-85b99b20-af4d-4dbb-a203-5a890c846394.e0a7d5df-01a3-4c5c-9efb-f532fd9bbf9e Jul 31 12:27:02 devstack sudo[103399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:27:02 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-c2ce81f7-c342-4881-a7ae-6a24c489844d tempest-CreateVolumesFromSnapshotTest-168995481 None] Acquiring lock "cinder-f0414ad6-02b7-4a2c-b8cd-86fafc7a5de6-delete_volume" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:27:02 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-c2ce81f7-c342-4881-a7ae-6a24c489844d tempest-CreateVolumesFromSnapshotTest-168995481 None] Lock "cinder-f0414ad6-02b7-4a2c-b8cd-86fafc7a5de6-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:27:02 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-c2ce81f7-c342-4881-a7ae-6a24c489844d tempest-CreateVolumesFromSnapshotTest-168995481 None] Acquiring lock "cinder-quobyte-f0414ad6-02b7-4a2c-b8cd-86fafc7a5de6" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:27:02 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-c2ce81f7-c342-4881-a7ae-6a24c489844d tempest-CreateVolumesFromSnapshotTest-168995481 None] Lock "cinder-quobyte-f0414ad6-02b7-4a2c-b8cd-86fafc7a5de6" acquired by "delete_volume" :: waited 0.018s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:27:02 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[0085b671-064b-4bcb-8c76-83158bee2285]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:27:02 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-c2ce81f7-c342-4881-a7ae-6a24c489844d tempest-CreateVolumesFromSnapshotTest-168995481 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-f0414ad6-02b7-4a2c-b8cd-86fafc7a5de6 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:27:02 devstack sudo[103390]: pam_unix(sudo:session): session closed for user root Jul 31 12:27:02 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-bdb69aa5-59e9-4152-89d9-321baa285463 tempest-VolumesListAdminTestJSON-1581256828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-60d7279b-c6a4-4d64-ab12-32fc3573b79d 1073741824" returned: 0 in 0.609s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:27:02 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-bdb69aa5-59e9-4152-89d9-321baa285463 tempest-VolumesListAdminTestJSON-1581256828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-60d7279b-c6a4-4d64-ab12-32fc3573b79d {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:27:02 devstack sudo[103405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-60d7279b-c6a4-4d64-ab12-32fc3573b79d Jul 31 12:27:02 devstack sudo[103405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:27:02 devstack sudo[103403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-f0414ad6-02b7-4a2c-b8cd-86fafc7a5de6 Jul 31 12:27:02 devstack sudo[103403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:27:02 devstack sudo[103399]: pam_unix(sudo:session): session closed for user root Jul 31 12:27:02 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-c3861662-90f8-457f-ae1e-1a14f46f9be9 tempest-SnapshotsActionsTest-789062798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-85b99b20-af4d-4dbb-a203-5a890c846394.e0a7d5df-01a3-4c5c-9efb-f532fd9bbf9e" returned: 0 in 0.505s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:27:02 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-c3861662-90f8-457f-ae1e-1a14f46f9be9 tempest-SnapshotsActionsTest-789062798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-85b99b20-af4d-4dbb-a203-5a890c846394.e0a7d5df-01a3-4c5c-9efb-f532fd9bbf9e {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:27:02 devstack sudo[103408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-85b99b20-af4d-4dbb-a203-5a890c846394.e0a7d5df-01a3-4c5c-9efb-f532fd9bbf9e Jul 31 12:27:02 devstack sudo[103408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:27:02 devstack sudo[103405]: pam_unix(sudo:session): session closed for user root Jul 31 12:27:02 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-bdb69aa5-59e9-4152-89d9-321baa285463 tempest-VolumesListAdminTestJSON-1581256828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-60d7279b-c6a4-4d64-ab12-32fc3573b79d" returned: 0 in 0.313s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:27:02 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-bdb69aa5-59e9-4152-89d9-321baa285463 tempest-VolumesListAdminTestJSON-1581256828 None] <== create_volume: return (973ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'} {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 12:27:02 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-bdb69aa5-59e9-4152-89d9-321baa285463 tempest-VolumesListAdminTestJSON-1581256828 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.978s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:27:02 devstack sudo[103403]: pam_unix(sudo:session): session closed for user root Jul 31 12:27:02 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [req-02b2ca03-a174-4c98-ad71-3bb04d5f0db5 req-13174c4a-4961-41ea-bd58-5ced0a5eec91 tempest-TestVolumeBootPattern-1492021642 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 3.920s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:27:02 devstack cinder-volume[89182]: DEBUG cinder.coordination [req-02b2ca03-a174-4c98-ad71-3bb04d5f0db5 req-13174c4a-4961-41ea-bd58-5ced0a5eec91 tempest-TestVolumeBootPattern-1492021642 None] Acquiring lock "cinder-quobyte-57aa151f-800a-418b-8ea1-c82856fc341d-ed54b024-d4ee-4263-a6c4-d3bb670e9b34" by "_create_volume_from_snapshot" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:27:02 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-c2ce81f7-c342-4881-a7ae-6a24c489844d tempest-CreateVolumesFromSnapshotTest-168995481 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-f0414ad6-02b7-4a2c-b8cd-86fafc7a5de6" returned: 0 in 0.388s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:27:02 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-c2ce81f7-c342-4881-a7ae-6a24c489844d tempest-CreateVolumesFromSnapshotTest-168995481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-f0414ad6-02b7-4a2c-b8cd-86fafc7a5de6 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:27:02 devstack sudo[103414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-f0414ad6-02b7-4a2c-b8cd-86fafc7a5de6 Jul 31 12:27:02 devstack sudo[103414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:27:02 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-bdb69aa5-59e9-4152-89d9-321baa285463 tempest-VolumesListAdminTestJSON-1581256828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b30233af-e548-4d6c-9af9-77e6e7157a19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-60d7279b-c6a4-4d64-ab12-32fc3573b79d', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:27:02 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-bdb69aa5-59e9-4152-89d9-321baa285463 tempest-VolumesListAdminTestJSON-1581256828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa0d3519-b27a-4af4-8b2b-14a8538e483e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:27:02 devstack cinder-volume[89182]: DEBUG cinder.coordination [req-02b2ca03-a174-4c98-ad71-3bb04d5f0db5 req-13174c4a-4961-41ea-bd58-5ced0a5eec91 tempest-TestVolumeBootPattern-1492021642 None] Lock "cinder-quobyte-57aa151f-800a-418b-8ea1-c82856fc341d-ed54b024-d4ee-4263-a6c4-d3bb670e9b34" acquired by "_create_volume_from_snapshot" :: waited 0.057s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:27:02 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [req-02b2ca03-a174-4c98-ad71-3bb04d5f0db5 req-13174c4a-4961-41ea-bd58-5ced0a5eec91 tempest-TestVolumeBootPattern-1492021642 None] Creating volume ed54b024-d4ee-4263-a6c4-d3bb670e9b34 from snapshot 57aa151f-800a-418b-8ea1-c82856fc341d {{(pid=89182) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 31 12:27:02 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [req-02b2ca03-a174-4c98-ad71-3bb04d5f0db5 req-13174c4a-4961-41ea-bd58-5ced0a5eec91 tempest-TestVolumeBootPattern-1492021642 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:27:02 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [req-02b2ca03-a174-4c98-ad71-3bb04d5f0db5 req-13174c4a-4961-41ea-bd58-5ced0a5eec91 tempest-TestVolumeBootPattern-1492021642 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:27:02 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [req-02b2ca03-a174-4c98-ad71-3bb04d5f0db5 req-13174c4a-4961-41ea-bd58-5ced0a5eec91 tempest-TestVolumeBootPattern-1492021642 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:27:02 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [req-02b2ca03-a174-4c98-ad71-3bb04d5f0db5 req-13174c4a-4961-41ea-bd58-5ced0a5eec91 tempest-TestVolumeBootPattern-1492021642 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:27:02 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [req-02b2ca03-a174-4c98-ad71-3bb04d5f0db5 req-13174c4a-4961-41ea-bd58-5ced0a5eec91 tempest-TestVolumeBootPattern-1492021642 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:27:02 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [req-02b2ca03-a174-4c98-ad71-3bb04d5f0db5 req-13174c4a-4961-41ea-bd58-5ced0a5eec91 tempest-TestVolumeBootPattern-1492021642 None] Selected osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 as target Quobyte volume. {{(pid=89182) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 12:27:02 devstack cinder-volume[89182]: DEBUG cinder.coordination [req-02b2ca03-a174-4c98-ad71-3bb04d5f0db5 req-13174c4a-4961-41ea-bd58-5ced0a5eec91 tempest-TestVolumeBootPattern-1492021642 None] Acquiring lock "cinder-quobyte-ed54b024-d4ee-4263-a6c4-d3bb670e9b34" by "_copy_volume_from_snapshot" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:27:02 devstack sudo[103408]: pam_unix(sudo:session): session closed for user root Jul 31 12:27:02 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-bdb69aa5-59e9-4152-89d9-321baa285463 tempest-VolumesListAdminTestJSON-1581256828 None] Volume volume-60d7279b-c6a4-4d64-ab12-32fc3573b79d (60d7279b-c6a4-4d64-ab12-32fc3573b79d): created successfully Jul 31 12:27:02 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-bdb69aa5-59e9-4152-89d9-321baa285463 tempest-VolumesListAdminTestJSON-1581256828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa0d3519-b27a-4af4-8b2b-14a8538e483e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:27:02 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-bdb69aa5-59e9-4152-89d9-321baa285463 tempest-VolumesListAdminTestJSON-1581256828 None] Flow 'volume_create_manager' (677b89d1-7074-42bc-87ba-de26fd28c304) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:27:02 devstack cinder-volume[89182]: DEBUG cinder.coordination [req-02b2ca03-a174-4c98-ad71-3bb04d5f0db5 req-13174c4a-4961-41ea-bd58-5ced0a5eec91 tempest-TestVolumeBootPattern-1492021642 None] Lock "cinder-quobyte-ed54b024-d4ee-4263-a6c4-d3bb670e9b34" acquired by "_copy_volume_from_snapshot" :: waited 0.052s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:27:02 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [req-02b2ca03-a174-4c98-ad71-3bb04d5f0db5 req-13174c4a-4961-41ea-bd58-5ced0a5eec91 tempest-TestVolumeBootPattern-1492021642 None] snapshot: 57aa151f-800a-418b-8ea1-c82856fc341d, volume: ed54b024-d4ee-4263-a6c4-d3bb670e9b34, {{(pid=89182) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Jul 31 12:27:02 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-c3861662-90f8-457f-ae1e-1a14f46f9be9 tempest-SnapshotsActionsTest-789062798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-85b99b20-af4d-4dbb-a203-5a890c846394.e0a7d5df-01a3-4c5c-9efb-f532fd9bbf9e" returned: 0 in 0.313s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:27:02 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [req-02b2ca03-a174-4c98-ad71-3bb04d5f0db5 req-13174c4a-4961-41ea-bd58-5ced0a5eec91 tempest-TestVolumeBootPattern-1492021642 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:27:02 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [req-02b2ca03-a174-4c98-ad71-3bb04d5f0db5 req-13174c4a-4961-41ea-bd58-5ced0a5eec91 tempest-TestVolumeBootPattern-1492021642 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:27:02 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [req-02b2ca03-a174-4c98-ad71-3bb04d5f0db5 req-13174c4a-4961-41ea-bd58-5ced0a5eec91 tempest-TestVolumeBootPattern-1492021642 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:27:02 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [req-02b2ca03-a174-4c98-ad71-3bb04d5f0db5 req-13174c4a-4961-41ea-bd58-5ced0a5eec91 tempest-TestVolumeBootPattern-1492021642 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:27:02 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [req-02b2ca03-a174-4c98-ad71-3bb04d5f0db5 req-13174c4a-4961-41ea-bd58-5ced0a5eec91 tempest-TestVolumeBootPattern-1492021642 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:27:02 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-c3861662-90f8-457f-ae1e-1a14f46f9be9 tempest-SnapshotsActionsTest-789062798 None] Lock "cinder-quobyte-e0a7d5df-01a3-4c5c-9efb-f532fd9bbf9e" released by "_delete_snapshot" :: held 1.687s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:27:02 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-bdb69aa5-59e9-4152-89d9-321baa285463 tempest-VolumesListAdminTestJSON-1581256828 None] Created volume successfully. Jul 31 12:27:02 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-c3861662-90f8-457f-ae1e-1a14f46f9be9 tempest-SnapshotsActionsTest-789062798 None] Lock "cinder-quobyte-85b99b20-af4d-4dbb-a203-5a890c846394" released by "delete_snapshot" :: held 1.715s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:27:03 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[72f1f215-e6dc-49b3-aa9f-822b83d4e02e]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:27:03 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [req-02b2ca03-a174-4c98-ad71-3bb04d5f0db5 req-13174c4a-4961-41ea-bd58-5ced0a5eec91 tempest-TestVolumeBootPattern-1492021642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-cce4d436-dd54-48f7-96a5-6746d683a50a.57aa151f-800a-418b-8ea1-c82856fc341d {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:27:03 devstack cinder-volume[89182]: DEBUG cinder.quota [None req-c3861662-90f8-457f-ae1e-1a14f46f9be9 tempest-SnapshotsActionsTest-789062798 None] Created reservations ['9d233b83-9306-45da-a4ab-d03ec37016c0', 'dd460f6d-8628-4eca-8566-931f1cc5d4ad', '3edb5914-4256-44a4-9c12-c3e75f404a41', '48941f3b-d7a4-484c-b489-b7cfb7bff76f'] {{(pid=89182) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 12:27:03 devstack sudo[103414]: pam_unix(sudo:session): session closed for user root Jul 31 12:27:03 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-c2ce81f7-c342-4881-a7ae-6a24c489844d tempest-CreateVolumesFromSnapshotTest-168995481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-f0414ad6-02b7-4a2c-b8cd-86fafc7a5de6" returned: 0 in 0.286s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:27:03 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-c2ce81f7-c342-4881-a7ae-6a24c489844d tempest-CreateVolumesFromSnapshotTest-168995481 None] Lock "cinder-quobyte-f0414ad6-02b7-4a2c-b8cd-86fafc7a5de6" released by "delete_volume" :: held 0.718s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:27:03 devstack sudo[103419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-cce4d436-dd54-48f7-96a5-6746d683a50a.57aa151f-800a-418b-8ea1-c82856fc341d Jul 31 12:27:03 devstack sudo[103419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:27:03 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-c3861662-90f8-457f-ae1e-1a14f46f9be9 tempest-SnapshotsActionsTest-789062798 None] Delete snapshot completed successfully. Jul 31 12:27:03 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-c3861662-90f8-457f-ae1e-1a14f46f9be9 tempest-SnapshotsActionsTest-789062798 None] Lock "cinder-e0a7d5df-01a3-4c5c-9efb-f532fd9bbf9e-delete_snapshot" released by "delete_snapshot" :: held 1.897s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:27:03 devstack cinder-volume[89182]: DEBUG cinder.quota [None req-c2ce81f7-c342-4881-a7ae-6a24c489844d tempest-CreateVolumesFromSnapshotTest-168995481 None] Created reservations ['8336a742-5cb7-42c7-80ce-93bce02e9688', 'b61b75bb-2ef0-4821-acc1-b0f3f47aa05c', '1f123e2a-b503-4d24-8af3-50a786c9cc0f', '0c62ad3e-9403-46bf-a877-e1d1b669dfea'] {{(pid=89182) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 12:27:03 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-c2ce81f7-c342-4881-a7ae-6a24c489844d tempest-CreateVolumesFromSnapshotTest-168995481 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:27:03 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-c2ce81f7-c342-4881-a7ae-6a24c489844d tempest-CreateVolumesFromSnapshotTest-168995481 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:27:03 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-c2ce81f7-c342-4881-a7ae-6a24c489844d tempest-CreateVolumesFromSnapshotTest-168995481 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:27:03 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-c2ce81f7-c342-4881-a7ae-6a24c489844d tempest-CreateVolumesFromSnapshotTest-168995481 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:27:03 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-c2ce81f7-c342-4881-a7ae-6a24c489844d tempest-CreateVolumesFromSnapshotTest-168995481 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:27:03 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-c2ce81f7-c342-4881-a7ae-6a24c489844d tempest-CreateVolumesFromSnapshotTest-168995481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:27:03 devstack sudo[103422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 Jul 31 12:27:03 devstack sudo[103422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:27:03 devstack sudo[103419]: pam_unix(sudo:session): session closed for user root Jul 31 12:27:03 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [req-02b2ca03-a174-4c98-ad71-3bb04d5f0db5 req-13174c4a-4961-41ea-bd58-5ced0a5eec91 tempest-TestVolumeBootPattern-1492021642 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-cce4d436-dd54-48f7-96a5-6746d683a50a.57aa151f-800a-418b-8ea1-c82856fc341d" returned: 0 in 0.450s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:27:03 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [req-02b2ca03-a174-4c98-ad71-3bb04d5f0db5 req-13174c4a-4961-41ea-bd58-5ced0a5eec91 tempest-TestVolumeBootPattern-1492021642 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cce4d436-dd54-48f7-96a5-6746d683a50a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89182) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 12:27:03 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[587e76f4-05fb-480d-b057-284e6ea54983]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:27:03 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [req-02b2ca03-a174-4c98-ad71-3bb04d5f0db5 req-13174c4a-4961-41ea-bd58-5ced0a5eec91 tempest-TestVolumeBootPattern-1492021642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-cce4d436-dd54-48f7-96a5-6746d683a50a {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:27:03 devstack sudo[103422]: pam_unix(sudo:session): session closed for user root Jul 31 12:27:03 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-c2ce81f7-c342-4881-a7ae-6a24c489844d tempest-CreateVolumesFromSnapshotTest-168995481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2" returned: 0 in 0.282s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:27:03 devstack cinder-volume[89182]: DEBUG cinder.manager [None req-c2ce81f7-c342-4881-a7ae-6a24c489844d tempest-CreateVolumesFromSnapshotTest-168995481 None] Notifying Schedulers of capabilities ... {{(pid=89182) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 12:27:03 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-4c100566-4b06-447f-9365-f38b628f8b24 tempest-CreateVolumesFromSnapshotTest-168995481 None] Acquiring lock "cinder-1f0c6b53-6ce8-4467-bbb7-36158dd1dc8c-delete_volume" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:27:03 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-c2ce81f7-c342-4881-a7ae-6a24c489844d tempest-CreateVolumesFromSnapshotTest-168995481 None] Deleted volume successfully. Jul 31 12:27:03 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-4c100566-4b06-447f-9365-f38b628f8b24 tempest-CreateVolumesFromSnapshotTest-168995481 None] Lock "cinder-1f0c6b53-6ce8-4467-bbb7-36158dd1dc8c-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:27:03 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-c2ce81f7-c342-4881-a7ae-6a24c489844d tempest-CreateVolumesFromSnapshotTest-168995481 None] Lock "cinder-f0414ad6-02b7-4a2c-b8cd-86fafc7a5de6-delete_volume" released by "delete_volume" :: held 1.265s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:27:03 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-4c100566-4b06-447f-9365-f38b628f8b24 tempest-CreateVolumesFromSnapshotTest-168995481 None] Acquiring lock "cinder-quobyte-1f0c6b53-6ce8-4467-bbb7-36158dd1dc8c" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:27:03 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-4c100566-4b06-447f-9365-f38b628f8b24 tempest-CreateVolumesFromSnapshotTest-168995481 None] Lock "cinder-quobyte-1f0c6b53-6ce8-4467-bbb7-36158dd1dc8c" acquired by "delete_volume" :: waited 0.026s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:27:03 devstack sudo[103429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-cce4d436-dd54-48f7-96a5-6746d683a50a Jul 31 12:27:03 devstack sudo[103429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:27:03 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d5f6d0e-f252-4b12-b2e9-c07028d8f36b]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:27:03 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-4c100566-4b06-447f-9365-f38b628f8b24 tempest-CreateVolumesFromSnapshotTest-168995481 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-1f0c6b53-6ce8-4467-bbb7-36158dd1dc8c {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:27:03 devstack sudo[103431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-1f0c6b53-6ce8-4467-bbb7-36158dd1dc8c Jul 31 12:27:03 devstack sudo[103431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:27:04 devstack sudo[103429]: pam_unix(sudo:session): session closed for user root Jul 31 12:27:04 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [req-02b2ca03-a174-4c98-ad71-3bb04d5f0db5 req-13174c4a-4961-41ea-bd58-5ced0a5eec91 tempest-TestVolumeBootPattern-1492021642 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-cce4d436-dd54-48f7-96a5-6746d683a50a" returned: 0 in 0.518s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:27:04 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [req-02b2ca03-a174-4c98-ad71-3bb04d5f0db5 req-13174c4a-4961-41ea-bd58-5ced0a5eec91 tempest-TestVolumeBootPattern-1492021642 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-cce4d436-dd54-48f7-96a5-6746d683a50a {{(pid=89182) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Jul 31 12:27:04 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [req-02b2ca03-a174-4c98-ad71-3bb04d5f0db5 req-13174c4a-4961-41ea-bd58-5ced0a5eec91 tempest-TestVolumeBootPattern-1492021642 None] Creating direct copy from snapshot {{(pid=89182) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Jul 31 12:27:04 devstack cinder-volume[89182]: DEBUG cinder.utils [req-02b2ca03-a174-4c98-ad71-3bb04d5f0db5 req-13174c4a-4961-41ea-bd58-5ced0a5eec91 tempest-TestVolumeBootPattern-1492021642 None] Path /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-ed54b024-d4ee-4263-a6c4-d3bb670e9b34 not found in is_blk_device check {{(pid=89182) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 31 12:27:04 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [req-02b2ca03-a174-4c98-ad71-3bb04d5f0db5 req-13174c4a-4961-41ea-bd58-5ced0a5eec91 tempest-TestVolumeBootPattern-1492021642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-cce4d436-dd54-48f7-96a5-6746d683a50a /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-ed54b024-d4ee-4263-a6c4-d3bb670e9b34 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:27:04 devstack sudo[103436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-cce4d436-dd54-48f7-96a5-6746d683a50a /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-ed54b024-d4ee-4263-a6c4-d3bb670e9b34 Jul 31 12:27:04 devstack sudo[103436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:27:04 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-9391a809-f68e-4c45-98f9-636761326419 tempest-SnapshotsActionsTest-2046780578 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:27:04 devstack cinder-volume[89182]: DEBUG cinder.volume.flows.manager.create_volume [None req-2e03a760-90ba-46f8-9d62-8b62c73d6cee tempest-VolumesListAdminTestJSON-1581256828 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89182) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 12:27:04 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-2e03a760-90ba-46f8-9d62-8b62c73d6cee tempest-VolumesListAdminTestJSON-1581256828 None] Flow 'volume_create_manager' (63102695-2d1d-47b3-b7ab-9a6e4ae6ec1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:27:04 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-2e03a760-90ba-46f8-9d62-8b62c73d6cee tempest-VolumesListAdminTestJSON-1581256828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (baf62b81-5595-407b-b510-42266031802b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:27:04 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-2e03a760-90ba-46f8-9d62-8b62c73d6cee tempest-VolumesListAdminTestJSON-1581256828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (baf62b81-5595-407b-b510-42266031802b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:27:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1094191605',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91b7df64-2607-4837-9ce5-ddba3005ff4f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e9c36764168e42c0996c692b5fa36f0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:27:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:27:04Z,use_quota=True,user_id='88dcfa388301478c8ac4e44d0ae139b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:27:04 devstack sudo[103431]: pam_unix(sudo:session): session closed for user root Jul 31 12:27:04 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-2e03a760-90ba-46f8-9d62-8b62c73d6cee tempest-VolumesListAdminTestJSON-1581256828 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8960ff1-a284-4f0d-ace3-9fbd2b0a0e3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:27:04 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-2e03a760-90ba-46f8-9d62-8b62c73d6cee tempest-VolumesListAdminTestJSON-1581256828 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8960ff1-a284-4f0d-ace3-9fbd2b0a0e3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:27:04 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-2e03a760-90ba-46f8-9d62-8b62c73d6cee tempest-VolumesListAdminTestJSON-1581256828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d69943a-261c-4bdd-8fd6-0e570a7e85ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:27:04 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-2e03a760-90ba-46f8-9d62-8b62c73d6cee tempest-VolumesListAdminTestJSON-1581256828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d69943a-261c-4bdd-8fd6-0e570a7e85ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '91b7df64-2607-4837-9ce5-ddba3005ff4f', 'volume_name': 'volume-91b7df64-2607-4837-9ce5-ddba3005ff4f', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:27:04 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-2e03a760-90ba-46f8-9d62-8b62c73d6cee tempest-VolumesListAdminTestJSON-1581256828 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aab1dcfc-62b5-49df-ae88-37a6b49cc66c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:27:04 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-2e03a760-90ba-46f8-9d62-8b62c73d6cee tempest-VolumesListAdminTestJSON-1581256828 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aab1dcfc-62b5-49df-ae88-37a6b49cc66c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:27:04 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-2e03a760-90ba-46f8-9d62-8b62c73d6cee tempest-VolumesListAdminTestJSON-1581256828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e210ddaf-100a-4c67-8a62-09214b90e77d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:27:04 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-2e03a760-90ba-46f8-9d62-8b62c73d6cee tempest-VolumesListAdminTestJSON-1581256828 None] Volume 91b7df64-2607-4837-9ce5-ddba3005ff4f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-91b7df64-2607-4837-9ce5-ddba3005ff4f', 'volume_size': 1} Jul 31 12:27:04 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-2e03a760-90ba-46f8-9d62-8b62c73d6cee tempest-VolumesListAdminTestJSON-1581256828 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:27:04 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-4c100566-4b06-447f-9365-f38b628f8b24 tempest-CreateVolumesFromSnapshotTest-168995481 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-1f0c6b53-6ce8-4467-bbb7-36158dd1dc8c" returned: 0 in 0.547s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:27:04 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-4c100566-4b06-447f-9365-f38b628f8b24 tempest-CreateVolumesFromSnapshotTest-168995481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-1f0c6b53-6ce8-4467-bbb7-36158dd1dc8c {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:27:04 devstack sudo[103441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-1f0c6b53-6ce8-4467-bbb7-36158dd1dc8c Jul 31 12:27:04 devstack sudo[103441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:27:04 devstack sudo[103441]: pam_unix(sudo:session): session closed for user root Jul 31 12:27:04 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-4c100566-4b06-447f-9365-f38b628f8b24 tempest-CreateVolumesFromSnapshotTest-168995481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-1f0c6b53-6ce8-4467-bbb7-36158dd1dc8c" returned: 0 in 0.285s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:27:04 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-4c100566-4b06-447f-9365-f38b628f8b24 tempest-CreateVolumesFromSnapshotTest-168995481 None] Lock "cinder-quobyte-1f0c6b53-6ce8-4467-bbb7-36158dd1dc8c" released by "delete_volume" :: held 0.920s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:27:04 devstack cinder-volume[89182]: DEBUG cinder.quota [None req-4c100566-4b06-447f-9365-f38b628f8b24 tempest-CreateVolumesFromSnapshotTest-168995481 None] Created reservations ['7d88f93f-10ee-47b9-9771-8439bba744c6', '25f60b53-8667-4a48-8aff-67b358b1c542', '669da533-b2f4-47e9-af90-bc0937c3b860', 'c499efb8-dbf9-4a2d-88f9-fd1e17f05453'] {{(pid=89182) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 12:27:04 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-4c100566-4b06-447f-9365-f38b628f8b24 tempest-CreateVolumesFromSnapshotTest-168995481 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:27:04 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-4c100566-4b06-447f-9365-f38b628f8b24 tempest-CreateVolumesFromSnapshotTest-168995481 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:27:04 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-4c100566-4b06-447f-9365-f38b628f8b24 tempest-CreateVolumesFromSnapshotTest-168995481 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:27:04 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-4c100566-4b06-447f-9365-f38b628f8b24 tempest-CreateVolumesFromSnapshotTest-168995481 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:27:04 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-4c100566-4b06-447f-9365-f38b628f8b24 tempest-CreateVolumesFromSnapshotTest-168995481 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:27:04 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-4c100566-4b06-447f-9365-f38b628f8b24 tempest-CreateVolumesFromSnapshotTest-168995481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:27:04 devstack sudo[103449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 Jul 31 12:27:04 devstack sudo[103449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:27:04 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-7efe8597-a320-4d9d-9bef-3b13a9f2398e tempest-CreateVolumesFromSnapshotTest-168995481 None] Acquiring lock "cinder-44eb8ba9-1878-4e4b-a9d7-7a345792c58e-delete_volume" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:27:04 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-7efe8597-a320-4d9d-9bef-3b13a9f2398e tempest-CreateVolumesFromSnapshotTest-168995481 None] Lock "cinder-44eb8ba9-1878-4e4b-a9d7-7a345792c58e-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:27:04 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-7efe8597-a320-4d9d-9bef-3b13a9f2398e tempest-CreateVolumesFromSnapshotTest-168995481 None] Acquiring lock "cinder-quobyte-44eb8ba9-1878-4e4b-a9d7-7a345792c58e" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:27:04 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-7efe8597-a320-4d9d-9bef-3b13a9f2398e tempest-CreateVolumesFromSnapshotTest-168995481 None] Lock "cinder-quobyte-44eb8ba9-1878-4e4b-a9d7-7a345792c58e" acquired by "delete_volume" :: waited 0.019s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:27:04 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3d2e25a-74fd-42ea-adbb-bfc4fdb1b7e5]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:27:04 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-7efe8597-a320-4d9d-9bef-3b13a9f2398e tempest-CreateVolumesFromSnapshotTest-168995481 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-44eb8ba9-1878-4e4b-a9d7-7a345792c58e {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:27:05 devstack sudo[103453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-44eb8ba9-1878-4e4b-a9d7-7a345792c58e Jul 31 12:27:05 devstack sudo[103453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:27:05 devstack sudo[103449]: pam_unix(sudo:session): session closed for user root Jul 31 12:27:05 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-4c100566-4b06-447f-9365-f38b628f8b24 tempest-CreateVolumesFromSnapshotTest-168995481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2" returned: 0 in 0.360s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:27:05 devstack cinder-volume[89182]: DEBUG cinder.manager [None req-4c100566-4b06-447f-9365-f38b628f8b24 tempest-CreateVolumesFromSnapshotTest-168995481 None] Notifying Schedulers of capabilities ... {{(pid=89182) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 12:27:05 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-4c100566-4b06-447f-9365-f38b628f8b24 tempest-CreateVolumesFromSnapshotTest-168995481 None] Deleted volume successfully. Jul 31 12:27:05 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-4c100566-4b06-447f-9365-f38b628f8b24 tempest-CreateVolumesFromSnapshotTest-168995481 None] Lock "cinder-1f0c6b53-6ce8-4467-bbb7-36158dd1dc8c-delete_volume" released by "delete_volume" :: held 1.536s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:27:05 devstack sudo[103436]: pam_unix(sudo:session): session closed for user root Jul 31 12:27:05 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [req-02b2ca03-a174-4c98-ad71-3bb04d5f0db5 req-13174c4a-4961-41ea-bd58-5ced0a5eec91 tempest-TestVolumeBootPattern-1492021642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-cce4d436-dd54-48f7-96a5-6746d683a50a /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-ed54b024-d4ee-4263-a6c4-d3bb670e9b34" returned: 0 in 1.247s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:27:05 devstack cinder-volume[89182]: DEBUG cinder.image.image_utils [req-02b2ca03-a174-4c98-ad71-3bb04d5f0db5 req-13174c4a-4961-41ea-bd58-5ced0a5eec91 tempest-TestVolumeBootPattern-1492021642 None] Image conversion details: src /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-cce4d436-dd54-48f7-96a5-6746d683a50a, size 1024.00 MB, duration 1.25 sec, destination /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-ed54b024-d4ee-4263-a6c4-d3bb670e9b34 {{(pid=89182) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 31 12:27:05 devstack cinder-volume[89182]: INFO cinder.image.image_utils [req-02b2ca03-a174-4c98-ad71-3bb04d5f0db5 req-13174c4a-4961-41ea-bd58-5ced0a5eec91 tempest-TestVolumeBootPattern-1492021642 None] Converted 1024.00 MB image at 819.22 MB/s Jul 31 12:27:05 devstack cinder-volume[89182]: WARNING cinder.volume.drivers.remotefs [req-02b2ca03-a174-4c98-ad71-3bb04d5f0db5 req-13174c4a-4961-41ea-bd58-5ced0a5eec91 tempest-TestVolumeBootPattern-1492021642 None] /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-ed54b024-d4ee-4263-a6c4-d3bb670e9b34 is being set with open permissions: ugo+rw Jul 31 12:27:05 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [req-02b2ca03-a174-4c98-ad71-3bb04d5f0db5 req-13174c4a-4961-41ea-bd58-5ced0a5eec91 tempest-TestVolumeBootPattern-1492021642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-ed54b024-d4ee-4263-a6c4-d3bb670e9b34 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:27:05 devstack sudo[103458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-ed54b024-d4ee-4263-a6c4-d3bb670e9b34 Jul 31 12:27:05 devstack sudo[103458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:27:05 devstack sudo[103453]: pam_unix(sudo:session): session closed for user root Jul 31 12:27:05 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-7efe8597-a320-4d9d-9bef-3b13a9f2398e tempest-CreateVolumesFromSnapshotTest-168995481 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-44eb8ba9-1878-4e4b-a9d7-7a345792c58e" returned: 0 in 0.439s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:27:05 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-7efe8597-a320-4d9d-9bef-3b13a9f2398e tempest-CreateVolumesFromSnapshotTest-168995481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-44eb8ba9-1878-4e4b-a9d7-7a345792c58e {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:27:05 devstack sudo[103461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-44eb8ba9-1878-4e4b-a9d7-7a345792c58e Jul 31 12:27:05 devstack sudo[103461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:27:05 devstack sudo[103458]: pam_unix(sudo:session): session closed for user root Jul 31 12:27:05 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [req-02b2ca03-a174-4c98-ad71-3bb04d5f0db5 req-13174c4a-4961-41ea-bd58-5ced0a5eec91 tempest-TestVolumeBootPattern-1492021642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-ed54b024-d4ee-4263-a6c4-d3bb670e9b34" returned: 0 in 0.290s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:27:05 devstack cinder-volume[89182]: DEBUG cinder.coordination [req-02b2ca03-a174-4c98-ad71-3bb04d5f0db5 req-13174c4a-4961-41ea-bd58-5ced0a5eec91 tempest-TestVolumeBootPattern-1492021642 None] Lock "cinder-quobyte-ed54b024-d4ee-4263-a6c4-d3bb670e9b34" released by "_copy_volume_from_snapshot" :: held 2.653s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:27:05 devstack sudo[103461]: pam_unix(sudo:session): session closed for user root Jul 31 12:27:05 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-7efe8597-a320-4d9d-9bef-3b13a9f2398e tempest-CreateVolumesFromSnapshotTest-168995481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-44eb8ba9-1878-4e4b-a9d7-7a345792c58e" returned: 0 in 0.247s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:27:05 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-7efe8597-a320-4d9d-9bef-3b13a9f2398e tempest-CreateVolumesFromSnapshotTest-168995481 None] Lock "cinder-quobyte-44eb8ba9-1878-4e4b-a9d7-7a345792c58e" released by "delete_volume" :: held 0.766s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:27:05 devstack cinder-volume[89182]: DEBUG cinder.coordination [req-02b2ca03-a174-4c98-ad71-3bb04d5f0db5 req-13174c4a-4961-41ea-bd58-5ced0a5eec91 tempest-TestVolumeBootPattern-1492021642 None] Lock "cinder-quobyte-57aa151f-800a-418b-8ea1-c82856fc341d-ed54b024-d4ee-4263-a6c4-d3bb670e9b34" released by "_create_volume_from_snapshot" :: held 2.767s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:27:05 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [req-02b2ca03-a174-4c98-ad71-3bb04d5f0db5 req-13174c4a-4961-41ea-bd58-5ced0a5eec91 tempest-TestVolumeBootPattern-1492021642 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 2.826s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:27:05 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-9391a809-f68e-4c45-98f9-636761326419 tempest-SnapshotsActionsTest-2046780578 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.492s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:27:05 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-9391a809-f68e-4c45-98f9-636761326419 tempest-SnapshotsActionsTest-2046780578 None] Creating offline snapshot 3a2886ae-4012-48a1-9596-a37a869ce980 of volume 85b99b20-af4d-4dbb-a203-5a890c846394 {{(pid=89182) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 31 12:27:05 devstack cinder-volume[89182]: DEBUG cinder.volume.volume_utils [req-02b2ca03-a174-4c98-ad71-3bb04d5f0db5 req-13174c4a-4961-41ea-bd58-5ced0a5eec91 tempest-TestVolumeBootPattern-1492021642 None] Marking volume ed54b024-d4ee-4263-a6c4-d3bb670e9b34 as bootable. {{(pid=89182) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 31 12:27:05 devstack cinder-volume[89182]: DEBUG cinder.volume.flows.manager.create_volume [req-02b2ca03-a174-4c98-ad71-3bb04d5f0db5 req-13174c4a-4961-41ea-bd58-5ced0a5eec91 tempest-TestVolumeBootPattern-1492021642 None] Copying metadata from snapshot 57aa151f-800a-418b-8ea1-c82856fc341d to ed54b024-d4ee-4263-a6c4-d3bb670e9b34. {{(pid=89182) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:429}} Jul 31 12:27:05 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a4cb986-6dca-48e1-8a76-c47aa88221a4]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:27:05 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-9391a809-f68e-4c45-98f9-636761326419 tempest-SnapshotsActionsTest-2046780578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-85b99b20-af4d-4dbb-a203-5a890c846394.df57d977-ee95-40d0-acbc-7a5f10d0db85 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:27:05 devstack cinder-volume[89182]: DEBUG cinder.quota [None req-7efe8597-a320-4d9d-9bef-3b13a9f2398e tempest-CreateVolumesFromSnapshotTest-168995481 None] Created reservations ['5814434c-276c-445d-965a-645e92f02e33', '56fa7516-3236-444a-82a4-b323deaba5e6', 'b324d8ff-229a-4b9f-8656-464722a87a18', 'a935c1f4-6808-40dc-9e1f-92527dd17aa0'] {{(pid=89182) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 12:27:05 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [req-02b2ca03-a174-4c98-ad71-3bb04d5f0db5 req-13174c4a-4961-41ea-bd58-5ced0a5eec91 tempest-TestVolumeBootPattern-1492021642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c14d9f20-8044-420d-b1ca-0dfa84dfe6c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ed54b024-d4ee-4263-a6c4-d3bb670e9b34', 'volume_size': 1, 'snapshot_id': '57aa151f-800a-418b-8ea1-c82856fc341d'}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:27:05 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [req-02b2ca03-a174-4c98-ad71-3bb04d5f0db5 req-13174c4a-4961-41ea-bd58-5ced0a5eec91 tempest-TestVolumeBootPattern-1492021642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e194581-7781-4237-bbd4-7b107f515796) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:27:05 devstack sudo[103465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-85b99b20-af4d-4dbb-a203-5a890c846394.df57d977-ee95-40d0-acbc-7a5f10d0db85 Jul 31 12:27:05 devstack sudo[103465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:27:05 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [req-02b2ca03-a174-4c98-ad71-3bb04d5f0db5 req-13174c4a-4961-41ea-bd58-5ced0a5eec91 tempest-TestVolumeBootPattern-1492021642 None] Volume volume-ed54b024-d4ee-4263-a6c4-d3bb670e9b34 (ed54b024-d4ee-4263-a6c4-d3bb670e9b34): created successfully Jul 31 12:27:05 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [req-02b2ca03-a174-4c98-ad71-3bb04d5f0db5 req-13174c4a-4961-41ea-bd58-5ced0a5eec91 tempest-TestVolumeBootPattern-1492021642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e194581-7781-4237-bbd4-7b107f515796) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:27:05 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [req-02b2ca03-a174-4c98-ad71-3bb04d5f0db5 req-13174c4a-4961-41ea-bd58-5ced0a5eec91 tempest-TestVolumeBootPattern-1492021642 None] Flow 'volume_create_manager' (79040b63-9031-4201-a6b6-9cfd0cbfefb2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:27:05 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-7efe8597-a320-4d9d-9bef-3b13a9f2398e tempest-CreateVolumesFromSnapshotTest-168995481 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:27:05 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-7efe8597-a320-4d9d-9bef-3b13a9f2398e tempest-CreateVolumesFromSnapshotTest-168995481 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:27:05 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-7efe8597-a320-4d9d-9bef-3b13a9f2398e tempest-CreateVolumesFromSnapshotTest-168995481 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:27:05 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-7efe8597-a320-4d9d-9bef-3b13a9f2398e tempest-CreateVolumesFromSnapshotTest-168995481 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:27:05 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-7efe8597-a320-4d9d-9bef-3b13a9f2398e tempest-CreateVolumesFromSnapshotTest-168995481 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:27:05 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-7efe8597-a320-4d9d-9bef-3b13a9f2398e tempest-CreateVolumesFromSnapshotTest-168995481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:27:05 devstack cinder-volume[89182]: INFO cinder.volume.manager [req-02b2ca03-a174-4c98-ad71-3bb04d5f0db5 req-13174c4a-4961-41ea-bd58-5ced0a5eec91 tempest-TestVolumeBootPattern-1492021642 None] Created volume successfully. Jul 31 12:27:05 devstack sudo[103469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 Jul 31 12:27:05 devstack sudo[103469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:27:05 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-77e5c177-296a-4a80-b3d5-ad6e5784bb80 tempest-CreateVolumesFromSnapshotTest-168995481 None] Acquiring lock "cinder-84a55734-08b1-4a47-b662-06a7fd45573e-delete_volume" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:27:06 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-77e5c177-296a-4a80-b3d5-ad6e5784bb80 tempest-CreateVolumesFromSnapshotTest-168995481 None] Lock "cinder-84a55734-08b1-4a47-b662-06a7fd45573e-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:27:06 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-77e5c177-296a-4a80-b3d5-ad6e5784bb80 tempest-CreateVolumesFromSnapshotTest-168995481 None] Acquiring lock "cinder-quobyte-84a55734-08b1-4a47-b662-06a7fd45573e" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:27:06 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-77e5c177-296a-4a80-b3d5-ad6e5784bb80 tempest-CreateVolumesFromSnapshotTest-168995481 None] Lock "cinder-quobyte-84a55734-08b1-4a47-b662-06a7fd45573e" acquired by "delete_volume" :: waited 0.025s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:27:06 devstack sudo[103469]: pam_unix(sudo:session): session closed for user root Jul 31 12:27:06 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-7efe8597-a320-4d9d-9bef-3b13a9f2398e tempest-CreateVolumesFromSnapshotTest-168995481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2" returned: 0 in 0.272s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:27:06 devstack cinder-volume[89182]: DEBUG cinder.manager [None req-7efe8597-a320-4d9d-9bef-3b13a9f2398e tempest-CreateVolumesFromSnapshotTest-168995481 None] Notifying Schedulers of capabilities ... {{(pid=89182) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 12:27:06 devstack sudo[103465]: pam_unix(sudo:session): session closed for user root Jul 31 12:27:06 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-9391a809-f68e-4c45-98f9-636761326419 tempest-SnapshotsActionsTest-2046780578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-85b99b20-af4d-4dbb-a203-5a890c846394.df57d977-ee95-40d0-acbc-7a5f10d0db85" returned: 0 in 0.443s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:27:06 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-9391a809-f68e-4c45-98f9-636761326419 tempest-SnapshotsActionsTest-2046780578 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-85b99b20-af4d-4dbb-a203-5a890c846394(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89182) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 12:27:06 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-9391a809-f68e-4c45-98f9-636761326419 tempest-SnapshotsActionsTest-2046780578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-85b99b20-af4d-4dbb-a203-5a890c846394.df57d977-ee95-40d0-acbc-7a5f10d0db85,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-85b99b20-af4d-4dbb-a203-5a890c846394.3a2886ae-4012-48a1-9596-a37a869ce980 1G {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:27:06 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-7efe8597-a320-4d9d-9bef-3b13a9f2398e tempest-CreateVolumesFromSnapshotTest-168995481 None] Deleted volume successfully. Jul 31 12:27:06 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[58c9b1b0-9a4a-4b01-8967-7b3610aa929a]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:27:06 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-77e5c177-296a-4a80-b3d5-ad6e5784bb80 tempest-CreateVolumesFromSnapshotTest-168995481 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-84a55734-08b1-4a47-b662-06a7fd45573e {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:27:06 devstack sudo[103475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-85b99b20-af4d-4dbb-a203-5a890c846394.df57d977-ee95-40d0-acbc-7a5f10d0db85,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-85b99b20-af4d-4dbb-a203-5a890c846394.3a2886ae-4012-48a1-9596-a37a869ce980 1G Jul 31 12:27:06 devstack sudo[103475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:27:06 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-7efe8597-a320-4d9d-9bef-3b13a9f2398e tempest-CreateVolumesFromSnapshotTest-168995481 None] Lock "cinder-44eb8ba9-1878-4e4b-a9d7-7a345792c58e-delete_volume" released by "delete_volume" :: held 1.407s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:27:06 devstack sudo[103476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-84a55734-08b1-4a47-b662-06a7fd45573e Jul 31 12:27:06 devstack sudo[103476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:27:06 devstack sudo[103476]: pam_unix(sudo:session): session closed for user root Jul 31 12:27:06 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-77e5c177-296a-4a80-b3d5-ad6e5784bb80 tempest-CreateVolumesFromSnapshotTest-168995481 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-84a55734-08b1-4a47-b662-06a7fd45573e" returned: 0 in 0.410s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:27:06 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-77e5c177-296a-4a80-b3d5-ad6e5784bb80 tempest-CreateVolumesFromSnapshotTest-168995481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-84a55734-08b1-4a47-b662-06a7fd45573e {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:27:06 devstack sudo[103489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-84a55734-08b1-4a47-b662-06a7fd45573e Jul 31 12:27:06 devstack sudo[103489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:27:06 devstack sudo[103475]: pam_unix(sudo:session): session closed for user root Jul 31 12:27:06 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-9391a809-f68e-4c45-98f9-636761326419 tempest-SnapshotsActionsTest-2046780578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-85b99b20-af4d-4dbb-a203-5a890c846394.df57d977-ee95-40d0-acbc-7a5f10d0db85,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-85b99b20-af4d-4dbb-a203-5a890c846394.3a2886ae-4012-48a1-9596-a37a869ce980 1G" returned: 0 in 0.469s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:27:06 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-9391a809-f68e-4c45-98f9-636761326419 tempest-SnapshotsActionsTest-2046780578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-85b99b20-af4d-4dbb-a203-5a890c846394.df57d977-ee95-40d0-acbc-7a5f10d0db85 -F qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-85b99b20-af4d-4dbb-a203-5a890c846394.3a2886ae-4012-48a1-9596-a37a869ce980 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:27:06 devstack sudo[103491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-85b99b20-af4d-4dbb-a203-5a890c846394.df57d977-ee95-40d0-acbc-7a5f10d0db85 -F qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-85b99b20-af4d-4dbb-a203-5a890c846394.3a2886ae-4012-48a1-9596-a37a869ce980 Jul 31 12:27:06 devstack sudo[103491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:27:06 devstack sudo[103489]: pam_unix(sudo:session): session closed for user root Jul 31 12:27:06 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-77e5c177-296a-4a80-b3d5-ad6e5784bb80 tempest-CreateVolumesFromSnapshotTest-168995481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-84a55734-08b1-4a47-b662-06a7fd45573e" returned: 0 in 0.246s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:27:06 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-77e5c177-296a-4a80-b3d5-ad6e5784bb80 tempest-CreateVolumesFromSnapshotTest-168995481 None] Lock "cinder-quobyte-84a55734-08b1-4a47-b662-06a7fd45573e" released by "delete_volume" :: held 0.720s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:27:06 devstack cinder-volume[89182]: DEBUG cinder.quota [None req-77e5c177-296a-4a80-b3d5-ad6e5784bb80 tempest-CreateVolumesFromSnapshotTest-168995481 None] Created reservations ['e889ebcf-eae6-44ea-9bd4-ad13faac91c8', 'a0913cbf-b33e-4df3-be36-d096ce50d72a', '65fd5b09-4efb-4904-b728-0d6f4e51fdf7', '20acba8a-84ac-4a1b-aa43-4645a5e9567a'] {{(pid=89182) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 12:27:06 devstack sudo[103491]: pam_unix(sudo:session): session closed for user root Jul 31 12:27:06 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-9391a809-f68e-4c45-98f9-636761326419 tempest-SnapshotsActionsTest-2046780578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-85b99b20-af4d-4dbb-a203-5a890c846394.df57d977-ee95-40d0-acbc-7a5f10d0db85 -F qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-85b99b20-af4d-4dbb-a203-5a890c846394.3a2886ae-4012-48a1-9596-a37a869ce980" returned: 0 in 0.324s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:27:06 devstack cinder-volume[89182]: WARNING cinder.volume.drivers.remotefs [None req-9391a809-f68e-4c45-98f9-636761326419 tempest-SnapshotsActionsTest-2046780578 None] /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-85b99b20-af4d-4dbb-a203-5a890c846394.3a2886ae-4012-48a1-9596-a37a869ce980 is being set with open permissions: ugo+rw Jul 31 12:27:06 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-9391a809-f68e-4c45-98f9-636761326419 tempest-SnapshotsActionsTest-2046780578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-85b99b20-af4d-4dbb-a203-5a890c846394.3a2886ae-4012-48a1-9596-a37a869ce980 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:27:06 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-77e5c177-296a-4a80-b3d5-ad6e5784bb80 tempest-CreateVolumesFromSnapshotTest-168995481 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:27:06 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-77e5c177-296a-4a80-b3d5-ad6e5784bb80 tempest-CreateVolumesFromSnapshotTest-168995481 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:27:06 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-77e5c177-296a-4a80-b3d5-ad6e5784bb80 tempest-CreateVolumesFromSnapshotTest-168995481 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:27:06 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-77e5c177-296a-4a80-b3d5-ad6e5784bb80 tempest-CreateVolumesFromSnapshotTest-168995481 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:27:06 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-77e5c177-296a-4a80-b3d5-ad6e5784bb80 tempest-CreateVolumesFromSnapshotTest-168995481 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:27:06 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-77e5c177-296a-4a80-b3d5-ad6e5784bb80 tempest-CreateVolumesFromSnapshotTest-168995481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:27:06 devstack sudo[103497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-85b99b20-af4d-4dbb-a203-5a890c846394.3a2886ae-4012-48a1-9596-a37a869ce980 Jul 31 12:27:06 devstack sudo[103497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:27:06 devstack sudo[103498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 Jul 31 12:27:06 devstack sudo[103498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:27:07 devstack sudo[103497]: pam_unix(sudo:session): session closed for user root Jul 31 12:27:07 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-9391a809-f68e-4c45-98f9-636761326419 tempest-SnapshotsActionsTest-2046780578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-85b99b20-af4d-4dbb-a203-5a890c846394.3a2886ae-4012-48a1-9596-a37a869ce980" returned: 0 in 0.270s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:27:07 devstack sudo[103498]: pam_unix(sudo:session): session closed for user root Jul 31 12:27:07 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-1a331e6b-a0d8-40e5-9c9a-e4b6f60236ee tempest-CreateVolumesFromSnapshotTest-168995481 None] Acquiring lock "cinder-2684e1f9-574e-4241-8885-f394fb33552e-delete_volume" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:27:07 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-77e5c177-296a-4a80-b3d5-ad6e5784bb80 tempest-CreateVolumesFromSnapshotTest-168995481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2" returned: 0 in 0.282s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:27:07 devstack cinder-volume[89182]: DEBUG cinder.manager [None req-77e5c177-296a-4a80-b3d5-ad6e5784bb80 tempest-CreateVolumesFromSnapshotTest-168995481 None] Notifying Schedulers of capabilities ... {{(pid=89182) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 12:27:07 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-9391a809-f68e-4c45-98f9-636761326419 tempest-SnapshotsActionsTest-2046780578 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.629s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:27:07 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-2e03a760-90ba-46f8-9d62-8b62c73d6cee tempest-VolumesListAdminTestJSON-1581256828 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.009s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:27:07 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-2e03a760-90ba-46f8-9d62-8b62c73d6cee tempest-VolumesListAdminTestJSON-1581256828 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:27:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1094191605',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91b7df64-2607-4837-9ce5-ddba3005ff4f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e9c36764168e42c0996c692b5fa36f0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:27:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:27:04Z,use_quota=True,user_id='88dcfa388301478c8ac4e44d0ae139b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)}" {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 12:27:07 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-2e03a760-90ba-46f8-9d62-8b62c73d6cee tempest-VolumesListAdminTestJSON-1581256828 None] Creating volume 91b7df64-2607-4837-9ce5-ddba3005ff4f {{(pid=89182) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 12:27:07 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-2e03a760-90ba-46f8-9d62-8b62c73d6cee tempest-VolumesListAdminTestJSON-1581256828 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:27:07 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-2e03a760-90ba-46f8-9d62-8b62c73d6cee tempest-VolumesListAdminTestJSON-1581256828 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:27:07 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-2e03a760-90ba-46f8-9d62-8b62c73d6cee tempest-VolumesListAdminTestJSON-1581256828 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:27:07 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-2e03a760-90ba-46f8-9d62-8b62c73d6cee tempest-VolumesListAdminTestJSON-1581256828 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:27:07 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-2e03a760-90ba-46f8-9d62-8b62c73d6cee tempest-VolumesListAdminTestJSON-1581256828 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:27:07 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-2e03a760-90ba-46f8-9d62-8b62c73d6cee tempest-VolumesListAdminTestJSON-1581256828 None] Selected osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 as target Quobyte volume. {{(pid=89182) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 12:27:07 devstack cinder-volume[89182]: INFO cinder.volume.drivers.remotefs [None req-2e03a760-90ba-46f8-9d62-8b62c73d6cee tempest-VolumesListAdminTestJSON-1581256828 None] casted to osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 Jul 31 12:27:07 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-2e03a760-90ba-46f8-9d62-8b62c73d6cee tempest-VolumesListAdminTestJSON-1581256828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-91b7df64-2607-4837-9ce5-ddba3005ff4f 1073741824 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:27:07 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-77e5c177-296a-4a80-b3d5-ad6e5784bb80 tempest-CreateVolumesFromSnapshotTest-168995481 None] Deleted volume successfully. Jul 31 12:27:07 devstack sudo[103503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-91b7df64-2607-4837-9ce5-ddba3005ff4f 1073741824 Jul 31 12:27:07 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-1a331e6b-a0d8-40e5-9c9a-e4b6f60236ee tempest-CreateVolumesFromSnapshotTest-168995481 None] Lock "cinder-2684e1f9-574e-4241-8885-f394fb33552e-delete_volume" acquired by "delete_volume" :: waited 0.075s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:27:07 devstack sudo[103503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:27:07 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-77e5c177-296a-4a80-b3d5-ad6e5784bb80 tempest-CreateVolumesFromSnapshotTest-168995481 None] Lock "cinder-84a55734-08b1-4a47-b662-06a7fd45573e-delete_volume" released by "delete_volume" :: held 1.306s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:27:07 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-9391a809-f68e-4c45-98f9-636761326419 tempest-SnapshotsActionsTest-2046780578 None] Create snapshot completed successfully Jul 31 12:27:07 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-1a331e6b-a0d8-40e5-9c9a-e4b6f60236ee tempest-CreateVolumesFromSnapshotTest-168995481 None] Acquiring lock "cinder-quobyte-2684e1f9-574e-4241-8885-f394fb33552e" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:27:07 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-1a331e6b-a0d8-40e5-9c9a-e4b6f60236ee tempest-CreateVolumesFromSnapshotTest-168995481 None] Lock "cinder-quobyte-2684e1f9-574e-4241-8885-f394fb33552e" acquired by "delete_volume" :: waited 0.014s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:27:07 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[08ceca61-a2a1-4d93-8afb-27258a0e87a9]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:27:07 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-1a331e6b-a0d8-40e5-9c9a-e4b6f60236ee tempest-CreateVolumesFromSnapshotTest-168995481 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-2684e1f9-574e-4241-8885-f394fb33552e {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:27:07 devstack sudo[103505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-2684e1f9-574e-4241-8885-f394fb33552e Jul 31 12:27:07 devstack sudo[103505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:27:07 devstack sudo[103505]: pam_unix(sudo:session): session closed for user root Jul 31 12:27:07 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-1a331e6b-a0d8-40e5-9c9a-e4b6f60236ee tempest-CreateVolumesFromSnapshotTest-168995481 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-2684e1f9-574e-4241-8885-f394fb33552e" returned: 0 in 0.413s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:27:07 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-1a331e6b-a0d8-40e5-9c9a-e4b6f60236ee tempest-CreateVolumesFromSnapshotTest-168995481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-2684e1f9-574e-4241-8885-f394fb33552e {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:27:07 devstack sudo[103514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-2684e1f9-574e-4241-8885-f394fb33552e Jul 31 12:27:07 devstack sudo[103514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:27:07 devstack sudo[103503]: pam_unix(sudo:session): session closed for user root Jul 31 12:27:07 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-2e03a760-90ba-46f8-9d62-8b62c73d6cee tempest-VolumesListAdminTestJSON-1581256828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-91b7df64-2607-4837-9ce5-ddba3005ff4f 1073741824" returned: 0 in 0.552s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:27:07 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-2e03a760-90ba-46f8-9d62-8b62c73d6cee tempest-VolumesListAdminTestJSON-1581256828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-91b7df64-2607-4837-9ce5-ddba3005ff4f {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:27:07 devstack sudo[103521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-91b7df64-2607-4837-9ce5-ddba3005ff4f Jul 31 12:27:07 devstack sudo[103521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:27:08 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [req-02b2ca03-a174-4c98-ad71-3bb04d5f0db5 req-4f143970-2201-4671-9fd1-4c4cfcfbc951 tempest-TestVolumeBootPattern-1492021642 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:27:08 devstack sudo[103514]: pam_unix(sudo:session): session closed for user root Jul 31 12:27:08 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-1a331e6b-a0d8-40e5-9c9a-e4b6f60236ee tempest-CreateVolumesFromSnapshotTest-168995481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-2684e1f9-574e-4241-8885-f394fb33552e" returned: 0 in 0.266s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:27:08 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-1a331e6b-a0d8-40e5-9c9a-e4b6f60236ee tempest-CreateVolumesFromSnapshotTest-168995481 None] Lock "cinder-quobyte-2684e1f9-574e-4241-8885-f394fb33552e" released by "delete_volume" :: held 0.717s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:27:08 devstack sudo[103521]: pam_unix(sudo:session): session closed for user root Jul 31 12:27:08 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-2e03a760-90ba-46f8-9d62-8b62c73d6cee tempest-VolumesListAdminTestJSON-1581256828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-91b7df64-2607-4837-9ce5-ddba3005ff4f" returned: 0 in 0.266s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:27:08 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-2e03a760-90ba-46f8-9d62-8b62c73d6cee tempest-VolumesListAdminTestJSON-1581256828 None] <== create_volume: return (861ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'} {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 12:27:08 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-2e03a760-90ba-46f8-9d62-8b62c73d6cee tempest-VolumesListAdminTestJSON-1581256828 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.863s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:27:08 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [req-02b2ca03-a174-4c98-ad71-3bb04d5f0db5 req-4f143970-2201-4671-9fd1-4c4cfcfbc951 tempest-TestVolumeBootPattern-1492021642 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.099s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:27:08 devstack cinder-volume[89182]: DEBUG cinder.quota [None req-1a331e6b-a0d8-40e5-9c9a-e4b6f60236ee tempest-CreateVolumesFromSnapshotTest-168995481 None] Created reservations ['b9df3fc5-1f79-48ea-a914-b8dc8dadc108', '5b824d26-a7dc-47d3-a677-e583ae01548d', 'e69a52a7-8760-49e7-b5ba-2b8e835860ce', '935f7951-332e-4a51-a101-ac4a11e8448c'] {{(pid=89182) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 12:27:08 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-2e03a760-90ba-46f8-9d62-8b62c73d6cee tempest-VolumesListAdminTestJSON-1581256828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e210ddaf-100a-4c67-8a62-09214b90e77d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-91b7df64-2607-4837-9ce5-ddba3005ff4f', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:27:08 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-2e03a760-90ba-46f8-9d62-8b62c73d6cee tempest-VolumesListAdminTestJSON-1581256828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66181c2b-a4a8-41c3-ac54-07abc3c076f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:27:08 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [req-02b2ca03-a174-4c98-ad71-3bb04d5f0db5 req-4f143970-2201-4671-9fd1-4c4cfcfbc951 tempest-TestVolumeBootPattern-1492021642 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.036s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:27:08 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-2e03a760-90ba-46f8-9d62-8b62c73d6cee tempest-VolumesListAdminTestJSON-1581256828 None] Volume volume-91b7df64-2607-4837-9ce5-ddba3005ff4f (91b7df64-2607-4837-9ce5-ddba3005ff4f): created successfully Jul 31 12:27:08 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-2e03a760-90ba-46f8-9d62-8b62c73d6cee tempest-VolumesListAdminTestJSON-1581256828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66181c2b-a4a8-41c3-ac54-07abc3c076f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:27:08 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-2e03a760-90ba-46f8-9d62-8b62c73d6cee tempest-VolumesListAdminTestJSON-1581256828 None] Flow 'volume_create_manager' (63102695-2d1d-47b3-b7ab-9a6e4ae6ec1f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:27:08 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-2e03a760-90ba-46f8-9d62-8b62c73d6cee tempest-VolumesListAdminTestJSON-1581256828 None] Created volume successfully. Jul 31 12:27:08 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [req-02b2ca03-a174-4c98-ad71-3bb04d5f0db5 req-4f143970-2201-4671-9fd1-4c4cfcfbc951 tempest-TestVolumeBootPattern-1492021642 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88', 'name': 'volume-ed54b024-d4ee-4263-a6c4-d3bb670e9b34', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd27fc3ef-8c68-4d38-8748-9d396320c73a', 'enforce_multipath': True} {{(pid=89182) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 31 12:27:08 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-752afa0c-e612-4625-a1b4-738a981cd3b7 tempest-SnapshotsActionsTest-789062798 None] Acquiring lock "cinder-3a2886ae-4012-48a1-9596-a37a869ce980-delete_snapshot" by "delete_snapshot" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:27:08 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-1a331e6b-a0d8-40e5-9c9a-e4b6f60236ee tempest-CreateVolumesFromSnapshotTest-168995481 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:27:08 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-1a331e6b-a0d8-40e5-9c9a-e4b6f60236ee tempest-CreateVolumesFromSnapshotTest-168995481 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:27:08 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-1a331e6b-a0d8-40e5-9c9a-e4b6f60236ee tempest-CreateVolumesFromSnapshotTest-168995481 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:27:08 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-1a331e6b-a0d8-40e5-9c9a-e4b6f60236ee tempest-CreateVolumesFromSnapshotTest-168995481 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:27:08 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-1a331e6b-a0d8-40e5-9c9a-e4b6f60236ee tempest-CreateVolumesFromSnapshotTest-168995481 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:27:08 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-1a331e6b-a0d8-40e5-9c9a-e4b6f60236ee tempest-CreateVolumesFromSnapshotTest-168995481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:27:08 devstack sudo[103528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 Jul 31 12:27:08 devstack sudo[103528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:27:08 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-752afa0c-e612-4625-a1b4-738a981cd3b7 tempest-SnapshotsActionsTest-789062798 None] Lock "cinder-3a2886ae-4012-48a1-9596-a37a869ce980-delete_snapshot" acquired by "delete_snapshot" :: waited 0.068s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:27:08 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-752afa0c-e612-4625-a1b4-738a981cd3b7 tempest-SnapshotsActionsTest-789062798 None] Acquiring lock "cinder-quobyte-85b99b20-af4d-4dbb-a203-5a890c846394" by "delete_snapshot" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:27:08 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-752afa0c-e612-4625-a1b4-738a981cd3b7 tempest-SnapshotsActionsTest-789062798 None] Lock "cinder-quobyte-85b99b20-af4d-4dbb-a203-5a890c846394" acquired by "delete_snapshot" :: waited 0.026s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:27:08 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-752afa0c-e612-4625-a1b4-738a981cd3b7 tempest-SnapshotsActionsTest-789062798 None] Acquiring lock "cinder-quobyte-3a2886ae-4012-48a1-9596-a37a869ce980" by "_delete_snapshot" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:27:08 devstack cinder-volume[89182]: INFO cinder.volume.manager [req-02b2ca03-a174-4c98-ad71-3bb04d5f0db5 req-4f143970-2201-4671-9fd1-4c4cfcfbc951 tempest-TestVolumeBootPattern-1492021642 None] attachment_update completed successfully. Jul 31 12:27:08 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-752afa0c-e612-4625-a1b4-738a981cd3b7 tempest-SnapshotsActionsTest-789062798 None] Lock "cinder-quobyte-3a2886ae-4012-48a1-9596-a37a869ce980" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:27:08 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-752afa0c-e612-4625-a1b4-738a981cd3b7 tempest-SnapshotsActionsTest-789062798 None] Deleting offline snapshot 3a2886ae-4012-48a1-9596-a37a869ce980 of volume 85b99b20-af4d-4dbb-a203-5a890c846394 {{(pid=89182) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 31 12:27:08 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-752afa0c-e612-4625-a1b4-738a981cd3b7 tempest-SnapshotsActionsTest-789062798 None] snapshot_file for this snap is: volume-85b99b20-af4d-4dbb-a203-5a890c846394.3a2886ae-4012-48a1-9596-a37a869ce980 {{(pid=89182) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 31 12:27:08 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[91ca0f64-82b0-4ce8-a4b9-b9c032e1482e]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:27:08 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-752afa0c-e612-4625-a1b4-738a981cd3b7 tempest-SnapshotsActionsTest-789062798 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-85b99b20-af4d-4dbb-a203-5a890c846394.3a2886ae-4012-48a1-9596-a37a869ce980 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:27:08 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-93ee7080-4294-4048-a7e6-8b5e2cc6ba49 tempest-CreateVolumesFromSnapshotTest-168995481 None] Acquiring lock "cinder-58be61a7-74e7-4f2e-8215-e44ac57ef48f-delete_snapshot" by "delete_snapshot" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:27:08 devstack sudo[103530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-85b99b20-af4d-4dbb-a203-5a890c846394.3a2886ae-4012-48a1-9596-a37a869ce980 Jul 31 12:27:08 devstack sudo[103530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:27:08 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-93ee7080-4294-4048-a7e6-8b5e2cc6ba49 tempest-CreateVolumesFromSnapshotTest-168995481 None] Lock "cinder-58be61a7-74e7-4f2e-8215-e44ac57ef48f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:27:08 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-93ee7080-4294-4048-a7e6-8b5e2cc6ba49 tempest-CreateVolumesFromSnapshotTest-168995481 None] Acquiring lock "cinder-quobyte-d1a009ea-dd7e-4085-8b56-a184a7feceb6" by "delete_snapshot" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:27:08 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-93ee7080-4294-4048-a7e6-8b5e2cc6ba49 tempest-CreateVolumesFromSnapshotTest-168995481 None] Lock "cinder-quobyte-d1a009ea-dd7e-4085-8b56-a184a7feceb6" acquired by "delete_snapshot" :: waited 0.023s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:27:08 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-93ee7080-4294-4048-a7e6-8b5e2cc6ba49 tempest-CreateVolumesFromSnapshotTest-168995481 None] Acquiring lock "cinder-quobyte-58be61a7-74e7-4f2e-8215-e44ac57ef48f" by "_delete_snapshot" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:27:08 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-93ee7080-4294-4048-a7e6-8b5e2cc6ba49 tempest-CreateVolumesFromSnapshotTest-168995481 None] Lock "cinder-quobyte-58be61a7-74e7-4f2e-8215-e44ac57ef48f" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:27:08 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-93ee7080-4294-4048-a7e6-8b5e2cc6ba49 tempest-CreateVolumesFromSnapshotTest-168995481 None] Deleting offline snapshot 58be61a7-74e7-4f2e-8215-e44ac57ef48f of volume d1a009ea-dd7e-4085-8b56-a184a7feceb6 {{(pid=89182) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 31 12:27:08 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-93ee7080-4294-4048-a7e6-8b5e2cc6ba49 tempest-CreateVolumesFromSnapshotTest-168995481 None] snapshot_file for this snap is: volume-d1a009ea-dd7e-4085-8b56-a184a7feceb6.58be61a7-74e7-4f2e-8215-e44ac57ef48f {{(pid=89182) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 31 12:27:08 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[71b211a4-f67a-473e-b56e-6af74af73e7c]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:27:08 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-93ee7080-4294-4048-a7e6-8b5e2cc6ba49 tempest-CreateVolumesFromSnapshotTest-168995481 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-d1a009ea-dd7e-4085-8b56-a184a7feceb6.58be61a7-74e7-4f2e-8215-e44ac57ef48f {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:27:08 devstack sudo[103528]: pam_unix(sudo:session): session closed for user root Jul 31 12:27:08 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-1a331e6b-a0d8-40e5-9c9a-e4b6f60236ee tempest-CreateVolumesFromSnapshotTest-168995481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2" returned: 0 in 0.480s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:27:08 devstack cinder-volume[89182]: DEBUG cinder.manager [None req-1a331e6b-a0d8-40e5-9c9a-e4b6f60236ee tempest-CreateVolumesFromSnapshotTest-168995481 None] Notifying Schedulers of capabilities ... {{(pid=89182) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 12:27:08 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-1a331e6b-a0d8-40e5-9c9a-e4b6f60236ee tempest-CreateVolumesFromSnapshotTest-168995481 None] Deleted volume successfully. Jul 31 12:27:08 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-1a331e6b-a0d8-40e5-9c9a-e4b6f60236ee tempest-CreateVolumesFromSnapshotTest-168995481 None] Lock "cinder-2684e1f9-574e-4241-8885-f394fb33552e-delete_volume" released by "delete_volume" :: held 1.526s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:27:08 devstack sudo[103533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-d1a009ea-dd7e-4085-8b56-a184a7feceb6.58be61a7-74e7-4f2e-8215-e44ac57ef48f Jul 31 12:27:08 devstack sudo[103533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:27:09 devstack sudo[103530]: pam_unix(sudo:session): session closed for user root Jul 31 12:27:09 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-752afa0c-e612-4625-a1b4-738a981cd3b7 tempest-SnapshotsActionsTest-789062798 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-85b99b20-af4d-4dbb-a203-5a890c846394.3a2886ae-4012-48a1-9596-a37a869ce980" returned: 0 in 0.569s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:27:09 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-752afa0c-e612-4625-a1b4-738a981cd3b7 tempest-SnapshotsActionsTest-789062798 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-85b99b20-af4d-4dbb-a203-5a890c846394(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89182) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 12:27:09 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[294085a6-dcac-46ce-91e0-d11343a662cf]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:27:09 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-752afa0c-e612-4625-a1b4-738a981cd3b7 tempest-SnapshotsActionsTest-789062798 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-85b99b20-af4d-4dbb-a203-5a890c846394.df57d977-ee95-40d0-acbc-7a5f10d0db85 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:27:09 devstack sudo[103567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-85b99b20-af4d-4dbb-a203-5a890c846394.df57d977-ee95-40d0-acbc-7a5f10d0db85 Jul 31 12:27:09 devstack sudo[103567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:27:09 devstack sudo[103533]: pam_unix(sudo:session): session closed for user root Jul 31 12:27:09 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-93ee7080-4294-4048-a7e6-8b5e2cc6ba49 tempest-CreateVolumesFromSnapshotTest-168995481 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-d1a009ea-dd7e-4085-8b56-a184a7feceb6.58be61a7-74e7-4f2e-8215-e44ac57ef48f" returned: 0 in 0.684s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:27:09 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-93ee7080-4294-4048-a7e6-8b5e2cc6ba49 tempest-CreateVolumesFromSnapshotTest-168995481 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d1a009ea-dd7e-4085-8b56-a184a7feceb6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89182) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 12:27:09 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[414a3599-5a8d-4e27-a113-d0acde59a421]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:27:09 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-93ee7080-4294-4048-a7e6-8b5e2cc6ba49 tempest-CreateVolumesFromSnapshotTest-168995481 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-d1a009ea-dd7e-4085-8b56-a184a7feceb6 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:27:09 devstack cinder-volume[89182]: DEBUG cinder.volume.flows.manager.create_volume [None req-f43fc479-075f-49e6-8f88-516942196a8e tempest-VolumesListAdminTestJSON-1616843947 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89182) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 12:27:09 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-f43fc479-075f-49e6-8f88-516942196a8e tempest-VolumesListAdminTestJSON-1616843947 None] Flow 'volume_create_manager' (882d0b21-fb58-48a8-8e6c-4b674700afef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:27:09 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-f43fc479-075f-49e6-8f88-516942196a8e tempest-VolumesListAdminTestJSON-1616843947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b306c3d4-d6a1-4545-9a43-ac058daf0561) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:27:09 devstack sudo[103624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-d1a009ea-dd7e-4085-8b56-a184a7feceb6 Jul 31 12:27:09 devstack sudo[103624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:27:09 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-f43fc479-075f-49e6-8f88-516942196a8e tempest-VolumesListAdminTestJSON-1616843947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b306c3d4-d6a1-4545-9a43-ac058daf0561) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:27:09Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97ee4fb9-3e04-4821-b242-21dce5257f92,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5457d2eca85947f9b5f07b43ea548204',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:27:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:27:09Z,use_quota=True,user_id='5de355d8fe6c46b8a42317ec09fd874c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:27:09 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-f43fc479-075f-49e6-8f88-516942196a8e tempest-VolumesListAdminTestJSON-1616843947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5f33b97-626e-40b5-bf85-c89f5685c713) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:27:09 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-f43fc479-075f-49e6-8f88-516942196a8e tempest-VolumesListAdminTestJSON-1616843947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5f33b97-626e-40b5-bf85-c89f5685c713) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:27:09 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-f43fc479-075f-49e6-8f88-516942196a8e tempest-VolumesListAdminTestJSON-1616843947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77dd7258-1afa-4d62-8ea2-733c2c73075c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:27:09 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-f43fc479-075f-49e6-8f88-516942196a8e tempest-VolumesListAdminTestJSON-1616843947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77dd7258-1afa-4d62-8ea2-733c2c73075c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '97ee4fb9-3e04-4821-b242-21dce5257f92', 'volume_name': 'volume-97ee4fb9-3e04-4821-b242-21dce5257f92', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:27:09 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-f43fc479-075f-49e6-8f88-516942196a8e tempest-VolumesListAdminTestJSON-1616843947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0a8b509-4bf1-4d21-a40f-9b7dc9ff4967) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:27:09 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-f43fc479-075f-49e6-8f88-516942196a8e tempest-VolumesListAdminTestJSON-1616843947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0a8b509-4bf1-4d21-a40f-9b7dc9ff4967) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:27:09 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-f43fc479-075f-49e6-8f88-516942196a8e tempest-VolumesListAdminTestJSON-1616843947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44f054b2-395f-4c98-946b-51137217d736) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:27:09 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-f43fc479-075f-49e6-8f88-516942196a8e tempest-VolumesListAdminTestJSON-1616843947 None] Volume 97ee4fb9-3e04-4821-b242-21dce5257f92: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-97ee4fb9-3e04-4821-b242-21dce5257f92', 'volume_size': 1} Jul 31 12:27:09 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-f43fc479-075f-49e6-8f88-516942196a8e tempest-VolumesListAdminTestJSON-1616843947 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:27:09 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-f43fc479-075f-49e6-8f88-516942196a8e tempest-VolumesListAdminTestJSON-1616843947 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:27:09 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-f43fc479-075f-49e6-8f88-516942196a8e tempest-VolumesListAdminTestJSON-1616843947 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:27:09Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97ee4fb9-3e04-4821-b242-21dce5257f92,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5457d2eca85947f9b5f07b43ea548204',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:27:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:27:09Z,use_quota=True,user_id='5de355d8fe6c46b8a42317ec09fd874c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)}" {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 12:27:09 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-f43fc479-075f-49e6-8f88-516942196a8e tempest-VolumesListAdminTestJSON-1616843947 None] Creating volume 97ee4fb9-3e04-4821-b242-21dce5257f92 {{(pid=89182) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 12:27:09 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-f43fc479-075f-49e6-8f88-516942196a8e tempest-VolumesListAdminTestJSON-1616843947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:27:09 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-f43fc479-075f-49e6-8f88-516942196a8e tempest-VolumesListAdminTestJSON-1616843947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:27:09 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-f43fc479-075f-49e6-8f88-516942196a8e tempest-VolumesListAdminTestJSON-1616843947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:27:09 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-f43fc479-075f-49e6-8f88-516942196a8e tempest-VolumesListAdminTestJSON-1616843947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:27:09 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-f43fc479-075f-49e6-8f88-516942196a8e tempest-VolumesListAdminTestJSON-1616843947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:27:09 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-f43fc479-075f-49e6-8f88-516942196a8e tempest-VolumesListAdminTestJSON-1616843947 None] Selected osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 as target Quobyte volume. {{(pid=89182) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 12:27:09 devstack cinder-volume[89182]: INFO cinder.volume.drivers.remotefs [None req-f43fc479-075f-49e6-8f88-516942196a8e tempest-VolumesListAdminTestJSON-1616843947 None] casted to osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 Jul 31 12:27:09 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-f43fc479-075f-49e6-8f88-516942196a8e tempest-VolumesListAdminTestJSON-1616843947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-97ee4fb9-3e04-4821-b242-21dce5257f92 1073741824 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:27:09 devstack sudo[103567]: pam_unix(sudo:session): session closed for user root Jul 31 12:27:09 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-752afa0c-e612-4625-a1b4-738a981cd3b7 tempest-SnapshotsActionsTest-789062798 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-85b99b20-af4d-4dbb-a203-5a890c846394.df57d977-ee95-40d0-acbc-7a5f10d0db85" returned: 0 in 0.756s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:27:09 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-752afa0c-e612-4625-a1b4-738a981cd3b7 tempest-SnapshotsActionsTest-789062798 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-85b99b20-af4d-4dbb-a203-5a890c846394(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89182) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 12:27:09 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-752afa0c-e612-4625-a1b4-738a981cd3b7 tempest-SnapshotsActionsTest-789062798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-85b99b20-af4d-4dbb-a203-5a890c846394.3a2886ae-4012-48a1-9596-a37a869ce980 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:27:09 devstack sudo[103960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-97ee4fb9-3e04-4821-b242-21dce5257f92 1073741824 Jul 31 12:27:09 devstack sudo[103960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:27:09 devstack sudo[103963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-85b99b20-af4d-4dbb-a203-5a890c846394.3a2886ae-4012-48a1-9596-a37a869ce980 Jul 31 12:27:09 devstack sudo[103963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:27:10 devstack sudo[103624]: pam_unix(sudo:session): session closed for user root Jul 31 12:27:10 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-93ee7080-4294-4048-a7e6-8b5e2cc6ba49 tempest-CreateVolumesFromSnapshotTest-168995481 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-d1a009ea-dd7e-4085-8b56-a184a7feceb6" returned: 0 in 0.555s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:27:10 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-93ee7080-4294-4048-a7e6-8b5e2cc6ba49 tempest-CreateVolumesFromSnapshotTest-168995481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-d1a009ea-dd7e-4085-8b56-a184a7feceb6.58be61a7-74e7-4f2e-8215-e44ac57ef48f {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:27:10 devstack sudo[103978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-d1a009ea-dd7e-4085-8b56-a184a7feceb6.58be61a7-74e7-4f2e-8215-e44ac57ef48f Jul 31 12:27:10 devstack sudo[103978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:27:10 devstack sudo[103963]: pam_unix(sudo:session): session closed for user root Jul 31 12:27:10 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-752afa0c-e612-4625-a1b4-738a981cd3b7 tempest-SnapshotsActionsTest-789062798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-85b99b20-af4d-4dbb-a203-5a890c846394.3a2886ae-4012-48a1-9596-a37a869ce980" returned: 0 in 0.669s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:27:10 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-752afa0c-e612-4625-a1b4-738a981cd3b7 tempest-SnapshotsActionsTest-789062798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-85b99b20-af4d-4dbb-a203-5a890c846394.3a2886ae-4012-48a1-9596-a37a869ce980 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:27:10 devstack sudo[103997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-85b99b20-af4d-4dbb-a203-5a890c846394.3a2886ae-4012-48a1-9596-a37a869ce980 Jul 31 12:27:10 devstack sudo[103997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:27:10 devstack sudo[103960]: pam_unix(sudo:session): session closed for user root Jul 31 12:27:10 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-f43fc479-075f-49e6-8f88-516942196a8e tempest-VolumesListAdminTestJSON-1616843947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-97ee4fb9-3e04-4821-b242-21dce5257f92 1073741824" returned: 0 in 0.778s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:27:10 devstack cinder-volume[89182]: DEBUG dbcounter [-] [89182] Writing DB stats cinder:SELECT=166,cinder:INSERT=75,cinder:UPDATE=175,cinder:DELETE=13 {{(pid=89182) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 12:27:10 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-f43fc479-075f-49e6-8f88-516942196a8e tempest-VolumesListAdminTestJSON-1616843947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-97ee4fb9-3e04-4821-b242-21dce5257f92 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:27:10 devstack sudo[104002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-97ee4fb9-3e04-4821-b242-21dce5257f92 Jul 31 12:27:10 devstack sudo[104002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:27:10 devstack sudo[103978]: pam_unix(sudo:session): session closed for user root Jul 31 12:27:10 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-93ee7080-4294-4048-a7e6-8b5e2cc6ba49 tempest-CreateVolumesFromSnapshotTest-168995481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-d1a009ea-dd7e-4085-8b56-a184a7feceb6.58be61a7-74e7-4f2e-8215-e44ac57ef48f" returned: 0 in 0.789s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:27:10 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-93ee7080-4294-4048-a7e6-8b5e2cc6ba49 tempest-CreateVolumesFromSnapshotTest-168995481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-d1a009ea-dd7e-4085-8b56-a184a7feceb6.58be61a7-74e7-4f2e-8215-e44ac57ef48f {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:27:10 devstack sudo[103997]: pam_unix(sudo:session): session closed for user root Jul 31 12:27:10 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-752afa0c-e612-4625-a1b4-738a981cd3b7 tempest-SnapshotsActionsTest-789062798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-85b99b20-af4d-4dbb-a203-5a890c846394.3a2886ae-4012-48a1-9596-a37a869ce980" returned: 0 in 0.374s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:27:10 devstack sudo[104015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-d1a009ea-dd7e-4085-8b56-a184a7feceb6.58be61a7-74e7-4f2e-8215-e44ac57ef48f Jul 31 12:27:10 devstack sudo[104015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:27:10 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-752afa0c-e612-4625-a1b4-738a981cd3b7 tempest-SnapshotsActionsTest-789062798 None] Lock "cinder-quobyte-3a2886ae-4012-48a1-9596-a37a869ce980" released by "_delete_snapshot" :: held 2.542s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:27:10 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-752afa0c-e612-4625-a1b4-738a981cd3b7 tempest-SnapshotsActionsTest-789062798 None] Lock "cinder-quobyte-85b99b20-af4d-4dbb-a203-5a890c846394" released by "delete_snapshot" :: held 2.582s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:27:10 devstack sudo[104002]: pam_unix(sudo:session): session closed for user root Jul 31 12:27:10 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-f43fc479-075f-49e6-8f88-516942196a8e tempest-VolumesListAdminTestJSON-1616843947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-97ee4fb9-3e04-4821-b242-21dce5257f92" returned: 0 in 0.355s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:27:11 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-f43fc479-075f-49e6-8f88-516942196a8e tempest-VolumesListAdminTestJSON-1616843947 None] <== create_volume: return (1200ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'} {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 12:27:11 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-f43fc479-075f-49e6-8f88-516942196a8e tempest-VolumesListAdminTestJSON-1616843947 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.203s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:27:11 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-f43fc479-075f-49e6-8f88-516942196a8e tempest-VolumesListAdminTestJSON-1616843947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44f054b2-395f-4c98-946b-51137217d736) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-97ee4fb9-3e04-4821-b242-21dce5257f92', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:27:11 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-f43fc479-075f-49e6-8f88-516942196a8e tempest-VolumesListAdminTestJSON-1616843947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43e696aa-cb3a-4954-ba21-4276ecebb227) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:27:11 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-f43fc479-075f-49e6-8f88-516942196a8e tempest-VolumesListAdminTestJSON-1616843947 None] Volume volume-97ee4fb9-3e04-4821-b242-21dce5257f92 (97ee4fb9-3e04-4821-b242-21dce5257f92): created successfully Jul 31 12:27:11 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-f43fc479-075f-49e6-8f88-516942196a8e tempest-VolumesListAdminTestJSON-1616843947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43e696aa-cb3a-4954-ba21-4276ecebb227) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:27:11 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-f43fc479-075f-49e6-8f88-516942196a8e tempest-VolumesListAdminTestJSON-1616843947 None] Flow 'volume_create_manager' (882d0b21-fb58-48a8-8e6c-4b674700afef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:27:11 devstack cinder-volume[89182]: DEBUG cinder.quota [None req-752afa0c-e612-4625-a1b4-738a981cd3b7 tempest-SnapshotsActionsTest-789062798 None] Created reservations ['ea9e51ad-73be-4313-9798-04d3619510f9', '4020a027-07d8-48bb-81ff-c1458dd2678a', '0d2659bc-5dca-4154-a9ff-a796c05faf9a', '16f40eeb-ecbe-4439-96ca-ea51d4615408'] {{(pid=89182) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 12:27:11 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-f43fc479-075f-49e6-8f88-516942196a8e tempest-VolumesListAdminTestJSON-1616843947 None] Created volume successfully. Jul 31 12:27:11 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-752afa0c-e612-4625-a1b4-738a981cd3b7 tempest-SnapshotsActionsTest-789062798 None] Delete snapshot completed successfully. Jul 31 12:27:11 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-752afa0c-e612-4625-a1b4-738a981cd3b7 tempest-SnapshotsActionsTest-789062798 None] Lock "cinder-3a2886ae-4012-48a1-9596-a37a869ce980-delete_snapshot" released by "delete_snapshot" :: held 2.804s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:27:11 devstack sudo[104015]: pam_unix(sudo:session): session closed for user root Jul 31 12:27:11 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-93ee7080-4294-4048-a7e6-8b5e2cc6ba49 tempest-CreateVolumesFromSnapshotTest-168995481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-d1a009ea-dd7e-4085-8b56-a184a7feceb6.58be61a7-74e7-4f2e-8215-e44ac57ef48f" returned: 0 in 0.326s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:27:11 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-93ee7080-4294-4048-a7e6-8b5e2cc6ba49 tempest-CreateVolumesFromSnapshotTest-168995481 None] Lock "cinder-quobyte-58be61a7-74e7-4f2e-8215-e44ac57ef48f" released by "_delete_snapshot" :: held 2.564s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:27:11 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-93ee7080-4294-4048-a7e6-8b5e2cc6ba49 tempest-CreateVolumesFromSnapshotTest-168995481 None] Lock "cinder-quobyte-d1a009ea-dd7e-4085-8b56-a184a7feceb6" released by "delete_snapshot" :: held 2.600s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:27:11 devstack cinder-volume[89182]: DEBUG cinder.quota [None req-93ee7080-4294-4048-a7e6-8b5e2cc6ba49 tempest-CreateVolumesFromSnapshotTest-168995481 None] Created reservations ['acc9b640-ed6d-4854-9e89-8bafe1fdda73', '66ca99de-3497-455f-acdc-46430fd4baec', 'd5aa4c10-8eef-462b-b6d9-7b3e6c178366', '992b9c92-04e6-40a5-afdf-7bca1ab68f2f'] {{(pid=89182) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 12:27:11 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-93ee7080-4294-4048-a7e6-8b5e2cc6ba49 tempest-CreateVolumesFromSnapshotTest-168995481 None] Delete snapshot completed successfully. Jul 31 12:27:11 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-93ee7080-4294-4048-a7e6-8b5e2cc6ba49 tempest-CreateVolumesFromSnapshotTest-168995481 None] Lock "cinder-58be61a7-74e7-4f2e-8215-e44ac57ef48f-delete_snapshot" released by "delete_snapshot" :: held 2.756s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:27:11 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-170a59b2-0734-42d4-a2fe-aeeb3a002b96 tempest-VolumesListAdminTestJSON-1616843947 None] Acquiring lock "cinder-97ee4fb9-3e04-4821-b242-21dce5257f92-delete_volume" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:27:11 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-170a59b2-0734-42d4-a2fe-aeeb3a002b96 tempest-VolumesListAdminTestJSON-1616843947 None] Lock "cinder-97ee4fb9-3e04-4821-b242-21dce5257f92-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:27:11 devstack cinder-volume[89182]: DEBUG dbcounter [-] [89182] Writing DB stats cinder:UPDATE=202,cinder:SELECT=180,cinder:INSERT=71,cinder:DELETE=16 {{(pid=89182) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 12:27:11 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-170a59b2-0734-42d4-a2fe-aeeb3a002b96 tempest-VolumesListAdminTestJSON-1616843947 None] Acquiring lock "cinder-quobyte-97ee4fb9-3e04-4821-b242-21dce5257f92" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:27:11 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-170a59b2-0734-42d4-a2fe-aeeb3a002b96 tempest-VolumesListAdminTestJSON-1616843947 None] Lock "cinder-quobyte-97ee4fb9-3e04-4821-b242-21dce5257f92" acquired by "delete_volume" :: waited 0.033s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:27:11 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[636c25d4-1e87-4be0-8df1-cfd08111b9df]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:27:11 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-170a59b2-0734-42d4-a2fe-aeeb3a002b96 tempest-VolumesListAdminTestJSON-1616843947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-97ee4fb9-3e04-4821-b242-21dce5257f92 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:27:11 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-236de285-9b4e-4c96-a8e2-6587d36d2319 tempest-VolumesListAdminTestJSON-1581256828 None] Acquiring lock "cinder-91b7df64-2607-4837-9ce5-ddba3005ff4f-delete_volume" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:27:11 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-236de285-9b4e-4c96-a8e2-6587d36d2319 tempest-VolumesListAdminTestJSON-1581256828 None] Lock "cinder-91b7df64-2607-4837-9ce5-ddba3005ff4f-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:27:12 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-236de285-9b4e-4c96-a8e2-6587d36d2319 tempest-VolumesListAdminTestJSON-1581256828 None] Acquiring lock "cinder-quobyte-91b7df64-2607-4837-9ce5-ddba3005ff4f" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:27:12 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-236de285-9b4e-4c96-a8e2-6587d36d2319 tempest-VolumesListAdminTestJSON-1581256828 None] Lock "cinder-quobyte-91b7df64-2607-4837-9ce5-ddba3005ff4f" acquired by "delete_volume" :: waited 0.082s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:27:12 devstack sudo[104039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-97ee4fb9-3e04-4821-b242-21dce5257f92 Jul 31 12:27:12 devstack sudo[104039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:27:12 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-a9c6ffb2-72b2-4166-9d98-0d6ad44bcd95 tempest-CreateVolumesFromSnapshotTest-168995481 None] Acquiring lock "cinder-d1a009ea-dd7e-4085-8b56-a184a7feceb6-delete_volume" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:27:12 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-c83831ed-ba03-4eb4-bda4-d0862f4c3617 tempest-SnapshotsActionsTest-2046780578 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:27:12 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-c83831ed-ba03-4eb4-bda4-d0862f4c3617 tempest-SnapshotsActionsTest-2046780578 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:27:12 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4a4cde0-c890-4b1b-882c-5ed1930ca136]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:27:12 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-236de285-9b4e-4c96-a8e2-6587d36d2319 tempest-VolumesListAdminTestJSON-1581256828 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-91b7df64-2607-4837-9ce5-ddba3005ff4f {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:27:12 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-c83831ed-ba03-4eb4-bda4-d0862f4c3617 tempest-SnapshotsActionsTest-2046780578 None] Creating offline snapshot 0845f027-f038-4415-b720-6de7768c4105 of volume 85b99b20-af4d-4dbb-a203-5a890c846394 {{(pid=89182) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 31 12:27:12 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-a9c6ffb2-72b2-4166-9d98-0d6ad44bcd95 tempest-CreateVolumesFromSnapshotTest-168995481 None] Lock "cinder-d1a009ea-dd7e-4085-8b56-a184a7feceb6-delete_volume" acquired by "delete_volume" :: waited 0.151s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:27:12 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[5defd623-4f72-4282-adca-db254dca3550]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:27:12 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-c83831ed-ba03-4eb4-bda4-d0862f4c3617 tempest-SnapshotsActionsTest-2046780578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-85b99b20-af4d-4dbb-a203-5a890c846394.df57d977-ee95-40d0-acbc-7a5f10d0db85 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:27:12 devstack sudo[104041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-91b7df64-2607-4837-9ce5-ddba3005ff4f Jul 31 12:27:12 devstack sudo[104041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:27:12 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-a9c6ffb2-72b2-4166-9d98-0d6ad44bcd95 tempest-CreateVolumesFromSnapshotTest-168995481 None] Acquiring lock "cinder-quobyte-d1a009ea-dd7e-4085-8b56-a184a7feceb6" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:27:12 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-a9c6ffb2-72b2-4166-9d98-0d6ad44bcd95 tempest-CreateVolumesFromSnapshotTest-168995481 None] Lock "cinder-quobyte-d1a009ea-dd7e-4085-8b56-a184a7feceb6" acquired by "delete_volume" :: waited 0.032s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:27:12 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b17bb21-9d5d-43bb-8aa0-fab4e48b50ce]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:27:12 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-a9c6ffb2-72b2-4166-9d98-0d6ad44bcd95 tempest-CreateVolumesFromSnapshotTest-168995481 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-d1a009ea-dd7e-4085-8b56-a184a7feceb6 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:27:12 devstack sudo[104042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-85b99b20-af4d-4dbb-a203-5a890c846394.df57d977-ee95-40d0-acbc-7a5f10d0db85 Jul 31 12:27:12 devstack sudo[104042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:27:12 devstack sudo[104039]: pam_unix(sudo:session): session closed for user root Jul 31 12:27:12 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-170a59b2-0734-42d4-a2fe-aeeb3a002b96 tempest-VolumesListAdminTestJSON-1616843947 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-97ee4fb9-3e04-4821-b242-21dce5257f92" returned: 0 in 0.747s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:27:12 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-170a59b2-0734-42d4-a2fe-aeeb3a002b96 tempest-VolumesListAdminTestJSON-1616843947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-97ee4fb9-3e04-4821-b242-21dce5257f92 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:27:12 devstack sudo[104049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-97ee4fb9-3e04-4821-b242-21dce5257f92 Jul 31 12:27:12 devstack sudo[104049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:27:12 devstack sudo[104047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-d1a009ea-dd7e-4085-8b56-a184a7feceb6 Jul 31 12:27:12 devstack sudo[104047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:27:12 devstack sudo[104049]: pam_unix(sudo:session): session closed for user root Jul 31 12:27:12 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-170a59b2-0734-42d4-a2fe-aeeb3a002b96 tempest-VolumesListAdminTestJSON-1616843947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-97ee4fb9-3e04-4821-b242-21dce5257f92" returned: 0 in 0.406s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:27:12 devstack sudo[104041]: pam_unix(sudo:session): session closed for user root Jul 31 12:27:13 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-170a59b2-0734-42d4-a2fe-aeeb3a002b96 tempest-VolumesListAdminTestJSON-1616843947 None] Lock "cinder-quobyte-97ee4fb9-3e04-4821-b242-21dce5257f92" released by "delete_volume" :: held 1.230s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:27:13 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-236de285-9b4e-4c96-a8e2-6587d36d2319 tempest-VolumesListAdminTestJSON-1581256828 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-91b7df64-2607-4837-9ce5-ddba3005ff4f" returned: 0 in 0.831s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:27:13 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-236de285-9b4e-4c96-a8e2-6587d36d2319 tempest-VolumesListAdminTestJSON-1581256828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-91b7df64-2607-4837-9ce5-ddba3005ff4f {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:27:13 devstack sudo[104059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-91b7df64-2607-4837-9ce5-ddba3005ff4f Jul 31 12:27:13 devstack sudo[104059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:27:13 devstack cinder-volume[89182]: DEBUG cinder.quota [None req-170a59b2-0734-42d4-a2fe-aeeb3a002b96 tempest-VolumesListAdminTestJSON-1616843947 None] Created reservations ['d05343ae-9fcc-4cfb-abcc-da5707dc4061', '67fca4a0-7b43-4cb9-b132-a8ef45a1c192', '25479c65-2bd3-4eb3-a15f-2b7673f3fe11', 'b69b5697-b51a-44f3-9b43-a4a9165edcaa'] {{(pid=89182) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 12:27:13 devstack sudo[104042]: pam_unix(sudo:session): session closed for user root Jul 31 12:27:13 devstack sudo[104047]: pam_unix(sudo:session): session closed for user root Jul 31 12:27:13 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-c83831ed-ba03-4eb4-bda4-d0862f4c3617 tempest-SnapshotsActionsTest-2046780578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-85b99b20-af4d-4dbb-a203-5a890c846394.df57d977-ee95-40d0-acbc-7a5f10d0db85" returned: 0 in 0.965s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:27:13 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-c83831ed-ba03-4eb4-bda4-d0862f4c3617 tempest-SnapshotsActionsTest-2046780578 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-85b99b20-af4d-4dbb-a203-5a890c846394(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89182) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 12:27:13 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-c83831ed-ba03-4eb4-bda4-d0862f4c3617 tempest-SnapshotsActionsTest-2046780578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-85b99b20-af4d-4dbb-a203-5a890c846394.df57d977-ee95-40d0-acbc-7a5f10d0db85,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-85b99b20-af4d-4dbb-a203-5a890c846394.0845f027-f038-4415-b720-6de7768c4105 1G {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:27:13 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-a9c6ffb2-72b2-4166-9d98-0d6ad44bcd95 tempest-CreateVolumesFromSnapshotTest-168995481 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-d1a009ea-dd7e-4085-8b56-a184a7feceb6" returned: 0 in 0.845s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:27:13 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-a9c6ffb2-72b2-4166-9d98-0d6ad44bcd95 tempest-CreateVolumesFromSnapshotTest-168995481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-d1a009ea-dd7e-4085-8b56-a184a7feceb6 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:27:13 devstack sudo[104067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-85b99b20-af4d-4dbb-a203-5a890c846394.df57d977-ee95-40d0-acbc-7a5f10d0db85,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-85b99b20-af4d-4dbb-a203-5a890c846394.0845f027-f038-4415-b720-6de7768c4105 1G Jul 31 12:27:13 devstack sudo[104067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:27:13 devstack sudo[104068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-d1a009ea-dd7e-4085-8b56-a184a7feceb6 Jul 31 12:27:13 devstack sudo[104068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:27:13 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-170a59b2-0734-42d4-a2fe-aeeb3a002b96 tempest-VolumesListAdminTestJSON-1616843947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:27:13 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-170a59b2-0734-42d4-a2fe-aeeb3a002b96 tempest-VolumesListAdminTestJSON-1616843947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:27:13 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-170a59b2-0734-42d4-a2fe-aeeb3a002b96 tempest-VolumesListAdminTestJSON-1616843947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:27:13 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-170a59b2-0734-42d4-a2fe-aeeb3a002b96 tempest-VolumesListAdminTestJSON-1616843947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:27:13 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-170a59b2-0734-42d4-a2fe-aeeb3a002b96 tempest-VolumesListAdminTestJSON-1616843947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:27:13 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-170a59b2-0734-42d4-a2fe-aeeb3a002b96 tempest-VolumesListAdminTestJSON-1616843947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:27:13 devstack sudo[104059]: pam_unix(sudo:session): session closed for user root Jul 31 12:27:13 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-236de285-9b4e-4c96-a8e2-6587d36d2319 tempest-VolumesListAdminTestJSON-1581256828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-91b7df64-2607-4837-9ce5-ddba3005ff4f" returned: 0 in 0.481s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:27:13 devstack sudo[104072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 Jul 31 12:27:13 devstack sudo[104072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:27:13 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-236de285-9b4e-4c96-a8e2-6587d36d2319 tempest-VolumesListAdminTestJSON-1581256828 None] Lock "cinder-quobyte-91b7df64-2607-4837-9ce5-ddba3005ff4f" released by "delete_volume" :: held 1.441s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:27:13 devstack cinder-volume[89182]: DEBUG cinder.quota [None req-236de285-9b4e-4c96-a8e2-6587d36d2319 tempest-VolumesListAdminTestJSON-1581256828 None] Created reservations ['723cc064-ddb3-48df-aaa1-1170341a13c4', 'fbba18c7-d9a3-49a7-baac-15b492b6e380', '11fa2c8b-11d0-426e-a8d2-ac1df67be669', '36f34ba2-cfcd-44c9-a0f0-1462e2f48868'] {{(pid=89182) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 12:27:13 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-236de285-9b4e-4c96-a8e2-6587d36d2319 tempest-VolumesListAdminTestJSON-1581256828 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:27:13 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-236de285-9b4e-4c96-a8e2-6587d36d2319 tempest-VolumesListAdminTestJSON-1581256828 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:27:13 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-236de285-9b4e-4c96-a8e2-6587d36d2319 tempest-VolumesListAdminTestJSON-1581256828 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:27:13 devstack sudo[104072]: pam_unix(sudo:session): session closed for user root Jul 31 12:27:13 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-236de285-9b4e-4c96-a8e2-6587d36d2319 tempest-VolumesListAdminTestJSON-1581256828 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:27:13 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-236de285-9b4e-4c96-a8e2-6587d36d2319 tempest-VolumesListAdminTestJSON-1581256828 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:27:13 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-236de285-9b4e-4c96-a8e2-6587d36d2319 tempest-VolumesListAdminTestJSON-1581256828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:27:13 devstack sudo[104068]: pam_unix(sudo:session): session closed for user root Jul 31 12:27:13 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-170a59b2-0734-42d4-a2fe-aeeb3a002b96 tempest-VolumesListAdminTestJSON-1616843947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2" returned: 0 in 0.416s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:27:13 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-a9c6ffb2-72b2-4166-9d98-0d6ad44bcd95 tempest-CreateVolumesFromSnapshotTest-168995481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-d1a009ea-dd7e-4085-8b56-a184a7feceb6" returned: 0 in 0.549s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:27:13 devstack cinder-volume[89182]: DEBUG cinder.manager [None req-170a59b2-0734-42d4-a2fe-aeeb3a002b96 tempest-VolumesListAdminTestJSON-1616843947 None] Notifying Schedulers of capabilities ... {{(pid=89182) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 12:27:13 devstack sudo[104079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 Jul 31 12:27:13 devstack sudo[104079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:27:13 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-170a59b2-0734-42d4-a2fe-aeeb3a002b96 tempest-VolumesListAdminTestJSON-1616843947 None] Deleted volume successfully. Jul 31 12:27:13 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-a9c6ffb2-72b2-4166-9d98-0d6ad44bcd95 tempest-CreateVolumesFromSnapshotTest-168995481 None] Lock "cinder-quobyte-d1a009ea-dd7e-4085-8b56-a184a7feceb6" released by "delete_volume" :: held 1.512s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:27:14 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-170a59b2-0734-42d4-a2fe-aeeb3a002b96 tempest-VolumesListAdminTestJSON-1616843947 None] Lock "cinder-97ee4fb9-3e04-4821-b242-21dce5257f92-delete_volume" released by "delete_volume" :: held 2.323s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:27:14 devstack cinder-volume[89182]: DEBUG cinder.quota [None req-a9c6ffb2-72b2-4166-9d98-0d6ad44bcd95 tempest-CreateVolumesFromSnapshotTest-168995481 None] Created reservations ['d48c26fa-5563-437f-b832-a74f53c6c2ed', 'fe223573-c40c-4164-9ae7-b4d2f2114623', '02723055-273e-4aab-847f-1b975729b463', '0639e562-1f58-426d-815a-531453aad18e'] {{(pid=89182) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 12:27:14 devstack sudo[104067]: pam_unix(sudo:session): session closed for user root Jul 31 12:27:14 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-c83831ed-ba03-4eb4-bda4-d0862f4c3617 tempest-SnapshotsActionsTest-2046780578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-85b99b20-af4d-4dbb-a203-5a890c846394.df57d977-ee95-40d0-acbc-7a5f10d0db85,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-85b99b20-af4d-4dbb-a203-5a890c846394.0845f027-f038-4415-b720-6de7768c4105 1G" returned: 0 in 0.847s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:27:14 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-c83831ed-ba03-4eb4-bda4-d0862f4c3617 tempest-SnapshotsActionsTest-2046780578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-85b99b20-af4d-4dbb-a203-5a890c846394.df57d977-ee95-40d0-acbc-7a5f10d0db85 -F qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-85b99b20-af4d-4dbb-a203-5a890c846394.0845f027-f038-4415-b720-6de7768c4105 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:27:14 devstack sudo[104081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-85b99b20-af4d-4dbb-a203-5a890c846394.df57d977-ee95-40d0-acbc-7a5f10d0db85 -F qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-85b99b20-af4d-4dbb-a203-5a890c846394.0845f027-f038-4415-b720-6de7768c4105 Jul 31 12:27:14 devstack sudo[104081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:27:14 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-a9c6ffb2-72b2-4166-9d98-0d6ad44bcd95 tempest-CreateVolumesFromSnapshotTest-168995481 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:27:14 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-a9c6ffb2-72b2-4166-9d98-0d6ad44bcd95 tempest-CreateVolumesFromSnapshotTest-168995481 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:27:14 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-a9c6ffb2-72b2-4166-9d98-0d6ad44bcd95 tempest-CreateVolumesFromSnapshotTest-168995481 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:27:14 devstack sudo[104079]: pam_unix(sudo:session): session closed for user root Jul 31 12:27:14 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-a9c6ffb2-72b2-4166-9d98-0d6ad44bcd95 tempest-CreateVolumesFromSnapshotTest-168995481 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:27:14 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-a9c6ffb2-72b2-4166-9d98-0d6ad44bcd95 tempest-CreateVolumesFromSnapshotTest-168995481 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:27:14 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-a9c6ffb2-72b2-4166-9d98-0d6ad44bcd95 tempest-CreateVolumesFromSnapshotTest-168995481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:27:14 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-236de285-9b4e-4c96-a8e2-6587d36d2319 tempest-VolumesListAdminTestJSON-1581256828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2" returned: 0 in 0.404s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:27:14 devstack cinder-volume[89182]: DEBUG cinder.manager [None req-236de285-9b4e-4c96-a8e2-6587d36d2319 tempest-VolumesListAdminTestJSON-1581256828 None] Notifying Schedulers of capabilities ... {{(pid=89182) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 12:27:14 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-236de285-9b4e-4c96-a8e2-6587d36d2319 tempest-VolumesListAdminTestJSON-1581256828 None] Deleted volume successfully. Jul 31 12:27:14 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-236de285-9b4e-4c96-a8e2-6587d36d2319 tempest-VolumesListAdminTestJSON-1581256828 None] Lock "cinder-91b7df64-2607-4837-9ce5-ddba3005ff4f-delete_volume" released by "delete_volume" :: held 2.399s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:27:14 devstack sudo[104084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 Jul 31 12:27:14 devstack sudo[104084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:27:14 devstack sudo[104084]: pam_unix(sudo:session): session closed for user root Jul 31 12:27:14 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-a9c6ffb2-72b2-4166-9d98-0d6ad44bcd95 tempest-CreateVolumesFromSnapshotTest-168995481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2" returned: 0 in 0.418s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:27:14 devstack cinder-volume[89182]: DEBUG cinder.manager [None req-a9c6ffb2-72b2-4166-9d98-0d6ad44bcd95 tempest-CreateVolumesFromSnapshotTest-168995481 None] Notifying Schedulers of capabilities ... {{(pid=89182) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 12:27:14 devstack sudo[104081]: pam_unix(sudo:session): session closed for user root Jul 31 12:27:14 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-c83831ed-ba03-4eb4-bda4-d0862f4c3617 tempest-SnapshotsActionsTest-2046780578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-85b99b20-af4d-4dbb-a203-5a890c846394.df57d977-ee95-40d0-acbc-7a5f10d0db85 -F qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-85b99b20-af4d-4dbb-a203-5a890c846394.0845f027-f038-4415-b720-6de7768c4105" returned: 0 in 0.526s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:27:14 devstack cinder-volume[89182]: WARNING cinder.volume.drivers.remotefs [None req-c83831ed-ba03-4eb4-bda4-d0862f4c3617 tempest-SnapshotsActionsTest-2046780578 None] /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-85b99b20-af4d-4dbb-a203-5a890c846394.0845f027-f038-4415-b720-6de7768c4105 is being set with open permissions: ugo+rw Jul 31 12:27:14 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-c83831ed-ba03-4eb4-bda4-d0862f4c3617 tempest-SnapshotsActionsTest-2046780578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-85b99b20-af4d-4dbb-a203-5a890c846394.0845f027-f038-4415-b720-6de7768c4105 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:27:14 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-a9c6ffb2-72b2-4166-9d98-0d6ad44bcd95 tempest-CreateVolumesFromSnapshotTest-168995481 None] Deleted volume successfully. Jul 31 12:27:14 devstack sudo[104090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-85b99b20-af4d-4dbb-a203-5a890c846394.0845f027-f038-4415-b720-6de7768c4105 Jul 31 12:27:14 devstack sudo[104090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:27:14 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-21cf57b3-56ae-4b08-ace2-1a9b0bc74841 tempest-VolumesListAdminTestJSON-1581256828 None] Acquiring lock "cinder-60d7279b-c6a4-4d64-ab12-32fc3573b79d-delete_volume" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:27:14 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-21cf57b3-56ae-4b08-ace2-1a9b0bc74841 tempest-VolumesListAdminTestJSON-1581256828 None] Lock "cinder-60d7279b-c6a4-4d64-ab12-32fc3573b79d-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:27:14 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-a9c6ffb2-72b2-4166-9d98-0d6ad44bcd95 tempest-CreateVolumesFromSnapshotTest-168995481 None] Lock "cinder-d1a009ea-dd7e-4085-8b56-a184a7feceb6-delete_volume" released by "delete_volume" :: held 2.467s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:27:14 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-21cf57b3-56ae-4b08-ace2-1a9b0bc74841 tempest-VolumesListAdminTestJSON-1581256828 None] Acquiring lock "cinder-quobyte-60d7279b-c6a4-4d64-ab12-32fc3573b79d" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:27:14 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-21cf57b3-56ae-4b08-ace2-1a9b0bc74841 tempest-VolumesListAdminTestJSON-1581256828 None] Lock "cinder-quobyte-60d7279b-c6a4-4d64-ab12-32fc3573b79d" acquired by "delete_volume" :: waited 0.029s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:27:14 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbe64a82-79ee-4d71-a633-e22a0c6065fc]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:27:14 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-21cf57b3-56ae-4b08-ace2-1a9b0bc74841 tempest-VolumesListAdminTestJSON-1581256828 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-60d7279b-c6a4-4d64-ab12-32fc3573b79d {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:27:15 devstack sudo[104092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-60d7279b-c6a4-4d64-ab12-32fc3573b79d Jul 31 12:27:15 devstack sudo[104092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:27:15 devstack sudo[104090]: pam_unix(sudo:session): session closed for user root Jul 31 12:27:15 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-c83831ed-ba03-4eb4-bda4-d0862f4c3617 tempest-SnapshotsActionsTest-2046780578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-85b99b20-af4d-4dbb-a203-5a890c846394.0845f027-f038-4415-b720-6de7768c4105" returned: 0 in 0.593s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:27:15 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-c83831ed-ba03-4eb4-bda4-d0862f4c3617 tempest-SnapshotsActionsTest-2046780578 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.136s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:27:15 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-c83831ed-ba03-4eb4-bda4-d0862f4c3617 tempest-SnapshotsActionsTest-2046780578 None] Create snapshot completed successfully Jul 31 12:27:15 devstack sudo[104092]: pam_unix(sudo:session): session closed for user root Jul 31 12:27:15 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-21cf57b3-56ae-4b08-ace2-1a9b0bc74841 tempest-VolumesListAdminTestJSON-1581256828 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-60d7279b-c6a4-4d64-ab12-32fc3573b79d" returned: 0 in 0.614s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:27:15 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-21cf57b3-56ae-4b08-ace2-1a9b0bc74841 tempest-VolumesListAdminTestJSON-1581256828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-60d7279b-c6a4-4d64-ab12-32fc3573b79d {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:27:15 devstack sudo[104102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-60d7279b-c6a4-4d64-ab12-32fc3573b79d Jul 31 12:27:15 devstack sudo[104102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:27:15 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-e6d46064-e0d6-47b4-807b-4fc37762afa9 tempest-SnapshotsActionsTest-789062798 None] Acquiring lock "cinder-0845f027-f038-4415-b720-6de7768c4105-delete_snapshot" by "delete_snapshot" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:27:15 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-e6d46064-e0d6-47b4-807b-4fc37762afa9 tempest-SnapshotsActionsTest-789062798 None] Lock "cinder-0845f027-f038-4415-b720-6de7768c4105-delete_snapshot" acquired by "delete_snapshot" :: waited 0.042s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:27:15 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-e6d46064-e0d6-47b4-807b-4fc37762afa9 tempest-SnapshotsActionsTest-789062798 None] Acquiring lock "cinder-quobyte-85b99b20-af4d-4dbb-a203-5a890c846394" by "delete_snapshot" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:27:15 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-e6d46064-e0d6-47b4-807b-4fc37762afa9 tempest-SnapshotsActionsTest-789062798 None] Lock "cinder-quobyte-85b99b20-af4d-4dbb-a203-5a890c846394" acquired by "delete_snapshot" :: waited 0.048s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:27:15 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-e6d46064-e0d6-47b4-807b-4fc37762afa9 tempest-SnapshotsActionsTest-789062798 None] Acquiring lock "cinder-quobyte-0845f027-f038-4415-b720-6de7768c4105" by "_delete_snapshot" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:27:15 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-e6d46064-e0d6-47b4-807b-4fc37762afa9 tempest-SnapshotsActionsTest-789062798 None] Lock "cinder-quobyte-0845f027-f038-4415-b720-6de7768c4105" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:27:15 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-e6d46064-e0d6-47b4-807b-4fc37762afa9 tempest-SnapshotsActionsTest-789062798 None] Deleting offline snapshot 0845f027-f038-4415-b720-6de7768c4105 of volume 85b99b20-af4d-4dbb-a203-5a890c846394 {{(pid=89182) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 31 12:27:15 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-e6d46064-e0d6-47b4-807b-4fc37762afa9 tempest-SnapshotsActionsTest-789062798 None] snapshot_file for this snap is: volume-85b99b20-af4d-4dbb-a203-5a890c846394.0845f027-f038-4415-b720-6de7768c4105 {{(pid=89182) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 31 12:27:15 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[1378618a-0b95-43f7-a3dd-74748e78022e]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:27:15 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-e6d46064-e0d6-47b4-807b-4fc37762afa9 tempest-SnapshotsActionsTest-789062798 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-85b99b20-af4d-4dbb-a203-5a890c846394.0845f027-f038-4415-b720-6de7768c4105 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:27:16 devstack sudo[104102]: pam_unix(sudo:session): session closed for user root Jul 31 12:27:16 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-21cf57b3-56ae-4b08-ace2-1a9b0bc74841 tempest-VolumesListAdminTestJSON-1581256828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-60d7279b-c6a4-4d64-ab12-32fc3573b79d" returned: 0 in 0.582s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:27:16 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-21cf57b3-56ae-4b08-ace2-1a9b0bc74841 tempest-VolumesListAdminTestJSON-1581256828 None] Lock "cinder-quobyte-60d7279b-c6a4-4d64-ab12-32fc3573b79d" released by "delete_volume" :: held 1.260s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:27:16 devstack sudo[104143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-85b99b20-af4d-4dbb-a203-5a890c846394.0845f027-f038-4415-b720-6de7768c4105 Jul 31 12:27:16 devstack sudo[104143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:27:16 devstack cinder-volume[89182]: DEBUG cinder.quota [None req-21cf57b3-56ae-4b08-ace2-1a9b0bc74841 tempest-VolumesListAdminTestJSON-1581256828 None] Created reservations ['1d2ca45d-5012-4499-9364-cc8f244f5c2d', '709679d7-2885-46f5-8657-6a49a3c5cbda', '430eaa2d-55d9-420f-ab7d-72a3fd52347e', 'b634364a-8397-4179-89bf-30cc9410fe0c'] {{(pid=89182) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 12:27:16 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-21cf57b3-56ae-4b08-ace2-1a9b0bc74841 tempest-VolumesListAdminTestJSON-1581256828 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:27:16 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-21cf57b3-56ae-4b08-ace2-1a9b0bc74841 tempest-VolumesListAdminTestJSON-1581256828 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:27:16 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-21cf57b3-56ae-4b08-ace2-1a9b0bc74841 tempest-VolumesListAdminTestJSON-1581256828 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:27:16 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-21cf57b3-56ae-4b08-ace2-1a9b0bc74841 tempest-VolumesListAdminTestJSON-1581256828 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:27:16 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-21cf57b3-56ae-4b08-ace2-1a9b0bc74841 tempest-VolumesListAdminTestJSON-1581256828 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:27:16 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-21cf57b3-56ae-4b08-ace2-1a9b0bc74841 tempest-VolumesListAdminTestJSON-1581256828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:27:16 devstack sudo[104151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 Jul 31 12:27:16 devstack sudo[104151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:27:16 devstack sudo[104151]: pam_unix(sudo:session): session closed for user root Jul 31 12:27:16 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-21cf57b3-56ae-4b08-ace2-1a9b0bc74841 tempest-VolumesListAdminTestJSON-1581256828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2" returned: 0 in 0.344s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:27:16 devstack sudo[104143]: pam_unix(sudo:session): session closed for user root Jul 31 12:27:16 devstack cinder-volume[89182]: DEBUG cinder.manager [None req-21cf57b3-56ae-4b08-ace2-1a9b0bc74841 tempest-VolumesListAdminTestJSON-1581256828 None] Notifying Schedulers of capabilities ... {{(pid=89182) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 12:27:16 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-e6d46064-e0d6-47b4-807b-4fc37762afa9 tempest-SnapshotsActionsTest-789062798 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-85b99b20-af4d-4dbb-a203-5a890c846394.0845f027-f038-4415-b720-6de7768c4105" returned: 0 in 0.714s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:27:16 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-e6d46064-e0d6-47b4-807b-4fc37762afa9 tempest-SnapshotsActionsTest-789062798 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-85b99b20-af4d-4dbb-a203-5a890c846394(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89182) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 12:27:16 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-21cf57b3-56ae-4b08-ace2-1a9b0bc74841 tempest-VolumesListAdminTestJSON-1581256828 None] Deleted volume successfully. Jul 31 12:27:16 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a220244-2d81-490f-9dfc-32fbbd75949b]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:27:16 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-e6d46064-e0d6-47b4-807b-4fc37762afa9 tempest-SnapshotsActionsTest-789062798 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-85b99b20-af4d-4dbb-a203-5a890c846394.df57d977-ee95-40d0-acbc-7a5f10d0db85 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:27:16 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-21cf57b3-56ae-4b08-ace2-1a9b0bc74841 tempest-VolumesListAdminTestJSON-1581256828 None] Lock "cinder-60d7279b-c6a4-4d64-ab12-32fc3573b79d-delete_volume" released by "delete_volume" :: held 1.939s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:27:16 devstack sudo[104158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-85b99b20-af4d-4dbb-a203-5a890c846394.df57d977-ee95-40d0-acbc-7a5f10d0db85 Jul 31 12:27:16 devstack sudo[104158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:27:17 devstack sudo[104158]: pam_unix(sudo:session): session closed for user root Jul 31 12:27:17 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-e6d46064-e0d6-47b4-807b-4fc37762afa9 tempest-SnapshotsActionsTest-789062798 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-85b99b20-af4d-4dbb-a203-5a890c846394.df57d977-ee95-40d0-acbc-7a5f10d0db85" returned: 0 in 0.548s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:27:17 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-e6d46064-e0d6-47b4-807b-4fc37762afa9 tempest-SnapshotsActionsTest-789062798 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-85b99b20-af4d-4dbb-a203-5a890c846394(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89182) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 12:27:17 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-e6d46064-e0d6-47b4-807b-4fc37762afa9 tempest-SnapshotsActionsTest-789062798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-85b99b20-af4d-4dbb-a203-5a890c846394.0845f027-f038-4415-b720-6de7768c4105 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:27:17 devstack sudo[104165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-85b99b20-af4d-4dbb-a203-5a890c846394.0845f027-f038-4415-b720-6de7768c4105 Jul 31 12:27:17 devstack sudo[104165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:27:17 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-8d4f99d2-3d2d-4be5-886f-51f55cdf4d28 tempest-VolumesListAdminTestJSON-1581256828 None] Acquiring lock "cinder-b408f9f4-4109-4257-948c-c326a7de6ab4-delete_volume" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:27:17 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-8d4f99d2-3d2d-4be5-886f-51f55cdf4d28 tempest-VolumesListAdminTestJSON-1581256828 None] Lock "cinder-b408f9f4-4109-4257-948c-c326a7de6ab4-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:27:17 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-8d4f99d2-3d2d-4be5-886f-51f55cdf4d28 tempest-VolumesListAdminTestJSON-1581256828 None] Acquiring lock "cinder-quobyte-b408f9f4-4109-4257-948c-c326a7de6ab4" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:27:17 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-8d4f99d2-3d2d-4be5-886f-51f55cdf4d28 tempest-VolumesListAdminTestJSON-1581256828 None] Lock "cinder-quobyte-b408f9f4-4109-4257-948c-c326a7de6ab4" acquired by "delete_volume" :: waited 0.031s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:27:17 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b9dead7-3161-4687-8656-25cc939584a8]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:27:17 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-8d4f99d2-3d2d-4be5-886f-51f55cdf4d28 tempest-VolumesListAdminTestJSON-1581256828 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-b408f9f4-4109-4257-948c-c326a7de6ab4 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:27:17 devstack cinder-volume[89182]: INFO cinder.volume.manager [req-4d5c930b-99a0-431f-85a3-04e891eae61c req-8898fcaa-78fd-407d-b17b-6290e60e4873 tempest-TestVolumeBootPattern-1492021642 None] Terminate volume connection completed successfully. Jul 31 12:27:17 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [req-4d5c930b-99a0-431f-85a3-04e891eae61c req-8898fcaa-78fd-407d-b17b-6290e60e4873 tempest-TestVolumeBootPattern-1492021642 None] Deleting attachment d27fc3ef-8c68-4d38-8748-9d396320c73a. {{(pid=89182) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 31 12:27:17 devstack sudo[104171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-b408f9f4-4109-4257-948c-c326a7de6ab4 Jul 31 12:27:17 devstack sudo[104171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:27:17 devstack sudo[104165]: pam_unix(sudo:session): session closed for user root Jul 31 12:27:17 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-e6d46064-e0d6-47b4-807b-4fc37762afa9 tempest-SnapshotsActionsTest-789062798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-85b99b20-af4d-4dbb-a203-5a890c846394.0845f027-f038-4415-b720-6de7768c4105" returned: 0 in 0.494s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:27:17 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-e6d46064-e0d6-47b4-807b-4fc37762afa9 tempest-SnapshotsActionsTest-789062798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-85b99b20-af4d-4dbb-a203-5a890c846394.0845f027-f038-4415-b720-6de7768c4105 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:27:17 devstack sudo[104173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-85b99b20-af4d-4dbb-a203-5a890c846394.0845f027-f038-4415-b720-6de7768c4105 Jul 31 12:27:17 devstack sudo[104173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:27:17 devstack cinder-volume[89182]: DEBUG cinder.coordination [req-4d5c930b-99a0-431f-85a3-04e891eae61c req-063f5198-d447-466a-bef6-045caf5ce847 tempest-TestVolumeBootPattern-1492021642 None] Acquiring lock "cinder-ed54b024-d4ee-4263-a6c4-d3bb670e9b34-delete_volume" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:27:17 devstack cinder-volume[89182]: DEBUG cinder.coordination [req-4d5c930b-99a0-431f-85a3-04e891eae61c req-063f5198-d447-466a-bef6-045caf5ce847 tempest-TestVolumeBootPattern-1492021642 None] Lock "cinder-ed54b024-d4ee-4263-a6c4-d3bb670e9b34-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:27:17 devstack cinder-volume[89182]: DEBUG cinder.coordination [req-4d5c930b-99a0-431f-85a3-04e891eae61c req-063f5198-d447-466a-bef6-045caf5ce847 tempest-TestVolumeBootPattern-1492021642 None] Acquiring lock "cinder-quobyte-ed54b024-d4ee-4263-a6c4-d3bb670e9b34" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:27:17 devstack cinder-volume[89182]: DEBUG cinder.coordination [req-4d5c930b-99a0-431f-85a3-04e891eae61c req-063f5198-d447-466a-bef6-045caf5ce847 tempest-TestVolumeBootPattern-1492021642 None] Lock "cinder-quobyte-ed54b024-d4ee-4263-a6c4-d3bb670e9b34" acquired by "delete_volume" :: waited 0.019s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:27:17 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[20be77b3-a78b-476f-b145-7af14da80b19]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:27:17 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [req-4d5c930b-99a0-431f-85a3-04e891eae61c req-063f5198-d447-466a-bef6-045caf5ce847 tempest-TestVolumeBootPattern-1492021642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-ed54b024-d4ee-4263-a6c4-d3bb670e9b34 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:27:18 devstack sudo[104171]: pam_unix(sudo:session): session closed for user root Jul 31 12:27:18 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-8d4f99d2-3d2d-4be5-886f-51f55cdf4d28 tempest-VolumesListAdminTestJSON-1581256828 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-b408f9f4-4109-4257-948c-c326a7de6ab4" returned: 0 in 0.492s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:27:18 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-8d4f99d2-3d2d-4be5-886f-51f55cdf4d28 tempest-VolumesListAdminTestJSON-1581256828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-b408f9f4-4109-4257-948c-c326a7de6ab4 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:27:18 devstack sudo[104180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-b408f9f4-4109-4257-948c-c326a7de6ab4 Jul 31 12:27:18 devstack sudo[104180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:27:18 devstack sudo[104177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-ed54b024-d4ee-4263-a6c4-d3bb670e9b34 Jul 31 12:27:18 devstack sudo[104177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:27:18 devstack sudo[104173]: pam_unix(sudo:session): session closed for user root Jul 31 12:27:18 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-e6d46064-e0d6-47b4-807b-4fc37762afa9 tempest-SnapshotsActionsTest-789062798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-85b99b20-af4d-4dbb-a203-5a890c846394.0845f027-f038-4415-b720-6de7768c4105" returned: 0 in 0.423s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:27:18 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-e6d46064-e0d6-47b4-807b-4fc37762afa9 tempest-SnapshotsActionsTest-789062798 None] Lock "cinder-quobyte-0845f027-f038-4415-b720-6de7768c4105" released by "_delete_snapshot" :: held 2.397s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:27:18 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-e6d46064-e0d6-47b4-807b-4fc37762afa9 tempest-SnapshotsActionsTest-789062798 None] Lock "cinder-quobyte-85b99b20-af4d-4dbb-a203-5a890c846394" released by "delete_snapshot" :: held 2.438s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:27:18 devstack cinder-volume[89182]: DEBUG cinder.quota [None req-e6d46064-e0d6-47b4-807b-4fc37762afa9 tempest-SnapshotsActionsTest-789062798 None] Created reservations ['5dd95567-1009-478e-9608-78a6858b12ed', 'f5ba90bd-7f66-4c9c-9859-d51f12f223bb', '02441c45-a963-4a2f-92a7-3edd6527be1f', 'bd101194-0dde-43eb-8ba3-ee03dd77846c'] {{(pid=89182) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 12:27:18 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-e6d46064-e0d6-47b4-807b-4fc37762afa9 tempest-SnapshotsActionsTest-789062798 None] Delete snapshot completed successfully. Jul 31 12:27:18 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-e6d46064-e0d6-47b4-807b-4fc37762afa9 tempest-SnapshotsActionsTest-789062798 None] Lock "cinder-0845f027-f038-4415-b720-6de7768c4105-delete_snapshot" released by "delete_snapshot" :: held 2.791s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:27:18 devstack sudo[104180]: pam_unix(sudo:session): session closed for user root Jul 31 12:27:18 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-8d4f99d2-3d2d-4be5-886f-51f55cdf4d28 tempest-VolumesListAdminTestJSON-1581256828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-b408f9f4-4109-4257-948c-c326a7de6ab4" returned: 0 in 0.492s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:27:18 devstack sudo[104177]: pam_unix(sudo:session): session closed for user root Jul 31 12:27:18 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-8d4f99d2-3d2d-4be5-886f-51f55cdf4d28 tempest-VolumesListAdminTestJSON-1581256828 None] Lock "cinder-quobyte-b408f9f4-4109-4257-948c-c326a7de6ab4" released by "delete_volume" :: held 1.046s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:27:18 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [req-4d5c930b-99a0-431f-85a3-04e891eae61c req-063f5198-d447-466a-bef6-045caf5ce847 tempest-TestVolumeBootPattern-1492021642 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-ed54b024-d4ee-4263-a6c4-d3bb670e9b34" returned: 0 in 0.627s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:27:18 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [req-4d5c930b-99a0-431f-85a3-04e891eae61c req-063f5198-d447-466a-bef6-045caf5ce847 tempest-TestVolumeBootPattern-1492021642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-ed54b024-d4ee-4263-a6c4-d3bb670e9b34 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:27:18 devstack sudo[104188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-ed54b024-d4ee-4263-a6c4-d3bb670e9b34 Jul 31 12:27:18 devstack sudo[104188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:27:18 devstack cinder-volume[89182]: DEBUG cinder.quota [None req-8d4f99d2-3d2d-4be5-886f-51f55cdf4d28 tempest-VolumesListAdminTestJSON-1581256828 None] Created reservations ['3a269d57-d01b-49f8-ae3e-0a293bdc1930', 'fcac4691-30f6-4b41-9110-af7160448919', '457d5fb1-68ca-49eb-9d50-3e2e6d9c1339', '3ca654e8-6066-45b7-897f-0b48ad23e2b9'] {{(pid=89182) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 12:27:18 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-8d4f99d2-3d2d-4be5-886f-51f55cdf4d28 tempest-VolumesListAdminTestJSON-1581256828 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:27:18 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-8d4f99d2-3d2d-4be5-886f-51f55cdf4d28 tempest-VolumesListAdminTestJSON-1581256828 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:27:18 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-8d4f99d2-3d2d-4be5-886f-51f55cdf4d28 tempest-VolumesListAdminTestJSON-1581256828 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:27:18 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-8d4f99d2-3d2d-4be5-886f-51f55cdf4d28 tempest-VolumesListAdminTestJSON-1581256828 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:27:18 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-8d4f99d2-3d2d-4be5-886f-51f55cdf4d28 tempest-VolumesListAdminTestJSON-1581256828 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:27:18 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-8d4f99d2-3d2d-4be5-886f-51f55cdf4d28 tempest-VolumesListAdminTestJSON-1581256828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:27:18 devstack sudo[104190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 Jul 31 12:27:18 devstack sudo[104190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:27:18 devstack sudo[104188]: pam_unix(sudo:session): session closed for user root Jul 31 12:27:18 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [req-4d5c930b-99a0-431f-85a3-04e891eae61c req-063f5198-d447-466a-bef6-045caf5ce847 tempest-TestVolumeBootPattern-1492021642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-ed54b024-d4ee-4263-a6c4-d3bb670e9b34" returned: 0 in 0.279s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:27:18 devstack cinder-volume[89182]: DEBUG cinder.coordination [req-4d5c930b-99a0-431f-85a3-04e891eae61c req-063f5198-d447-466a-bef6-045caf5ce847 tempest-TestVolumeBootPattern-1492021642 None] Lock "cinder-quobyte-ed54b024-d4ee-4263-a6c4-d3bb670e9b34" released by "delete_volume" :: held 0.972s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:27:18 devstack cinder-volume[89182]: DEBUG cinder.quota [req-4d5c930b-99a0-431f-85a3-04e891eae61c req-063f5198-d447-466a-bef6-045caf5ce847 tempest-TestVolumeBootPattern-1492021642 None] Created reservations ['8f993ffb-ea9e-4cdb-8a46-5bf737756e15', '98159093-dc99-4fa6-839c-62fdd65187ac', 'a8660df3-2c93-4127-a486-39e0fe14e486', 'fc418533-f405-470f-9d4c-1e4562105654'] {{(pid=89182) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 12:27:18 devstack sudo[104190]: pam_unix(sudo:session): session closed for user root Jul 31 12:27:18 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-8d4f99d2-3d2d-4be5-886f-51f55cdf4d28 tempest-VolumesListAdminTestJSON-1581256828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2" returned: 0 in 0.272s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:27:18 devstack cinder-volume[89182]: DEBUG cinder.manager [None req-8d4f99d2-3d2d-4be5-886f-51f55cdf4d28 tempest-VolumesListAdminTestJSON-1581256828 None] Notifying Schedulers of capabilities ... {{(pid=89182) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 12:27:18 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-8d4f99d2-3d2d-4be5-886f-51f55cdf4d28 tempest-VolumesListAdminTestJSON-1581256828 None] Deleted volume successfully. Jul 31 12:27:19 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-8d4f99d2-3d2d-4be5-886f-51f55cdf4d28 tempest-VolumesListAdminTestJSON-1581256828 None] Lock "cinder-b408f9f4-4109-4257-948c-c326a7de6ab4-delete_volume" released by "delete_volume" :: held 1.627s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:27:19 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [req-4d5c930b-99a0-431f-85a3-04e891eae61c req-063f5198-d447-466a-bef6-045caf5ce847 tempest-TestVolumeBootPattern-1492021642 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:27:19 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [req-4d5c930b-99a0-431f-85a3-04e891eae61c req-063f5198-d447-466a-bef6-045caf5ce847 tempest-TestVolumeBootPattern-1492021642 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:27:19 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [req-4d5c930b-99a0-431f-85a3-04e891eae61c req-063f5198-d447-466a-bef6-045caf5ce847 tempest-TestVolumeBootPattern-1492021642 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:27:19 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [req-4d5c930b-99a0-431f-85a3-04e891eae61c req-063f5198-d447-466a-bef6-045caf5ce847 tempest-TestVolumeBootPattern-1492021642 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:27:19 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [req-4d5c930b-99a0-431f-85a3-04e891eae61c req-063f5198-d447-466a-bef6-045caf5ce847 tempest-TestVolumeBootPattern-1492021642 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:27:19 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [req-4d5c930b-99a0-431f-85a3-04e891eae61c req-063f5198-d447-466a-bef6-045caf5ce847 tempest-TestVolumeBootPattern-1492021642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:27:19 devstack sudo[104194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 Jul 31 12:27:19 devstack sudo[104194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:27:19 devstack sudo[104194]: pam_unix(sudo:session): session closed for user root Jul 31 12:27:19 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [req-4d5c930b-99a0-431f-85a3-04e891eae61c req-063f5198-d447-466a-bef6-045caf5ce847 tempest-TestVolumeBootPattern-1492021642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2" returned: 0 in 0.271s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:27:19 devstack cinder-volume[89182]: DEBUG cinder.manager [req-4d5c930b-99a0-431f-85a3-04e891eae61c req-063f5198-d447-466a-bef6-045caf5ce847 tempest-TestVolumeBootPattern-1492021642 None] Notifying Schedulers of capabilities ... {{(pid=89182) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 12:27:19 devstack cinder-volume[89182]: INFO cinder.volume.manager [req-4d5c930b-99a0-431f-85a3-04e891eae61c req-063f5198-d447-466a-bef6-045caf5ce847 tempest-TestVolumeBootPattern-1492021642 None] Deleted volume successfully. Jul 31 12:27:19 devstack cinder-volume[89182]: DEBUG cinder.coordination [req-4d5c930b-99a0-431f-85a3-04e891eae61c req-063f5198-d447-466a-bef6-045caf5ce847 tempest-TestVolumeBootPattern-1492021642 None] Lock "cinder-ed54b024-d4ee-4263-a6c4-d3bb670e9b34-delete_volume" released by "delete_volume" :: held 1.540s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:27:19 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-a1100d2f-6701-49e3-94c7-3462f751f2c2 tempest-SnapshotsActionsTest-2046780578 None] Acquiring lock "cinder-df57d977-ee95-40d0-acbc-7a5f10d0db85-delete_snapshot" by "delete_snapshot" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:27:19 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-a1100d2f-6701-49e3-94c7-3462f751f2c2 tempest-SnapshotsActionsTest-2046780578 None] Lock "cinder-df57d977-ee95-40d0-acbc-7a5f10d0db85-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:27:19 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-a1100d2f-6701-49e3-94c7-3462f751f2c2 tempest-SnapshotsActionsTest-2046780578 None] Acquiring lock "cinder-quobyte-85b99b20-af4d-4dbb-a203-5a890c846394" by "delete_snapshot" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:27:19 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-a1100d2f-6701-49e3-94c7-3462f751f2c2 tempest-SnapshotsActionsTest-2046780578 None] Lock "cinder-quobyte-85b99b20-af4d-4dbb-a203-5a890c846394" acquired by "delete_snapshot" :: waited 0.019s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:27:19 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-a1100d2f-6701-49e3-94c7-3462f751f2c2 tempest-SnapshotsActionsTest-2046780578 None] Acquiring lock "cinder-quobyte-df57d977-ee95-40d0-acbc-7a5f10d0db85" by "_delete_snapshot" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:27:19 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-a1100d2f-6701-49e3-94c7-3462f751f2c2 tempest-SnapshotsActionsTest-2046780578 None] Lock "cinder-quobyte-df57d977-ee95-40d0-acbc-7a5f10d0db85" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:27:19 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-a1100d2f-6701-49e3-94c7-3462f751f2c2 tempest-SnapshotsActionsTest-2046780578 None] Deleting offline snapshot df57d977-ee95-40d0-acbc-7a5f10d0db85 of volume 85b99b20-af4d-4dbb-a203-5a890c846394 {{(pid=89182) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 31 12:27:19 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-a1100d2f-6701-49e3-94c7-3462f751f2c2 tempest-SnapshotsActionsTest-2046780578 None] snapshot_file for this snap is: volume-85b99b20-af4d-4dbb-a203-5a890c846394.df57d977-ee95-40d0-acbc-7a5f10d0db85 {{(pid=89182) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 31 12:27:19 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a429d7b-6d6d-4e0f-a4de-b6bea3cec6d2]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:27:19 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-a1100d2f-6701-49e3-94c7-3462f751f2c2 tempest-SnapshotsActionsTest-2046780578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-85b99b20-af4d-4dbb-a203-5a890c846394.df57d977-ee95-40d0-acbc-7a5f10d0db85 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:27:19 devstack sudo[104197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-85b99b20-af4d-4dbb-a203-5a890c846394.df57d977-ee95-40d0-acbc-7a5f10d0db85 Jul 31 12:27:19 devstack sudo[104197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:27:19 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-1be37c18-8709-4898-ae7d-957ceb34e77a tempest-TestVolumeBootPattern-1492021642 None] Acquiring lock "cinder-57aa151f-800a-418b-8ea1-c82856fc341d-delete_snapshot" by "delete_snapshot" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:27:19 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-1be37c18-8709-4898-ae7d-957ceb34e77a tempest-TestVolumeBootPattern-1492021642 None] Lock "cinder-57aa151f-800a-418b-8ea1-c82856fc341d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:27:19 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-1be37c18-8709-4898-ae7d-957ceb34e77a tempest-TestVolumeBootPattern-1492021642 None] Acquiring lock "cinder-quobyte-cce4d436-dd54-48f7-96a5-6746d683a50a" by "delete_snapshot" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:27:19 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-1be37c18-8709-4898-ae7d-957ceb34e77a tempest-TestVolumeBootPattern-1492021642 None] Lock "cinder-quobyte-cce4d436-dd54-48f7-96a5-6746d683a50a" acquired by "delete_snapshot" :: waited 0.022s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:27:19 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-1be37c18-8709-4898-ae7d-957ceb34e77a tempest-TestVolumeBootPattern-1492021642 None] Acquiring lock "cinder-quobyte-57aa151f-800a-418b-8ea1-c82856fc341d" by "_delete_snapshot" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:27:19 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-1be37c18-8709-4898-ae7d-957ceb34e77a tempest-TestVolumeBootPattern-1492021642 None] Lock "cinder-quobyte-57aa151f-800a-418b-8ea1-c82856fc341d" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:27:19 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-1be37c18-8709-4898-ae7d-957ceb34e77a tempest-TestVolumeBootPattern-1492021642 None] Deleting offline snapshot 57aa151f-800a-418b-8ea1-c82856fc341d of volume cce4d436-dd54-48f7-96a5-6746d683a50a {{(pid=89182) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 31 12:27:19 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-1be37c18-8709-4898-ae7d-957ceb34e77a tempest-TestVolumeBootPattern-1492021642 None] snapshot_file for this snap is: volume-cce4d436-dd54-48f7-96a5-6746d683a50a.57aa151f-800a-418b-8ea1-c82856fc341d {{(pid=89182) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 31 12:27:19 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f974d08-f226-4724-9f1a-ea24e5829107]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:27:19 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-1be37c18-8709-4898-ae7d-957ceb34e77a tempest-TestVolumeBootPattern-1492021642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-cce4d436-dd54-48f7-96a5-6746d683a50a.57aa151f-800a-418b-8ea1-c82856fc341d {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:27:19 devstack sudo[104199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-cce4d436-dd54-48f7-96a5-6746d683a50a.57aa151f-800a-418b-8ea1-c82856fc341d Jul 31 12:27:19 devstack sudo[104199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:27:20 devstack sudo[104197]: pam_unix(sudo:session): session closed for user root Jul 31 12:27:20 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-a1100d2f-6701-49e3-94c7-3462f751f2c2 tempest-SnapshotsActionsTest-2046780578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-85b99b20-af4d-4dbb-a203-5a890c846394.df57d977-ee95-40d0-acbc-7a5f10d0db85" returned: 0 in 0.471s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:27:20 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-a1100d2f-6701-49e3-94c7-3462f751f2c2 tempest-SnapshotsActionsTest-2046780578 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-85b99b20-af4d-4dbb-a203-5a890c846394(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89182) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 12:27:20 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[6085b100-6315-471e-ae06-11301fc4203a]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:27:20 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-a1100d2f-6701-49e3-94c7-3462f751f2c2 tempest-SnapshotsActionsTest-2046780578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-85b99b20-af4d-4dbb-a203-5a890c846394 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:27:20 devstack sudo[104205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-85b99b20-af4d-4dbb-a203-5a890c846394 Jul 31 12:27:20 devstack sudo[104205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:27:20 devstack sudo[104199]: pam_unix(sudo:session): session closed for user root Jul 31 12:27:20 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-1be37c18-8709-4898-ae7d-957ceb34e77a tempest-TestVolumeBootPattern-1492021642 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-cce4d436-dd54-48f7-96a5-6746d683a50a.57aa151f-800a-418b-8ea1-c82856fc341d" returned: 0 in 0.474s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:27:20 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-1be37c18-8709-4898-ae7d-957ceb34e77a tempest-TestVolumeBootPattern-1492021642 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cce4d436-dd54-48f7-96a5-6746d683a50a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89182) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 12:27:20 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c9609d4-7f86-4a09-b853-a7608f8a92ef]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:27:20 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-1be37c18-8709-4898-ae7d-957ceb34e77a tempest-TestVolumeBootPattern-1492021642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-cce4d436-dd54-48f7-96a5-6746d683a50a {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:27:20 devstack sudo[104210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-cce4d436-dd54-48f7-96a5-6746d683a50a Jul 31 12:27:20 devstack sudo[104210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:27:20 devstack sudo[104205]: pam_unix(sudo:session): session closed for user root Jul 31 12:27:20 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-a1100d2f-6701-49e3-94c7-3462f751f2c2 tempest-SnapshotsActionsTest-2046780578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-85b99b20-af4d-4dbb-a203-5a890c846394" returned: 0 in 0.531s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:27:20 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-a1100d2f-6701-49e3-94c7-3462f751f2c2 tempest-SnapshotsActionsTest-2046780578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-85b99b20-af4d-4dbb-a203-5a890c846394.df57d977-ee95-40d0-acbc-7a5f10d0db85 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:27:20 devstack sudo[104215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-85b99b20-af4d-4dbb-a203-5a890c846394.df57d977-ee95-40d0-acbc-7a5f10d0db85 Jul 31 12:27:20 devstack sudo[104215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:27:20 devstack sudo[104210]: pam_unix(sudo:session): session closed for user root Jul 31 12:27:20 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-1be37c18-8709-4898-ae7d-957ceb34e77a tempest-TestVolumeBootPattern-1492021642 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-cce4d436-dd54-48f7-96a5-6746d683a50a" returned: 0 in 0.469s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:27:20 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-1be37c18-8709-4898-ae7d-957ceb34e77a tempest-TestVolumeBootPattern-1492021642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-cce4d436-dd54-48f7-96a5-6746d683a50a.57aa151f-800a-418b-8ea1-c82856fc341d {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:27:20 devstack sudo[104220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-cce4d436-dd54-48f7-96a5-6746d683a50a.57aa151f-800a-418b-8ea1-c82856fc341d Jul 31 12:27:20 devstack sudo[104220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:27:21 devstack sudo[104215]: pam_unix(sudo:session): session closed for user root Jul 31 12:27:21 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-a1100d2f-6701-49e3-94c7-3462f751f2c2 tempest-SnapshotsActionsTest-2046780578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-85b99b20-af4d-4dbb-a203-5a890c846394.df57d977-ee95-40d0-acbc-7a5f10d0db85" returned: 0 in 0.481s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:27:21 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-a1100d2f-6701-49e3-94c7-3462f751f2c2 tempest-SnapshotsActionsTest-2046780578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-85b99b20-af4d-4dbb-a203-5a890c846394.df57d977-ee95-40d0-acbc-7a5f10d0db85 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:27:21 devstack sudo[104225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-85b99b20-af4d-4dbb-a203-5a890c846394.df57d977-ee95-40d0-acbc-7a5f10d0db85 Jul 31 12:27:21 devstack sudo[104225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:27:21 devstack sudo[104220]: pam_unix(sudo:session): session closed for user root Jul 31 12:27:21 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-1be37c18-8709-4898-ae7d-957ceb34e77a tempest-TestVolumeBootPattern-1492021642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-cce4d436-dd54-48f7-96a5-6746d683a50a.57aa151f-800a-418b-8ea1-c82856fc341d" returned: 0 in 0.526s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:27:21 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-1be37c18-8709-4898-ae7d-957ceb34e77a tempest-TestVolumeBootPattern-1492021642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-cce4d436-dd54-48f7-96a5-6746d683a50a.57aa151f-800a-418b-8ea1-c82856fc341d {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:27:21 devstack sudo[104231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-cce4d436-dd54-48f7-96a5-6746d683a50a.57aa151f-800a-418b-8ea1-c82856fc341d Jul 31 12:27:21 devstack sudo[104231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:27:21 devstack sudo[104225]: pam_unix(sudo:session): session closed for user root Jul 31 12:27:21 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-a1100d2f-6701-49e3-94c7-3462f751f2c2 tempest-SnapshotsActionsTest-2046780578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-85b99b20-af4d-4dbb-a203-5a890c846394.df57d977-ee95-40d0-acbc-7a5f10d0db85" returned: 0 in 0.322s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:27:21 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-a1100d2f-6701-49e3-94c7-3462f751f2c2 tempest-SnapshotsActionsTest-2046780578 None] Lock "cinder-quobyte-df57d977-ee95-40d0-acbc-7a5f10d0db85" released by "_delete_snapshot" :: held 1.980s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:27:21 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-a1100d2f-6701-49e3-94c7-3462f751f2c2 tempest-SnapshotsActionsTest-2046780578 None] Lock "cinder-quobyte-85b99b20-af4d-4dbb-a203-5a890c846394" released by "delete_snapshot" :: held 2.011s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:27:21 devstack cinder-volume[89182]: DEBUG cinder.quota [None req-a1100d2f-6701-49e3-94c7-3462f751f2c2 tempest-SnapshotsActionsTest-2046780578 None] Created reservations ['4b08da8f-c768-486c-b50a-58db70a02f4c', '3bd0b463-4d5a-469f-97fa-cf18d336b01c', '57babcd4-0622-4510-8be2-4331ff8b8c6e', '389f026c-62ce-45e5-b2d1-740a7fbf0d57'] {{(pid=89182) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 12:27:21 devstack sudo[104231]: pam_unix(sudo:session): session closed for user root Jul 31 12:27:21 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-1be37c18-8709-4898-ae7d-957ceb34e77a tempest-TestVolumeBootPattern-1492021642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-cce4d436-dd54-48f7-96a5-6746d683a50a.57aa151f-800a-418b-8ea1-c82856fc341d" returned: 0 in 0.345s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:27:21 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-1be37c18-8709-4898-ae7d-957ceb34e77a tempest-TestVolumeBootPattern-1492021642 None] Lock "cinder-quobyte-57aa151f-800a-418b-8ea1-c82856fc341d" released by "_delete_snapshot" :: held 1.973s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:27:21 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-1be37c18-8709-4898-ae7d-957ceb34e77a tempest-TestVolumeBootPattern-1492021642 None] Lock "cinder-quobyte-cce4d436-dd54-48f7-96a5-6746d683a50a" released by "delete_snapshot" :: held 2.008s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:27:21 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-a1100d2f-6701-49e3-94c7-3462f751f2c2 tempest-SnapshotsActionsTest-2046780578 None] Delete snapshot completed successfully. Jul 31 12:27:21 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-a1100d2f-6701-49e3-94c7-3462f751f2c2 tempest-SnapshotsActionsTest-2046780578 None] Lock "cinder-df57d977-ee95-40d0-acbc-7a5f10d0db85-delete_snapshot" released by "delete_snapshot" :: held 2.336s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:27:21 devstack cinder-volume[89182]: DEBUG cinder.quota [None req-1be37c18-8709-4898-ae7d-957ceb34e77a tempest-TestVolumeBootPattern-1492021642 None] Created reservations ['de925f90-8f82-4be7-b2cc-a28c31315f2a', '911dc1d1-ab15-4ad6-b88c-f2f9d342b069', 'e07ae19a-2f82-47b7-ac37-27e797da9654', 'db67ac01-da10-4b5d-8074-051efd3549f5'] {{(pid=89182) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 12:27:21 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-1be37c18-8709-4898-ae7d-957ceb34e77a tempest-TestVolumeBootPattern-1492021642 None] Delete snapshot completed successfully. Jul 31 12:27:21 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-1be37c18-8709-4898-ae7d-957ceb34e77a tempest-TestVolumeBootPattern-1492021642 None] Lock "cinder-57aa151f-800a-418b-8ea1-c82856fc341d-delete_snapshot" released by "delete_snapshot" :: held 2.178s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:27:21 devstack cinder-volume[89182]: DEBUG oslo_service.periodic_task [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89182) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 31 12:27:21 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:27:21 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:27:21 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:27:21 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:27:21 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:27:21 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:27:22 devstack sudo[104235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 Jul 31 12:27:22 devstack sudo[104235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:27:22 devstack sudo[104235]: pam_unix(sudo:session): session closed for user root Jul 31 12:27:22 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2" returned: 0 in 0.267s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:27:22 devstack cinder-volume[89182]: DEBUG cinder.manager [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] Notifying Schedulers of capabilities ... {{(pid=89182) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 12:27:22 devstack cinder-volume[89182]: DEBUG oslo_service.periodic_task [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] Running periodic task VolumeManager._thread_info {{(pid=89182) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 31 12:27:22 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] thread count: 28 {{(pid=89182) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 31 12:27:22 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] thread info: [<_MainThread(MainThread, started 136154603720832)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=89182) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 31 12:27:22 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-d1a6bd08-7f92-4784-a6ad-443c2b27ba3c tempest-SnapshotsActionsTest-2046780578 None] Acquiring lock "cinder-85b99b20-af4d-4dbb-a203-5a890c846394-delete_volume" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:27:22 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-d1a6bd08-7f92-4784-a6ad-443c2b27ba3c tempest-SnapshotsActionsTest-2046780578 None] Lock "cinder-85b99b20-af4d-4dbb-a203-5a890c846394-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:27:22 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-d1a6bd08-7f92-4784-a6ad-443c2b27ba3c tempest-SnapshotsActionsTest-2046780578 None] Acquiring lock "cinder-quobyte-85b99b20-af4d-4dbb-a203-5a890c846394" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:27:22 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-d1a6bd08-7f92-4784-a6ad-443c2b27ba3c tempest-SnapshotsActionsTest-2046780578 None] Lock "cinder-quobyte-85b99b20-af4d-4dbb-a203-5a890c846394" acquired by "delete_volume" :: waited 0.035s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:27:22 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc2225e4-958d-416b-9b99-38fc598e334c]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:27:22 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-d1a6bd08-7f92-4784-a6ad-443c2b27ba3c tempest-SnapshotsActionsTest-2046780578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-85b99b20-af4d-4dbb-a203-5a890c846394 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:27:22 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-5e4d10c1-d0b5-4e3b-8576-26ca3d3a8b72 tempest-TestVolumeBootPattern-1492021642 None] Acquiring lock "cinder-cce4d436-dd54-48f7-96a5-6746d683a50a-delete_volume" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:27:23 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-5e4d10c1-d0b5-4e3b-8576-26ca3d3a8b72 tempest-TestVolumeBootPattern-1492021642 None] Lock "cinder-cce4d436-dd54-48f7-96a5-6746d683a50a-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:27:23 devstack sudo[104238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-85b99b20-af4d-4dbb-a203-5a890c846394 Jul 31 12:27:23 devstack sudo[104238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:27:23 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-5e4d10c1-d0b5-4e3b-8576-26ca3d3a8b72 tempest-TestVolumeBootPattern-1492021642 None] Acquiring lock "cinder-quobyte-cce4d436-dd54-48f7-96a5-6746d683a50a" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:27:23 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-5e4d10c1-d0b5-4e3b-8576-26ca3d3a8b72 tempest-TestVolumeBootPattern-1492021642 None] Lock "cinder-quobyte-cce4d436-dd54-48f7-96a5-6746d683a50a" acquired by "delete_volume" :: waited 0.027s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:27:23 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[43e6a039-9cda-48b8-959f-759f5db091f8]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:27:23 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-5e4d10c1-d0b5-4e3b-8576-26ca3d3a8b72 tempest-TestVolumeBootPattern-1492021642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-cce4d436-dd54-48f7-96a5-6746d683a50a {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:27:23 devstack sudo[104240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-cce4d436-dd54-48f7-96a5-6746d683a50a Jul 31 12:27:23 devstack sudo[104240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:27:23 devstack sudo[104238]: pam_unix(sudo:session): session closed for user root Jul 31 12:27:23 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-d1a6bd08-7f92-4784-a6ad-443c2b27ba3c tempest-SnapshotsActionsTest-2046780578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-85b99b20-af4d-4dbb-a203-5a890c846394" returned: 0 in 0.453s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:27:23 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-d1a6bd08-7f92-4784-a6ad-443c2b27ba3c tempest-SnapshotsActionsTest-2046780578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-85b99b20-af4d-4dbb-a203-5a890c846394 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:27:23 devstack sudo[104245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-85b99b20-af4d-4dbb-a203-5a890c846394 Jul 31 12:27:23 devstack sudo[104245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:27:23 devstack sudo[104240]: pam_unix(sudo:session): session closed for user root Jul 31 12:27:23 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-5e4d10c1-d0b5-4e3b-8576-26ca3d3a8b72 tempest-TestVolumeBootPattern-1492021642 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-cce4d436-dd54-48f7-96a5-6746d683a50a" returned: 0 in 0.477s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:27:23 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-5e4d10c1-d0b5-4e3b-8576-26ca3d3a8b72 tempest-TestVolumeBootPattern-1492021642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-cce4d436-dd54-48f7-96a5-6746d683a50a {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:27:23 devstack sudo[104245]: pam_unix(sudo:session): session closed for user root Jul 31 12:27:23 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-d1a6bd08-7f92-4784-a6ad-443c2b27ba3c tempest-SnapshotsActionsTest-2046780578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-85b99b20-af4d-4dbb-a203-5a890c846394" returned: 0 in 0.310s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:27:23 devstack sudo[104251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-cce4d436-dd54-48f7-96a5-6746d683a50a Jul 31 12:27:23 devstack sudo[104251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:27:23 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-d1a6bd08-7f92-4784-a6ad-443c2b27ba3c tempest-SnapshotsActionsTest-2046780578 None] Lock "cinder-quobyte-85b99b20-af4d-4dbb-a203-5a890c846394" released by "delete_volume" :: held 0.857s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:27:23 devstack cinder-volume[89182]: DEBUG cinder.quota [None req-d1a6bd08-7f92-4784-a6ad-443c2b27ba3c tempest-SnapshotsActionsTest-2046780578 None] Created reservations ['c87434e9-d64f-49a5-81a4-f57accb0f496', 'dcff4cb3-157b-425c-94f8-09cd3f23f8aa', 'a659f1ec-adfb-414a-95c1-08367be53404', 'b0275003-c32d-46f8-8b2a-c31ffc9990e3'] {{(pid=89182) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 12:27:23 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-d1a6bd08-7f92-4784-a6ad-443c2b27ba3c tempest-SnapshotsActionsTest-2046780578 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:27:23 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-d1a6bd08-7f92-4784-a6ad-443c2b27ba3c tempest-SnapshotsActionsTest-2046780578 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:27:23 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-d1a6bd08-7f92-4784-a6ad-443c2b27ba3c tempest-SnapshotsActionsTest-2046780578 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:27:23 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-d1a6bd08-7f92-4784-a6ad-443c2b27ba3c tempest-SnapshotsActionsTest-2046780578 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:27:23 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-d1a6bd08-7f92-4784-a6ad-443c2b27ba3c tempest-SnapshotsActionsTest-2046780578 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:27:23 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-d1a6bd08-7f92-4784-a6ad-443c2b27ba3c tempest-SnapshotsActionsTest-2046780578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:27:23 devstack sudo[104251]: pam_unix(sudo:session): session closed for user root Jul 31 12:27:23 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-5e4d10c1-d0b5-4e3b-8576-26ca3d3a8b72 tempest-TestVolumeBootPattern-1492021642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-cce4d436-dd54-48f7-96a5-6746d683a50a" returned: 0 in 0.339s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:27:23 devstack sudo[104254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 Jul 31 12:27:23 devstack sudo[104254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:27:24 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-5e4d10c1-d0b5-4e3b-8576-26ca3d3a8b72 tempest-TestVolumeBootPattern-1492021642 None] Lock "cinder-quobyte-cce4d436-dd54-48f7-96a5-6746d683a50a" released by "delete_volume" :: held 0.905s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:27:24 devstack cinder-volume[89182]: DEBUG cinder.quota [None req-5e4d10c1-d0b5-4e3b-8576-26ca3d3a8b72 tempest-TestVolumeBootPattern-1492021642 None] Created reservations ['70c14897-20ce-4866-8362-efbacdd26736', '8e1b750c-5e8a-459c-b00f-49b0d7618c6e', 'f273aa42-fd89-4db1-8ac0-a1cedd9222cf', '54a2fc17-05af-4057-b84c-c07412258403'] {{(pid=89182) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 12:27:24 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-5e4d10c1-d0b5-4e3b-8576-26ca3d3a8b72 tempest-TestVolumeBootPattern-1492021642 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:27:24 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-5e4d10c1-d0b5-4e3b-8576-26ca3d3a8b72 tempest-TestVolumeBootPattern-1492021642 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:27:24 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-5e4d10c1-d0b5-4e3b-8576-26ca3d3a8b72 tempest-TestVolumeBootPattern-1492021642 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:27:24 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-5e4d10c1-d0b5-4e3b-8576-26ca3d3a8b72 tempest-TestVolumeBootPattern-1492021642 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:27:24 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-5e4d10c1-d0b5-4e3b-8576-26ca3d3a8b72 tempest-TestVolumeBootPattern-1492021642 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:27:24 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-5e4d10c1-d0b5-4e3b-8576-26ca3d3a8b72 tempest-TestVolumeBootPattern-1492021642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:27:24 devstack sudo[104254]: pam_unix(sudo:session): session closed for user root Jul 31 12:27:24 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-d1a6bd08-7f92-4784-a6ad-443c2b27ba3c tempest-SnapshotsActionsTest-2046780578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2" returned: 0 in 0.325s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:27:24 devstack cinder-volume[89182]: DEBUG cinder.manager [None req-d1a6bd08-7f92-4784-a6ad-443c2b27ba3c tempest-SnapshotsActionsTest-2046780578 None] Notifying Schedulers of capabilities ... {{(pid=89182) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 12:27:24 devstack sudo[104257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 Jul 31 12:27:24 devstack sudo[104257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:27:24 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-d1a6bd08-7f92-4784-a6ad-443c2b27ba3c tempest-SnapshotsActionsTest-2046780578 None] Deleted volume successfully. Jul 31 12:27:24 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-d1a6bd08-7f92-4784-a6ad-443c2b27ba3c tempest-SnapshotsActionsTest-2046780578 None] Lock "cinder-85b99b20-af4d-4dbb-a203-5a890c846394-delete_volume" released by "delete_volume" :: held 1.588s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:27:24 devstack sudo[104257]: pam_unix(sudo:session): session closed for user root Jul 31 12:27:24 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-5e4d10c1-d0b5-4e3b-8576-26ca3d3a8b72 tempest-TestVolumeBootPattern-1492021642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2" returned: 0 in 0.428s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:27:24 devstack cinder-volume[89182]: DEBUG cinder.manager [None req-5e4d10c1-d0b5-4e3b-8576-26ca3d3a8b72 tempest-TestVolumeBootPattern-1492021642 None] Notifying Schedulers of capabilities ... {{(pid=89182) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 12:27:24 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-5e4d10c1-d0b5-4e3b-8576-26ca3d3a8b72 tempest-TestVolumeBootPattern-1492021642 None] Deleted volume successfully. Jul 31 12:27:24 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-5e4d10c1-d0b5-4e3b-8576-26ca3d3a8b72 tempest-TestVolumeBootPattern-1492021642 None] Lock "cinder-cce4d436-dd54-48f7-96a5-6746d683a50a-delete_volume" released by "delete_volume" :: held 1.680s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:27:25 devstack cinder-volume[89182]: DEBUG cinder.volume.flows.manager.create_volume [None req-b95c4289-e1d2-4207-bbc2-bca29a0931b6 tempest-VolumesDeleteCascade-686353286 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89182) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 12:27:25 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-b95c4289-e1d2-4207-bbc2-bca29a0931b6 tempest-VolumesDeleteCascade-686353286 None] Flow 'volume_create_manager' (3f588268-cbf4-4123-88c5-3b1a7abee744) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:27:25 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-b95c4289-e1d2-4207-bbc2-bca29a0931b6 tempest-VolumesDeleteCascade-686353286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (810144a3-407f-43d9-adfa-5adc057b046c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:27:25 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-b95c4289-e1d2-4207-bbc2-bca29a0931b6 tempest-VolumesDeleteCascade-686353286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (810144a3-407f-43d9-adfa-5adc057b046c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:27:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-594202281',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e69673e7-93b9-4f39-a6db-30574a93b958,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22d4ed81133e4de7bc686b4670d05ef9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:27:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:27:26Z,use_quota=True,user_id='8f34a7438a064490a47de3ab977a33bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:27:25 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-b95c4289-e1d2-4207-bbc2-bca29a0931b6 tempest-VolumesDeleteCascade-686353286 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ddf5ff07-3352-4f65-b643-35ab8936bdb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:27:25 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-b95c4289-e1d2-4207-bbc2-bca29a0931b6 tempest-VolumesDeleteCascade-686353286 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ddf5ff07-3352-4f65-b643-35ab8936bdb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:27:25 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-b95c4289-e1d2-4207-bbc2-bca29a0931b6 tempest-VolumesDeleteCascade-686353286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03da5599-7650-4148-a5f9-6c4b537f37f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:27:25 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-b95c4289-e1d2-4207-bbc2-bca29a0931b6 tempest-VolumesDeleteCascade-686353286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03da5599-7650-4148-a5f9-6c4b537f37f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e69673e7-93b9-4f39-a6db-30574a93b958', 'volume_name': 'volume-e69673e7-93b9-4f39-a6db-30574a93b958', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:27:25 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-b95c4289-e1d2-4207-bbc2-bca29a0931b6 tempest-VolumesDeleteCascade-686353286 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ff4847b-8028-4ed7-9fa4-6e7ef6acc8f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:27:25 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-b95c4289-e1d2-4207-bbc2-bca29a0931b6 tempest-VolumesDeleteCascade-686353286 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ff4847b-8028-4ed7-9fa4-6e7ef6acc8f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:27:25 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-b95c4289-e1d2-4207-bbc2-bca29a0931b6 tempest-VolumesDeleteCascade-686353286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc9c989c-91d1-4538-9a04-f6e5265b45b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:27:25 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-b95c4289-e1d2-4207-bbc2-bca29a0931b6 tempest-VolumesDeleteCascade-686353286 None] Volume e69673e7-93b9-4f39-a6db-30574a93b958: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e69673e7-93b9-4f39-a6db-30574a93b958', 'volume_size': 1} Jul 31 12:27:25 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-b95c4289-e1d2-4207-bbc2-bca29a0931b6 tempest-VolumesDeleteCascade-686353286 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:27:25 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-b95c4289-e1d2-4207-bbc2-bca29a0931b6 tempest-VolumesDeleteCascade-686353286 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:27:25 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-b95c4289-e1d2-4207-bbc2-bca29a0931b6 tempest-VolumesDeleteCascade-686353286 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:27:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-594202281',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e69673e7-93b9-4f39-a6db-30574a93b958,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22d4ed81133e4de7bc686b4670d05ef9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:27:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:27:26Z,use_quota=True,user_id='8f34a7438a064490a47de3ab977a33bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)}" {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 12:27:25 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-b95c4289-e1d2-4207-bbc2-bca29a0931b6 tempest-VolumesDeleteCascade-686353286 None] Creating volume e69673e7-93b9-4f39-a6db-30574a93b958 {{(pid=89182) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 12:27:25 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-b95c4289-e1d2-4207-bbc2-bca29a0931b6 tempest-VolumesDeleteCascade-686353286 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:27:25 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-b95c4289-e1d2-4207-bbc2-bca29a0931b6 tempest-VolumesDeleteCascade-686353286 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:27:25 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-b95c4289-e1d2-4207-bbc2-bca29a0931b6 tempest-VolumesDeleteCascade-686353286 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:27:25 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-b95c4289-e1d2-4207-bbc2-bca29a0931b6 tempest-VolumesDeleteCascade-686353286 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:27:25 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-b95c4289-e1d2-4207-bbc2-bca29a0931b6 tempest-VolumesDeleteCascade-686353286 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:27:25 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-b95c4289-e1d2-4207-bbc2-bca29a0931b6 tempest-VolumesDeleteCascade-686353286 None] Selected osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 as target Quobyte volume. {{(pid=89182) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 12:27:25 devstack cinder-volume[89182]: INFO cinder.volume.drivers.remotefs [None req-b95c4289-e1d2-4207-bbc2-bca29a0931b6 tempest-VolumesDeleteCascade-686353286 None] casted to osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 Jul 31 12:27:25 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-b95c4289-e1d2-4207-bbc2-bca29a0931b6 tempest-VolumesDeleteCascade-686353286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e69673e7-93b9-4f39-a6db-30574a93b958 1073741824 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:27:25 devstack sudo[104260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e69673e7-93b9-4f39-a6db-30574a93b958 1073741824 Jul 31 12:27:25 devstack sudo[104260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:27:26 devstack sudo[104260]: pam_unix(sudo:session): session closed for user root Jul 31 12:27:26 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-b95c4289-e1d2-4207-bbc2-bca29a0931b6 tempest-VolumesDeleteCascade-686353286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e69673e7-93b9-4f39-a6db-30574a93b958 1073741824" returned: 0 in 0.614s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:27:26 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-b95c4289-e1d2-4207-bbc2-bca29a0931b6 tempest-VolumesDeleteCascade-686353286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e69673e7-93b9-4f39-a6db-30574a93b958 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:27:26 devstack sudo[104267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e69673e7-93b9-4f39-a6db-30574a93b958 Jul 31 12:27:26 devstack sudo[104267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:27:26 devstack sudo[104267]: pam_unix(sudo:session): session closed for user root Jul 31 12:27:26 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-b95c4289-e1d2-4207-bbc2-bca29a0931b6 tempest-VolumesDeleteCascade-686353286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e69673e7-93b9-4f39-a6db-30574a93b958" returned: 0 in 0.325s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:27:26 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-b95c4289-e1d2-4207-bbc2-bca29a0931b6 tempest-VolumesDeleteCascade-686353286 None] <== create_volume: return (1015ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'} {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 12:27:26 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-b95c4289-e1d2-4207-bbc2-bca29a0931b6 tempest-VolumesDeleteCascade-686353286 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.018s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:27:26 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-b95c4289-e1d2-4207-bbc2-bca29a0931b6 tempest-VolumesDeleteCascade-686353286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc9c989c-91d1-4538-9a04-f6e5265b45b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e69673e7-93b9-4f39-a6db-30574a93b958', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:27:26 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-b95c4289-e1d2-4207-bbc2-bca29a0931b6 tempest-VolumesDeleteCascade-686353286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c422382b-3483-48ff-ad4c-8ec7bef5bae7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:27:26 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-b95c4289-e1d2-4207-bbc2-bca29a0931b6 tempest-VolumesDeleteCascade-686353286 None] Volume volume-e69673e7-93b9-4f39-a6db-30574a93b958 (e69673e7-93b9-4f39-a6db-30574a93b958): created successfully Jul 31 12:27:26 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-b95c4289-e1d2-4207-bbc2-bca29a0931b6 tempest-VolumesDeleteCascade-686353286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c422382b-3483-48ff-ad4c-8ec7bef5bae7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:27:26 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-b95c4289-e1d2-4207-bbc2-bca29a0931b6 tempest-VolumesDeleteCascade-686353286 None] Flow 'volume_create_manager' (3f588268-cbf4-4123-88c5-3b1a7abee744) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:27:26 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-b95c4289-e1d2-4207-bbc2-bca29a0931b6 tempest-VolumesDeleteCascade-686353286 None] Created volume successfully. Jul 31 12:27:27 devstack cinder-volume[89182]: DEBUG cinder.volume.flows.manager.create_volume [None req-a13574ed-2e3b-42b5-a691-82581bfac10e tempest-ProjectReaderTests-183788016 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89182) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 12:27:27 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-a13574ed-2e3b-42b5-a691-82581bfac10e tempest-ProjectReaderTests-183788016 None] Flow 'volume_create_manager' (a4c596a4-d414-4975-aefd-5f952fada2be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:27:27 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-a13574ed-2e3b-42b5-a691-82581bfac10e tempest-ProjectReaderTests-183788016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6027c073-c708-41d5-99eb-8d21b1eb72a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:27:27 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-a13574ed-2e3b-42b5-a691-82581bfac10e tempest-ProjectReaderTests-183788016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6027c073-c708-41d5-99eb-8d21b1eb72a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:27:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-436952774',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5306705b-1770-4a69-9624-4f529668eef4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c9d7fd99aeb453796f13a3c2ef6933a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:27:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:27:27Z,use_quota=True,user_id='944dc9ae4795400995426b6a5c6e31af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:27:27 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-a13574ed-2e3b-42b5-a691-82581bfac10e tempest-ProjectReaderTests-183788016 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54776eac-fcdd-4c90-8294-ba329ce8dcb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:27:27 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-a13574ed-2e3b-42b5-a691-82581bfac10e tempest-ProjectReaderTests-183788016 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54776eac-fcdd-4c90-8294-ba329ce8dcb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:27:27 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-a13574ed-2e3b-42b5-a691-82581bfac10e tempest-ProjectReaderTests-183788016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a9bdd52-5988-4240-9ea2-f4d1a1acb96b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:27:27 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-a13574ed-2e3b-42b5-a691-82581bfac10e tempest-ProjectReaderTests-183788016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a9bdd52-5988-4240-9ea2-f4d1a1acb96b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5306705b-1770-4a69-9624-4f529668eef4', 'volume_name': 'volume-5306705b-1770-4a69-9624-4f529668eef4', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:27:27 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-a13574ed-2e3b-42b5-a691-82581bfac10e tempest-ProjectReaderTests-183788016 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3e725c8-43da-4aab-99d2-841163e97426) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:27:27 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-a13574ed-2e3b-42b5-a691-82581bfac10e tempest-ProjectReaderTests-183788016 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3e725c8-43da-4aab-99d2-841163e97426) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:27:27 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-a13574ed-2e3b-42b5-a691-82581bfac10e tempest-ProjectReaderTests-183788016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8e90869-0145-4d08-a11a-46c1945cc722) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:27:27 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-a13574ed-2e3b-42b5-a691-82581bfac10e tempest-ProjectReaderTests-183788016 None] Volume 5306705b-1770-4a69-9624-4f529668eef4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5306705b-1770-4a69-9624-4f529668eef4', 'volume_size': 1} Jul 31 12:27:27 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-a13574ed-2e3b-42b5-a691-82581bfac10e tempest-ProjectReaderTests-183788016 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:27:27 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-a13574ed-2e3b-42b5-a691-82581bfac10e tempest-ProjectReaderTests-183788016 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:27:27 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-a13574ed-2e3b-42b5-a691-82581bfac10e tempest-ProjectReaderTests-183788016 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:27:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-436952774',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5306705b-1770-4a69-9624-4f529668eef4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c9d7fd99aeb453796f13a3c2ef6933a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:27:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:27:27Z,use_quota=True,user_id='944dc9ae4795400995426b6a5c6e31af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)}" {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 12:27:27 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-a13574ed-2e3b-42b5-a691-82581bfac10e tempest-ProjectReaderTests-183788016 None] Creating volume 5306705b-1770-4a69-9624-4f529668eef4 {{(pid=89182) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 12:27:27 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-a13574ed-2e3b-42b5-a691-82581bfac10e tempest-ProjectReaderTests-183788016 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:27:27 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-a13574ed-2e3b-42b5-a691-82581bfac10e tempest-ProjectReaderTests-183788016 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:27:27 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-a13574ed-2e3b-42b5-a691-82581bfac10e tempest-ProjectReaderTests-183788016 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:27:27 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-a13574ed-2e3b-42b5-a691-82581bfac10e tempest-ProjectReaderTests-183788016 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:27:27 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-a13574ed-2e3b-42b5-a691-82581bfac10e tempest-ProjectReaderTests-183788016 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:27:27 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-a13574ed-2e3b-42b5-a691-82581bfac10e tempest-ProjectReaderTests-183788016 None] Selected osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 as target Quobyte volume. {{(pid=89182) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 12:27:27 devstack cinder-volume[89182]: INFO cinder.volume.drivers.remotefs [None req-a13574ed-2e3b-42b5-a691-82581bfac10e tempest-ProjectReaderTests-183788016 None] casted to osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 Jul 31 12:27:27 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-a13574ed-2e3b-42b5-a691-82581bfac10e tempest-ProjectReaderTests-183788016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-5306705b-1770-4a69-9624-4f529668eef4 1073741824 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:27:27 devstack sudo[104271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-5306705b-1770-4a69-9624-4f529668eef4 1073741824 Jul 31 12:27:27 devstack sudo[104271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:27:27 devstack sudo[104271]: pam_unix(sudo:session): session closed for user root Jul 31 12:27:27 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-a13574ed-2e3b-42b5-a691-82581bfac10e tempest-ProjectReaderTests-183788016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-5306705b-1770-4a69-9624-4f529668eef4 1073741824" returned: 0 in 0.674s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:27:27 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-a13574ed-2e3b-42b5-a691-82581bfac10e tempest-ProjectReaderTests-183788016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-5306705b-1770-4a69-9624-4f529668eef4 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:27:28 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-f359f0de-25b4-4476-80e5-b8650cfc7c8c tempest-VolumesDeleteCascade-686353286 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:27:28 devstack sudo[104280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-5306705b-1770-4a69-9624-4f529668eef4 Jul 31 12:27:28 devstack sudo[104280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:27:28 devstack sudo[104280]: pam_unix(sudo:session): session closed for user root Jul 31 12:27:28 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-a13574ed-2e3b-42b5-a691-82581bfac10e tempest-ProjectReaderTests-183788016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-5306705b-1770-4a69-9624-4f529668eef4" returned: 0 in 0.281s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:27:28 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-a13574ed-2e3b-42b5-a691-82581bfac10e tempest-ProjectReaderTests-183788016 None] <== create_volume: return (1100ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'} {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 12:27:28 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-a13574ed-2e3b-42b5-a691-82581bfac10e tempest-ProjectReaderTests-183788016 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.103s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:27:28 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-f359f0de-25b4-4476-80e5-b8650cfc7c8c tempest-VolumesDeleteCascade-686353286 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.269s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:27:28 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-a13574ed-2e3b-42b5-a691-82581bfac10e tempest-ProjectReaderTests-183788016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8e90869-0145-4d08-a11a-46c1945cc722) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5306705b-1770-4a69-9624-4f529668eef4', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:27:28 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-a13574ed-2e3b-42b5-a691-82581bfac10e tempest-ProjectReaderTests-183788016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2c2d407-b2c3-4c13-8156-668dcde90942) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:27:28 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-f359f0de-25b4-4476-80e5-b8650cfc7c8c tempest-VolumesDeleteCascade-686353286 None] Creating offline snapshot 6b0ddbc8-7260-4206-94be-1705a042b595 of volume e69673e7-93b9-4f39-a6db-30574a93b958 {{(pid=89182) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 31 12:27:28 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-a13574ed-2e3b-42b5-a691-82581bfac10e tempest-ProjectReaderTests-183788016 None] Volume volume-5306705b-1770-4a69-9624-4f529668eef4 (5306705b-1770-4a69-9624-4f529668eef4): created successfully Jul 31 12:27:28 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-a13574ed-2e3b-42b5-a691-82581bfac10e tempest-ProjectReaderTests-183788016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2c2d407-b2c3-4c13-8156-668dcde90942) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:27:28 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-a13574ed-2e3b-42b5-a691-82581bfac10e tempest-ProjectReaderTests-183788016 None] Flow 'volume_create_manager' (a4c596a4-d414-4975-aefd-5f952fada2be) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:27:28 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[9abdbece-84ad-45a8-8da7-60d5e6fe2bd4]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:27:28 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-f359f0de-25b4-4476-80e5-b8650cfc7c8c tempest-VolumesDeleteCascade-686353286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e69673e7-93b9-4f39-a6db-30574a93b958 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:27:28 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-a13574ed-2e3b-42b5-a691-82581bfac10e tempest-ProjectReaderTests-183788016 None] Created volume successfully. Jul 31 12:27:28 devstack sudo[104283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e69673e7-93b9-4f39-a6db-30574a93b958 Jul 31 12:27:28 devstack sudo[104283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:27:28 devstack sudo[104283]: pam_unix(sudo:session): session closed for user root Jul 31 12:27:28 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-f359f0de-25b4-4476-80e5-b8650cfc7c8c tempest-VolumesDeleteCascade-686353286 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e69673e7-93b9-4f39-a6db-30574a93b958" returned: 0 in 0.436s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:27:28 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-f359f0de-25b4-4476-80e5-b8650cfc7c8c tempest-VolumesDeleteCascade-686353286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e69673e7-93b9-4f39-a6db-30574a93b958,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e69673e7-93b9-4f39-a6db-30574a93b958.6b0ddbc8-7260-4206-94be-1705a042b595 1G {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:27:28 devstack sudo[104288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e69673e7-93b9-4f39-a6db-30574a93b958,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e69673e7-93b9-4f39-a6db-30574a93b958.6b0ddbc8-7260-4206-94be-1705a042b595 1G Jul 31 12:27:28 devstack sudo[104288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:27:29 devstack sudo[104288]: pam_unix(sudo:session): session closed for user root Jul 31 12:27:29 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-f359f0de-25b4-4476-80e5-b8650cfc7c8c tempest-VolumesDeleteCascade-686353286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e69673e7-93b9-4f39-a6db-30574a93b958,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e69673e7-93b9-4f39-a6db-30574a93b958.6b0ddbc8-7260-4206-94be-1705a042b595 1G" returned: 0 in 0.610s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:27:29 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-f359f0de-25b4-4476-80e5-b8650cfc7c8c tempest-VolumesDeleteCascade-686353286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e69673e7-93b9-4f39-a6db-30574a93b958 -F qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e69673e7-93b9-4f39-a6db-30574a93b958.6b0ddbc8-7260-4206-94be-1705a042b595 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:27:29 devstack sudo[104296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e69673e7-93b9-4f39-a6db-30574a93b958 -F qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e69673e7-93b9-4f39-a6db-30574a93b958.6b0ddbc8-7260-4206-94be-1705a042b595 Jul 31 12:27:29 devstack sudo[104296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:27:29 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-7cf9c19e-0e1f-4d95-af43-9ce0ba10bad7 tempest-ProjectReaderTests-183788016 None] Acquiring lock "cinder-5306705b-1770-4a69-9624-4f529668eef4-delete_volume" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:27:29 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-7cf9c19e-0e1f-4d95-af43-9ce0ba10bad7 tempest-ProjectReaderTests-183788016 None] Lock "cinder-5306705b-1770-4a69-9624-4f529668eef4-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:27:29 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-7cf9c19e-0e1f-4d95-af43-9ce0ba10bad7 tempest-ProjectReaderTests-183788016 None] Acquiring lock "cinder-quobyte-5306705b-1770-4a69-9624-4f529668eef4" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:27:29 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-7cf9c19e-0e1f-4d95-af43-9ce0ba10bad7 tempest-ProjectReaderTests-183788016 None] Lock "cinder-quobyte-5306705b-1770-4a69-9624-4f529668eef4" acquired by "delete_volume" :: waited 0.026s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:27:29 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[71f359fb-2466-452b-8445-7ae553bb0534]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:27:29 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-7cf9c19e-0e1f-4d95-af43-9ce0ba10bad7 tempest-ProjectReaderTests-183788016 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-5306705b-1770-4a69-9624-4f529668eef4 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:27:29 devstack sudo[104296]: pam_unix(sudo:session): session closed for user root Jul 31 12:27:29 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-f359f0de-25b4-4476-80e5-b8650cfc7c8c tempest-VolumesDeleteCascade-686353286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e69673e7-93b9-4f39-a6db-30574a93b958 -F qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e69673e7-93b9-4f39-a6db-30574a93b958.6b0ddbc8-7260-4206-94be-1705a042b595" returned: 0 in 0.436s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:27:29 devstack cinder-volume[89182]: WARNING cinder.volume.drivers.remotefs [None req-f359f0de-25b4-4476-80e5-b8650cfc7c8c tempest-VolumesDeleteCascade-686353286 None] /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e69673e7-93b9-4f39-a6db-30574a93b958.6b0ddbc8-7260-4206-94be-1705a042b595 is being set with open permissions: ugo+rw Jul 31 12:27:29 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-f359f0de-25b4-4476-80e5-b8650cfc7c8c tempest-VolumesDeleteCascade-686353286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e69673e7-93b9-4f39-a6db-30574a93b958.6b0ddbc8-7260-4206-94be-1705a042b595 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:27:29 devstack sudo[104299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-5306705b-1770-4a69-9624-4f529668eef4 Jul 31 12:27:29 devstack sudo[104299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:27:29 devstack sudo[104303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e69673e7-93b9-4f39-a6db-30574a93b958.6b0ddbc8-7260-4206-94be-1705a042b595 Jul 31 12:27:29 devstack sudo[104303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:27:30 devstack sudo[104303]: pam_unix(sudo:session): session closed for user root Jul 31 12:27:30 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-f359f0de-25b4-4476-80e5-b8650cfc7c8c tempest-VolumesDeleteCascade-686353286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e69673e7-93b9-4f39-a6db-30574a93b958.6b0ddbc8-7260-4206-94be-1705a042b595" returned: 0 in 0.341s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:27:30 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-f359f0de-25b4-4476-80e5-b8650cfc7c8c tempest-VolumesDeleteCascade-686353286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e69673e7-93b9-4f39-a6db-30574a93b958.info {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:27:30 devstack sudo[104299]: pam_unix(sudo:session): session closed for user root Jul 31 12:27:30 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-7cf9c19e-0e1f-4d95-af43-9ce0ba10bad7 tempest-ProjectReaderTests-183788016 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-5306705b-1770-4a69-9624-4f529668eef4" returned: 0 in 0.533s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:27:30 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-7cf9c19e-0e1f-4d95-af43-9ce0ba10bad7 tempest-ProjectReaderTests-183788016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-5306705b-1770-4a69-9624-4f529668eef4 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:27:30 devstack sudo[104311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e69673e7-93b9-4f39-a6db-30574a93b958.info Jul 31 12:27:30 devstack sudo[104311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:27:30 devstack sudo[104312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-5306705b-1770-4a69-9624-4f529668eef4 Jul 31 12:27:30 devstack sudo[104312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:27:30 devstack sudo[104312]: pam_unix(sudo:session): session closed for user root Jul 31 12:27:30 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-7cf9c19e-0e1f-4d95-af43-9ce0ba10bad7 tempest-ProjectReaderTests-183788016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-5306705b-1770-4a69-9624-4f529668eef4" returned: 0 in 0.333s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:27:30 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-7cf9c19e-0e1f-4d95-af43-9ce0ba10bad7 tempest-ProjectReaderTests-183788016 None] Lock "cinder-quobyte-5306705b-1770-4a69-9624-4f529668eef4" released by "delete_volume" :: held 0.925s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:27:30 devstack sudo[104311]: pam_unix(sudo:session): session closed for user root Jul 31 12:27:30 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-f359f0de-25b4-4476-80e5-b8650cfc7c8c tempest-VolumesDeleteCascade-686353286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e69673e7-93b9-4f39-a6db-30574a93b958.info" returned: 0 in 0.413s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:27:30 devstack cinder-volume[89182]: WARNING cinder.volume.drivers.remotefs [None req-f359f0de-25b4-4476-80e5-b8650cfc7c8c tempest-VolumesDeleteCascade-686353286 None] /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e69673e7-93b9-4f39-a6db-30574a93b958.info is being set with open permissions: ugo+rw Jul 31 12:27:30 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-f359f0de-25b4-4476-80e5-b8650cfc7c8c tempest-VolumesDeleteCascade-686353286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e69673e7-93b9-4f39-a6db-30574a93b958.info {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:27:30 devstack sudo[104319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e69673e7-93b9-4f39-a6db-30574a93b958.info Jul 31 12:27:30 devstack sudo[104319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:27:30 devstack cinder-volume[89182]: DEBUG cinder.quota [None req-7cf9c19e-0e1f-4d95-af43-9ce0ba10bad7 tempest-ProjectReaderTests-183788016 None] Created reservations ['aaf8b002-03e7-417e-960a-7c18dc528bc8', '9cec0bb2-2f63-4af9-bcfc-832577ae3d9b', 'ad99f686-a00e-4ce4-bceb-e1dbb3172e0b', 'fd6b073c-85fc-41ec-aff4-2e2f623b0088'] {{(pid=89182) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 12:27:30 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-7cf9c19e-0e1f-4d95-af43-9ce0ba10bad7 tempest-ProjectReaderTests-183788016 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:27:30 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-7cf9c19e-0e1f-4d95-af43-9ce0ba10bad7 tempest-ProjectReaderTests-183788016 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:27:30 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-7cf9c19e-0e1f-4d95-af43-9ce0ba10bad7 tempest-ProjectReaderTests-183788016 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:27:30 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-7cf9c19e-0e1f-4d95-af43-9ce0ba10bad7 tempest-ProjectReaderTests-183788016 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:27:30 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-7cf9c19e-0e1f-4d95-af43-9ce0ba10bad7 tempest-ProjectReaderTests-183788016 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:27:30 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-7cf9c19e-0e1f-4d95-af43-9ce0ba10bad7 tempest-ProjectReaderTests-183788016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:27:30 devstack sudo[104322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 Jul 31 12:27:30 devstack sudo[104322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:27:31 devstack sudo[104319]: pam_unix(sudo:session): session closed for user root Jul 31 12:27:31 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-f359f0de-25b4-4476-80e5-b8650cfc7c8c tempest-VolumesDeleteCascade-686353286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e69673e7-93b9-4f39-a6db-30574a93b958.info" returned: 0 in 0.406s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:27:31 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-f359f0de-25b4-4476-80e5-b8650cfc7c8c tempest-VolumesDeleteCascade-686353286 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.799s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:27:31 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-f359f0de-25b4-4476-80e5-b8650cfc7c8c tempest-VolumesDeleteCascade-686353286 None] Create snapshot completed successfully Jul 31 12:27:31 devstack sudo[104322]: pam_unix(sudo:session): session closed for user root Jul 31 12:27:31 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-7cf9c19e-0e1f-4d95-af43-9ce0ba10bad7 tempest-ProjectReaderTests-183788016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2" returned: 0 in 0.272s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:27:31 devstack cinder-volume[89182]: DEBUG cinder.manager [None req-7cf9c19e-0e1f-4d95-af43-9ce0ba10bad7 tempest-ProjectReaderTests-183788016 None] Notifying Schedulers of capabilities ... {{(pid=89182) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 12:27:31 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-7cf9c19e-0e1f-4d95-af43-9ce0ba10bad7 tempest-ProjectReaderTests-183788016 None] Deleted volume successfully. Jul 31 12:27:31 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-7cf9c19e-0e1f-4d95-af43-9ce0ba10bad7 tempest-ProjectReaderTests-183788016 None] Lock "cinder-5306705b-1770-4a69-9624-4f529668eef4-delete_volume" released by "delete_volume" :: held 1.612s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:27:32 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-e98e9329-384e-43c1-ab1e-9a39722fa5fe tempest-VolumesDeleteCascade-686353286 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:27:32 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-e98e9329-384e-43c1-ab1e-9a39722fa5fe tempest-VolumesDeleteCascade-686353286 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:27:32 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-e98e9329-384e-43c1-ab1e-9a39722fa5fe tempest-VolumesDeleteCascade-686353286 None] Creating offline snapshot 55d90d4a-1114-4ec7-bac1-661b04c29711 of volume e69673e7-93b9-4f39-a6db-30574a93b958 {{(pid=89182) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 31 12:27:32 devstack cinder-volume[89182]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c43c66e-5744-48a9-acaa-07be065a1729 tempest-ProjectReaderTests-183788016 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89182) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 12:27:32 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-6c43c66e-5744-48a9-acaa-07be065a1729 tempest-ProjectReaderTests-183788016 None] Flow 'volume_create_manager' (6b7ad677-1708-44e7-ba03-02887f73f8ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:27:32 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-6c43c66e-5744-48a9-acaa-07be065a1729 tempest-ProjectReaderTests-183788016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1fa86491-f959-4827-a95b-b8fdfde4c97d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:27:32 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6062876-09ef-4e1a-8aae-29442e6c1d6c]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:27:32 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-e98e9329-384e-43c1-ab1e-9a39722fa5fe tempest-VolumesDeleteCascade-686353286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e69673e7-93b9-4f39-a6db-30574a93b958.6b0ddbc8-7260-4206-94be-1705a042b595 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:27:32 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-6c43c66e-5744-48a9-acaa-07be065a1729 tempest-ProjectReaderTests-183788016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1fa86491-f959-4827-a95b-b8fdfde4c97d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:27:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-260389470',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99fbba4c-e28d-427d-94ce-86bd0c15d8c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c9d7fd99aeb453796f13a3c2ef6933a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:27:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:27:33Z,use_quota=True,user_id='944dc9ae4795400995426b6a5c6e31af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:27:32 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-6c43c66e-5744-48a9-acaa-07be065a1729 tempest-ProjectReaderTests-183788016 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1328a3e-85e2-4258-a974-ac31b88a5bdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:27:32 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-6c43c66e-5744-48a9-acaa-07be065a1729 tempest-ProjectReaderTests-183788016 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1328a3e-85e2-4258-a974-ac31b88a5bdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:27:32 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-6c43c66e-5744-48a9-acaa-07be065a1729 tempest-ProjectReaderTests-183788016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb185b53-440c-4f91-a84d-bc6949199084) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:27:32 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-6c43c66e-5744-48a9-acaa-07be065a1729 tempest-ProjectReaderTests-183788016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb185b53-440c-4f91-a84d-bc6949199084) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '99fbba4c-e28d-427d-94ce-86bd0c15d8c4', 'volume_name': 'volume-99fbba4c-e28d-427d-94ce-86bd0c15d8c4', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:27:32 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-6c43c66e-5744-48a9-acaa-07be065a1729 tempest-ProjectReaderTests-183788016 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4cf4af8f-ca5f-47ab-8a58-f91759e7c0aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:27:32 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-6c43c66e-5744-48a9-acaa-07be065a1729 tempest-ProjectReaderTests-183788016 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4cf4af8f-ca5f-47ab-8a58-f91759e7c0aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:27:32 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-6c43c66e-5744-48a9-acaa-07be065a1729 tempest-ProjectReaderTests-183788016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d6c50ee-4e5d-4b2e-adf9-c7ff20d64dc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:27:32 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-6c43c66e-5744-48a9-acaa-07be065a1729 tempest-ProjectReaderTests-183788016 None] Volume 99fbba4c-e28d-427d-94ce-86bd0c15d8c4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-99fbba4c-e28d-427d-94ce-86bd0c15d8c4', 'volume_size': 1} Jul 31 12:27:32 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-6c43c66e-5744-48a9-acaa-07be065a1729 tempest-ProjectReaderTests-183788016 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:27:32 devstack sudo[104326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e69673e7-93b9-4f39-a6db-30574a93b958.6b0ddbc8-7260-4206-94be-1705a042b595 Jul 31 12:27:32 devstack sudo[104326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:27:33 devstack sudo[104326]: pam_unix(sudo:session): session closed for user root Jul 31 12:27:33 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-e98e9329-384e-43c1-ab1e-9a39722fa5fe tempest-VolumesDeleteCascade-686353286 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e69673e7-93b9-4f39-a6db-30574a93b958.6b0ddbc8-7260-4206-94be-1705a042b595" returned: 0 in 0.433s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:27:33 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-e98e9329-384e-43c1-ab1e-9a39722fa5fe tempest-VolumesDeleteCascade-686353286 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e69673e7-93b9-4f39-a6db-30574a93b958(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89182) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 12:27:33 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-e98e9329-384e-43c1-ab1e-9a39722fa5fe tempest-VolumesDeleteCascade-686353286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e69673e7-93b9-4f39-a6db-30574a93b958.6b0ddbc8-7260-4206-94be-1705a042b595,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e69673e7-93b9-4f39-a6db-30574a93b958.55d90d4a-1114-4ec7-bac1-661b04c29711 1G {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:27:33 devstack sudo[104331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e69673e7-93b9-4f39-a6db-30574a93b958.6b0ddbc8-7260-4206-94be-1705a042b595,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e69673e7-93b9-4f39-a6db-30574a93b958.55d90d4a-1114-4ec7-bac1-661b04c29711 1G Jul 31 12:27:33 devstack sudo[104331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:27:33 devstack sudo[104331]: pam_unix(sudo:session): session closed for user root Jul 31 12:27:33 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-e98e9329-384e-43c1-ab1e-9a39722fa5fe tempest-VolumesDeleteCascade-686353286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e69673e7-93b9-4f39-a6db-30574a93b958.6b0ddbc8-7260-4206-94be-1705a042b595,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e69673e7-93b9-4f39-a6db-30574a93b958.55d90d4a-1114-4ec7-bac1-661b04c29711 1G" returned: 0 in 0.642s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:27:33 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-e98e9329-384e-43c1-ab1e-9a39722fa5fe tempest-VolumesDeleteCascade-686353286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e69673e7-93b9-4f39-a6db-30574a93b958.6b0ddbc8-7260-4206-94be-1705a042b595 -F qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e69673e7-93b9-4f39-a6db-30574a93b958.55d90d4a-1114-4ec7-bac1-661b04c29711 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:27:33 devstack sudo[104338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e69673e7-93b9-4f39-a6db-30574a93b958.6b0ddbc8-7260-4206-94be-1705a042b595 -F qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e69673e7-93b9-4f39-a6db-30574a93b958.55d90d4a-1114-4ec7-bac1-661b04c29711 Jul 31 12:27:33 devstack sudo[104338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:27:34 devstack sudo[104338]: pam_unix(sudo:session): session closed for user root Jul 31 12:27:34 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-e98e9329-384e-43c1-ab1e-9a39722fa5fe tempest-VolumesDeleteCascade-686353286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e69673e7-93b9-4f39-a6db-30574a93b958.6b0ddbc8-7260-4206-94be-1705a042b595 -F qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e69673e7-93b9-4f39-a6db-30574a93b958.55d90d4a-1114-4ec7-bac1-661b04c29711" returned: 0 in 0.364s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:27:34 devstack cinder-volume[89182]: WARNING cinder.volume.drivers.remotefs [None req-e98e9329-384e-43c1-ab1e-9a39722fa5fe tempest-VolumesDeleteCascade-686353286 None] /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e69673e7-93b9-4f39-a6db-30574a93b958.55d90d4a-1114-4ec7-bac1-661b04c29711 is being set with open permissions: ugo+rw Jul 31 12:27:34 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-e98e9329-384e-43c1-ab1e-9a39722fa5fe tempest-VolumesDeleteCascade-686353286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e69673e7-93b9-4f39-a6db-30574a93b958.55d90d4a-1114-4ec7-bac1-661b04c29711 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:27:34 devstack sudo[104343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e69673e7-93b9-4f39-a6db-30574a93b958.55d90d4a-1114-4ec7-bac1-661b04c29711 Jul 31 12:27:34 devstack sudo[104343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:27:34 devstack sudo[104343]: pam_unix(sudo:session): session closed for user root Jul 31 12:27:34 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-e98e9329-384e-43c1-ab1e-9a39722fa5fe tempest-VolumesDeleteCascade-686353286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e69673e7-93b9-4f39-a6db-30574a93b958.55d90d4a-1114-4ec7-bac1-661b04c29711" returned: 0 in 0.281s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:27:34 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-e98e9329-384e-43c1-ab1e-9a39722fa5fe tempest-VolumesDeleteCascade-686353286 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.898s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:27:34 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-6c43c66e-5744-48a9-acaa-07be065a1729 tempest-ProjectReaderTests-183788016 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.662s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:27:34 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-6c43c66e-5744-48a9-acaa-07be065a1729 tempest-ProjectReaderTests-183788016 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:27:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-260389470',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99fbba4c-e28d-427d-94ce-86bd0c15d8c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c9d7fd99aeb453796f13a3c2ef6933a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:27:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:27:33Z,use_quota=True,user_id='944dc9ae4795400995426b6a5c6e31af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)}" {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 12:27:34 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-6c43c66e-5744-48a9-acaa-07be065a1729 tempest-ProjectReaderTests-183788016 None] Creating volume 99fbba4c-e28d-427d-94ce-86bd0c15d8c4 {{(pid=89182) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 12:27:34 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-6c43c66e-5744-48a9-acaa-07be065a1729 tempest-ProjectReaderTests-183788016 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:27:34 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-6c43c66e-5744-48a9-acaa-07be065a1729 tempest-ProjectReaderTests-183788016 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:27:34 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-6c43c66e-5744-48a9-acaa-07be065a1729 tempest-ProjectReaderTests-183788016 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:27:34 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-6c43c66e-5744-48a9-acaa-07be065a1729 tempest-ProjectReaderTests-183788016 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:27:34 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-6c43c66e-5744-48a9-acaa-07be065a1729 tempest-ProjectReaderTests-183788016 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:27:34 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-6c43c66e-5744-48a9-acaa-07be065a1729 tempest-ProjectReaderTests-183788016 None] Selected osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 as target Quobyte volume. {{(pid=89182) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 12:27:34 devstack cinder-volume[89182]: INFO cinder.volume.drivers.remotefs [None req-6c43c66e-5744-48a9-acaa-07be065a1729 tempest-ProjectReaderTests-183788016 None] casted to osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 Jul 31 12:27:34 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-6c43c66e-5744-48a9-acaa-07be065a1729 tempest-ProjectReaderTests-183788016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-99fbba4c-e28d-427d-94ce-86bd0c15d8c4 1073741824 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:27:34 devstack sudo[104346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-99fbba4c-e28d-427d-94ce-86bd0c15d8c4 1073741824 Jul 31 12:27:34 devstack sudo[104346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:27:34 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-e98e9329-384e-43c1-ab1e-9a39722fa5fe tempest-VolumesDeleteCascade-686353286 None] Create snapshot completed successfully Jul 31 12:27:35 devstack sudo[104346]: pam_unix(sudo:session): session closed for user root Jul 31 12:27:35 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-6c43c66e-5744-48a9-acaa-07be065a1729 tempest-ProjectReaderTests-183788016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-99fbba4c-e28d-427d-94ce-86bd0c15d8c4 1073741824" returned: 0 in 0.533s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:27:35 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-6c43c66e-5744-48a9-acaa-07be065a1729 tempest-ProjectReaderTests-183788016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-99fbba4c-e28d-427d-94ce-86bd0c15d8c4 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:27:35 devstack sudo[104352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-99fbba4c-e28d-427d-94ce-86bd0c15d8c4 Jul 31 12:27:35 devstack sudo[104352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:27:35 devstack sudo[104352]: pam_unix(sudo:session): session closed for user root Jul 31 12:27:35 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-6c43c66e-5744-48a9-acaa-07be065a1729 tempest-ProjectReaderTests-183788016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-99fbba4c-e28d-427d-94ce-86bd0c15d8c4" returned: 0 in 0.299s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:27:35 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-6c43c66e-5744-48a9-acaa-07be065a1729 tempest-ProjectReaderTests-183788016 None] <== create_volume: return (884ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'} {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 12:27:35 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-6c43c66e-5744-48a9-acaa-07be065a1729 tempest-ProjectReaderTests-183788016 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.887s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:27:35 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-6c43c66e-5744-48a9-acaa-07be065a1729 tempest-ProjectReaderTests-183788016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d6c50ee-4e5d-4b2e-adf9-c7ff20d64dc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-99fbba4c-e28d-427d-94ce-86bd0c15d8c4', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:27:35 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-6c43c66e-5744-48a9-acaa-07be065a1729 tempest-ProjectReaderTests-183788016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1011f64-0df9-4be4-8a74-f927cc6163a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:27:35 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-6c43c66e-5744-48a9-acaa-07be065a1729 tempest-ProjectReaderTests-183788016 None] Volume volume-99fbba4c-e28d-427d-94ce-86bd0c15d8c4 (99fbba4c-e28d-427d-94ce-86bd0c15d8c4): created successfully Jul 31 12:27:35 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-6c43c66e-5744-48a9-acaa-07be065a1729 tempest-ProjectReaderTests-183788016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1011f64-0df9-4be4-8a74-f927cc6163a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:27:35 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-6c43c66e-5744-48a9-acaa-07be065a1729 tempest-ProjectReaderTests-183788016 None] Flow 'volume_create_manager' (6b7ad677-1708-44e7-ba03-02887f73f8ae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:27:35 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-6c43c66e-5744-48a9-acaa-07be065a1729 tempest-ProjectReaderTests-183788016 None] Created volume successfully. Jul 31 12:27:35 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-b344404f-f013-484e-a82d-32f961f91190 tempest-VolumesDeleteCascade-686353286 None] Acquiring lock "cinder-e69673e7-93b9-4f39-a6db-30574a93b958-delete_volume" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:27:35 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-b344404f-f013-484e-a82d-32f961f91190 tempest-VolumesDeleteCascade-686353286 None] Lock "cinder-e69673e7-93b9-4f39-a6db-30574a93b958-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:27:35 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-b344404f-f013-484e-a82d-32f961f91190 tempest-VolumesDeleteCascade-686353286 None] Performing cascade delete. {{(pid=89182) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jul 31 12:27:35 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-b344404f-f013-484e-a82d-32f961f91190 tempest-VolumesDeleteCascade-686353286 None] Acquiring lock "cinder-55d90d4a-1114-4ec7-bac1-661b04c29711-delete_snapshot" by "delete_snapshot" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:27:35 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-452329bb-e4c5-476a-9e4e-f3638da01ac0 tempest-ProjectReaderTests-183788016 None] Acquiring lock "cinder-99fbba4c-e28d-427d-94ce-86bd0c15d8c4-delete_volume" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:27:35 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-b344404f-f013-484e-a82d-32f961f91190 tempest-VolumesDeleteCascade-686353286 None] Lock "cinder-55d90d4a-1114-4ec7-bac1-661b04c29711-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:27:36 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-452329bb-e4c5-476a-9e4e-f3638da01ac0 tempest-ProjectReaderTests-183788016 None] Lock "cinder-99fbba4c-e28d-427d-94ce-86bd0c15d8c4-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:27:36 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-b344404f-f013-484e-a82d-32f961f91190 tempest-VolumesDeleteCascade-686353286 None] Acquiring lock "cinder-quobyte-e69673e7-93b9-4f39-a6db-30574a93b958" by "delete_snapshot" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:27:36 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-b344404f-f013-484e-a82d-32f961f91190 tempest-VolumesDeleteCascade-686353286 None] Lock "cinder-quobyte-e69673e7-93b9-4f39-a6db-30574a93b958" acquired by "delete_snapshot" :: waited 0.024s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:27:36 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-b344404f-f013-484e-a82d-32f961f91190 tempest-VolumesDeleteCascade-686353286 None] Acquiring lock "cinder-quobyte-55d90d4a-1114-4ec7-bac1-661b04c29711" by "_delete_snapshot" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:27:36 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-452329bb-e4c5-476a-9e4e-f3638da01ac0 tempest-ProjectReaderTests-183788016 None] Acquiring lock "cinder-quobyte-99fbba4c-e28d-427d-94ce-86bd0c15d8c4" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:27:36 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-b344404f-f013-484e-a82d-32f961f91190 tempest-VolumesDeleteCascade-686353286 None] Lock "cinder-quobyte-55d90d4a-1114-4ec7-bac1-661b04c29711" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:27:36 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-b344404f-f013-484e-a82d-32f961f91190 tempest-VolumesDeleteCascade-686353286 None] Deleting offline snapshot 55d90d4a-1114-4ec7-bac1-661b04c29711 of volume e69673e7-93b9-4f39-a6db-30574a93b958 {{(pid=89182) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 31 12:27:36 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-b344404f-f013-484e-a82d-32f961f91190 tempest-VolumesDeleteCascade-686353286 None] snapshot_file for this snap is: volume-e69673e7-93b9-4f39-a6db-30574a93b958.55d90d4a-1114-4ec7-bac1-661b04c29711 {{(pid=89182) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 31 12:27:36 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-452329bb-e4c5-476a-9e4e-f3638da01ac0 tempest-ProjectReaderTests-183788016 None] Lock "cinder-quobyte-99fbba4c-e28d-427d-94ce-86bd0c15d8c4" acquired by "delete_volume" :: waited 0.053s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:27:36 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[314726c7-9c99-45a1-9a92-dabe3554134a]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:27:36 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-b344404f-f013-484e-a82d-32f961f91190 tempest-VolumesDeleteCascade-686353286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e69673e7-93b9-4f39-a6db-30574a93b958.55d90d4a-1114-4ec7-bac1-661b04c29711 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:27:36 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5b41e89-0e9c-4bc2-8ffc-a313fd7393b7]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:27:36 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-452329bb-e4c5-476a-9e4e-f3638da01ac0 tempest-ProjectReaderTests-183788016 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-99fbba4c-e28d-427d-94ce-86bd0c15d8c4 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:27:36 devstack sudo[104355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e69673e7-93b9-4f39-a6db-30574a93b958.55d90d4a-1114-4ec7-bac1-661b04c29711 Jul 31 12:27:36 devstack sudo[104355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:27:36 devstack sudo[104356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-99fbba4c-e28d-427d-94ce-86bd0c15d8c4 Jul 31 12:27:36 devstack sudo[104356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:27:36 devstack sudo[104355]: pam_unix(sudo:session): session closed for user root Jul 31 12:27:36 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-b344404f-f013-484e-a82d-32f961f91190 tempest-VolumesDeleteCascade-686353286 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e69673e7-93b9-4f39-a6db-30574a93b958.55d90d4a-1114-4ec7-bac1-661b04c29711" returned: 0 in 0.477s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:27:36 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-b344404f-f013-484e-a82d-32f961f91190 tempest-VolumesDeleteCascade-686353286 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e69673e7-93b9-4f39-a6db-30574a93b958(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89182) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 12:27:36 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[73a304cf-a159-4a95-8f22-0181cf4ccf76]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:27:36 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-b344404f-f013-484e-a82d-32f961f91190 tempest-VolumesDeleteCascade-686353286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e69673e7-93b9-4f39-a6db-30574a93b958.6b0ddbc8-7260-4206-94be-1705a042b595 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:27:36 devstack sudo[104356]: pam_unix(sudo:session): session closed for user root Jul 31 12:27:36 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-452329bb-e4c5-476a-9e4e-f3638da01ac0 tempest-ProjectReaderTests-183788016 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-99fbba4c-e28d-427d-94ce-86bd0c15d8c4" returned: 0 in 0.498s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:27:36 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-452329bb-e4c5-476a-9e4e-f3638da01ac0 tempest-ProjectReaderTests-183788016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-99fbba4c-e28d-427d-94ce-86bd0c15d8c4 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:27:36 devstack sudo[104367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-99fbba4c-e28d-427d-94ce-86bd0c15d8c4 Jul 31 12:27:36 devstack sudo[104367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:27:36 devstack sudo[104366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e69673e7-93b9-4f39-a6db-30574a93b958.6b0ddbc8-7260-4206-94be-1705a042b595 Jul 31 12:27:36 devstack sudo[104366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:27:36 devstack sudo[104367]: pam_unix(sudo:session): session closed for user root Jul 31 12:27:36 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-452329bb-e4c5-476a-9e4e-f3638da01ac0 tempest-ProjectReaderTests-183788016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-99fbba4c-e28d-427d-94ce-86bd0c15d8c4" returned: 0 in 0.324s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:27:36 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-452329bb-e4c5-476a-9e4e-f3638da01ac0 tempest-ProjectReaderTests-183788016 None] Lock "cinder-quobyte-99fbba4c-e28d-427d-94ce-86bd0c15d8c4" released by "delete_volume" :: held 0.880s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:27:37 devstack sudo[104366]: pam_unix(sudo:session): session closed for user root Jul 31 12:27:37 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-b344404f-f013-484e-a82d-32f961f91190 tempest-VolumesDeleteCascade-686353286 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e69673e7-93b9-4f39-a6db-30574a93b958.6b0ddbc8-7260-4206-94be-1705a042b595" returned: 0 in 0.404s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:27:37 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-b344404f-f013-484e-a82d-32f961f91190 tempest-VolumesDeleteCascade-686353286 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e69673e7-93b9-4f39-a6db-30574a93b958(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89182) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 12:27:37 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-b344404f-f013-484e-a82d-32f961f91190 tempest-VolumesDeleteCascade-686353286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e69673e7-93b9-4f39-a6db-30574a93b958.55d90d4a-1114-4ec7-bac1-661b04c29711 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:27:37 devstack sudo[104376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e69673e7-93b9-4f39-a6db-30574a93b958.55d90d4a-1114-4ec7-bac1-661b04c29711 Jul 31 12:27:37 devstack sudo[104376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:27:37 devstack cinder-volume[89182]: DEBUG cinder.quota [None req-452329bb-e4c5-476a-9e4e-f3638da01ac0 tempest-ProjectReaderTests-183788016 None] Created reservations ['95415898-b83e-43da-bf29-a7da318b9df2', '87cb81f0-d8aa-48dc-b37c-dc58dcbee7e0', 'dc04340e-d7ae-468b-915f-1bbdd60a1e4e', '07b76462-ff1e-428b-bad9-b133c7e2eb6e'] {{(pid=89182) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 12:27:37 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-452329bb-e4c5-476a-9e4e-f3638da01ac0 tempest-ProjectReaderTests-183788016 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:27:37 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-452329bb-e4c5-476a-9e4e-f3638da01ac0 tempest-ProjectReaderTests-183788016 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:27:37 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-452329bb-e4c5-476a-9e4e-f3638da01ac0 tempest-ProjectReaderTests-183788016 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:27:37 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-452329bb-e4c5-476a-9e4e-f3638da01ac0 tempest-ProjectReaderTests-183788016 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:27:37 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-452329bb-e4c5-476a-9e4e-f3638da01ac0 tempest-ProjectReaderTests-183788016 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:27:37 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-452329bb-e4c5-476a-9e4e-f3638da01ac0 tempest-ProjectReaderTests-183788016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:27:37 devstack sudo[104378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 Jul 31 12:27:37 devstack sudo[104378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:27:37 devstack sudo[104376]: pam_unix(sudo:session): session closed for user root Jul 31 12:27:37 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-b344404f-f013-484e-a82d-32f961f91190 tempest-VolumesDeleteCascade-686353286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e69673e7-93b9-4f39-a6db-30574a93b958.55d90d4a-1114-4ec7-bac1-661b04c29711" returned: 0 in 0.447s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:27:37 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-b344404f-f013-484e-a82d-32f961f91190 tempest-VolumesDeleteCascade-686353286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e69673e7-93b9-4f39-a6db-30574a93b958.55d90d4a-1114-4ec7-bac1-661b04c29711 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:27:37 devstack sudo[104378]: pam_unix(sudo:session): session closed for user root Jul 31 12:27:37 devstack sudo[104385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e69673e7-93b9-4f39-a6db-30574a93b958.55d90d4a-1114-4ec7-bac1-661b04c29711 Jul 31 12:27:37 devstack sudo[104385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:27:37 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-452329bb-e4c5-476a-9e4e-f3638da01ac0 tempest-ProjectReaderTests-183788016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2" returned: 0 in 0.316s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:27:37 devstack cinder-volume[89182]: DEBUG cinder.manager [None req-452329bb-e4c5-476a-9e4e-f3638da01ac0 tempest-ProjectReaderTests-183788016 None] Notifying Schedulers of capabilities ... {{(pid=89182) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 12:27:37 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-452329bb-e4c5-476a-9e4e-f3638da01ac0 tempest-ProjectReaderTests-183788016 None] Deleted volume successfully. Jul 31 12:27:37 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-452329bb-e4c5-476a-9e4e-f3638da01ac0 tempest-ProjectReaderTests-183788016 None] Lock "cinder-99fbba4c-e28d-427d-94ce-86bd0c15d8c4-delete_volume" released by "delete_volume" :: held 1.561s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:27:37 devstack sudo[104385]: pam_unix(sudo:session): session closed for user root Jul 31 12:27:37 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-b344404f-f013-484e-a82d-32f961f91190 tempest-VolumesDeleteCascade-686353286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e69673e7-93b9-4f39-a6db-30574a93b958.55d90d4a-1114-4ec7-bac1-661b04c29711" returned: 0 in 0.310s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:27:37 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-b344404f-f013-484e-a82d-32f961f91190 tempest-VolumesDeleteCascade-686353286 None] Lock "cinder-quobyte-55d90d4a-1114-4ec7-bac1-661b04c29711" released by "_delete_snapshot" :: held 1.757s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:27:37 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-b344404f-f013-484e-a82d-32f961f91190 tempest-VolumesDeleteCascade-686353286 None] Lock "cinder-quobyte-e69673e7-93b9-4f39-a6db-30574a93b958" released by "delete_snapshot" :: held 1.792s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:27:37 devstack cinder-volume[89182]: DEBUG cinder.quota [None req-b344404f-f013-484e-a82d-32f961f91190 tempest-VolumesDeleteCascade-686353286 None] Created reservations ['d028937a-e02f-45ae-ba2b-d55c31001674', 'dc34db95-a4c2-41d5-9268-91ed0c10851c', '394d4920-79d8-4dcc-a688-c5c2862c9db1', '1e8110aa-599b-4be0-bb5c-3aaa6d4aa5dc'] {{(pid=89182) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 12:27:37 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-b344404f-f013-484e-a82d-32f961f91190 tempest-VolumesDeleteCascade-686353286 None] Delete snapshot completed successfully. Jul 31 12:27:37 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-b344404f-f013-484e-a82d-32f961f91190 tempest-VolumesDeleteCascade-686353286 None] Lock "cinder-55d90d4a-1114-4ec7-bac1-661b04c29711-delete_snapshot" released by "delete_snapshot" :: held 1.993s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:27:37 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-b344404f-f013-484e-a82d-32f961f91190 tempest-VolumesDeleteCascade-686353286 None] Acquiring lock "cinder-6b0ddbc8-7260-4206-94be-1705a042b595-delete_snapshot" by "delete_snapshot" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:27:38 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-b344404f-f013-484e-a82d-32f961f91190 tempest-VolumesDeleteCascade-686353286 None] Lock "cinder-6b0ddbc8-7260-4206-94be-1705a042b595-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:27:38 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-b344404f-f013-484e-a82d-32f961f91190 tempest-VolumesDeleteCascade-686353286 None] Acquiring lock "cinder-quobyte-e69673e7-93b9-4f39-a6db-30574a93b958" by "delete_snapshot" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:27:38 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-b344404f-f013-484e-a82d-32f961f91190 tempest-VolumesDeleteCascade-686353286 None] Lock "cinder-quobyte-e69673e7-93b9-4f39-a6db-30574a93b958" acquired by "delete_snapshot" :: waited 0.016s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:27:38 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-b344404f-f013-484e-a82d-32f961f91190 tempest-VolumesDeleteCascade-686353286 None] Acquiring lock "cinder-quobyte-6b0ddbc8-7260-4206-94be-1705a042b595" by "_delete_snapshot" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:27:38 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-b344404f-f013-484e-a82d-32f961f91190 tempest-VolumesDeleteCascade-686353286 None] Lock "cinder-quobyte-6b0ddbc8-7260-4206-94be-1705a042b595" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:27:38 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-b344404f-f013-484e-a82d-32f961f91190 tempest-VolumesDeleteCascade-686353286 None] Deleting offline snapshot 6b0ddbc8-7260-4206-94be-1705a042b595 of volume e69673e7-93b9-4f39-a6db-30574a93b958 {{(pid=89182) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 31 12:27:38 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-b344404f-f013-484e-a82d-32f961f91190 tempest-VolumesDeleteCascade-686353286 None] snapshot_file for this snap is: volume-e69673e7-93b9-4f39-a6db-30574a93b958.6b0ddbc8-7260-4206-94be-1705a042b595 {{(pid=89182) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 31 12:27:38 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[aacb876a-3cbd-4501-b94c-6651a7c230e8]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:27:38 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-b344404f-f013-484e-a82d-32f961f91190 tempest-VolumesDeleteCascade-686353286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e69673e7-93b9-4f39-a6db-30574a93b958.6b0ddbc8-7260-4206-94be-1705a042b595 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:27:38 devstack sudo[104388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e69673e7-93b9-4f39-a6db-30574a93b958.6b0ddbc8-7260-4206-94be-1705a042b595 Jul 31 12:27:38 devstack sudo[104388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:27:38 devstack sudo[104388]: pam_unix(sudo:session): session closed for user root Jul 31 12:27:38 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-b344404f-f013-484e-a82d-32f961f91190 tempest-VolumesDeleteCascade-686353286 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e69673e7-93b9-4f39-a6db-30574a93b958.6b0ddbc8-7260-4206-94be-1705a042b595" returned: 0 in 0.565s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:27:38 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-b344404f-f013-484e-a82d-32f961f91190 tempest-VolumesDeleteCascade-686353286 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e69673e7-93b9-4f39-a6db-30574a93b958(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89182) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 12:27:38 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3b4ecb8-10d1-4706-88cb-c688e910d336]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:27:38 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-b344404f-f013-484e-a82d-32f961f91190 tempest-VolumesDeleteCascade-686353286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e69673e7-93b9-4f39-a6db-30574a93b958 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:27:38 devstack sudo[104427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e69673e7-93b9-4f39-a6db-30574a93b958 Jul 31 12:27:38 devstack sudo[104427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:27:39 devstack cinder-volume[89182]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ec109e6-44f0-435c-9296-3cb8f5a06b53 tempest-ProjectReaderTests-183788016 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89182) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 12:27:39 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-4ec109e6-44f0-435c-9296-3cb8f5a06b53 tempest-ProjectReaderTests-183788016 None] Flow 'volume_create_manager' (99c9c28b-4e2d-4704-af68-0f4d530c5215) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:27:39 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-4ec109e6-44f0-435c-9296-3cb8f5a06b53 tempest-ProjectReaderTests-183788016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5480f55a-a569-4c92-a01b-e43b6fc4e9c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:27:39 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-4ec109e6-44f0-435c-9296-3cb8f5a06b53 tempest-ProjectReaderTests-183788016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5480f55a-a569-4c92-a01b-e43b6fc4e9c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:27:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1618091770',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb522bb3-3390-4ea8-a67d-5837c8d79d24,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c9d7fd99aeb453796f13a3c2ef6933a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:27:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:27:39Z,use_quota=True,user_id='944dc9ae4795400995426b6a5c6e31af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:27:39 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-4ec109e6-44f0-435c-9296-3cb8f5a06b53 tempest-ProjectReaderTests-183788016 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98e75fb2-08a8-4447-a5c5-9d38432a2307) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:27:39 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-4ec109e6-44f0-435c-9296-3cb8f5a06b53 tempest-ProjectReaderTests-183788016 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98e75fb2-08a8-4447-a5c5-9d38432a2307) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:27:39 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-4ec109e6-44f0-435c-9296-3cb8f5a06b53 tempest-ProjectReaderTests-183788016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e3d00e3-11a0-4e53-bff8-f8e94d16f792) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:27:39 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-4ec109e6-44f0-435c-9296-3cb8f5a06b53 tempest-ProjectReaderTests-183788016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e3d00e3-11a0-4e53-bff8-f8e94d16f792) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cb522bb3-3390-4ea8-a67d-5837c8d79d24', 'volume_name': 'volume-cb522bb3-3390-4ea8-a67d-5837c8d79d24', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:27:39 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-4ec109e6-44f0-435c-9296-3cb8f5a06b53 tempest-ProjectReaderTests-183788016 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15898570-30d4-4b09-8eb5-d6015bd3d011) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:27:39 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-4ec109e6-44f0-435c-9296-3cb8f5a06b53 tempest-ProjectReaderTests-183788016 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15898570-30d4-4b09-8eb5-d6015bd3d011) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:27:39 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-4ec109e6-44f0-435c-9296-3cb8f5a06b53 tempest-ProjectReaderTests-183788016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f2e09c5-0876-4290-b79a-aa1127ec539e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:27:39 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-4ec109e6-44f0-435c-9296-3cb8f5a06b53 tempest-ProjectReaderTests-183788016 None] Volume cb522bb3-3390-4ea8-a67d-5837c8d79d24: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cb522bb3-3390-4ea8-a67d-5837c8d79d24', 'volume_size': 1} Jul 31 12:27:39 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-4ec109e6-44f0-435c-9296-3cb8f5a06b53 tempest-ProjectReaderTests-183788016 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:27:39 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-4ec109e6-44f0-435c-9296-3cb8f5a06b53 tempest-ProjectReaderTests-183788016 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:27:39 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-4ec109e6-44f0-435c-9296-3cb8f5a06b53 tempest-ProjectReaderTests-183788016 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:27:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1618091770',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb522bb3-3390-4ea8-a67d-5837c8d79d24,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c9d7fd99aeb453796f13a3c2ef6933a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:27:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:27:39Z,use_quota=True,user_id='944dc9ae4795400995426b6a5c6e31af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)}" {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 12:27:39 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-4ec109e6-44f0-435c-9296-3cb8f5a06b53 tempest-ProjectReaderTests-183788016 None] Creating volume cb522bb3-3390-4ea8-a67d-5837c8d79d24 {{(pid=89182) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 12:27:39 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-4ec109e6-44f0-435c-9296-3cb8f5a06b53 tempest-ProjectReaderTests-183788016 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:27:39 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-4ec109e6-44f0-435c-9296-3cb8f5a06b53 tempest-ProjectReaderTests-183788016 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:27:39 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-4ec109e6-44f0-435c-9296-3cb8f5a06b53 tempest-ProjectReaderTests-183788016 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:27:39 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-4ec109e6-44f0-435c-9296-3cb8f5a06b53 tempest-ProjectReaderTests-183788016 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:27:39 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-4ec109e6-44f0-435c-9296-3cb8f5a06b53 tempest-ProjectReaderTests-183788016 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:27:39 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-4ec109e6-44f0-435c-9296-3cb8f5a06b53 tempest-ProjectReaderTests-183788016 None] Selected osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 as target Quobyte volume. {{(pid=89182) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 12:27:39 devstack cinder-volume[89182]: INFO cinder.volume.drivers.remotefs [None req-4ec109e6-44f0-435c-9296-3cb8f5a06b53 tempest-ProjectReaderTests-183788016 None] casted to osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 Jul 31 12:27:39 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-4ec109e6-44f0-435c-9296-3cb8f5a06b53 tempest-ProjectReaderTests-183788016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-cb522bb3-3390-4ea8-a67d-5837c8d79d24 1073741824 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:27:39 devstack sudo[104434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-cb522bb3-3390-4ea8-a67d-5837c8d79d24 1073741824 Jul 31 12:27:39 devstack sudo[104434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:27:39 devstack sudo[104427]: pam_unix(sudo:session): session closed for user root Jul 31 12:27:39 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-b344404f-f013-484e-a82d-32f961f91190 tempest-VolumesDeleteCascade-686353286 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e69673e7-93b9-4f39-a6db-30574a93b958" returned: 0 in 0.558s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:27:39 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-b344404f-f013-484e-a82d-32f961f91190 tempest-VolumesDeleteCascade-686353286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e69673e7-93b9-4f39-a6db-30574a93b958.6b0ddbc8-7260-4206-94be-1705a042b595 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:27:39 devstack sudo[104436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e69673e7-93b9-4f39-a6db-30574a93b958.6b0ddbc8-7260-4206-94be-1705a042b595 Jul 31 12:27:39 devstack sudo[104436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:27:39 devstack sudo[104436]: pam_unix(sudo:session): session closed for user root Jul 31 12:27:39 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-b344404f-f013-484e-a82d-32f961f91190 tempest-VolumesDeleteCascade-686353286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e69673e7-93b9-4f39-a6db-30574a93b958.6b0ddbc8-7260-4206-94be-1705a042b595" returned: 0 in 0.434s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:27:39 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-b344404f-f013-484e-a82d-32f961f91190 tempest-VolumesDeleteCascade-686353286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e69673e7-93b9-4f39-a6db-30574a93b958.6b0ddbc8-7260-4206-94be-1705a042b595 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:27:39 devstack sudo[104434]: pam_unix(sudo:session): session closed for user root Jul 31 12:27:39 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-4ec109e6-44f0-435c-9296-3cb8f5a06b53 tempest-ProjectReaderTests-183788016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-cb522bb3-3390-4ea8-a67d-5837c8d79d24 1073741824" returned: 0 in 0.554s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:27:39 devstack sudo[104446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e69673e7-93b9-4f39-a6db-30574a93b958.6b0ddbc8-7260-4206-94be-1705a042b595 Jul 31 12:27:39 devstack sudo[104446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:27:39 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-4ec109e6-44f0-435c-9296-3cb8f5a06b53 tempest-ProjectReaderTests-183788016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-cb522bb3-3390-4ea8-a67d-5837c8d79d24 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:27:39 devstack sudo[104448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-cb522bb3-3390-4ea8-a67d-5837c8d79d24 Jul 31 12:27:39 devstack sudo[104448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:27:40 devstack sudo[104446]: pam_unix(sudo:session): session closed for user root Jul 31 12:27:40 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-b344404f-f013-484e-a82d-32f961f91190 tempest-VolumesDeleteCascade-686353286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e69673e7-93b9-4f39-a6db-30574a93b958.6b0ddbc8-7260-4206-94be-1705a042b595" returned: 0 in 0.321s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:27:40 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-b344404f-f013-484e-a82d-32f961f91190 tempest-VolumesDeleteCascade-686353286 None] Lock "cinder-quobyte-6b0ddbc8-7260-4206-94be-1705a042b595" released by "_delete_snapshot" :: held 2.018s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:27:40 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-b344404f-f013-484e-a82d-32f961f91190 tempest-VolumesDeleteCascade-686353286 None] Lock "cinder-quobyte-e69673e7-93b9-4f39-a6db-30574a93b958" released by "delete_snapshot" :: held 2.043s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:27:40 devstack sudo[104448]: pam_unix(sudo:session): session closed for user root Jul 31 12:27:40 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-4ec109e6-44f0-435c-9296-3cb8f5a06b53 tempest-ProjectReaderTests-183788016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-cb522bb3-3390-4ea8-a67d-5837c8d79d24" returned: 0 in 0.334s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:27:40 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-4ec109e6-44f0-435c-9296-3cb8f5a06b53 tempest-ProjectReaderTests-183788016 None] <== create_volume: return (939ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'} {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 12:27:40 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-4ec109e6-44f0-435c-9296-3cb8f5a06b53 tempest-ProjectReaderTests-183788016 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.943s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:27:40 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-4ec109e6-44f0-435c-9296-3cb8f5a06b53 tempest-ProjectReaderTests-183788016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f2e09c5-0876-4290-b79a-aa1127ec539e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cb522bb3-3390-4ea8-a67d-5837c8d79d24', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:27:40 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-4ec109e6-44f0-435c-9296-3cb8f5a06b53 tempest-ProjectReaderTests-183788016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c8b43d9-6d9b-40bd-ad0d-2d0315ac7eb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:27:40 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-4ec109e6-44f0-435c-9296-3cb8f5a06b53 tempest-ProjectReaderTests-183788016 None] Volume volume-cb522bb3-3390-4ea8-a67d-5837c8d79d24 (cb522bb3-3390-4ea8-a67d-5837c8d79d24): created successfully Jul 31 12:27:40 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-4ec109e6-44f0-435c-9296-3cb8f5a06b53 tempest-ProjectReaderTests-183788016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c8b43d9-6d9b-40bd-ad0d-2d0315ac7eb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:27:40 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-4ec109e6-44f0-435c-9296-3cb8f5a06b53 tempest-ProjectReaderTests-183788016 None] Flow 'volume_create_manager' (99c9c28b-4e2d-4704-af68-0f4d530c5215) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:27:40 devstack cinder-volume[89182]: DEBUG cinder.quota [None req-b344404f-f013-484e-a82d-32f961f91190 tempest-VolumesDeleteCascade-686353286 None] Created reservations ['7c096b71-2e1c-4ae8-ba4f-21953694301b', '8044cfa0-b987-4457-99b4-f36b7fca492d', 'da72a8ba-48e0-4f04-808c-377481858f8e', '43ef5304-6d07-4611-9350-42154eda5415'] {{(pid=89182) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 12:27:40 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-4ec109e6-44f0-435c-9296-3cb8f5a06b53 tempest-ProjectReaderTests-183788016 None] Created volume successfully. Jul 31 12:27:40 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-b344404f-f013-484e-a82d-32f961f91190 tempest-VolumesDeleteCascade-686353286 None] Delete snapshot completed successfully. Jul 31 12:27:40 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-b344404f-f013-484e-a82d-32f961f91190 tempest-VolumesDeleteCascade-686353286 None] Lock "cinder-6b0ddbc8-7260-4206-94be-1705a042b595-delete_snapshot" released by "delete_snapshot" :: held 2.262s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:27:40 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-b344404f-f013-484e-a82d-32f961f91190 tempest-VolumesDeleteCascade-686353286 None] Snapshots deleted, issuing volume delete {{(pid=89182) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jul 31 12:27:40 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-b344404f-f013-484e-a82d-32f961f91190 tempest-VolumesDeleteCascade-686353286 None] Acquiring lock "cinder-quobyte-e69673e7-93b9-4f39-a6db-30574a93b958" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:27:40 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-b344404f-f013-484e-a82d-32f961f91190 tempest-VolumesDeleteCascade-686353286 None] Lock "cinder-quobyte-e69673e7-93b9-4f39-a6db-30574a93b958" acquired by "delete_volume" :: waited 0.023s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:27:40 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[88b717cd-55a3-4172-a458-eff9f04a6ab6]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:27:40 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-b344404f-f013-484e-a82d-32f961f91190 tempest-VolumesDeleteCascade-686353286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e69673e7-93b9-4f39-a6db-30574a93b958 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:27:40 devstack sudo[104452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e69673e7-93b9-4f39-a6db-30574a93b958 Jul 31 12:27:40 devstack sudo[104452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:27:40 devstack sudo[104452]: pam_unix(sudo:session): session closed for user root Jul 31 12:27:40 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-b344404f-f013-484e-a82d-32f961f91190 tempest-VolumesDeleteCascade-686353286 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e69673e7-93b9-4f39-a6db-30574a93b958" returned: 0 in 0.395s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:27:40 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-b344404f-f013-484e-a82d-32f961f91190 tempest-VolumesDeleteCascade-686353286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e69673e7-93b9-4f39-a6db-30574a93b958 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:27:40 devstack sudo[104457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e69673e7-93b9-4f39-a6db-30574a93b958 Jul 31 12:27:40 devstack sudo[104457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:27:41 devstack sudo[104457]: pam_unix(sudo:session): session closed for user root Jul 31 12:27:41 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-b344404f-f013-484e-a82d-32f961f91190 tempest-VolumesDeleteCascade-686353286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e69673e7-93b9-4f39-a6db-30574a93b958" returned: 0 in 0.332s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:27:41 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-d358608e-8d2c-46c0-943a-83fee822e722 tempest-ProjectReaderTests-183788016 None] Acquiring lock "cinder-cb522bb3-3390-4ea8-a67d-5837c8d79d24-delete_volume" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:27:41 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-b344404f-f013-484e-a82d-32f961f91190 tempest-VolumesDeleteCascade-686353286 None] Lock "cinder-quobyte-e69673e7-93b9-4f39-a6db-30574a93b958" released by "delete_volume" :: held 0.826s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:27:41 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-d358608e-8d2c-46c0-943a-83fee822e722 tempest-ProjectReaderTests-183788016 None] Lock "cinder-cb522bb3-3390-4ea8-a67d-5837c8d79d24-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:27:41 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-d358608e-8d2c-46c0-943a-83fee822e722 tempest-ProjectReaderTests-183788016 None] Acquiring lock "cinder-quobyte-cb522bb3-3390-4ea8-a67d-5837c8d79d24" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:27:41 devstack cinder-volume[89182]: DEBUG cinder.quota [None req-b344404f-f013-484e-a82d-32f961f91190 tempest-VolumesDeleteCascade-686353286 None] Created reservations ['efdc4961-d2a9-41b9-8b8d-724a3863a489', '71e53e71-8731-431f-8231-53b657ff4d64', 'ec70b8de-a3eb-421c-a95f-10a1615c3c6e', 'f6db9c4c-33b9-401c-8544-17e2d008af79'] {{(pid=89182) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 12:27:41 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-d358608e-8d2c-46c0-943a-83fee822e722 tempest-ProjectReaderTests-183788016 None] Lock "cinder-quobyte-cb522bb3-3390-4ea8-a67d-5837c8d79d24" acquired by "delete_volume" :: waited 0.035s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:27:41 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcacef84-c1d8-48fa-b02a-55454b8f5bfd]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:27:41 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-d358608e-8d2c-46c0-943a-83fee822e722 tempest-ProjectReaderTests-183788016 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-cb522bb3-3390-4ea8-a67d-5837c8d79d24 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:27:41 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-b344404f-f013-484e-a82d-32f961f91190 tempest-VolumesDeleteCascade-686353286 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:27:41 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-b344404f-f013-484e-a82d-32f961f91190 tempest-VolumesDeleteCascade-686353286 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:27:41 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-b344404f-f013-484e-a82d-32f961f91190 tempest-VolumesDeleteCascade-686353286 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:27:41 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-b344404f-f013-484e-a82d-32f961f91190 tempest-VolumesDeleteCascade-686353286 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:27:41 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-b344404f-f013-484e-a82d-32f961f91190 tempest-VolumesDeleteCascade-686353286 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:27:41 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-b344404f-f013-484e-a82d-32f961f91190 tempest-VolumesDeleteCascade-686353286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:27:41 devstack sudo[104461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 Jul 31 12:27:41 devstack sudo[104461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:27:41 devstack sudo[104460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-cb522bb3-3390-4ea8-a67d-5837c8d79d24 Jul 31 12:27:41 devstack sudo[104460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:27:41 devstack sudo[104461]: pam_unix(sudo:session): session closed for user root Jul 31 12:27:41 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-b344404f-f013-484e-a82d-32f961f91190 tempest-VolumesDeleteCascade-686353286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2" returned: 0 in 0.341s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:27:41 devstack cinder-volume[89182]: DEBUG cinder.manager [None req-b344404f-f013-484e-a82d-32f961f91190 tempest-VolumesDeleteCascade-686353286 None] Notifying Schedulers of capabilities ... {{(pid=89182) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 12:27:41 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-b344404f-f013-484e-a82d-32f961f91190 tempest-VolumesDeleteCascade-686353286 None] Deleted volume successfully. Jul 31 12:27:41 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-b344404f-f013-484e-a82d-32f961f91190 tempest-VolumesDeleteCascade-686353286 None] Lock "cinder-e69673e7-93b9-4f39-a6db-30574a93b958-delete_volume" released by "delete_volume" :: held 5.873s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:27:41 devstack sudo[104460]: pam_unix(sudo:session): session closed for user root Jul 31 12:27:41 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-d358608e-8d2c-46c0-943a-83fee822e722 tempest-ProjectReaderTests-183788016 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-cb522bb3-3390-4ea8-a67d-5837c8d79d24" returned: 0 in 0.586s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:27:41 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-d358608e-8d2c-46c0-943a-83fee822e722 tempest-ProjectReaderTests-183788016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-cb522bb3-3390-4ea8-a67d-5837c8d79d24 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:27:41 devstack sudo[104468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-cb522bb3-3390-4ea8-a67d-5837c8d79d24 Jul 31 12:27:41 devstack sudo[104468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:27:42 devstack sudo[104468]: pam_unix(sudo:session): session closed for user root Jul 31 12:27:42 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-d358608e-8d2c-46c0-943a-83fee822e722 tempest-ProjectReaderTests-183788016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-cb522bb3-3390-4ea8-a67d-5837c8d79d24" returned: 0 in 0.420s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:27:42 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-d358608e-8d2c-46c0-943a-83fee822e722 tempest-ProjectReaderTests-183788016 None] Lock "cinder-quobyte-cb522bb3-3390-4ea8-a67d-5837c8d79d24" released by "delete_volume" :: held 1.078s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:27:42 devstack cinder-volume[89182]: DEBUG cinder.volume.flows.manager.create_volume [None req-2956fb2e-2e99-4c9d-9930-c8861f01bfef tempest-VolumesDeleteCascade-686353286 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89182) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 12:27:42 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-2956fb2e-2e99-4c9d-9930-c8861f01bfef tempest-VolumesDeleteCascade-686353286 None] Flow 'volume_create_manager' (a82c9ea2-97f1-4fb6-a96c-89c67a2c5cba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:27:42 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-2956fb2e-2e99-4c9d-9930-c8861f01bfef tempest-VolumesDeleteCascade-686353286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cdd6201c-2154-41fe-b78b-83fd45a903c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:27:42 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-2956fb2e-2e99-4c9d-9930-c8861f01bfef tempest-VolumesDeleteCascade-686353286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cdd6201c-2154-41fe-b78b-83fd45a903c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:27:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-60653958',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0de99573-1382-4b24-8a74-c5faf1727a9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22d4ed81133e4de7bc686b4670d05ef9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:27:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:27:42Z,use_quota=True,user_id='8f34a7438a064490a47de3ab977a33bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:27:42 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-2956fb2e-2e99-4c9d-9930-c8861f01bfef tempest-VolumesDeleteCascade-686353286 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (569e631e-6f81-487c-a13f-1aca0bab4ccf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:27:42 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-2956fb2e-2e99-4c9d-9930-c8861f01bfef tempest-VolumesDeleteCascade-686353286 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (569e631e-6f81-487c-a13f-1aca0bab4ccf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:27:42 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-2956fb2e-2e99-4c9d-9930-c8861f01bfef tempest-VolumesDeleteCascade-686353286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5406480e-b9f6-40de-81d8-2196c742cf43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:27:42 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-2956fb2e-2e99-4c9d-9930-c8861f01bfef tempest-VolumesDeleteCascade-686353286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5406480e-b9f6-40de-81d8-2196c742cf43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0de99573-1382-4b24-8a74-c5faf1727a9b', 'volume_name': 'volume-0de99573-1382-4b24-8a74-c5faf1727a9b', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:27:42 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-2956fb2e-2e99-4c9d-9930-c8861f01bfef tempest-VolumesDeleteCascade-686353286 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c53e256-569e-4fde-920d-6c4bfebb94ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:27:42 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-2956fb2e-2e99-4c9d-9930-c8861f01bfef tempest-VolumesDeleteCascade-686353286 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c53e256-569e-4fde-920d-6c4bfebb94ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:27:42 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-2956fb2e-2e99-4c9d-9930-c8861f01bfef tempest-VolumesDeleteCascade-686353286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d58e0db-bce7-4260-bddc-2506698f2c78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:27:42 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-2956fb2e-2e99-4c9d-9930-c8861f01bfef tempest-VolumesDeleteCascade-686353286 None] Volume 0de99573-1382-4b24-8a74-c5faf1727a9b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0de99573-1382-4b24-8a74-c5faf1727a9b', 'volume_size': 1} Jul 31 12:27:42 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-2956fb2e-2e99-4c9d-9930-c8861f01bfef tempest-VolumesDeleteCascade-686353286 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:27:42 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-2956fb2e-2e99-4c9d-9930-c8861f01bfef tempest-VolumesDeleteCascade-686353286 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:27:42 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-2956fb2e-2e99-4c9d-9930-c8861f01bfef tempest-VolumesDeleteCascade-686353286 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:27:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-60653958',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0de99573-1382-4b24-8a74-c5faf1727a9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22d4ed81133e4de7bc686b4670d05ef9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:27:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:27:42Z,use_quota=True,user_id='8f34a7438a064490a47de3ab977a33bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)}" {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 12:27:42 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-2956fb2e-2e99-4c9d-9930-c8861f01bfef tempest-VolumesDeleteCascade-686353286 None] Creating volume 0de99573-1382-4b24-8a74-c5faf1727a9b {{(pid=89182) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 12:27:42 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-2956fb2e-2e99-4c9d-9930-c8861f01bfef tempest-VolumesDeleteCascade-686353286 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:27:42 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-2956fb2e-2e99-4c9d-9930-c8861f01bfef tempest-VolumesDeleteCascade-686353286 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:27:42 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-2956fb2e-2e99-4c9d-9930-c8861f01bfef tempest-VolumesDeleteCascade-686353286 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:27:42 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-2956fb2e-2e99-4c9d-9930-c8861f01bfef tempest-VolumesDeleteCascade-686353286 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:27:42 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-2956fb2e-2e99-4c9d-9930-c8861f01bfef tempest-VolumesDeleteCascade-686353286 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:27:42 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-2956fb2e-2e99-4c9d-9930-c8861f01bfef tempest-VolumesDeleteCascade-686353286 None] Selected osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 as target Quobyte volume. {{(pid=89182) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 12:27:42 devstack cinder-volume[89182]: INFO cinder.volume.drivers.remotefs [None req-2956fb2e-2e99-4c9d-9930-c8861f01bfef tempest-VolumesDeleteCascade-686353286 None] casted to osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 Jul 31 12:27:42 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-2956fb2e-2e99-4c9d-9930-c8861f01bfef tempest-VolumesDeleteCascade-686353286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0de99573-1382-4b24-8a74-c5faf1727a9b 1073741824 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:27:42 devstack sudo[104471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0de99573-1382-4b24-8a74-c5faf1727a9b 1073741824 Jul 31 12:27:42 devstack sudo[104471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:27:42 devstack cinder-volume[89182]: DEBUG cinder.quota [None req-d358608e-8d2c-46c0-943a-83fee822e722 tempest-ProjectReaderTests-183788016 None] Created reservations ['ef965376-9b3f-4ce2-a0be-4c7da4c661f1', '95e5defa-de2c-4ad9-894b-70c14445bee8', '436a1a71-dd22-4c49-8ab4-727715739eb9', '44d240b3-412a-49b4-a0e1-9ef2df8a4f28'] {{(pid=89182) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 12:27:42 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-d358608e-8d2c-46c0-943a-83fee822e722 tempest-ProjectReaderTests-183788016 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:27:42 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-d358608e-8d2c-46c0-943a-83fee822e722 tempest-ProjectReaderTests-183788016 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:27:42 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-d358608e-8d2c-46c0-943a-83fee822e722 tempest-ProjectReaderTests-183788016 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:27:42 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-d358608e-8d2c-46c0-943a-83fee822e722 tempest-ProjectReaderTests-183788016 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:27:42 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-d358608e-8d2c-46c0-943a-83fee822e722 tempest-ProjectReaderTests-183788016 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:27:42 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-d358608e-8d2c-46c0-943a-83fee822e722 tempest-ProjectReaderTests-183788016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:27:42 devstack sudo[104473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 Jul 31 12:27:42 devstack sudo[104473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:27:42 devstack sudo[104473]: pam_unix(sudo:session): session closed for user root Jul 31 12:27:42 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-d358608e-8d2c-46c0-943a-83fee822e722 tempest-ProjectReaderTests-183788016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2" returned: 0 in 0.292s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:27:42 devstack cinder-volume[89182]: DEBUG cinder.manager [None req-d358608e-8d2c-46c0-943a-83fee822e722 tempest-ProjectReaderTests-183788016 None] Notifying Schedulers of capabilities ... {{(pid=89182) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 12:27:42 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-d358608e-8d2c-46c0-943a-83fee822e722 tempest-ProjectReaderTests-183788016 None] Deleted volume successfully. Jul 31 12:27:42 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-d358608e-8d2c-46c0-943a-83fee822e722 tempest-ProjectReaderTests-183788016 None] Lock "cinder-cb522bb3-3390-4ea8-a67d-5837c8d79d24-delete_volume" released by "delete_volume" :: held 1.801s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:27:43 devstack sudo[104471]: pam_unix(sudo:session): session closed for user root Jul 31 12:27:43 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-2956fb2e-2e99-4c9d-9930-c8861f01bfef tempest-VolumesDeleteCascade-686353286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0de99573-1382-4b24-8a74-c5faf1727a9b 1073741824" returned: 0 in 0.612s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:27:43 devstack cinder-volume[89182]: DEBUG cinder.volume.flows.manager.create_volume [None req-1dc69117-9167-47c1-be29-e67a1fab0bf4 tempest-VolumeAndVolumeTypeFromImageTest-1671639501 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89182) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 12:27:43 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-1dc69117-9167-47c1-be29-e67a1fab0bf4 tempest-VolumeAndVolumeTypeFromImageTest-1671639501 None] Flow 'volume_create_manager' (8989f9a3-5f35-41b4-ae06-c92b7943e71a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:27:43 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-1dc69117-9167-47c1-be29-e67a1fab0bf4 tempest-VolumeAndVolumeTypeFromImageTest-1671639501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6eeea4b-b76c-4a37-afb9-0eb1186390f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:27:43 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-1dc69117-9167-47c1-be29-e67a1fab0bf4 tempest-VolumeAndVolumeTypeFromImageTest-1671639501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6eeea4b-b76c-4a37-afb9-0eb1186390f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:27:43Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34e190c1-2337-46d4-b060-07a560018f3e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52df8409c336418ba529d4af6f8c8ec5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:27:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:27:43Z,use_quota=True,user_id='b66ea0b6adcc424ab8df21f3b7e55c63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cd7d4f73-df4d-41a2-b57a-7cb5058a4b4c),volume_type_id=cd7d4f73-df4d-41a2-b57a-7cb5058a4b4c)' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:27:43 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-1dc69117-9167-47c1-be29-e67a1fab0bf4 tempest-VolumeAndVolumeTypeFromImageTest-1671639501 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f02c0350-5f15-4d06-a7e6-dd50fee3fc28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:27:43 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-1dc69117-9167-47c1-be29-e67a1fab0bf4 tempest-VolumeAndVolumeTypeFromImageTest-1671639501 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f02c0350-5f15-4d06-a7e6-dd50fee3fc28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:27:43 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-1dc69117-9167-47c1-be29-e67a1fab0bf4 tempest-VolumeAndVolumeTypeFromImageTest-1671639501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5b3910c-1e00-4aa2-a2b2-368fcec8b47e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:27:43 devstack cinder-volume[89182]: DEBUG cinder.image.glance [None req-1dc69117-9167-47c1-be29-e67a1fab0bf4 tempest-VolumeAndVolumeTypeFromImageTest-1671639501 None] Creating Keystone auth plugin from conf {{(pid=89182) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 31 12:27:43 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-2956fb2e-2e99-4c9d-9930-c8861f01bfef tempest-VolumesDeleteCascade-686353286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0de99573-1382-4b24-8a74-c5faf1727a9b {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:27:43 devstack sudo[104480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0de99573-1382-4b24-8a74-c5faf1727a9b Jul 31 12:27:43 devstack sudo[104480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:27:43 devstack sudo[104480]: pam_unix(sudo:session): session closed for user root Jul 31 12:27:43 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-2956fb2e-2e99-4c9d-9930-c8861f01bfef tempest-VolumesDeleteCascade-686353286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0de99573-1382-4b24-8a74-c5faf1727a9b" returned: 0 in 0.323s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:27:43 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-2956fb2e-2e99-4c9d-9930-c8861f01bfef tempest-VolumesDeleteCascade-686353286 None] <== create_volume: return (1046ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'} {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 12:27:43 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-2956fb2e-2e99-4c9d-9930-c8861f01bfef tempest-VolumesDeleteCascade-686353286 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.050s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:27:43 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-2956fb2e-2e99-4c9d-9930-c8861f01bfef tempest-VolumesDeleteCascade-686353286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d58e0db-bce7-4260-bddc-2506698f2c78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0de99573-1382-4b24-8a74-c5faf1727a9b', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:27:43 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-2956fb2e-2e99-4c9d-9930-c8861f01bfef tempest-VolumesDeleteCascade-686353286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72c5aa1c-93c3-4cc9-949c-ec568fd8876d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:27:43 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-2956fb2e-2e99-4c9d-9930-c8861f01bfef tempest-VolumesDeleteCascade-686353286 None] Volume volume-0de99573-1382-4b24-8a74-c5faf1727a9b (0de99573-1382-4b24-8a74-c5faf1727a9b): created successfully Jul 31 12:27:43 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-2956fb2e-2e99-4c9d-9930-c8861f01bfef tempest-VolumesDeleteCascade-686353286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72c5aa1c-93c3-4cc9-949c-ec568fd8876d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:27:43 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-2956fb2e-2e99-4c9d-9930-c8861f01bfef tempest-VolumesDeleteCascade-686353286 None] Flow 'volume_create_manager' (a82c9ea2-97f1-4fb6-a96c-89c67a2c5cba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:27:43 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-2956fb2e-2e99-4c9d-9930-c8861f01bfef tempest-VolumesDeleteCascade-686353286 None] Created volume successfully. Jul 31 12:27:43 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-1dc69117-9167-47c1-be29-e67a1fab0bf4 tempest-VolumeAndVolumeTypeFromImageTest-1671639501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5b3910c-1e00-4aa2-a2b2-368fcec8b47e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '34e190c1-2337-46d4-b060-07a560018f3e', 'volume_name': 'volume-34e190c1-2337-46d4-b060-07a560018f3e', 'volume_size': 1, 'image_id': '4ad7d475-7141-43f6-89f6-536fca5534e5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4ad7d475-7141-43f6-89f6-536fca5534e5', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '2c0bde1f162a2b457ec4bde69aa4e5f8', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '52df8409c336418ba529d4af6f8c8ec5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '82878017b73ff4076ef4e7f3271f529d28ebb19d7d7988e8b68b3dabdec6bf90da33b80a4df37f979069b1e5d56fff283679ed67b6025e00e490ad1953fd14fb', 'id': '4ad7d475-7141-43f6-89f6-536fca5534e5', 'created_at': datetime.datetime(2026, 7, 31, 10, 27, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 31, 10, 27, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4ad7d475-7141-43f6-89f6-536fca5534e5/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:27:43 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-1dc69117-9167-47c1-be29-e67a1fab0bf4 tempest-VolumeAndVolumeTypeFromImageTest-1671639501 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6baec6fd-a848-44ec-a9dd-46c55ad755e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:27:43 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-1dc69117-9167-47c1-be29-e67a1fab0bf4 tempest-VolumeAndVolumeTypeFromImageTest-1671639501 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6baec6fd-a848-44ec-a9dd-46c55ad755e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:27:43 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-1dc69117-9167-47c1-be29-e67a1fab0bf4 tempest-VolumeAndVolumeTypeFromImageTest-1671639501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (453295b1-48a8-442c-b449-0d491cc96d90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:27:43 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-1dc69117-9167-47c1-be29-e67a1fab0bf4 tempest-VolumeAndVolumeTypeFromImageTest-1671639501 None] Volume 34e190c1-2337-46d4-b060-07a560018f3e: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-34e190c1-2337-46d4-b060-07a560018f3e', 'volume_size': 1, 'image_id': '4ad7d475-7141-43f6-89f6-536fca5534e5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4ad7d475-7141-43f6-89f6-536fca5534e5', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '2c0bde1f162a2b457ec4bde69aa4e5f8', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '52df8409c336418ba529d4af6f8c8ec5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '82878017b73ff4076ef4e7f3271f529d28ebb19d7d7988e8b68b3dabdec6bf90da33b80a4df37f979069b1e5d56fff283679ed67b6025e00e490ad1953fd14fb', 'id': '4ad7d475-7141-43f6-89f6-536fca5534e5', 'created_at': datetime.datetime(2026, 7, 31, 10, 27, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 31, 10, 27, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4ad7d475-7141-43f6-89f6-536fca5534e5/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jul 31 12:27:43 devstack cinder-volume[89182]: DEBUG cinder.volume.flows.manager.create_volume [None req-1dc69117-9167-47c1-be29-e67a1fab0bf4 tempest-VolumeAndVolumeTypeFromImageTest-1671639501 None] Trying to clone 34e190c1-2337-46d4-b060-07a560018f3e from image 4ad7d475-7141-43f6-89f6-536fca5534e5 at location (None, [{'url': 'file:///opt/stack/data/glance/images/4ad7d475-7141-43f6-89f6-536fca5534e5', 'metadata': {}}]). {{(pid=89182) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 31 12:27:43 devstack cinder-volume[89182]: DEBUG cinder.image.image_utils [None req-1dc69117-9167-47c1-be29-e67a1fab0bf4 tempest-VolumeAndVolumeTypeFromImageTest-1671639501 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_4ad7d475-7141-43f6-89f6-536fca5534e5_dh6ayzrydevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=89182) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 31 12:27:43 devstack cinder-volume[89182]: INFO cinder.image.image_utils [None req-1dc69117-9167-47c1-be29-e67a1fab0bf4 tempest-VolumeAndVolumeTypeFromImageTest-1671639501 None] Image download 0.00 MB at 0.00 MB/s Jul 31 12:27:43 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fafda5e-681c-4609-95b6-e02c47c4aa40]: (4, 'raw') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:27:43 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-1dc69117-9167-47c1-be29-e67a1fab0bf4 tempest-VolumeAndVolumeTypeFromImageTest-1671639501 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4ad7d475-7141-43f6-89f6-536fca5534e5_dh6ayzrydevstack@QuobyteHD {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:27:44 devstack cinder-volume[89182]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a568c9c-6a31-40cf-9aec-d36c57d615c1 tempest-ProjectReaderTests-183788016 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89182) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 12:27:44 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-0a568c9c-6a31-40cf-9aec-d36c57d615c1 tempest-ProjectReaderTests-183788016 None] Flow 'volume_create_manager' (1531c4c8-4c97-4fa4-8bc5-d3e993183d59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:27:44 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-0a568c9c-6a31-40cf-9aec-d36c57d615c1 tempest-ProjectReaderTests-183788016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3828bbf-0a5c-4cac-b04c-3a482eecaec6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:27:44 devstack sudo[104483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4ad7d475-7141-43f6-89f6-536fca5534e5_dh6ayzrydevstack@QuobyteHD Jul 31 12:27:44 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-0a568c9c-6a31-40cf-9aec-d36c57d615c1 tempest-ProjectReaderTests-183788016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3828bbf-0a5c-4cac-b04c-3a482eecaec6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:27:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1885825368',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8193832e-7d4e-4288-9699-097fb0585218,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c9d7fd99aeb453796f13a3c2ef6933a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:27:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:27:44Z,use_quota=True,user_id='944dc9ae4795400995426b6a5c6e31af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:27:44 devstack sudo[104483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:27:44 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-0a568c9c-6a31-40cf-9aec-d36c57d615c1 tempest-ProjectReaderTests-183788016 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3daf6e86-6f3b-4ced-be17-6065c0572e81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:27:44 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-0a568c9c-6a31-40cf-9aec-d36c57d615c1 tempest-ProjectReaderTests-183788016 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3daf6e86-6f3b-4ced-be17-6065c0572e81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:27:44 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-0a568c9c-6a31-40cf-9aec-d36c57d615c1 tempest-ProjectReaderTests-183788016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41d0de65-98a5-4d03-9a52-f847530486b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:27:44 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-0a568c9c-6a31-40cf-9aec-d36c57d615c1 tempest-ProjectReaderTests-183788016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41d0de65-98a5-4d03-9a52-f847530486b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8193832e-7d4e-4288-9699-097fb0585218', 'volume_name': 'volume-8193832e-7d4e-4288-9699-097fb0585218', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:27:44 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-0a568c9c-6a31-40cf-9aec-d36c57d615c1 tempest-ProjectReaderTests-183788016 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ea42a50-62f0-43e4-a8c4-ec88d4723ccb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:27:44 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-0a568c9c-6a31-40cf-9aec-d36c57d615c1 tempest-ProjectReaderTests-183788016 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ea42a50-62f0-43e4-a8c4-ec88d4723ccb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:27:44 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-0a568c9c-6a31-40cf-9aec-d36c57d615c1 tempest-ProjectReaderTests-183788016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4815933d-ff0a-4e4c-9956-fd720dfe4996) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:27:44 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-0a568c9c-6a31-40cf-9aec-d36c57d615c1 tempest-ProjectReaderTests-183788016 None] Volume 8193832e-7d4e-4288-9699-097fb0585218: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8193832e-7d4e-4288-9699-097fb0585218', 'volume_size': 1} Jul 31 12:27:44 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-0a568c9c-6a31-40cf-9aec-d36c57d615c1 tempest-ProjectReaderTests-183788016 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:27:44 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-0a568c9c-6a31-40cf-9aec-d36c57d615c1 tempest-ProjectReaderTests-183788016 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:27:44 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-0a568c9c-6a31-40cf-9aec-d36c57d615c1 tempest-ProjectReaderTests-183788016 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:27:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1885825368',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8193832e-7d4e-4288-9699-097fb0585218,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c9d7fd99aeb453796f13a3c2ef6933a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:27:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:27:44Z,use_quota=True,user_id='944dc9ae4795400995426b6a5c6e31af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)}" {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 12:27:44 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-0a568c9c-6a31-40cf-9aec-d36c57d615c1 tempest-ProjectReaderTests-183788016 None] Creating volume 8193832e-7d4e-4288-9699-097fb0585218 {{(pid=89182) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 12:27:44 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-0a568c9c-6a31-40cf-9aec-d36c57d615c1 tempest-ProjectReaderTests-183788016 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:27:44 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-0a568c9c-6a31-40cf-9aec-d36c57d615c1 tempest-ProjectReaderTests-183788016 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:27:44 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-0a568c9c-6a31-40cf-9aec-d36c57d615c1 tempest-ProjectReaderTests-183788016 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:27:44 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-0a568c9c-6a31-40cf-9aec-d36c57d615c1 tempest-ProjectReaderTests-183788016 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:27:44 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-0a568c9c-6a31-40cf-9aec-d36c57d615c1 tempest-ProjectReaderTests-183788016 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:27:44 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-0a568c9c-6a31-40cf-9aec-d36c57d615c1 tempest-ProjectReaderTests-183788016 None] Selected osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 as target Quobyte volume. {{(pid=89182) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 12:27:44 devstack cinder-volume[89182]: INFO cinder.volume.drivers.remotefs [None req-0a568c9c-6a31-40cf-9aec-d36c57d615c1 tempest-ProjectReaderTests-183788016 None] casted to osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 Jul 31 12:27:44 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-0a568c9c-6a31-40cf-9aec-d36c57d615c1 tempest-ProjectReaderTests-183788016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-8193832e-7d4e-4288-9699-097fb0585218 1073741824 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:27:44 devstack sudo[104485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-8193832e-7d4e-4288-9699-097fb0585218 1073741824 Jul 31 12:27:44 devstack sudo[104485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:27:44 devstack sudo[104483]: pam_unix(sudo:session): session closed for user root Jul 31 12:27:44 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-1dc69117-9167-47c1-be29-e67a1fab0bf4 tempest-VolumeAndVolumeTypeFromImageTest-1671639501 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4ad7d475-7141-43f6-89f6-536fca5534e5_dh6ayzrydevstack@QuobyteHD" returned: 0 in 0.410s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:27:44 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-1dc69117-9167-47c1-be29-e67a1fab0bf4 tempest-VolumeAndVolumeTypeFromImageTest-1671639501 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4ad7d475-7141-43f6-89f6-536fca5534e5_dh6ayzrydevstack@QuobyteHD {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:27:44 devstack sudo[104489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4ad7d475-7141-43f6-89f6-536fca5534e5_dh6ayzrydevstack@QuobyteHD Jul 31 12:27:44 devstack sudo[104489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:27:44 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-d26cb1c2-c61a-4c53-ba77-83ed47bf566d tempest-VolumesDeleteCascade-686353286 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:27:44 devstack sudo[104485]: pam_unix(sudo:session): session closed for user root Jul 31 12:27:44 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-0a568c9c-6a31-40cf-9aec-d36c57d615c1 tempest-ProjectReaderTests-183788016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-8193832e-7d4e-4288-9699-097fb0585218 1073741824" returned: 0 in 0.601s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:27:44 devstack sudo[104489]: pam_unix(sudo:session): session closed for user root Jul 31 12:27:44 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-1dc69117-9167-47c1-be29-e67a1fab0bf4 tempest-VolumeAndVolumeTypeFromImageTest-1671639501 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4ad7d475-7141-43f6-89f6-536fca5534e5_dh6ayzrydevstack@QuobyteHD" returned: 1 in 0.403s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:27:44 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-1dc69117-9167-47c1-be29-e67a1fab0bf4 tempest-VolumeAndVolumeTypeFromImageTest-1671639501 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4ad7d475-7141-43f6-89f6-536fca5534e5_dh6ayzrydevstack@QuobyteHD' failed. Not Retrying. {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 31 12:27:44 devstack cinder-volume[89182]: DEBUG cinder.image.image_utils [None req-1dc69117-9167-47c1-be29-e67a1fab0bf4 tempest-VolumeAndVolumeTypeFromImageTest-1671639501 None] Temporary image 4ad7d475-7141-43f6-89f6-536fca5534e5 is fetched for user b66ea0b6adcc424ab8df21f3b7e55c63. {{(pid=89182) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 31 12:27:44 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-0a568c9c-6a31-40cf-9aec-d36c57d615c1 tempest-ProjectReaderTests-183788016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-8193832e-7d4e-4288-9699-097fb0585218 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:27:44 devstack sudo[104499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-8193832e-7d4e-4288-9699-097fb0585218 Jul 31 12:27:44 devstack sudo[104499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:27:44 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[91d6dbcd-ffd4-41cc-a0db-85e364d70663]: (4, 'raw') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:27:44 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-1dc69117-9167-47c1-be29-e67a1fab0bf4 tempest-VolumeAndVolumeTypeFromImageTest-1671639501 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4ad7d475-7141-43f6-89f6-536fca5534e5_dh6ayzrydevstack@QuobyteHD {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:27:44 devstack sudo[104501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4ad7d475-7141-43f6-89f6-536fca5534e5_dh6ayzrydevstack@QuobyteHD Jul 31 12:27:44 devstack sudo[104501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:27:45 devstack sudo[104499]: pam_unix(sudo:session): session closed for user root Jul 31 12:27:45 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-0a568c9c-6a31-40cf-9aec-d36c57d615c1 tempest-ProjectReaderTests-183788016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-8193832e-7d4e-4288-9699-097fb0585218" returned: 0 in 0.273s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:27:45 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-0a568c9c-6a31-40cf-9aec-d36c57d615c1 tempest-ProjectReaderTests-183788016 None] <== create_volume: return (925ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'} {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 12:27:45 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-0a568c9c-6a31-40cf-9aec-d36c57d615c1 tempest-ProjectReaderTests-183788016 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.929s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:27:45 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-d26cb1c2-c61a-4c53-ba77-83ed47bf566d tempest-VolumesDeleteCascade-686353286 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.360s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:27:45 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-0a568c9c-6a31-40cf-9aec-d36c57d615c1 tempest-ProjectReaderTests-183788016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4815933d-ff0a-4e4c-9956-fd720dfe4996) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8193832e-7d4e-4288-9699-097fb0585218', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:27:45 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-0a568c9c-6a31-40cf-9aec-d36c57d615c1 tempest-ProjectReaderTests-183788016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82f2f4d0-248f-499e-9756-8d0069f6111b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:27:45 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-d26cb1c2-c61a-4c53-ba77-83ed47bf566d tempest-VolumesDeleteCascade-686353286 None] Creating offline snapshot 533cfeab-873c-4302-bb16-1ec06e755d7e of volume 0de99573-1382-4b24-8a74-c5faf1727a9b {{(pid=89182) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 31 12:27:45 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-0a568c9c-6a31-40cf-9aec-d36c57d615c1 tempest-ProjectReaderTests-183788016 None] Volume volume-8193832e-7d4e-4288-9699-097fb0585218 (8193832e-7d4e-4288-9699-097fb0585218): created successfully Jul 31 12:27:45 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-0a568c9c-6a31-40cf-9aec-d36c57d615c1 tempest-ProjectReaderTests-183788016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82f2f4d0-248f-499e-9756-8d0069f6111b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:27:45 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-0a568c9c-6a31-40cf-9aec-d36c57d615c1 tempest-ProjectReaderTests-183788016 None] Flow 'volume_create_manager' (1531c4c8-4c97-4fa4-8bc5-d3e993183d59) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:27:45 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[55d165a7-f3a2-4235-b0d2-fd9e02aac72f]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:27:45 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-d26cb1c2-c61a-4c53-ba77-83ed47bf566d tempest-VolumesDeleteCascade-686353286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0de99573-1382-4b24-8a74-c5faf1727a9b {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:27:45 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-0a568c9c-6a31-40cf-9aec-d36c57d615c1 tempest-ProjectReaderTests-183788016 None] Created volume successfully. Jul 31 12:27:45 devstack sudo[104501]: pam_unix(sudo:session): session closed for user root Jul 31 12:27:45 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-1dc69117-9167-47c1-be29-e67a1fab0bf4 tempest-VolumeAndVolumeTypeFromImageTest-1671639501 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4ad7d475-7141-43f6-89f6-536fca5534e5_dh6ayzrydevstack@QuobyteHD" returned: 0 in 0.378s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:27:45 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-1dc69117-9167-47c1-be29-e67a1fab0bf4 tempest-VolumeAndVolumeTypeFromImageTest-1671639501 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4ad7d475-7141-43f6-89f6-536fca5534e5_dh6ayzrydevstack@QuobyteHD {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:27:45 devstack sudo[104504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0de99573-1382-4b24-8a74-c5faf1727a9b Jul 31 12:27:45 devstack sudo[104504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:27:45 devstack sudo[104507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4ad7d475-7141-43f6-89f6-536fca5534e5_dh6ayzrydevstack@QuobyteHD Jul 31 12:27:45 devstack sudo[104507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:27:45 devstack sudo[104504]: pam_unix(sudo:session): session closed for user root Jul 31 12:27:45 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-d26cb1c2-c61a-4c53-ba77-83ed47bf566d tempest-VolumesDeleteCascade-686353286 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0de99573-1382-4b24-8a74-c5faf1727a9b" returned: 0 in 0.453s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:27:45 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-d26cb1c2-c61a-4c53-ba77-83ed47bf566d tempest-VolumesDeleteCascade-686353286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0de99573-1382-4b24-8a74-c5faf1727a9b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0de99573-1382-4b24-8a74-c5faf1727a9b.533cfeab-873c-4302-bb16-1ec06e755d7e 1G {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:27:45 devstack sudo[104507]: pam_unix(sudo:session): session closed for user root Jul 31 12:27:45 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-1dc69117-9167-47c1-be29-e67a1fab0bf4 tempest-VolumeAndVolumeTypeFromImageTest-1671639501 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4ad7d475-7141-43f6-89f6-536fca5534e5_dh6ayzrydevstack@QuobyteHD" returned: 1 in 0.376s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:27:45 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-1dc69117-9167-47c1-be29-e67a1fab0bf4 tempest-VolumeAndVolumeTypeFromImageTest-1671639501 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4ad7d475-7141-43f6-89f6-536fca5534e5_dh6ayzrydevstack@QuobyteHD' failed. Not Retrying. {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 31 12:27:45 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-1dc69117-9167-47c1-be29-e67a1fab0bf4 tempest-VolumeAndVolumeTypeFromImageTest-1671639501 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:27:45 devstack sudo[104516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0de99573-1382-4b24-8a74-c5faf1727a9b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0de99573-1382-4b24-8a74-c5faf1727a9b.533cfeab-873c-4302-bb16-1ec06e755d7e 1G Jul 31 12:27:45 devstack sudo[104516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:27:45 devstack cinder-volume[89182]: DEBUG cinder.volume.flows.manager.create_volume [None req-e4f659a3-98b6-4fb9-8323-5237aa247915 tempest-VolumeTypesAccessTest-1330704345 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89182) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 12:27:45 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-e4f659a3-98b6-4fb9-8323-5237aa247915 tempest-VolumeTypesAccessTest-1330704345 None] Flow 'volume_create_manager' (84741efb-d46b-48d4-9fca-1d39a56d7a93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:27:45 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-e4f659a3-98b6-4fb9-8323-5237aa247915 tempest-VolumeTypesAccessTest-1330704345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17c1f561-55cb-482b-9cf0-c986e86b48ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:27:45 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-e4f659a3-98b6-4fb9-8323-5237aa247915 tempest-VolumeTypesAccessTest-1330704345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17c1f561-55cb-482b-9cf0-c986e86b48ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:27:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-102969674',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56cb36f3-fd44-4b25-98ef-634eadebebe7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1f42d58848b407d998259c7a9672f13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:27:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:27:46Z,use_quota=True,user_id='0ff8e273ffc942d7850f0c2b90390668',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(eb6f46b1-e941-4775-abef-8fb4b2c9735a),volume_type_id=eb6f46b1-e941-4775-abef-8fb4b2c9735a)' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:27:45 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-e4f659a3-98b6-4fb9-8323-5237aa247915 tempest-VolumeTypesAccessTest-1330704345 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (671cc343-0c5f-4f67-82f6-f2a21aa3b5b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:27:45 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-e4f659a3-98b6-4fb9-8323-5237aa247915 tempest-VolumeTypesAccessTest-1330704345 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (671cc343-0c5f-4f67-82f6-f2a21aa3b5b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:27:45 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-e4f659a3-98b6-4fb9-8323-5237aa247915 tempest-VolumeTypesAccessTest-1330704345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6c97f82-8a33-4cef-bd29-7e0d1eec1b1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:27:45 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-e4f659a3-98b6-4fb9-8323-5237aa247915 tempest-VolumeTypesAccessTest-1330704345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6c97f82-8a33-4cef-bd29-7e0d1eec1b1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '56cb36f3-fd44-4b25-98ef-634eadebebe7', 'volume_name': 'volume-56cb36f3-fd44-4b25-98ef-634eadebebe7', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:27:45 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-e4f659a3-98b6-4fb9-8323-5237aa247915 tempest-VolumeTypesAccessTest-1330704345 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb2def45-d1f0-4dcc-bb5e-eb61180f5e17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:27:45 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-e4f659a3-98b6-4fb9-8323-5237aa247915 tempest-VolumeTypesAccessTest-1330704345 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb2def45-d1f0-4dcc-bb5e-eb61180f5e17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:27:45 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-e4f659a3-98b6-4fb9-8323-5237aa247915 tempest-VolumeTypesAccessTest-1330704345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b6432f4-efd1-45e3-a27a-d1f9f8fd5803) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:27:45 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-e4f659a3-98b6-4fb9-8323-5237aa247915 tempest-VolumeTypesAccessTest-1330704345 None] Volume 56cb36f3-fd44-4b25-98ef-634eadebebe7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-56cb36f3-fd44-4b25-98ef-634eadebebe7', 'volume_size': 1} Jul 31 12:27:45 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-e4f659a3-98b6-4fb9-8323-5237aa247915 tempest-VolumeTypesAccessTest-1330704345 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:27:45 devstack sudo[104516]: pam_unix(sudo:session): session closed for user root Jul 31 12:27:45 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-d26cb1c2-c61a-4c53-ba77-83ed47bf566d tempest-VolumesDeleteCascade-686353286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0de99573-1382-4b24-8a74-c5faf1727a9b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0de99573-1382-4b24-8a74-c5faf1727a9b.533cfeab-873c-4302-bb16-1ec06e755d7e 1G" returned: 0 in 0.416s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:27:45 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-d26cb1c2-c61a-4c53-ba77-83ed47bf566d tempest-VolumesDeleteCascade-686353286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0de99573-1382-4b24-8a74-c5faf1727a9b -F qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0de99573-1382-4b24-8a74-c5faf1727a9b.533cfeab-873c-4302-bb16-1ec06e755d7e {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:27:46 devstack sudo[104521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0de99573-1382-4b24-8a74-c5faf1727a9b -F qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0de99573-1382-4b24-8a74-c5faf1727a9b.533cfeab-873c-4302-bb16-1ec06e755d7e Jul 31 12:27:46 devstack sudo[104521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:27:46 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-18cb032d-1808-4796-bb98-a1537a8031b8 tempest-ProjectReaderTests-183788016 None] Acquiring lock "cinder-8193832e-7d4e-4288-9699-097fb0585218-delete_volume" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:27:46 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-18cb032d-1808-4796-bb98-a1537a8031b8 tempest-ProjectReaderTests-183788016 None] Lock "cinder-8193832e-7d4e-4288-9699-097fb0585218-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:27:46 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-18cb032d-1808-4796-bb98-a1537a8031b8 tempest-ProjectReaderTests-183788016 None] Acquiring lock "cinder-quobyte-8193832e-7d4e-4288-9699-097fb0585218" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:27:46 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-18cb032d-1808-4796-bb98-a1537a8031b8 tempest-ProjectReaderTests-183788016 None] Lock "cinder-quobyte-8193832e-7d4e-4288-9699-097fb0585218" acquired by "delete_volume" :: waited 0.026s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:27:46 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cd9405c-4a66-4445-8fc2-ca13498da5a8]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:27:46 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-18cb032d-1808-4796-bb98-a1537a8031b8 tempest-ProjectReaderTests-183788016 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-8193832e-7d4e-4288-9699-097fb0585218 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:27:46 devstack sudo[104521]: pam_unix(sudo:session): session closed for user root Jul 31 12:27:46 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-d26cb1c2-c61a-4c53-ba77-83ed47bf566d tempest-VolumesDeleteCascade-686353286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0de99573-1382-4b24-8a74-c5faf1727a9b -F qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0de99573-1382-4b24-8a74-c5faf1727a9b.533cfeab-873c-4302-bb16-1ec06e755d7e" returned: 0 in 0.331s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:27:46 devstack cinder-volume[89182]: WARNING cinder.volume.drivers.remotefs [None req-d26cb1c2-c61a-4c53-ba77-83ed47bf566d tempest-VolumesDeleteCascade-686353286 None] /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0de99573-1382-4b24-8a74-c5faf1727a9b.533cfeab-873c-4302-bb16-1ec06e755d7e is being set with open permissions: ugo+rw Jul 31 12:27:46 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-d26cb1c2-c61a-4c53-ba77-83ed47bf566d tempest-VolumesDeleteCascade-686353286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0de99573-1382-4b24-8a74-c5faf1727a9b.533cfeab-873c-4302-bb16-1ec06e755d7e {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:27:46 devstack sudo[104524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-8193832e-7d4e-4288-9699-097fb0585218 Jul 31 12:27:46 devstack sudo[104524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:27:46 devstack sudo[104528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0de99573-1382-4b24-8a74-c5faf1727a9b.533cfeab-873c-4302-bb16-1ec06e755d7e Jul 31 12:27:46 devstack sudo[104528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:27:46 devstack sudo[104528]: pam_unix(sudo:session): session closed for user root Jul 31 12:27:46 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-d26cb1c2-c61a-4c53-ba77-83ed47bf566d tempest-VolumesDeleteCascade-686353286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0de99573-1382-4b24-8a74-c5faf1727a9b.533cfeab-873c-4302-bb16-1ec06e755d7e" returned: 0 in 0.266s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:27:46 devstack sudo[104524]: pam_unix(sudo:session): session closed for user root Jul 31 12:27:46 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-18cb032d-1808-4796-bb98-a1537a8031b8 tempest-ProjectReaderTests-183788016 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-8193832e-7d4e-4288-9699-097fb0585218" returned: 0 in 0.381s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:27:46 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-18cb032d-1808-4796-bb98-a1537a8031b8 tempest-ProjectReaderTests-183788016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-8193832e-7d4e-4288-9699-097fb0585218 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:27:46 devstack sudo[104536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-8193832e-7d4e-4288-9699-097fb0585218 Jul 31 12:27:46 devstack sudo[104536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:27:46 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-d26cb1c2-c61a-4c53-ba77-83ed47bf566d tempest-VolumesDeleteCascade-686353286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0de99573-1382-4b24-8a74-c5faf1727a9b.info {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:27:46 devstack sudo[104538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0de99573-1382-4b24-8a74-c5faf1727a9b.info Jul 31 12:27:46 devstack sudo[104538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:27:46 devstack sudo[104536]: pam_unix(sudo:session): session closed for user root Jul 31 12:27:46 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-18cb032d-1808-4796-bb98-a1537a8031b8 tempest-ProjectReaderTests-183788016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-8193832e-7d4e-4288-9699-097fb0585218" returned: 0 in 0.246s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:27:46 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-18cb032d-1808-4796-bb98-a1537a8031b8 tempest-ProjectReaderTests-183788016 None] Lock "cinder-quobyte-8193832e-7d4e-4288-9699-097fb0585218" released by "delete_volume" :: held 0.674s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:27:46 devstack sudo[104538]: pam_unix(sudo:session): session closed for user root Jul 31 12:27:46 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-d26cb1c2-c61a-4c53-ba77-83ed47bf566d tempest-VolumesDeleteCascade-686353286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0de99573-1382-4b24-8a74-c5faf1727a9b.info" returned: 0 in 0.284s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:27:46 devstack cinder-volume[89182]: WARNING cinder.volume.drivers.remotefs [None req-d26cb1c2-c61a-4c53-ba77-83ed47bf566d tempest-VolumesDeleteCascade-686353286 None] /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0de99573-1382-4b24-8a74-c5faf1727a9b.info is being set with open permissions: ugo+rw Jul 31 12:27:46 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-d26cb1c2-c61a-4c53-ba77-83ed47bf566d tempest-VolumesDeleteCascade-686353286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0de99573-1382-4b24-8a74-c5faf1727a9b.info {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:27:46 devstack cinder-volume[89182]: DEBUG cinder.quota [None req-18cb032d-1808-4796-bb98-a1537a8031b8 tempest-ProjectReaderTests-183788016 None] Created reservations ['fb5c1e57-eaed-43ef-9f28-e4f9f873ff04', 'd96f6ece-7a6e-4e11-ad67-1b667828448b', '1dfc8436-a68c-4d72-a781-c919a7d5f358', 'fccb6d37-8728-4279-9b0b-962d49eca07f'] {{(pid=89182) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 12:27:46 devstack sudo[104542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0de99573-1382-4b24-8a74-c5faf1727a9b.info Jul 31 12:27:46 devstack sudo[104542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:27:47 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-18cb032d-1808-4796-bb98-a1537a8031b8 tempest-ProjectReaderTests-183788016 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:27:47 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-18cb032d-1808-4796-bb98-a1537a8031b8 tempest-ProjectReaderTests-183788016 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:27:47 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-18cb032d-1808-4796-bb98-a1537a8031b8 tempest-ProjectReaderTests-183788016 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:27:47 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-18cb032d-1808-4796-bb98-a1537a8031b8 tempest-ProjectReaderTests-183788016 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:27:47 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-18cb032d-1808-4796-bb98-a1537a8031b8 tempest-ProjectReaderTests-183788016 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:27:47 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-18cb032d-1808-4796-bb98-a1537a8031b8 tempest-ProjectReaderTests-183788016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:27:47 devstack sudo[104544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 Jul 31 12:27:47 devstack sudo[104544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:27:47 devstack sudo[104542]: pam_unix(sudo:session): session closed for user root Jul 31 12:27:47 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-d26cb1c2-c61a-4c53-ba77-83ed47bf566d tempest-VolumesDeleteCascade-686353286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0de99573-1382-4b24-8a74-c5faf1727a9b.info" returned: 0 in 0.279s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:27:47 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-d26cb1c2-c61a-4c53-ba77-83ed47bf566d tempest-VolumesDeleteCascade-686353286 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.179s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:27:47 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-1dc69117-9167-47c1-be29-e67a1fab0bf4 tempest-VolumeAndVolumeTypeFromImageTest-1671639501 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.640s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:27:47 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-1dc69117-9167-47c1-be29-e67a1fab0bf4 tempest-VolumeAndVolumeTypeFromImageTest-1671639501 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:27:43Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34e190c1-2337-46d4-b060-07a560018f3e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52df8409c336418ba529d4af6f8c8ec5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:27:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:27:43Z,use_quota=True,user_id='b66ea0b6adcc424ab8df21f3b7e55c63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cd7d4f73-df4d-41a2-b57a-7cb5058a4b4c),volume_type_id=cd7d4f73-df4d-41a2-b57a-7cb5058a4b4c)}" {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 12:27:47 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-1dc69117-9167-47c1-be29-e67a1fab0bf4 tempest-VolumeAndVolumeTypeFromImageTest-1671639501 None] Creating volume 34e190c1-2337-46d4-b060-07a560018f3e {{(pid=89182) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 12:27:47 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-1dc69117-9167-47c1-be29-e67a1fab0bf4 tempest-VolumeAndVolumeTypeFromImageTest-1671639501 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:27:47 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-1dc69117-9167-47c1-be29-e67a1fab0bf4 tempest-VolumeAndVolumeTypeFromImageTest-1671639501 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:27:47 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-1dc69117-9167-47c1-be29-e67a1fab0bf4 tempest-VolumeAndVolumeTypeFromImageTest-1671639501 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:27:47 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-1dc69117-9167-47c1-be29-e67a1fab0bf4 tempest-VolumeAndVolumeTypeFromImageTest-1671639501 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:27:47 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-1dc69117-9167-47c1-be29-e67a1fab0bf4 tempest-VolumeAndVolumeTypeFromImageTest-1671639501 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:27:47 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-1dc69117-9167-47c1-be29-e67a1fab0bf4 tempest-VolumeAndVolumeTypeFromImageTest-1671639501 None] Selected osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 as target Quobyte volume. {{(pid=89182) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 12:27:47 devstack cinder-volume[89182]: INFO cinder.volume.drivers.remotefs [None req-1dc69117-9167-47c1-be29-e67a1fab0bf4 tempest-VolumeAndVolumeTypeFromImageTest-1671639501 None] casted to osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 Jul 31 12:27:47 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-1dc69117-9167-47c1-be29-e67a1fab0bf4 tempest-VolumeAndVolumeTypeFromImageTest-1671639501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-34e190c1-2337-46d4-b060-07a560018f3e 1073741824 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:27:47 devstack sudo[104548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-34e190c1-2337-46d4-b060-07a560018f3e 1073741824 Jul 31 12:27:47 devstack sudo[104548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:27:47 devstack sudo[104544]: pam_unix(sudo:session): session closed for user root Jul 31 12:27:47 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-d26cb1c2-c61a-4c53-ba77-83ed47bf566d tempest-VolumesDeleteCascade-686353286 None] Create snapshot completed successfully Jul 31 12:27:47 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-18cb032d-1808-4796-bb98-a1537a8031b8 tempest-ProjectReaderTests-183788016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2" returned: 0 in 0.281s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:27:47 devstack cinder-volume[89182]: DEBUG cinder.manager [None req-18cb032d-1808-4796-bb98-a1537a8031b8 tempest-ProjectReaderTests-183788016 None] Notifying Schedulers of capabilities ... {{(pid=89182) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 12:27:47 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-18cb032d-1808-4796-bb98-a1537a8031b8 tempest-ProjectReaderTests-183788016 None] Deleted volume successfully. Jul 31 12:27:47 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-18cb032d-1808-4796-bb98-a1537a8031b8 tempest-ProjectReaderTests-183788016 None] Lock "cinder-8193832e-7d4e-4288-9699-097fb0585218-delete_volume" released by "delete_volume" :: held 1.205s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:27:47 devstack sudo[104548]: pam_unix(sudo:session): session closed for user root Jul 31 12:27:47 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-1dc69117-9167-47c1-be29-e67a1fab0bf4 tempest-VolumeAndVolumeTypeFromImageTest-1671639501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-34e190c1-2337-46d4-b060-07a560018f3e 1073741824" returned: 0 in 0.514s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:27:47 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-1dc69117-9167-47c1-be29-e67a1fab0bf4 tempest-VolumeAndVolumeTypeFromImageTest-1671639501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-34e190c1-2337-46d4-b060-07a560018f3e {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:27:47 devstack sudo[104554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-34e190c1-2337-46d4-b060-07a560018f3e Jul 31 12:27:47 devstack sudo[104554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:27:48 devstack sudo[104554]: pam_unix(sudo:session): session closed for user root Jul 31 12:27:48 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-1dc69117-9167-47c1-be29-e67a1fab0bf4 tempest-VolumeAndVolumeTypeFromImageTest-1671639501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-34e190c1-2337-46d4-b060-07a560018f3e" returned: 0 in 0.271s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:27:48 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-1dc69117-9167-47c1-be29-e67a1fab0bf4 tempest-VolumeAndVolumeTypeFromImageTest-1671639501 None] <== create_volume: return (834ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'} {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 12:27:48 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-1dc69117-9167-47c1-be29-e67a1fab0bf4 tempest-VolumeAndVolumeTypeFromImageTest-1671639501 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.840s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:27:48 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-e4f659a3-98b6-4fb9-8323-5237aa247915 tempest-VolumeTypesAccessTest-1330704345 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.313s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:27:48 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-e4f659a3-98b6-4fb9-8323-5237aa247915 tempest-VolumeTypesAccessTest-1330704345 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:27:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-102969674',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56cb36f3-fd44-4b25-98ef-634eadebebe7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1f42d58848b407d998259c7a9672f13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:27:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:27:46Z,use_quota=True,user_id='0ff8e273ffc942d7850f0c2b90390668',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(eb6f46b1-e941-4775-abef-8fb4b2c9735a),volume_type_id=eb6f46b1-e941-4775-abef-8fb4b2c9735a)}" {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 12:27:48 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-e4f659a3-98b6-4fb9-8323-5237aa247915 tempest-VolumeTypesAccessTest-1330704345 None] Creating volume 56cb36f3-fd44-4b25-98ef-634eadebebe7 {{(pid=89182) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 12:27:48 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-e4f659a3-98b6-4fb9-8323-5237aa247915 tempest-VolumeTypesAccessTest-1330704345 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:27:48 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-e4f659a3-98b6-4fb9-8323-5237aa247915 tempest-VolumeTypesAccessTest-1330704345 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:27:48 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-e4f659a3-98b6-4fb9-8323-5237aa247915 tempest-VolumeTypesAccessTest-1330704345 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:27:48 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-e4f659a3-98b6-4fb9-8323-5237aa247915 tempest-VolumeTypesAccessTest-1330704345 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:27:48 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-e4f659a3-98b6-4fb9-8323-5237aa247915 tempest-VolumeTypesAccessTest-1330704345 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:27:48 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-e4f659a3-98b6-4fb9-8323-5237aa247915 tempest-VolumeTypesAccessTest-1330704345 None] Selected osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 as target Quobyte volume. {{(pid=89182) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 12:27:48 devstack cinder-volume[89182]: INFO cinder.volume.drivers.remotefs [None req-e4f659a3-98b6-4fb9-8323-5237aa247915 tempest-VolumeTypesAccessTest-1330704345 None] casted to osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 Jul 31 12:27:48 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-e4f659a3-98b6-4fb9-8323-5237aa247915 tempest-VolumeTypesAccessTest-1330704345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-56cb36f3-fd44-4b25-98ef-634eadebebe7 1073741824 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:27:48 devstack sudo[104557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-56cb36f3-fd44-4b25-98ef-634eadebebe7 1073741824 Jul 31 12:27:48 devstack sudo[104557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:27:48 devstack cinder-volume[89182]: DEBUG cinder.volume.volume_utils [None req-1dc69117-9167-47c1-be29-e67a1fab0bf4 tempest-VolumeAndVolumeTypeFromImageTest-1671639501 None] Attempting download of 4ad7d475-7141-43f6-89f6-536fca5534e5 ((None, [{'url': 'file:///opt/stack/data/glance/images/4ad7d475-7141-43f6-89f6-536fca5534e5', 'metadata': {}}])) to volume 34e190c1-2337-46d4-b060-07a560018f3e. {{(pid=89182) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 31 12:27:48 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[55dac740-a522-4b7e-88a1-7452d7afb1f7]: (4, 'raw') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:27:48 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-1dc69117-9167-47c1-be29-e67a1fab0bf4 tempest-VolumeAndVolumeTypeFromImageTest-1671639501 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4ad7d475-7141-43f6-89f6-536fca5534e5_ni8bswmh {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:27:48 devstack sudo[104559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4ad7d475-7141-43f6-89f6-536fca5534e5_ni8bswmh Jul 31 12:27:48 devstack sudo[104559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:27:48 devstack cinder-volume[89182]: DEBUG cinder.volume.flows.manager.create_volume [None req-01573a3c-27db-4025-a871-4e8fc45defc0 tempest-VolumesDeleteCascade-686353286 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89182) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 12:27:48 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-01573a3c-27db-4025-a871-4e8fc45defc0 tempest-VolumesDeleteCascade-686353286 None] Flow 'volume_create_manager' (bc0d04b1-a237-4363-865e-a4c9fcdbc427) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:27:48 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-01573a3c-27db-4025-a871-4e8fc45defc0 tempest-VolumesDeleteCascade-686353286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b3e0353-059a-47ff-ac63-d467bb447300) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:27:48 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-01573a3c-27db-4025-a871-4e8fc45defc0 tempest-VolumesDeleteCascade-686353286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b3e0353-059a-47ff-ac63-d467bb447300) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:27:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-727141886',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a9c5f41-84e6-4d58-a66f-c56e69faa068,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22d4ed81133e4de7bc686b4670d05ef9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:27:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=533cfeab-873c-4302-bb16-1ec06e755d7e,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:27:48Z,use_quota=True,user_id='8f34a7438a064490a47de3ab977a33bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:27:48 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-01573a3c-27db-4025-a871-4e8fc45defc0 tempest-VolumesDeleteCascade-686353286 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59b3e1f4-4861-427e-9e78-8dc934516e60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:27:48 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-01573a3c-27db-4025-a871-4e8fc45defc0 tempest-VolumesDeleteCascade-686353286 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59b3e1f4-4861-427e-9e78-8dc934516e60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:27:48 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-01573a3c-27db-4025-a871-4e8fc45defc0 tempest-VolumesDeleteCascade-686353286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e97de03-fccb-4d50-81db-c702102319e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:27:48 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-01573a3c-27db-4025-a871-4e8fc45defc0 tempest-VolumesDeleteCascade-686353286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e97de03-fccb-4d50-81db-c702102319e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '2a9c5f41-84e6-4d58-a66f-c56e69faa068', 'volume_name': 'volume-2a9c5f41-84e6-4d58-a66f-c56e69faa068', 'volume_size': 1, 'snapshot_id': '533cfeab-873c-4302-bb16-1ec06e755d7e'}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:27:48 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-01573a3c-27db-4025-a871-4e8fc45defc0 tempest-VolumesDeleteCascade-686353286 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9f6e689-2ffb-4129-a271-0ffc7ff4d7b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:27:48 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-01573a3c-27db-4025-a871-4e8fc45defc0 tempest-VolumesDeleteCascade-686353286 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9f6e689-2ffb-4129-a271-0ffc7ff4d7b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:27:48 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-01573a3c-27db-4025-a871-4e8fc45defc0 tempest-VolumesDeleteCascade-686353286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44f39bc1-88c3-490a-b334-c16a601d2045) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:27:48 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-01573a3c-27db-4025-a871-4e8fc45defc0 tempest-VolumesDeleteCascade-686353286 None] Volume 2a9c5f41-84e6-4d58-a66f-c56e69faa068: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-2a9c5f41-84e6-4d58-a66f-c56e69faa068', 'volume_size': 1, 'snapshot_id': '533cfeab-873c-4302-bb16-1ec06e755d7e'} Jul 31 12:27:48 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-01573a3c-27db-4025-a871-4e8fc45defc0 tempest-VolumesDeleteCascade-686353286 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:27:48 devstack sudo[104559]: pam_unix(sudo:session): session closed for user root Jul 31 12:27:48 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-1dc69117-9167-47c1-be29-e67a1fab0bf4 tempest-VolumeAndVolumeTypeFromImageTest-1671639501 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4ad7d475-7141-43f6-89f6-536fca5534e5_ni8bswmh" returned: 0 in 0.430s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:27:48 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-1dc69117-9167-47c1-be29-e67a1fab0bf4 tempest-VolumeAndVolumeTypeFromImageTest-1671639501 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4ad7d475-7141-43f6-89f6-536fca5534e5_ni8bswmh {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:27:48 devstack sudo[104557]: pam_unix(sudo:session): session closed for user root Jul 31 12:27:48 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-e4f659a3-98b6-4fb9-8323-5237aa247915 tempest-VolumeTypesAccessTest-1330704345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-56cb36f3-fd44-4b25-98ef-634eadebebe7 1073741824" returned: 0 in 0.708s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:27:48 devstack sudo[104567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4ad7d475-7141-43f6-89f6-536fca5534e5_ni8bswmh Jul 31 12:27:48 devstack sudo[104567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:27:48 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-e4f659a3-98b6-4fb9-8323-5237aa247915 tempest-VolumeTypesAccessTest-1330704345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-56cb36f3-fd44-4b25-98ef-634eadebebe7 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:27:48 devstack sudo[104569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-56cb36f3-fd44-4b25-98ef-634eadebebe7 Jul 31 12:27:48 devstack sudo[104569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:27:49 devstack sudo[104567]: pam_unix(sudo:session): session closed for user root Jul 31 12:27:49 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-1dc69117-9167-47c1-be29-e67a1fab0bf4 tempest-VolumeAndVolumeTypeFromImageTest-1671639501 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4ad7d475-7141-43f6-89f6-536fca5534e5_ni8bswmh" returned: 1 in 0.379s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:27:49 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-1dc69117-9167-47c1-be29-e67a1fab0bf4 tempest-VolumeAndVolumeTypeFromImageTest-1671639501 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4ad7d475-7141-43f6-89f6-536fca5534e5_ni8bswmh' failed. Not Retrying. {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 31 12:27:49 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1c7495e-e22f-41b1-8797-9dd9df8e7020]: (4, 'raw') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:27:49 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-1dc69117-9167-47c1-be29-e67a1fab0bf4 tempest-VolumeAndVolumeTypeFromImageTest-1671639501 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4ad7d475-7141-43f6-89f6-536fca5534e5_dh6ayzrydevstack@QuobyteHD {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:27:49 devstack sudo[104569]: pam_unix(sudo:session): session closed for user root Jul 31 12:27:49 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-e4f659a3-98b6-4fb9-8323-5237aa247915 tempest-VolumeTypesAccessTest-1330704345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-56cb36f3-fd44-4b25-98ef-634eadebebe7" returned: 0 in 0.305s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:27:49 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-e4f659a3-98b6-4fb9-8323-5237aa247915 tempest-VolumeTypesAccessTest-1330704345 None] <== create_volume: return (1068ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'} {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 12:27:49 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-e4f659a3-98b6-4fb9-8323-5237aa247915 tempest-VolumeTypesAccessTest-1330704345 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.074s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:27:49 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-01573a3c-27db-4025-a871-4e8fc45defc0 tempest-VolumesDeleteCascade-686353286 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.506s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:27:49 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-01573a3c-27db-4025-a871-4e8fc45defc0 tempest-VolumesDeleteCascade-686353286 None] Acquiring lock "cinder-quobyte-533cfeab-873c-4302-bb16-1ec06e755d7e-2a9c5f41-84e6-4d58-a66f-c56e69faa068" by "_create_volume_from_snapshot" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:27:49 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-e4f659a3-98b6-4fb9-8323-5237aa247915 tempest-VolumeTypesAccessTest-1330704345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b6432f4-efd1-45e3-a27a-d1f9f8fd5803) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-56cb36f3-fd44-4b25-98ef-634eadebebe7', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:27:49 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-e4f659a3-98b6-4fb9-8323-5237aa247915 tempest-VolumeTypesAccessTest-1330704345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2dc8e32-8d11-4f45-b889-a8e022170bf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:27:49 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-01573a3c-27db-4025-a871-4e8fc45defc0 tempest-VolumesDeleteCascade-686353286 None] Lock "cinder-quobyte-533cfeab-873c-4302-bb16-1ec06e755d7e-2a9c5f41-84e6-4d58-a66f-c56e69faa068" acquired by "_create_volume_from_snapshot" :: waited 0.047s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:27:49 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-01573a3c-27db-4025-a871-4e8fc45defc0 tempest-VolumesDeleteCascade-686353286 None] Creating volume 2a9c5f41-84e6-4d58-a66f-c56e69faa068 from snapshot 533cfeab-873c-4302-bb16-1ec06e755d7e {{(pid=89182) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 31 12:27:49 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-01573a3c-27db-4025-a871-4e8fc45defc0 tempest-VolumesDeleteCascade-686353286 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:27:49 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-01573a3c-27db-4025-a871-4e8fc45defc0 tempest-VolumesDeleteCascade-686353286 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:27:49 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-01573a3c-27db-4025-a871-4e8fc45defc0 tempest-VolumesDeleteCascade-686353286 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:27:49 devstack sudo[104579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4ad7d475-7141-43f6-89f6-536fca5534e5_dh6ayzrydevstack@QuobyteHD Jul 31 12:27:49 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-01573a3c-27db-4025-a871-4e8fc45defc0 tempest-VolumesDeleteCascade-686353286 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:27:49 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-01573a3c-27db-4025-a871-4e8fc45defc0 tempest-VolumesDeleteCascade-686353286 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:27:49 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-01573a3c-27db-4025-a871-4e8fc45defc0 tempest-VolumesDeleteCascade-686353286 None] Selected osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 as target Quobyte volume. {{(pid=89182) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 12:27:49 devstack sudo[104579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:27:49 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-01573a3c-27db-4025-a871-4e8fc45defc0 tempest-VolumesDeleteCascade-686353286 None] Acquiring lock "cinder-quobyte-2a9c5f41-84e6-4d58-a66f-c56e69faa068" by "_copy_volume_from_snapshot" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:27:49 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-e4f659a3-98b6-4fb9-8323-5237aa247915 tempest-VolumeTypesAccessTest-1330704345 None] Volume volume-56cb36f3-fd44-4b25-98ef-634eadebebe7 (56cb36f3-fd44-4b25-98ef-634eadebebe7): created successfully Jul 31 12:27:49 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-e4f659a3-98b6-4fb9-8323-5237aa247915 tempest-VolumeTypesAccessTest-1330704345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2dc8e32-8d11-4f45-b889-a8e022170bf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:27:49 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-e4f659a3-98b6-4fb9-8323-5237aa247915 tempest-VolumeTypesAccessTest-1330704345 None] Flow 'volume_create_manager' (84741efb-d46b-48d4-9fca-1d39a56d7a93) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:27:49 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-e4f659a3-98b6-4fb9-8323-5237aa247915 tempest-VolumeTypesAccessTest-1330704345 None] Created volume successfully. Jul 31 12:27:49 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-01573a3c-27db-4025-a871-4e8fc45defc0 tempest-VolumesDeleteCascade-686353286 None] Lock "cinder-quobyte-2a9c5f41-84e6-4d58-a66f-c56e69faa068" acquired by "_copy_volume_from_snapshot" :: waited 0.037s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:27:49 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-01573a3c-27db-4025-a871-4e8fc45defc0 tempest-VolumesDeleteCascade-686353286 None] snapshot: 533cfeab-873c-4302-bb16-1ec06e755d7e, volume: 2a9c5f41-84e6-4d58-a66f-c56e69faa068, {{(pid=89182) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Jul 31 12:27:49 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-01573a3c-27db-4025-a871-4e8fc45defc0 tempest-VolumesDeleteCascade-686353286 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:27:49 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-01573a3c-27db-4025-a871-4e8fc45defc0 tempest-VolumesDeleteCascade-686353286 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:27:49 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-01573a3c-27db-4025-a871-4e8fc45defc0 tempest-VolumesDeleteCascade-686353286 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:27:49 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-01573a3c-27db-4025-a871-4e8fc45defc0 tempest-VolumesDeleteCascade-686353286 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:27:49 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-01573a3c-27db-4025-a871-4e8fc45defc0 tempest-VolumesDeleteCascade-686353286 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:27:49 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[17807b06-78d0-47ee-a131-729491a2f9a3]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:27:49 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-01573a3c-27db-4025-a871-4e8fc45defc0 tempest-VolumesDeleteCascade-686353286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0de99573-1382-4b24-8a74-c5faf1727a9b.533cfeab-873c-4302-bb16-1ec06e755d7e {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:27:49 devstack sudo[104582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0de99573-1382-4b24-8a74-c5faf1727a9b.533cfeab-873c-4302-bb16-1ec06e755d7e Jul 31 12:27:49 devstack sudo[104582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:27:49 devstack sudo[104579]: pam_unix(sudo:session): session closed for user root Jul 31 12:27:49 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-1dc69117-9167-47c1-be29-e67a1fab0bf4 tempest-VolumeAndVolumeTypeFromImageTest-1671639501 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4ad7d475-7141-43f6-89f6-536fca5534e5_dh6ayzrydevstack@QuobyteHD" returned: 0 in 0.416s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:27:49 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-1dc69117-9167-47c1-be29-e67a1fab0bf4 tempest-VolumeAndVolumeTypeFromImageTest-1671639501 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4ad7d475-7141-43f6-89f6-536fca5534e5_dh6ayzrydevstack@QuobyteHD {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:27:49 devstack sudo[104586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4ad7d475-7141-43f6-89f6-536fca5534e5_dh6ayzrydevstack@QuobyteHD Jul 31 12:27:49 devstack sudo[104586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:27:49 devstack sudo[104582]: pam_unix(sudo:session): session closed for user root Jul 31 12:27:49 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-01573a3c-27db-4025-a871-4e8fc45defc0 tempest-VolumesDeleteCascade-686353286 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0de99573-1382-4b24-8a74-c5faf1727a9b.533cfeab-873c-4302-bb16-1ec06e755d7e" returned: 0 in 0.443s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:27:49 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-01573a3c-27db-4025-a871-4e8fc45defc0 tempest-VolumesDeleteCascade-686353286 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0de99573-1382-4b24-8a74-c5faf1727a9b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89182) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 12:27:49 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6a9aabe-2767-481e-a712-be493758c685]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:27:49 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-01573a3c-27db-4025-a871-4e8fc45defc0 tempest-VolumesDeleteCascade-686353286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0de99573-1382-4b24-8a74-c5faf1727a9b {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:27:49 devstack sudo[104586]: pam_unix(sudo:session): session closed for user root Jul 31 12:27:49 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-1dc69117-9167-47c1-be29-e67a1fab0bf4 tempest-VolumeAndVolumeTypeFromImageTest-1671639501 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4ad7d475-7141-43f6-89f6-536fca5534e5_dh6ayzrydevstack@QuobyteHD" returned: 1 in 0.359s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:27:49 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-1dc69117-9167-47c1-be29-e67a1fab0bf4 tempest-VolumeAndVolumeTypeFromImageTest-1671639501 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4ad7d475-7141-43f6-89f6-536fca5534e5_dh6ayzrydevstack@QuobyteHD' failed. Not Retrying. {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 31 12:27:49 devstack cinder-volume[89182]: DEBUG cinder.image.image_utils [None req-1dc69117-9167-47c1-be29-e67a1fab0bf4 tempest-VolumeAndVolumeTypeFromImageTest-1671639501 None] 4ad7d475-7141-43f6-89f6-536fca5534e5 was raw, converting to qcow2 {{(pid=89182) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 31 12:27:49 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-1dc69117-9167-47c1-be29-e67a1fab0bf4 tempest-VolumeAndVolumeTypeFromImageTest-1671639501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_4ad7d475-7141-43f6-89f6-536fca5534e5_dh6ayzrydevstack@QuobyteHD /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-34e190c1-2337-46d4-b060-07a560018f3e {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:27:49 devstack sudo[104595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_4ad7d475-7141-43f6-89f6-536fca5534e5_dh6ayzrydevstack@QuobyteHD /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-34e190c1-2337-46d4-b060-07a560018f3e Jul 31 12:27:49 devstack sudo[104595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:27:49 devstack sudo[104591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0de99573-1382-4b24-8a74-c5faf1727a9b Jul 31 12:27:49 devstack sudo[104591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:27:49 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-9a5f6165-047e-48f0-9372-0c4f1db52d3e tempest-VolumeTypesAccessTest-1330704345 None] Acquiring lock "cinder-56cb36f3-fd44-4b25-98ef-634eadebebe7-delete_volume" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:27:49 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-9a5f6165-047e-48f0-9372-0c4f1db52d3e tempest-VolumeTypesAccessTest-1330704345 None] Lock "cinder-56cb36f3-fd44-4b25-98ef-634eadebebe7-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:27:50 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-9a5f6165-047e-48f0-9372-0c4f1db52d3e tempest-VolumeTypesAccessTest-1330704345 None] Acquiring lock "cinder-quobyte-56cb36f3-fd44-4b25-98ef-634eadebebe7" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:27:50 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-9a5f6165-047e-48f0-9372-0c4f1db52d3e tempest-VolumeTypesAccessTest-1330704345 None] Lock "cinder-quobyte-56cb36f3-fd44-4b25-98ef-634eadebebe7" acquired by "delete_volume" :: waited 0.018s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:27:50 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cd60c3f-b4ee-466e-a580-6c8b00407a02]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:27:50 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-9a5f6165-047e-48f0-9372-0c4f1db52d3e tempest-VolumeTypesAccessTest-1330704345 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-56cb36f3-fd44-4b25-98ef-634eadebebe7 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:27:50 devstack sudo[104598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-56cb36f3-fd44-4b25-98ef-634eadebebe7 Jul 31 12:27:50 devstack sudo[104598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:27:50 devstack sudo[104591]: pam_unix(sudo:session): session closed for user root Jul 31 12:27:50 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-01573a3c-27db-4025-a871-4e8fc45defc0 tempest-VolumesDeleteCascade-686353286 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0de99573-1382-4b24-8a74-c5faf1727a9b" returned: 0 in 0.457s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:27:50 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-01573a3c-27db-4025-a871-4e8fc45defc0 tempest-VolumesDeleteCascade-686353286 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0de99573-1382-4b24-8a74-c5faf1727a9b {{(pid=89182) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Jul 31 12:27:50 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-01573a3c-27db-4025-a871-4e8fc45defc0 tempest-VolumesDeleteCascade-686353286 None] Creating direct copy from snapshot {{(pid=89182) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Jul 31 12:27:50 devstack cinder-volume[89182]: DEBUG cinder.utils [None req-01573a3c-27db-4025-a871-4e8fc45defc0 tempest-VolumesDeleteCascade-686353286 None] Path /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-2a9c5f41-84e6-4d58-a66f-c56e69faa068 not found in is_blk_device check {{(pid=89182) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 31 12:27:50 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-01573a3c-27db-4025-a871-4e8fc45defc0 tempest-VolumesDeleteCascade-686353286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0de99573-1382-4b24-8a74-c5faf1727a9b /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-2a9c5f41-84e6-4d58-a66f-c56e69faa068 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:27:50 devstack sudo[104607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0de99573-1382-4b24-8a74-c5faf1727a9b /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-2a9c5f41-84e6-4d58-a66f-c56e69faa068 Jul 31 12:27:50 devstack sudo[104607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:27:50 devstack sudo[104595]: pam_unix(sudo:session): session closed for user root Jul 31 12:27:50 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-1dc69117-9167-47c1-be29-e67a1fab0bf4 tempest-VolumeAndVolumeTypeFromImageTest-1671639501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_4ad7d475-7141-43f6-89f6-536fca5534e5_dh6ayzrydevstack@QuobyteHD /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-34e190c1-2337-46d4-b060-07a560018f3e" returned: 0 in 0.499s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:27:50 devstack cinder-volume[89182]: DEBUG cinder.image.image_utils [None req-1dc69117-9167-47c1-be29-e67a1fab0bf4 tempest-VolumeAndVolumeTypeFromImageTest-1671639501 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_4ad7d475-7141-43f6-89f6-536fca5534e5_dh6ayzrydevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-34e190c1-2337-46d4-b060-07a560018f3e {{(pid=89182) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 31 12:27:50 devstack cinder-volume[89182]: INFO cinder.image.image_utils [None req-1dc69117-9167-47c1-be29-e67a1fab0bf4 tempest-VolumeAndVolumeTypeFromImageTest-1671639501 None] Converted 0.00 MB image at 0.00 MB/s Jul 31 12:27:50 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-1dc69117-9167-47c1-be29-e67a1fab0bf4 tempest-VolumeAndVolumeTypeFromImageTest-1671639501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-34e190c1-2337-46d4-b060-07a560018f3e 1G {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:27:50 devstack sudo[104610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-34e190c1-2337-46d4-b060-07a560018f3e 1G Jul 31 12:27:50 devstack sudo[104610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:27:50 devstack sudo[104598]: pam_unix(sudo:session): session closed for user root Jul 31 12:27:50 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-9a5f6165-047e-48f0-9372-0c4f1db52d3e tempest-VolumeTypesAccessTest-1330704345 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-56cb36f3-fd44-4b25-98ef-634eadebebe7" returned: 0 in 0.382s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:27:50 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-9a5f6165-047e-48f0-9372-0c4f1db52d3e tempest-VolumeTypesAccessTest-1330704345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-56cb36f3-fd44-4b25-98ef-634eadebebe7 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:27:50 devstack sudo[104614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-56cb36f3-fd44-4b25-98ef-634eadebebe7 Jul 31 12:27:50 devstack sudo[104614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:27:50 devstack sudo[104610]: pam_unix(sudo:session): session closed for user root Jul 31 12:27:50 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-1dc69117-9167-47c1-be29-e67a1fab0bf4 tempest-VolumeAndVolumeTypeFromImageTest-1671639501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-34e190c1-2337-46d4-b060-07a560018f3e 1G" returned: 0 in 0.339s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:27:50 devstack cinder-volume[89182]: DEBUG cinder.volume.volume_utils [None req-1dc69117-9167-47c1-be29-e67a1fab0bf4 tempest-VolumeAndVolumeTypeFromImageTest-1671639501 None] Downloaded image 4ad7d475-7141-43f6-89f6-536fca5534e5 ((None, [{'url': 'file:///opt/stack/data/glance/images/4ad7d475-7141-43f6-89f6-536fca5534e5', 'metadata': {}}])) to volume 34e190c1-2337-46d4-b060-07a560018f3e successfully. {{(pid=89182) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 31 12:27:50 devstack cinder-volume[89182]: DEBUG cinder.image.image_utils [None req-1dc69117-9167-47c1-be29-e67a1fab0bf4 tempest-VolumeAndVolumeTypeFromImageTest-1671639501 None] Temporary image 4ad7d475-7141-43f6-89f6-536fca5534e5 for user b66ea0b6adcc424ab8df21f3b7e55c63 is deleted. {{(pid=89182) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 31 12:27:50 devstack cinder-volume[89182]: DEBUG cinder.volume.volume_utils [None req-1dc69117-9167-47c1-be29-e67a1fab0bf4 tempest-VolumeAndVolumeTypeFromImageTest-1671639501 None] Marking volume 34e190c1-2337-46d4-b060-07a560018f3e as bootable. {{(pid=89182) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 31 12:27:50 devstack cinder-volume[89182]: DEBUG cinder.volume.flows.manager.create_volume [None req-1dc69117-9167-47c1-be29-e67a1fab0bf4 tempest-VolumeAndVolumeTypeFromImageTest-1671639501 None] Copying metadata from image 4ad7d475-7141-43f6-89f6-536fca5534e5 to 34e190c1-2337-46d4-b060-07a560018f3e. {{(pid=89182) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 31 12:27:50 devstack cinder-volume[89182]: DEBUG cinder.volume.flows.manager.create_volume [None req-1dc69117-9167-47c1-be29-e67a1fab0bf4 tempest-VolumeAndVolumeTypeFromImageTest-1671639501 None] Creating volume glance metadata for volume 34e190c1-2337-46d4-b060-07a560018f3e backed by image 4ad7d475-7141-43f6-89f6-536fca5534e5 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '4ad7d475-7141-43f6-89f6-536fca5534e5', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '2c0bde1f162a2b457ec4bde69aa4e5f8', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=89182) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 31 12:27:50 devstack sudo[104614]: pam_unix(sudo:session): session closed for user root Jul 31 12:27:50 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-9a5f6165-047e-48f0-9372-0c4f1db52d3e tempest-VolumeTypesAccessTest-1330704345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-56cb36f3-fd44-4b25-98ef-634eadebebe7" returned: 0 in 0.315s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:27:50 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-9a5f6165-047e-48f0-9372-0c4f1db52d3e tempest-VolumeTypesAccessTest-1330704345 None] Lock "cinder-quobyte-56cb36f3-fd44-4b25-98ef-634eadebebe7" released by "delete_volume" :: held 0.767s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:27:50 devstack cinder-volume[89182]: WARNING cinder.quota [None req-9a5f6165-047e-48f0-9372-0c4f1db52d3e tempest-VolumeTypesAccessTest-1330704345 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1931664532 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1931664532, it is now deprecated. Please use the default quota class for default quota. Jul 31 12:27:50 devstack cinder-volume[89182]: WARNING cinder.quota [None req-9a5f6165-047e-48f0-9372-0c4f1db52d3e tempest-VolumeTypesAccessTest-1330704345 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1931664532 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1931664532, it is now deprecated. Please use the default quota class for default quota. Jul 31 12:27:50 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-1dc69117-9167-47c1-be29-e67a1fab0bf4 tempest-VolumeAndVolumeTypeFromImageTest-1671639501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (453295b1-48a8-442c-b449-0d491cc96d90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-34e190c1-2337-46d4-b060-07a560018f3e', 'volume_size': 1, 'image_id': '4ad7d475-7141-43f6-89f6-536fca5534e5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4ad7d475-7141-43f6-89f6-536fca5534e5', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '2c0bde1f162a2b457ec4bde69aa4e5f8', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '52df8409c336418ba529d4af6f8c8ec5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '82878017b73ff4076ef4e7f3271f529d28ebb19d7d7988e8b68b3dabdec6bf90da33b80a4df37f979069b1e5d56fff283679ed67b6025e00e490ad1953fd14fb', 'id': '4ad7d475-7141-43f6-89f6-536fca5534e5', 'created_at': datetime.datetime(2026, 7, 31, 10, 27, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 31, 10, 27, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4ad7d475-7141-43f6-89f6-536fca5534e5/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:27:50 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-1dc69117-9167-47c1-be29-e67a1fab0bf4 tempest-VolumeAndVolumeTypeFromImageTest-1671639501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59d80a73-a70b-4b58-9310-18e68913e218) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:27:50 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-1dc69117-9167-47c1-be29-e67a1fab0bf4 tempest-VolumeAndVolumeTypeFromImageTest-1671639501 None] Volume volume-34e190c1-2337-46d4-b060-07a560018f3e (34e190c1-2337-46d4-b060-07a560018f3e): created successfully Jul 31 12:27:50 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-1dc69117-9167-47c1-be29-e67a1fab0bf4 tempest-VolumeAndVolumeTypeFromImageTest-1671639501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59d80a73-a70b-4b58-9310-18e68913e218) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:27:50 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-1dc69117-9167-47c1-be29-e67a1fab0bf4 tempest-VolumeAndVolumeTypeFromImageTest-1671639501 None] Flow 'volume_create_manager' (8989f9a3-5f35-41b4-ae06-c92b7943e71a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:27:50 devstack cinder-volume[89182]: DEBUG cinder.quota [None req-9a5f6165-047e-48f0-9372-0c4f1db52d3e tempest-VolumeTypesAccessTest-1330704345 None] Created reservations ['99306f9f-921c-4d4b-9227-e13162047fab', 'f8acb1d4-c346-4d27-bee1-093874867f81', 'dad883e9-3c45-47c4-8a65-2029c25967a0', '8f7d1e5b-9b85-4a43-989d-116c4c47a7c8'] {{(pid=89182) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 12:27:50 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-1dc69117-9167-47c1-be29-e67a1fab0bf4 tempest-VolumeAndVolumeTypeFromImageTest-1671639501 None] Created volume successfully. Jul 31 12:27:51 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-9a5f6165-047e-48f0-9372-0c4f1db52d3e tempest-VolumeTypesAccessTest-1330704345 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:27:51 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-9a5f6165-047e-48f0-9372-0c4f1db52d3e tempest-VolumeTypesAccessTest-1330704345 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:27:51 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-9a5f6165-047e-48f0-9372-0c4f1db52d3e tempest-VolumeTypesAccessTest-1330704345 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:27:51 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-9a5f6165-047e-48f0-9372-0c4f1db52d3e tempest-VolumeTypesAccessTest-1330704345 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:27:51 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-9a5f6165-047e-48f0-9372-0c4f1db52d3e tempest-VolumeTypesAccessTest-1330704345 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:27:51 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-9a5f6165-047e-48f0-9372-0c4f1db52d3e tempest-VolumeTypesAccessTest-1330704345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:27:51 devstack sudo[104631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 Jul 31 12:27:51 devstack sudo[104631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:27:51 devstack sudo[104631]: pam_unix(sudo:session): session closed for user root Jul 31 12:27:51 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-9a5f6165-047e-48f0-9372-0c4f1db52d3e tempest-VolumeTypesAccessTest-1330704345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2" returned: 0 in 0.350s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:27:51 devstack cinder-volume[89182]: DEBUG cinder.manager [None req-9a5f6165-047e-48f0-9372-0c4f1db52d3e tempest-VolumeTypesAccessTest-1330704345 None] Notifying Schedulers of capabilities ... {{(pid=89182) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 12:27:51 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-9a5f6165-047e-48f0-9372-0c4f1db52d3e tempest-VolumeTypesAccessTest-1330704345 None] Deleted volume successfully. Jul 31 12:27:51 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-9a5f6165-047e-48f0-9372-0c4f1db52d3e tempest-VolumeTypesAccessTest-1330704345 None] Lock "cinder-56cb36f3-fd44-4b25-98ef-634eadebebe7-delete_volume" released by "delete_volume" :: held 1.538s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:27:51 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-18fd5a7d-4c03-4494-b16c-5fa4385294fe tempest-VolumeAndVolumeTypeFromImageTest-1671639501 None] Acquiring lock "cinder-34e190c1-2337-46d4-b060-07a560018f3e-delete_volume" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:27:51 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-18fd5a7d-4c03-4494-b16c-5fa4385294fe tempest-VolumeAndVolumeTypeFromImageTest-1671639501 None] Lock "cinder-34e190c1-2337-46d4-b060-07a560018f3e-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:27:52 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-18fd5a7d-4c03-4494-b16c-5fa4385294fe tempest-VolumeAndVolumeTypeFromImageTest-1671639501 None] Acquiring lock "cinder-quobyte-34e190c1-2337-46d4-b060-07a560018f3e" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:27:52 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-18fd5a7d-4c03-4494-b16c-5fa4385294fe tempest-VolumeAndVolumeTypeFromImageTest-1671639501 None] Lock "cinder-quobyte-34e190c1-2337-46d4-b060-07a560018f3e" acquired by "delete_volume" :: waited 0.041s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:27:52 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd59583c-96ee-4c35-95d8-c4a7b2bef0d5]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:27:52 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-18fd5a7d-4c03-4494-b16c-5fa4385294fe tempest-VolumeAndVolumeTypeFromImageTest-1671639501 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-34e190c1-2337-46d4-b060-07a560018f3e {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:27:52 devstack sudo[104634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-34e190c1-2337-46d4-b060-07a560018f3e Jul 31 12:27:52 devstack sudo[104634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:27:53 devstack sudo[104634]: pam_unix(sudo:session): session closed for user root Jul 31 12:27:53 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-18fd5a7d-4c03-4494-b16c-5fa4385294fe tempest-VolumeAndVolumeTypeFromImageTest-1671639501 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-34e190c1-2337-46d4-b060-07a560018f3e" returned: 0 in 1.105s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:27:53 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-18fd5a7d-4c03-4494-b16c-5fa4385294fe tempest-VolumeAndVolumeTypeFromImageTest-1671639501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-34e190c1-2337-46d4-b060-07a560018f3e {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:27:53 devstack sudo[104639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-34e190c1-2337-46d4-b060-07a560018f3e Jul 31 12:27:53 devstack sudo[104639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:27:53 devstack sudo[104639]: pam_unix(sudo:session): session closed for user root Jul 31 12:27:53 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-18fd5a7d-4c03-4494-b16c-5fa4385294fe tempest-VolumeAndVolumeTypeFromImageTest-1671639501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-34e190c1-2337-46d4-b060-07a560018f3e" returned: 0 in 0.536s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:27:53 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-18fd5a7d-4c03-4494-b16c-5fa4385294fe tempest-VolumeAndVolumeTypeFromImageTest-1671639501 None] Lock "cinder-quobyte-34e190c1-2337-46d4-b060-07a560018f3e" released by "delete_volume" :: held 1.789s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:27:54 devstack cinder-volume[89182]: WARNING cinder.quota [None req-18fd5a7d-4c03-4494-b16c-5fa4385294fe tempest-VolumeAndVolumeTypeFromImageTest-1671639501 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jul 31 12:27:54 devstack cinder-volume[89182]: WARNING cinder.quota [None req-18fd5a7d-4c03-4494-b16c-5fa4385294fe tempest-VolumeAndVolumeTypeFromImageTest-1671639501 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jul 31 12:27:54 devstack cinder-volume[89182]: DEBUG cinder.quota [None req-18fd5a7d-4c03-4494-b16c-5fa4385294fe tempest-VolumeAndVolumeTypeFromImageTest-1671639501 None] Created reservations ['dcae953b-55a6-4775-8688-bec25aaa8bb7', 'c61150e7-19a6-48db-9047-7290595904bc', '10270ab7-7c9a-4732-802b-90d06f6d5971', 'ac93cab7-bd90-4e12-a728-551c6efc004b'] {{(pid=89182) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 12:27:54 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-18fd5a7d-4c03-4494-b16c-5fa4385294fe tempest-VolumeAndVolumeTypeFromImageTest-1671639501 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:27:54 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-18fd5a7d-4c03-4494-b16c-5fa4385294fe tempest-VolumeAndVolumeTypeFromImageTest-1671639501 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:27:54 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-18fd5a7d-4c03-4494-b16c-5fa4385294fe tempest-VolumeAndVolumeTypeFromImageTest-1671639501 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:27:54 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-18fd5a7d-4c03-4494-b16c-5fa4385294fe tempest-VolumeAndVolumeTypeFromImageTest-1671639501 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:27:54 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-18fd5a7d-4c03-4494-b16c-5fa4385294fe tempest-VolumeAndVolumeTypeFromImageTest-1671639501 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:27:54 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-18fd5a7d-4c03-4494-b16c-5fa4385294fe tempest-VolumeAndVolumeTypeFromImageTest-1671639501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:27:54 devstack sudo[104642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 Jul 31 12:27:54 devstack sudo[104642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:27:54 devstack sudo[104642]: pam_unix(sudo:session): session closed for user root Jul 31 12:27:54 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-18fd5a7d-4c03-4494-b16c-5fa4385294fe tempest-VolumeAndVolumeTypeFromImageTest-1671639501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2" returned: 0 in 0.476s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:27:54 devstack cinder-volume[89182]: DEBUG cinder.manager [None req-18fd5a7d-4c03-4494-b16c-5fa4385294fe tempest-VolumeAndVolumeTypeFromImageTest-1671639501 None] Notifying Schedulers of capabilities ... {{(pid=89182) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 12:27:54 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-18fd5a7d-4c03-4494-b16c-5fa4385294fe tempest-VolumeAndVolumeTypeFromImageTest-1671639501 None] Deleted volume successfully. Jul 31 12:27:55 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-18fd5a7d-4c03-4494-b16c-5fa4385294fe tempest-VolumeAndVolumeTypeFromImageTest-1671639501 None] Lock "cinder-34e190c1-2337-46d4-b060-07a560018f3e-delete_volume" released by "delete_volume" :: held 3.059s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:27:56 devstack sudo[104607]: pam_unix(sudo:session): session closed for user root Jul 31 12:27:56 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-01573a3c-27db-4025-a871-4e8fc45defc0 tempest-VolumesDeleteCascade-686353286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0de99573-1382-4b24-8a74-c5faf1727a9b /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-2a9c5f41-84e6-4d58-a66f-c56e69faa068" returned: 0 in 5.775s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:27:56 devstack cinder-volume[89182]: DEBUG cinder.image.image_utils [None req-01573a3c-27db-4025-a871-4e8fc45defc0 tempest-VolumesDeleteCascade-686353286 None] Image conversion details: src /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0de99573-1382-4b24-8a74-c5faf1727a9b, size 1024.00 MB, duration 5.78 sec, destination /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-2a9c5f41-84e6-4d58-a66f-c56e69faa068 {{(pid=89182) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 31 12:27:56 devstack cinder-volume[89182]: INFO cinder.image.image_utils [None req-01573a3c-27db-4025-a871-4e8fc45defc0 tempest-VolumesDeleteCascade-686353286 None] Converted 1024.00 MB image at 177.28 MB/s Jul 31 12:27:56 devstack cinder-volume[89182]: WARNING cinder.volume.drivers.remotefs [None req-01573a3c-27db-4025-a871-4e8fc45defc0 tempest-VolumesDeleteCascade-686353286 None] /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-2a9c5f41-84e6-4d58-a66f-c56e69faa068 is being set with open permissions: ugo+rw Jul 31 12:27:56 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-01573a3c-27db-4025-a871-4e8fc45defc0 tempest-VolumesDeleteCascade-686353286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-2a9c5f41-84e6-4d58-a66f-c56e69faa068 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:27:56 devstack sudo[104645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-2a9c5f41-84e6-4d58-a66f-c56e69faa068 Jul 31 12:27:56 devstack sudo[104645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:27:56 devstack sudo[104645]: pam_unix(sudo:session): session closed for user root Jul 31 12:27:56 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-01573a3c-27db-4025-a871-4e8fc45defc0 tempest-VolumesDeleteCascade-686353286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-2a9c5f41-84e6-4d58-a66f-c56e69faa068" returned: 0 in 0.356s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:27:56 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-01573a3c-27db-4025-a871-4e8fc45defc0 tempest-VolumesDeleteCascade-686353286 None] Lock "cinder-quobyte-2a9c5f41-84e6-4d58-a66f-c56e69faa068" released by "_copy_volume_from_snapshot" :: held 7.131s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:27:56 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-01573a3c-27db-4025-a871-4e8fc45defc0 tempest-VolumesDeleteCascade-686353286 None] Lock "cinder-quobyte-533cfeab-873c-4302-bb16-1ec06e755d7e-2a9c5f41-84e6-4d58-a66f-c56e69faa068" released by "_create_volume_from_snapshot" :: held 7.242s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:27:56 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-01573a3c-27db-4025-a871-4e8fc45defc0 tempest-VolumesDeleteCascade-686353286 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.290s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:27:56 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-01573a3c-27db-4025-a871-4e8fc45defc0 tempest-VolumesDeleteCascade-686353286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44f39bc1-88c3-490a-b334-c16a601d2045) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2a9c5f41-84e6-4d58-a66f-c56e69faa068', 'volume_size': 1, 'snapshot_id': '533cfeab-873c-4302-bb16-1ec06e755d7e'}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:27:56 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-01573a3c-27db-4025-a871-4e8fc45defc0 tempest-VolumesDeleteCascade-686353286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ee9f2ae-1f0f-45bb-b119-76b3c37a5ce6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:27:56 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-01573a3c-27db-4025-a871-4e8fc45defc0 tempest-VolumesDeleteCascade-686353286 None] Volume volume-2a9c5f41-84e6-4d58-a66f-c56e69faa068 (2a9c5f41-84e6-4d58-a66f-c56e69faa068): created successfully Jul 31 12:27:56 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-01573a3c-27db-4025-a871-4e8fc45defc0 tempest-VolumesDeleteCascade-686353286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ee9f2ae-1f0f-45bb-b119-76b3c37a5ce6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:27:56 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-01573a3c-27db-4025-a871-4e8fc45defc0 tempest-VolumesDeleteCascade-686353286 None] Flow 'volume_create_manager' (bc0d04b1-a237-4363-865e-a4c9fcdbc427) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:27:56 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-01573a3c-27db-4025-a871-4e8fc45defc0 tempest-VolumesDeleteCascade-686353286 None] Created volume successfully. Jul 31 12:27:57 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-2cba2248-afca-4c04-a67c-f2c6afab575f tempest-VolumesDeleteCascade-686353286 None] Acquiring lock "cinder-0de99573-1382-4b24-8a74-c5faf1727a9b-delete_volume" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:27:57 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-2cba2248-afca-4c04-a67c-f2c6afab575f tempest-VolumesDeleteCascade-686353286 None] Lock "cinder-0de99573-1382-4b24-8a74-c5faf1727a9b-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:27:57 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-2cba2248-afca-4c04-a67c-f2c6afab575f tempest-VolumesDeleteCascade-686353286 None] Performing cascade delete. {{(pid=89182) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jul 31 12:27:57 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-2cba2248-afca-4c04-a67c-f2c6afab575f tempest-VolumesDeleteCascade-686353286 None] Acquiring lock "cinder-533cfeab-873c-4302-bb16-1ec06e755d7e-delete_snapshot" by "delete_snapshot" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:27:57 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-2cba2248-afca-4c04-a67c-f2c6afab575f tempest-VolumesDeleteCascade-686353286 None] Lock "cinder-533cfeab-873c-4302-bb16-1ec06e755d7e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:27:57 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-2cba2248-afca-4c04-a67c-f2c6afab575f tempest-VolumesDeleteCascade-686353286 None] Acquiring lock "cinder-quobyte-0de99573-1382-4b24-8a74-c5faf1727a9b" by "delete_snapshot" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:27:57 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-2cba2248-afca-4c04-a67c-f2c6afab575f tempest-VolumesDeleteCascade-686353286 None] Lock "cinder-quobyte-0de99573-1382-4b24-8a74-c5faf1727a9b" acquired by "delete_snapshot" :: waited 0.025s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:27:57 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-2cba2248-afca-4c04-a67c-f2c6afab575f tempest-VolumesDeleteCascade-686353286 None] Acquiring lock "cinder-quobyte-533cfeab-873c-4302-bb16-1ec06e755d7e" by "_delete_snapshot" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:27:57 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-2cba2248-afca-4c04-a67c-f2c6afab575f tempest-VolumesDeleteCascade-686353286 None] Lock "cinder-quobyte-533cfeab-873c-4302-bb16-1ec06e755d7e" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:27:57 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-2cba2248-afca-4c04-a67c-f2c6afab575f tempest-VolumesDeleteCascade-686353286 None] Deleting offline snapshot 533cfeab-873c-4302-bb16-1ec06e755d7e of volume 0de99573-1382-4b24-8a74-c5faf1727a9b {{(pid=89182) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 31 12:27:57 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-2cba2248-afca-4c04-a67c-f2c6afab575f tempest-VolumesDeleteCascade-686353286 None] snapshot_file for this snap is: volume-0de99573-1382-4b24-8a74-c5faf1727a9b.533cfeab-873c-4302-bb16-1ec06e755d7e {{(pid=89182) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 31 12:27:57 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f771f28-c495-4c4a-be33-903b53bb925c]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:27:57 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-2cba2248-afca-4c04-a67c-f2c6afab575f tempest-VolumesDeleteCascade-686353286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0de99573-1382-4b24-8a74-c5faf1727a9b.533cfeab-873c-4302-bb16-1ec06e755d7e {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:27:57 devstack sudo[104649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0de99573-1382-4b24-8a74-c5faf1727a9b.533cfeab-873c-4302-bb16-1ec06e755d7e Jul 31 12:27:57 devstack sudo[104649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:27:58 devstack sudo[104649]: pam_unix(sudo:session): session closed for user root Jul 31 12:27:58 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-2cba2248-afca-4c04-a67c-f2c6afab575f tempest-VolumesDeleteCascade-686353286 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0de99573-1382-4b24-8a74-c5faf1727a9b.533cfeab-873c-4302-bb16-1ec06e755d7e" returned: 0 in 0.403s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:27:58 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-2cba2248-afca-4c04-a67c-f2c6afab575f tempest-VolumesDeleteCascade-686353286 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0de99573-1382-4b24-8a74-c5faf1727a9b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89182) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 12:27:58 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b8da220-31f5-44ae-a69e-d04cac611653]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:27:58 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-2cba2248-afca-4c04-a67c-f2c6afab575f tempest-VolumesDeleteCascade-686353286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0de99573-1382-4b24-8a74-c5faf1727a9b {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:27:58 devstack sudo[104654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0de99573-1382-4b24-8a74-c5faf1727a9b Jul 31 12:27:58 devstack sudo[104654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:27:58 devstack sudo[104654]: pam_unix(sudo:session): session closed for user root Jul 31 12:27:58 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-2cba2248-afca-4c04-a67c-f2c6afab575f tempest-VolumesDeleteCascade-686353286 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0de99573-1382-4b24-8a74-c5faf1727a9b" returned: 0 in 0.705s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:27:58 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-2cba2248-afca-4c04-a67c-f2c6afab575f tempest-VolumesDeleteCascade-686353286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0de99573-1382-4b24-8a74-c5faf1727a9b.533cfeab-873c-4302-bb16-1ec06e755d7e {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:27:58 devstack sudo[104660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0de99573-1382-4b24-8a74-c5faf1727a9b.533cfeab-873c-4302-bb16-1ec06e755d7e Jul 31 12:27:58 devstack sudo[104660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:27:59 devstack sudo[104660]: pam_unix(sudo:session): session closed for user root Jul 31 12:27:59 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-2cba2248-afca-4c04-a67c-f2c6afab575f tempest-VolumesDeleteCascade-686353286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0de99573-1382-4b24-8a74-c5faf1727a9b.533cfeab-873c-4302-bb16-1ec06e755d7e" returned: 0 in 0.425s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:27:59 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-2cba2248-afca-4c04-a67c-f2c6afab575f tempest-VolumesDeleteCascade-686353286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0de99573-1382-4b24-8a74-c5faf1727a9b.533cfeab-873c-4302-bb16-1ec06e755d7e {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:27:59 devstack sudo[104667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0de99573-1382-4b24-8a74-c5faf1727a9b.533cfeab-873c-4302-bb16-1ec06e755d7e Jul 31 12:27:59 devstack sudo[104667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:27:59 devstack sudo[104667]: pam_unix(sudo:session): session closed for user root Jul 31 12:27:59 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-2cba2248-afca-4c04-a67c-f2c6afab575f tempest-VolumesDeleteCascade-686353286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0de99573-1382-4b24-8a74-c5faf1727a9b.533cfeab-873c-4302-bb16-1ec06e755d7e" returned: 0 in 0.281s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:27:59 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-2cba2248-afca-4c04-a67c-f2c6afab575f tempest-VolumesDeleteCascade-686353286 None] Lock "cinder-quobyte-533cfeab-873c-4302-bb16-1ec06e755d7e" released by "_delete_snapshot" :: held 1.927s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:27:59 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-2cba2248-afca-4c04-a67c-f2c6afab575f tempest-VolumesDeleteCascade-686353286 None] Lock "cinder-quobyte-0de99573-1382-4b24-8a74-c5faf1727a9b" released by "delete_snapshot" :: held 1.955s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:27:59 devstack cinder-volume[89182]: DEBUG cinder.quota [None req-2cba2248-afca-4c04-a67c-f2c6afab575f tempest-VolumesDeleteCascade-686353286 None] Created reservations ['e7975ef3-f05d-499d-8481-c017bd46235a', '36f3e279-5ff1-420e-a610-f799d30c74b5', '108a3b49-0f39-4710-9080-3c59c751885b', 'e0253cdf-8b1c-4e79-84f0-ad43f7919fda'] {{(pid=89182) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 12:27:59 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-2cba2248-afca-4c04-a67c-f2c6afab575f tempest-VolumesDeleteCascade-686353286 None] Delete snapshot completed successfully. Jul 31 12:27:59 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-2cba2248-afca-4c04-a67c-f2c6afab575f tempest-VolumesDeleteCascade-686353286 None] Lock "cinder-533cfeab-873c-4302-bb16-1ec06e755d7e-delete_snapshot" released by "delete_snapshot" :: held 2.156s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:27:59 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-2cba2248-afca-4c04-a67c-f2c6afab575f tempest-VolumesDeleteCascade-686353286 None] Snapshots deleted, issuing volume delete {{(pid=89182) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jul 31 12:27:59 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-2cba2248-afca-4c04-a67c-f2c6afab575f tempest-VolumesDeleteCascade-686353286 None] Acquiring lock "cinder-quobyte-0de99573-1382-4b24-8a74-c5faf1727a9b" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:27:59 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-2cba2248-afca-4c04-a67c-f2c6afab575f tempest-VolumesDeleteCascade-686353286 None] Lock "cinder-quobyte-0de99573-1382-4b24-8a74-c5faf1727a9b" acquired by "delete_volume" :: waited 0.017s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:27:59 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[7847236b-2709-4880-9b5d-06c4ec541c7f]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:27:59 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-2cba2248-afca-4c04-a67c-f2c6afab575f tempest-VolumesDeleteCascade-686353286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0de99573-1382-4b24-8a74-c5faf1727a9b {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:27:59 devstack sudo[104670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0de99573-1382-4b24-8a74-c5faf1727a9b Jul 31 12:27:59 devstack sudo[104670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:28:00 devstack sudo[104670]: pam_unix(sudo:session): session closed for user root Jul 31 12:28:00 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-2cba2248-afca-4c04-a67c-f2c6afab575f tempest-VolumesDeleteCascade-686353286 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0de99573-1382-4b24-8a74-c5faf1727a9b" returned: 0 in 0.434s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:28:00 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-2cba2248-afca-4c04-a67c-f2c6afab575f tempest-VolumesDeleteCascade-686353286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0de99573-1382-4b24-8a74-c5faf1727a9b {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:28:00 devstack sudo[104675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0de99573-1382-4b24-8a74-c5faf1727a9b Jul 31 12:28:00 devstack sudo[104675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:28:00 devstack sudo[104675]: pam_unix(sudo:session): session closed for user root Jul 31 12:28:00 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-2cba2248-afca-4c04-a67c-f2c6afab575f tempest-VolumesDeleteCascade-686353286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0de99573-1382-4b24-8a74-c5faf1727a9b" returned: 0 in 0.312s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:28:00 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-2cba2248-afca-4c04-a67c-f2c6afab575f tempest-VolumesDeleteCascade-686353286 None] Lock "cinder-quobyte-0de99573-1382-4b24-8a74-c5faf1727a9b" released by "delete_volume" :: held 0.834s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:28:00 devstack cinder-volume[89182]: DEBUG cinder.quota [None req-2cba2248-afca-4c04-a67c-f2c6afab575f tempest-VolumesDeleteCascade-686353286 None] Created reservations ['119d2a23-e612-4989-a37d-c4dd14662fda', '3b7e2b6a-b9ab-4229-a70d-bb9dd8997e38', 'cf6d5b3e-6749-4022-beb0-4f5214d2255e', 'd407484e-a310-417f-85cf-05e2c3b2ba36'] {{(pid=89182) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 12:28:00 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-2cba2248-afca-4c04-a67c-f2c6afab575f tempest-VolumesDeleteCascade-686353286 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:28:00 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-2cba2248-afca-4c04-a67c-f2c6afab575f tempest-VolumesDeleteCascade-686353286 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:28:00 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-2cba2248-afca-4c04-a67c-f2c6afab575f tempest-VolumesDeleteCascade-686353286 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:28:00 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-2cba2248-afca-4c04-a67c-f2c6afab575f tempest-VolumesDeleteCascade-686353286 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:28:00 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-2cba2248-afca-4c04-a67c-f2c6afab575f tempest-VolumesDeleteCascade-686353286 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:28:00 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-2cba2248-afca-4c04-a67c-f2c6afab575f tempest-VolumesDeleteCascade-686353286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:28:00 devstack sudo[104678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 Jul 31 12:28:00 devstack sudo[104678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:28:01 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-3840727b-df50-4f75-90e4-53a6b75d2c11 tempest-VolumesDeleteCascade-686353286 None] Acquiring lock "cinder-2a9c5f41-84e6-4d58-a66f-c56e69faa068-delete_volume" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:28:01 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-3840727b-df50-4f75-90e4-53a6b75d2c11 tempest-VolumesDeleteCascade-686353286 None] Lock "cinder-2a9c5f41-84e6-4d58-a66f-c56e69faa068-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:28:01 devstack sudo[104678]: pam_unix(sudo:session): session closed for user root Jul 31 12:28:01 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-2cba2248-afca-4c04-a67c-f2c6afab575f tempest-VolumesDeleteCascade-686353286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2" returned: 0 in 0.450s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:28:01 devstack cinder-volume[89182]: DEBUG cinder.manager [None req-2cba2248-afca-4c04-a67c-f2c6afab575f tempest-VolumesDeleteCascade-686353286 None] Notifying Schedulers of capabilities ... {{(pid=89182) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 12:28:01 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-2cba2248-afca-4c04-a67c-f2c6afab575f tempest-VolumesDeleteCascade-686353286 None] Deleted volume successfully. Jul 31 12:28:01 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-3840727b-df50-4f75-90e4-53a6b75d2c11 tempest-VolumesDeleteCascade-686353286 None] Acquiring lock "cinder-quobyte-2a9c5f41-84e6-4d58-a66f-c56e69faa068" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:28:01 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-3840727b-df50-4f75-90e4-53a6b75d2c11 tempest-VolumesDeleteCascade-686353286 None] Lock "cinder-quobyte-2a9c5f41-84e6-4d58-a66f-c56e69faa068" acquired by "delete_volume" :: waited 0.028s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:28:01 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-2cba2248-afca-4c04-a67c-f2c6afab575f tempest-VolumesDeleteCascade-686353286 None] Lock "cinder-0de99573-1382-4b24-8a74-c5faf1727a9b-delete_volume" released by "delete_volume" :: held 3.783s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:28:01 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[a59881e2-52cb-46b9-8be5-efcd3e614eb7]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:28:01 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-3840727b-df50-4f75-90e4-53a6b75d2c11 tempest-VolumesDeleteCascade-686353286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-2a9c5f41-84e6-4d58-a66f-c56e69faa068 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:28:01 devstack cinder-volume[89182]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ccbb1d5-c6f9-48a7-ba61-56e3acf5f34c tempest-CreateVolumesFromImageTest-1869356007 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89182) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 12:28:01 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-2ccbb1d5-c6f9-48a7-ba61-56e3acf5f34c tempest-CreateVolumesFromImageTest-1869356007 None] Flow 'volume_create_manager' (dd7d48f2-84cc-4cc1-9f12-1de7bc1b364c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:28:01 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-2ccbb1d5-c6f9-48a7-ba61-56e3acf5f34c tempest-CreateVolumesFromImageTest-1869356007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11acc8b2-e4b5-4779-9070-fe1bc6ce5fea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:28:01 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-2ccbb1d5-c6f9-48a7-ba61-56e3acf5f34c tempest-CreateVolumesFromImageTest-1869356007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11acc8b2-e4b5-4779-9070-fe1bc6ce5fea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:28:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1735892509',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d965740-5993-4dde-a985-04b5dacbd6ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1fed8ae63e04d5580661f5bb3a2f43c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:28:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:28:01Z,use_quota=True,user_id='b1e93750c6af42bda0de3df3cac24d6e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:28:01 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-2ccbb1d5-c6f9-48a7-ba61-56e3acf5f34c tempest-CreateVolumesFromImageTest-1869356007 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d8a05e3-1f3f-494d-8652-2507b2c4b47e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:28:01 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-2ccbb1d5-c6f9-48a7-ba61-56e3acf5f34c tempest-CreateVolumesFromImageTest-1869356007 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d8a05e3-1f3f-494d-8652-2507b2c4b47e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:28:01 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-2ccbb1d5-c6f9-48a7-ba61-56e3acf5f34c tempest-CreateVolumesFromImageTest-1869356007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (956cd612-f088-400d-b7dd-4055e645d9a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:28:01 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-2ccbb1d5-c6f9-48a7-ba61-56e3acf5f34c tempest-CreateVolumesFromImageTest-1869356007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (956cd612-f088-400d-b7dd-4055e645d9a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7d965740-5993-4dde-a985-04b5dacbd6ca', 'volume_name': 'volume-7d965740-5993-4dde-a985-04b5dacbd6ca', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:28:01 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-2ccbb1d5-c6f9-48a7-ba61-56e3acf5f34c tempest-CreateVolumesFromImageTest-1869356007 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ff0eb1a-0ed4-47bd-a3a5-7032392cd73d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:28:01 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-2ccbb1d5-c6f9-48a7-ba61-56e3acf5f34c tempest-CreateVolumesFromImageTest-1869356007 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ff0eb1a-0ed4-47bd-a3a5-7032392cd73d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:28:01 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-2ccbb1d5-c6f9-48a7-ba61-56e3acf5f34c tempest-CreateVolumesFromImageTest-1869356007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9163330-b008-46ed-ab76-93d08c8cffe4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:28:01 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-2ccbb1d5-c6f9-48a7-ba61-56e3acf5f34c tempest-CreateVolumesFromImageTest-1869356007 None] Volume 7d965740-5993-4dde-a985-04b5dacbd6ca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7d965740-5993-4dde-a985-04b5dacbd6ca', 'volume_size': 1} Jul 31 12:28:01 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-2ccbb1d5-c6f9-48a7-ba61-56e3acf5f34c tempest-CreateVolumesFromImageTest-1869356007 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:28:01 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-2ccbb1d5-c6f9-48a7-ba61-56e3acf5f34c tempest-CreateVolumesFromImageTest-1869356007 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:28:01 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-2ccbb1d5-c6f9-48a7-ba61-56e3acf5f34c tempest-CreateVolumesFromImageTest-1869356007 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:28:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1735892509',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d965740-5993-4dde-a985-04b5dacbd6ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1fed8ae63e04d5580661f5bb3a2f43c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:28:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:28:01Z,use_quota=True,user_id='b1e93750c6af42bda0de3df3cac24d6e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)}" {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 12:28:01 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-2ccbb1d5-c6f9-48a7-ba61-56e3acf5f34c tempest-CreateVolumesFromImageTest-1869356007 None] Creating volume 7d965740-5993-4dde-a985-04b5dacbd6ca {{(pid=89182) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 12:28:01 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-2ccbb1d5-c6f9-48a7-ba61-56e3acf5f34c tempest-CreateVolumesFromImageTest-1869356007 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:28:01 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-2ccbb1d5-c6f9-48a7-ba61-56e3acf5f34c tempest-CreateVolumesFromImageTest-1869356007 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:28:01 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-2ccbb1d5-c6f9-48a7-ba61-56e3acf5f34c tempest-CreateVolumesFromImageTest-1869356007 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:28:01 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-2ccbb1d5-c6f9-48a7-ba61-56e3acf5f34c tempest-CreateVolumesFromImageTest-1869356007 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:28:01 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-2ccbb1d5-c6f9-48a7-ba61-56e3acf5f34c tempest-CreateVolumesFromImageTest-1869356007 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:28:01 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-2ccbb1d5-c6f9-48a7-ba61-56e3acf5f34c tempest-CreateVolumesFromImageTest-1869356007 None] Selected osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 as target Quobyte volume. {{(pid=89182) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 12:28:01 devstack cinder-volume[89182]: INFO cinder.volume.drivers.remotefs [None req-2ccbb1d5-c6f9-48a7-ba61-56e3acf5f34c tempest-CreateVolumesFromImageTest-1869356007 None] casted to osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 Jul 31 12:28:01 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-2ccbb1d5-c6f9-48a7-ba61-56e3acf5f34c tempest-CreateVolumesFromImageTest-1869356007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-7d965740-5993-4dde-a985-04b5dacbd6ca 1073741824 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:28:01 devstack sudo[104682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-7d965740-5993-4dde-a985-04b5dacbd6ca 1073741824 Jul 31 12:28:01 devstack sudo[104682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:28:01 devstack sudo[104681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-2a9c5f41-84e6-4d58-a66f-c56e69faa068 Jul 31 12:28:01 devstack sudo[104681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:28:01 devstack cinder-volume[89182]: DEBUG cinder.volume.flows.manager.create_volume [None req-c70119ba-f67d-44eb-997f-758534e80d98 tempest-CreateVolumesFromImageTest-1869356007 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89182) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 12:28:01 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-c70119ba-f67d-44eb-997f-758534e80d98 tempest-CreateVolumesFromImageTest-1869356007 None] Flow 'volume_create_manager' (70deca1a-0798-4a19-b425-df018f39fe84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:28:01 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-c70119ba-f67d-44eb-997f-758534e80d98 tempest-CreateVolumesFromImageTest-1869356007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ffb28989-282b-46e7-bdd3-683c0e6dca5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:28:01 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-c70119ba-f67d-44eb-997f-758534e80d98 tempest-CreateVolumesFromImageTest-1869356007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ffb28989-282b-46e7-bdd3-683c0e6dca5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:28:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1922996293',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8eb15d74-26f2-4c11-a552-434b1ffda38f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1fed8ae63e04d5580661f5bb3a2f43c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:28:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:28:02Z,use_quota=True,user_id='b1e93750c6af42bda0de3df3cac24d6e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:28:01 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-c70119ba-f67d-44eb-997f-758534e80d98 tempest-CreateVolumesFromImageTest-1869356007 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5fb84c9e-4199-46bf-ad51-cba1203b6e2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:28:01 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-c70119ba-f67d-44eb-997f-758534e80d98 tempest-CreateVolumesFromImageTest-1869356007 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5fb84c9e-4199-46bf-ad51-cba1203b6e2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:28:01 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-c70119ba-f67d-44eb-997f-758534e80d98 tempest-CreateVolumesFromImageTest-1869356007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9cc359f1-d9a1-4080-a579-c56ebe700385) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:28:01 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-c70119ba-f67d-44eb-997f-758534e80d98 tempest-CreateVolumesFromImageTest-1869356007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9cc359f1-d9a1-4080-a579-c56ebe700385) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8eb15d74-26f2-4c11-a552-434b1ffda38f', 'volume_name': 'volume-8eb15d74-26f2-4c11-a552-434b1ffda38f', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:28:01 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-c70119ba-f67d-44eb-997f-758534e80d98 tempest-CreateVolumesFromImageTest-1869356007 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (569f34ec-b9a9-4953-9b9d-5ba7e5387d36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:28:01 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-c70119ba-f67d-44eb-997f-758534e80d98 tempest-CreateVolumesFromImageTest-1869356007 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (569f34ec-b9a9-4953-9b9d-5ba7e5387d36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:28:01 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-c70119ba-f67d-44eb-997f-758534e80d98 tempest-CreateVolumesFromImageTest-1869356007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb02296a-9ed5-4358-bf14-6c5a4e32f730) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:28:01 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-c70119ba-f67d-44eb-997f-758534e80d98 tempest-CreateVolumesFromImageTest-1869356007 None] Volume 8eb15d74-26f2-4c11-a552-434b1ffda38f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8eb15d74-26f2-4c11-a552-434b1ffda38f', 'volume_size': 1} Jul 31 12:28:01 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-c70119ba-f67d-44eb-997f-758534e80d98 tempest-CreateVolumesFromImageTest-1869356007 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:28:02 devstack sudo[104681]: pam_unix(sudo:session): session closed for user root Jul 31 12:28:02 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-3840727b-df50-4f75-90e4-53a6b75d2c11 tempest-VolumesDeleteCascade-686353286 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-2a9c5f41-84e6-4d58-a66f-c56e69faa068" returned: 0 in 0.731s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:28:02 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-3840727b-df50-4f75-90e4-53a6b75d2c11 tempest-VolumesDeleteCascade-686353286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-2a9c5f41-84e6-4d58-a66f-c56e69faa068 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:28:02 devstack sudo[104682]: pam_unix(sudo:session): session closed for user root Jul 31 12:28:02 devstack sudo[104691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-2a9c5f41-84e6-4d58-a66f-c56e69faa068 Jul 31 12:28:02 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-2ccbb1d5-c6f9-48a7-ba61-56e3acf5f34c tempest-CreateVolumesFromImageTest-1869356007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-7d965740-5993-4dde-a985-04b5dacbd6ca 1073741824" returned: 0 in 0.588s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:28:02 devstack sudo[104691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:28:02 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-2ccbb1d5-c6f9-48a7-ba61-56e3acf5f34c tempest-CreateVolumesFromImageTest-1869356007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-7d965740-5993-4dde-a985-04b5dacbd6ca {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:28:02 devstack sudo[104693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-7d965740-5993-4dde-a985-04b5dacbd6ca Jul 31 12:28:02 devstack sudo[104693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:28:02 devstack cinder-volume[89182]: DEBUG cinder.volume.flows.manager.create_volume [None req-f1047c21-4c54-4e2b-be69-ce442dd114d6 tempest-CreateVolumesFromImageTest-1869356007 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89182) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 12:28:02 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-f1047c21-4c54-4e2b-be69-ce442dd114d6 tempest-CreateVolumesFromImageTest-1869356007 None] Flow 'volume_create_manager' (a20b46e1-03c4-44a8-a2c6-e676d3bc928f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:28:02 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-f1047c21-4c54-4e2b-be69-ce442dd114d6 tempest-CreateVolumesFromImageTest-1869356007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa8be584-cfa2-403b-b6bc-8aedf38a8100) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:28:02 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-f1047c21-4c54-4e2b-be69-ce442dd114d6 tempest-CreateVolumesFromImageTest-1869356007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa8be584-cfa2-403b-b6bc-8aedf38a8100) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:28:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1344478035',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=109dd3ba-34e6-4e4f-adf6-eb86b4ce43bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1fed8ae63e04d5580661f5bb3a2f43c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:28:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:28:02Z,use_quota=True,user_id='b1e93750c6af42bda0de3df3cac24d6e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:28:02 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-f1047c21-4c54-4e2b-be69-ce442dd114d6 tempest-CreateVolumesFromImageTest-1869356007 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e8a5e8e-ff10-4176-ad6a-e47d109928da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:28:02 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-f1047c21-4c54-4e2b-be69-ce442dd114d6 tempest-CreateVolumesFromImageTest-1869356007 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e8a5e8e-ff10-4176-ad6a-e47d109928da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:28:02 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-f1047c21-4c54-4e2b-be69-ce442dd114d6 tempest-CreateVolumesFromImageTest-1869356007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a694faf2-8ccf-4c46-a357-b5c680cbb1eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:28:02 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-f1047c21-4c54-4e2b-be69-ce442dd114d6 tempest-CreateVolumesFromImageTest-1869356007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a694faf2-8ccf-4c46-a357-b5c680cbb1eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '109dd3ba-34e6-4e4f-adf6-eb86b4ce43bb', 'volume_name': 'volume-109dd3ba-34e6-4e4f-adf6-eb86b4ce43bb', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:28:02 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-f1047c21-4c54-4e2b-be69-ce442dd114d6 tempest-CreateVolumesFromImageTest-1869356007 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fffeb725-457e-4a7d-992b-f23d899d0626) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:28:02 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-f1047c21-4c54-4e2b-be69-ce442dd114d6 tempest-CreateVolumesFromImageTest-1869356007 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fffeb725-457e-4a7d-992b-f23d899d0626) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:28:02 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-f1047c21-4c54-4e2b-be69-ce442dd114d6 tempest-CreateVolumesFromImageTest-1869356007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc2284de-fc60-4f21-bc66-4430df005dab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:28:02 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-f1047c21-4c54-4e2b-be69-ce442dd114d6 tempest-CreateVolumesFromImageTest-1869356007 None] Volume 109dd3ba-34e6-4e4f-adf6-eb86b4ce43bb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-109dd3ba-34e6-4e4f-adf6-eb86b4ce43bb', 'volume_size': 1} Jul 31 12:28:02 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-f1047c21-4c54-4e2b-be69-ce442dd114d6 tempest-CreateVolumesFromImageTest-1869356007 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:28:02 devstack sudo[104691]: pam_unix(sudo:session): session closed for user root Jul 31 12:28:02 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-3840727b-df50-4f75-90e4-53a6b75d2c11 tempest-VolumesDeleteCascade-686353286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-2a9c5f41-84e6-4d58-a66f-c56e69faa068" returned: 0 in 0.449s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:28:02 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-3840727b-df50-4f75-90e4-53a6b75d2c11 tempest-VolumesDeleteCascade-686353286 None] Lock "cinder-quobyte-2a9c5f41-84e6-4d58-a66f-c56e69faa068" released by "delete_volume" :: held 1.242s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:28:02 devstack cinder-volume[89182]: DEBUG cinder.quota [None req-3840727b-df50-4f75-90e4-53a6b75d2c11 tempest-VolumesDeleteCascade-686353286 None] Created reservations ['f0688c90-b85f-4c30-9deb-9e7ab4e1ae6a', 'df0bcf2d-26c1-4d9d-9fdf-a9109d1902db', 'e666281a-b1fb-4095-bbfd-e702661cf482', 'ceb39414-f3db-4a2b-8166-3539e2f5f0e7'] {{(pid=89182) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 12:28:02 devstack sudo[104693]: pam_unix(sudo:session): session closed for user root Jul 31 12:28:02 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-2ccbb1d5-c6f9-48a7-ba61-56e3acf5f34c tempest-CreateVolumesFromImageTest-1869356007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-7d965740-5993-4dde-a985-04b5dacbd6ca" returned: 0 in 0.428s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:28:02 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-2ccbb1d5-c6f9-48a7-ba61-56e3acf5f34c tempest-CreateVolumesFromImageTest-1869356007 None] <== create_volume: return (1104ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'} {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 12:28:02 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-2ccbb1d5-c6f9-48a7-ba61-56e3acf5f34c tempest-CreateVolumesFromImageTest-1869356007 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.108s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:28:02 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-c70119ba-f67d-44eb-997f-758534e80d98 tempest-CreateVolumesFromImageTest-1869356007 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.627s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:28:02 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-c70119ba-f67d-44eb-997f-758534e80d98 tempest-CreateVolumesFromImageTest-1869356007 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:28:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1922996293',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8eb15d74-26f2-4c11-a552-434b1ffda38f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1fed8ae63e04d5580661f5bb3a2f43c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:28:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:28:02Z,use_quota=True,user_id='b1e93750c6af42bda0de3df3cac24d6e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)}" {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 12:28:02 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-c70119ba-f67d-44eb-997f-758534e80d98 tempest-CreateVolumesFromImageTest-1869356007 None] Creating volume 8eb15d74-26f2-4c11-a552-434b1ffda38f {{(pid=89182) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 12:28:02 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-c70119ba-f67d-44eb-997f-758534e80d98 tempest-CreateVolumesFromImageTest-1869356007 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:28:02 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-c70119ba-f67d-44eb-997f-758534e80d98 tempest-CreateVolumesFromImageTest-1869356007 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:28:02 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-c70119ba-f67d-44eb-997f-758534e80d98 tempest-CreateVolumesFromImageTest-1869356007 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:28:02 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-c70119ba-f67d-44eb-997f-758534e80d98 tempest-CreateVolumesFromImageTest-1869356007 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:28:02 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-c70119ba-f67d-44eb-997f-758534e80d98 tempest-CreateVolumesFromImageTest-1869356007 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:28:02 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-c70119ba-f67d-44eb-997f-758534e80d98 tempest-CreateVolumesFromImageTest-1869356007 None] Selected osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 as target Quobyte volume. {{(pid=89182) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 12:28:02 devstack cinder-volume[89182]: INFO cinder.volume.drivers.remotefs [None req-c70119ba-f67d-44eb-997f-758534e80d98 tempest-CreateVolumesFromImageTest-1869356007 None] casted to osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 Jul 31 12:28:02 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-c70119ba-f67d-44eb-997f-758534e80d98 tempest-CreateVolumesFromImageTest-1869356007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-8eb15d74-26f2-4c11-a552-434b1ffda38f 1073741824 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:28:02 devstack sudo[104697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-8eb15d74-26f2-4c11-a552-434b1ffda38f 1073741824 Jul 31 12:28:02 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-2ccbb1d5-c6f9-48a7-ba61-56e3acf5f34c tempest-CreateVolumesFromImageTest-1869356007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9163330-b008-46ed-ab76-93d08c8cffe4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7d965740-5993-4dde-a985-04b5dacbd6ca', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:28:02 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-2ccbb1d5-c6f9-48a7-ba61-56e3acf5f34c tempest-CreateVolumesFromImageTest-1869356007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba8c0900-46b5-4b5c-8838-482a13405e6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:28:02 devstack sudo[104697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:28:02 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-2ccbb1d5-c6f9-48a7-ba61-56e3acf5f34c tempest-CreateVolumesFromImageTest-1869356007 None] Volume volume-7d965740-5993-4dde-a985-04b5dacbd6ca (7d965740-5993-4dde-a985-04b5dacbd6ca): created successfully Jul 31 12:28:02 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-2ccbb1d5-c6f9-48a7-ba61-56e3acf5f34c tempest-CreateVolumesFromImageTest-1869356007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba8c0900-46b5-4b5c-8838-482a13405e6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:28:02 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-2ccbb1d5-c6f9-48a7-ba61-56e3acf5f34c tempest-CreateVolumesFromImageTest-1869356007 None] Flow 'volume_create_manager' (dd7d48f2-84cc-4cc1-9f12-1de7bc1b364c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:28:02 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-2ccbb1d5-c6f9-48a7-ba61-56e3acf5f34c tempest-CreateVolumesFromImageTest-1869356007 None] Created volume successfully. Jul 31 12:28:02 devstack cinder-volume[89182]: DEBUG cinder.volume.flows.manager.create_volume [None req-4383431a-b1b8-42fb-8cc1-bc72d26da675 tempest-CreateVolumesFromImageTest-1869356007 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89182) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 12:28:02 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-4383431a-b1b8-42fb-8cc1-bc72d26da675 tempest-CreateVolumesFromImageTest-1869356007 None] Flow 'volume_create_manager' (a87412a1-026e-4906-9f92-f39474925cfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:28:02 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-4383431a-b1b8-42fb-8cc1-bc72d26da675 tempest-CreateVolumesFromImageTest-1869356007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0a781b7-d56e-48f6-9719-e5e7bab34ec5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:28:02 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-3840727b-df50-4f75-90e4-53a6b75d2c11 tempest-VolumesDeleteCascade-686353286 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:28:02 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-3840727b-df50-4f75-90e4-53a6b75d2c11 tempest-VolumesDeleteCascade-686353286 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:28:02 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-3840727b-df50-4f75-90e4-53a6b75d2c11 tempest-VolumesDeleteCascade-686353286 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:28:02 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-3840727b-df50-4f75-90e4-53a6b75d2c11 tempest-VolumesDeleteCascade-686353286 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:28:02 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-3840727b-df50-4f75-90e4-53a6b75d2c11 tempest-VolumesDeleteCascade-686353286 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:28:02 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-3840727b-df50-4f75-90e4-53a6b75d2c11 tempest-VolumesDeleteCascade-686353286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:28:02 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-4383431a-b1b8-42fb-8cc1-bc72d26da675 tempest-CreateVolumesFromImageTest-1869356007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0a781b7-d56e-48f6-9719-e5e7bab34ec5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:28:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1243318381',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46232616-9e44-4137-9240-ce2362d54963,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1fed8ae63e04d5580661f5bb3a2f43c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:28:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:28:03Z,use_quota=True,user_id='b1e93750c6af42bda0de3df3cac24d6e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:28:02 devstack sudo[104699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 Jul 31 12:28:02 devstack sudo[104699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:28:02 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-4383431a-b1b8-42fb-8cc1-bc72d26da675 tempest-CreateVolumesFromImageTest-1869356007 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e878ccb-5f10-4c92-9869-e12de75c9b3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:28:02 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-4383431a-b1b8-42fb-8cc1-bc72d26da675 tempest-CreateVolumesFromImageTest-1869356007 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e878ccb-5f10-4c92-9869-e12de75c9b3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:28:02 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-4383431a-b1b8-42fb-8cc1-bc72d26da675 tempest-CreateVolumesFromImageTest-1869356007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b1b2a10-998f-4203-ad63-a9f11e21757c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:28:02 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-4383431a-b1b8-42fb-8cc1-bc72d26da675 tempest-CreateVolumesFromImageTest-1869356007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b1b2a10-998f-4203-ad63-a9f11e21757c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '46232616-9e44-4137-9240-ce2362d54963', 'volume_name': 'volume-46232616-9e44-4137-9240-ce2362d54963', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:28:02 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-4383431a-b1b8-42fb-8cc1-bc72d26da675 tempest-CreateVolumesFromImageTest-1869356007 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50d38a6e-a322-4817-813b-b5822991c8a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:28:02 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-4383431a-b1b8-42fb-8cc1-bc72d26da675 tempest-CreateVolumesFromImageTest-1869356007 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50d38a6e-a322-4817-813b-b5822991c8a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:28:02 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-4383431a-b1b8-42fb-8cc1-bc72d26da675 tempest-CreateVolumesFromImageTest-1869356007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5da5268-5ce7-45a5-862d-90491d2953ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:28:02 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-4383431a-b1b8-42fb-8cc1-bc72d26da675 tempest-CreateVolumesFromImageTest-1869356007 None] Volume 46232616-9e44-4137-9240-ce2362d54963: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-46232616-9e44-4137-9240-ce2362d54963', 'volume_size': 1} Jul 31 12:28:02 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-4383431a-b1b8-42fb-8cc1-bc72d26da675 tempest-CreateVolumesFromImageTest-1869356007 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:28:03 devstack sudo[104699]: pam_unix(sudo:session): session closed for user root Jul 31 12:28:03 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-3840727b-df50-4f75-90e4-53a6b75d2c11 tempest-VolumesDeleteCascade-686353286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2" returned: 0 in 0.373s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:28:03 devstack cinder-volume[89182]: DEBUG cinder.manager [None req-3840727b-df50-4f75-90e4-53a6b75d2c11 tempest-VolumesDeleteCascade-686353286 None] Notifying Schedulers of capabilities ... {{(pid=89182) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 12:28:03 devstack sudo[104697]: pam_unix(sudo:session): session closed for user root Jul 31 12:28:03 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-3840727b-df50-4f75-90e4-53a6b75d2c11 tempest-VolumesDeleteCascade-686353286 None] Deleted volume successfully. Jul 31 12:28:03 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-c70119ba-f67d-44eb-997f-758534e80d98 tempest-CreateVolumesFromImageTest-1869356007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-8eb15d74-26f2-4c11-a552-434b1ffda38f 1073741824" returned: 0 in 0.642s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:28:03 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-3840727b-df50-4f75-90e4-53a6b75d2c11 tempest-VolumesDeleteCascade-686353286 None] Lock "cinder-2a9c5f41-84e6-4d58-a66f-c56e69faa068-delete_volume" released by "delete_volume" :: held 2.128s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:28:03 devstack cinder-volume[89182]: DEBUG cinder.volume.flows.manager.create_volume [None req-a48cd0b8-d597-43c2-85bf-d82c6f88b47a tempest-CreateVolumesFromImageTest-1869356007 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89182) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 12:28:03 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-a48cd0b8-d597-43c2-85bf-d82c6f88b47a tempest-CreateVolumesFromImageTest-1869356007 None] Flow 'volume_create_manager' (b9b76ee1-16a9-47b2-9556-f50a5e32e46e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:28:03 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-a48cd0b8-d597-43c2-85bf-d82c6f88b47a tempest-CreateVolumesFromImageTest-1869356007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06aa795a-2246-4699-9f89-b4dd3dd9823c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:28:03 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-c70119ba-f67d-44eb-997f-758534e80d98 tempest-CreateVolumesFromImageTest-1869356007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-8eb15d74-26f2-4c11-a552-434b1ffda38f {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:28:03 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-a48cd0b8-d597-43c2-85bf-d82c6f88b47a tempest-CreateVolumesFromImageTest-1869356007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06aa795a-2246-4699-9f89-b4dd3dd9823c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:28:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1677087554',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=795115c4-8132-457c-8c39-9349dfc5b509,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1fed8ae63e04d5580661f5bb3a2f43c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:28:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:28:03Z,use_quota=True,user_id='b1e93750c6af42bda0de3df3cac24d6e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:28:03 devstack sudo[104707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-8eb15d74-26f2-4c11-a552-434b1ffda38f Jul 31 12:28:03 devstack sudo[104707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:28:03 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-a48cd0b8-d597-43c2-85bf-d82c6f88b47a tempest-CreateVolumesFromImageTest-1869356007 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f00a5135-670f-467e-a01e-24e489e8a3a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:28:03 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-a48cd0b8-d597-43c2-85bf-d82c6f88b47a tempest-CreateVolumesFromImageTest-1869356007 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f00a5135-670f-467e-a01e-24e489e8a3a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:28:03 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-a48cd0b8-d597-43c2-85bf-d82c6f88b47a tempest-CreateVolumesFromImageTest-1869356007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa6bf97f-2a32-41f3-932b-1440000c5d97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:28:03 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-a48cd0b8-d597-43c2-85bf-d82c6f88b47a tempest-CreateVolumesFromImageTest-1869356007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa6bf97f-2a32-41f3-932b-1440000c5d97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '795115c4-8132-457c-8c39-9349dfc5b509', 'volume_name': 'volume-795115c4-8132-457c-8c39-9349dfc5b509', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:28:03 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-a48cd0b8-d597-43c2-85bf-d82c6f88b47a tempest-CreateVolumesFromImageTest-1869356007 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c27cbe89-7f22-4e6c-8deb-d5302da765bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:28:03 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-a48cd0b8-d597-43c2-85bf-d82c6f88b47a tempest-CreateVolumesFromImageTest-1869356007 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c27cbe89-7f22-4e6c-8deb-d5302da765bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:28:03 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-a48cd0b8-d597-43c2-85bf-d82c6f88b47a tempest-CreateVolumesFromImageTest-1869356007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53415f2b-d11c-4afc-afcd-12a7afb5edec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:28:03 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-a48cd0b8-d597-43c2-85bf-d82c6f88b47a tempest-CreateVolumesFromImageTest-1869356007 None] Volume 795115c4-8132-457c-8c39-9349dfc5b509: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-795115c4-8132-457c-8c39-9349dfc5b509', 'volume_size': 1} Jul 31 12:28:03 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-a48cd0b8-d597-43c2-85bf-d82c6f88b47a tempest-CreateVolumesFromImageTest-1869356007 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:28:03 devstack sudo[104707]: pam_unix(sudo:session): session closed for user root Jul 31 12:28:03 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-c70119ba-f67d-44eb-997f-758534e80d98 tempest-CreateVolumesFromImageTest-1869356007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-8eb15d74-26f2-4c11-a552-434b1ffda38f" returned: 0 in 0.311s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:28:03 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-c70119ba-f67d-44eb-997f-758534e80d98 tempest-CreateVolumesFromImageTest-1869356007 None] <== create_volume: return (1051ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'} {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 12:28:03 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-c70119ba-f67d-44eb-997f-758534e80d98 tempest-CreateVolumesFromImageTest-1869356007 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.054s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:28:03 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-f1047c21-4c54-4e2b-be69-ce442dd114d6 tempest-CreateVolumesFromImageTest-1869356007 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.154s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:28:03 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-f1047c21-4c54-4e2b-be69-ce442dd114d6 tempest-CreateVolumesFromImageTest-1869356007 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:28:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1344478035',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=109dd3ba-34e6-4e4f-adf6-eb86b4ce43bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1fed8ae63e04d5580661f5bb3a2f43c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:28:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:28:02Z,use_quota=True,user_id='b1e93750c6af42bda0de3df3cac24d6e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)}" {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 12:28:03 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-f1047c21-4c54-4e2b-be69-ce442dd114d6 tempest-CreateVolumesFromImageTest-1869356007 None] Creating volume 109dd3ba-34e6-4e4f-adf6-eb86b4ce43bb {{(pid=89182) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 12:28:03 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-f1047c21-4c54-4e2b-be69-ce442dd114d6 tempest-CreateVolumesFromImageTest-1869356007 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:28:03 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-f1047c21-4c54-4e2b-be69-ce442dd114d6 tempest-CreateVolumesFromImageTest-1869356007 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:28:03 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-f1047c21-4c54-4e2b-be69-ce442dd114d6 tempest-CreateVolumesFromImageTest-1869356007 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:28:03 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-f1047c21-4c54-4e2b-be69-ce442dd114d6 tempest-CreateVolumesFromImageTest-1869356007 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:28:03 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-f1047c21-4c54-4e2b-be69-ce442dd114d6 tempest-CreateVolumesFromImageTest-1869356007 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:28:03 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-f1047c21-4c54-4e2b-be69-ce442dd114d6 tempest-CreateVolumesFromImageTest-1869356007 None] Selected osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 as target Quobyte volume. {{(pid=89182) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 12:28:03 devstack cinder-volume[89182]: INFO cinder.volume.drivers.remotefs [None req-f1047c21-4c54-4e2b-be69-ce442dd114d6 tempest-CreateVolumesFromImageTest-1869356007 None] casted to osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 Jul 31 12:28:03 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-f1047c21-4c54-4e2b-be69-ce442dd114d6 tempest-CreateVolumesFromImageTest-1869356007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-109dd3ba-34e6-4e4f-adf6-eb86b4ce43bb 1073741824 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:28:03 devstack sudo[104710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-109dd3ba-34e6-4e4f-adf6-eb86b4ce43bb 1073741824 Jul 31 12:28:03 devstack sudo[104710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:28:03 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-c70119ba-f67d-44eb-997f-758534e80d98 tempest-CreateVolumesFromImageTest-1869356007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb02296a-9ed5-4358-bf14-6c5a4e32f730) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8eb15d74-26f2-4c11-a552-434b1ffda38f', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:28:03 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-c70119ba-f67d-44eb-997f-758534e80d98 tempest-CreateVolumesFromImageTest-1869356007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c08aff4-d693-478d-a3a0-008b7bfb63db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:28:03 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-c70119ba-f67d-44eb-997f-758534e80d98 tempest-CreateVolumesFromImageTest-1869356007 None] Volume volume-8eb15d74-26f2-4c11-a552-434b1ffda38f (8eb15d74-26f2-4c11-a552-434b1ffda38f): created successfully Jul 31 12:28:03 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-c70119ba-f67d-44eb-997f-758534e80d98 tempest-CreateVolumesFromImageTest-1869356007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c08aff4-d693-478d-a3a0-008b7bfb63db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:28:03 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-c70119ba-f67d-44eb-997f-758534e80d98 tempest-CreateVolumesFromImageTest-1869356007 None] Flow 'volume_create_manager' (70deca1a-0798-4a19-b425-df018f39fe84) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:28:03 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-c70119ba-f67d-44eb-997f-758534e80d98 tempest-CreateVolumesFromImageTest-1869356007 None] Created volume successfully. Jul 31 12:28:04 devstack sudo[104710]: pam_unix(sudo:session): session closed for user root Jul 31 12:28:04 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-f1047c21-4c54-4e2b-be69-ce442dd114d6 tempest-CreateVolumesFromImageTest-1869356007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-109dd3ba-34e6-4e4f-adf6-eb86b4ce43bb 1073741824" returned: 0 in 0.536s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:28:04 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-f1047c21-4c54-4e2b-be69-ce442dd114d6 tempest-CreateVolumesFromImageTest-1869356007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-109dd3ba-34e6-4e4f-adf6-eb86b4ce43bb {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:28:04 devstack sudo[104717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-109dd3ba-34e6-4e4f-adf6-eb86b4ce43bb Jul 31 12:28:04 devstack sudo[104717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:28:04 devstack sudo[104717]: pam_unix(sudo:session): session closed for user root Jul 31 12:28:04 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-f1047c21-4c54-4e2b-be69-ce442dd114d6 tempest-CreateVolumesFromImageTest-1869356007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-109dd3ba-34e6-4e4f-adf6-eb86b4ce43bb" returned: 0 in 0.347s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:28:04 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-f1047c21-4c54-4e2b-be69-ce442dd114d6 tempest-CreateVolumesFromImageTest-1869356007 None] <== create_volume: return (933ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'} {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 12:28:04 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-f1047c21-4c54-4e2b-be69-ce442dd114d6 tempest-CreateVolumesFromImageTest-1869356007 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.936s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:28:04 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-4383431a-b1b8-42fb-8cc1-bc72d26da675 tempest-CreateVolumesFromImageTest-1869356007 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.642s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:28:04 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-4383431a-b1b8-42fb-8cc1-bc72d26da675 tempest-CreateVolumesFromImageTest-1869356007 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:28:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1243318381',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46232616-9e44-4137-9240-ce2362d54963,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1fed8ae63e04d5580661f5bb3a2f43c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:28:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:28:03Z,use_quota=True,user_id='b1e93750c6af42bda0de3df3cac24d6e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)}" {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 12:28:04 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-4383431a-b1b8-42fb-8cc1-bc72d26da675 tempest-CreateVolumesFromImageTest-1869356007 None] Creating volume 46232616-9e44-4137-9240-ce2362d54963 {{(pid=89182) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 12:28:04 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-4383431a-b1b8-42fb-8cc1-bc72d26da675 tempest-CreateVolumesFromImageTest-1869356007 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:28:04 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-4383431a-b1b8-42fb-8cc1-bc72d26da675 tempest-CreateVolumesFromImageTest-1869356007 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:28:04 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-4383431a-b1b8-42fb-8cc1-bc72d26da675 tempest-CreateVolumesFromImageTest-1869356007 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:28:04 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-4383431a-b1b8-42fb-8cc1-bc72d26da675 tempest-CreateVolumesFromImageTest-1869356007 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:28:04 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-4383431a-b1b8-42fb-8cc1-bc72d26da675 tempest-CreateVolumesFromImageTest-1869356007 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:28:04 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-4383431a-b1b8-42fb-8cc1-bc72d26da675 tempest-CreateVolumesFromImageTest-1869356007 None] Selected osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 as target Quobyte volume. {{(pid=89182) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 12:28:04 devstack cinder-volume[89182]: INFO cinder.volume.drivers.remotefs [None req-4383431a-b1b8-42fb-8cc1-bc72d26da675 tempest-CreateVolumesFromImageTest-1869356007 None] casted to osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 Jul 31 12:28:04 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-4383431a-b1b8-42fb-8cc1-bc72d26da675 tempest-CreateVolumesFromImageTest-1869356007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-46232616-9e44-4137-9240-ce2362d54963 1073741824 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:28:04 devstack sudo[104720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-46232616-9e44-4137-9240-ce2362d54963 1073741824 Jul 31 12:28:04 devstack sudo[104720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:28:04 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-f1047c21-4c54-4e2b-be69-ce442dd114d6 tempest-CreateVolumesFromImageTest-1869356007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc2284de-fc60-4f21-bc66-4430df005dab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-109dd3ba-34e6-4e4f-adf6-eb86b4ce43bb', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:28:04 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-f1047c21-4c54-4e2b-be69-ce442dd114d6 tempest-CreateVolumesFromImageTest-1869356007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6347eab9-c760-47e8-b314-aa71e0933512) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:28:04 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-f1047c21-4c54-4e2b-be69-ce442dd114d6 tempest-CreateVolumesFromImageTest-1869356007 None] Volume volume-109dd3ba-34e6-4e4f-adf6-eb86b4ce43bb (109dd3ba-34e6-4e4f-adf6-eb86b4ce43bb): created successfully Jul 31 12:28:04 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-f1047c21-4c54-4e2b-be69-ce442dd114d6 tempest-CreateVolumesFromImageTest-1869356007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6347eab9-c760-47e8-b314-aa71e0933512) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:28:04 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-f1047c21-4c54-4e2b-be69-ce442dd114d6 tempest-CreateVolumesFromImageTest-1869356007 None] Flow 'volume_create_manager' (a20b46e1-03c4-44a8-a2c6-e676d3bc928f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:28:04 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-f1047c21-4c54-4e2b-be69-ce442dd114d6 tempest-CreateVolumesFromImageTest-1869356007 None] Created volume successfully. Jul 31 12:28:05 devstack sudo[104720]: pam_unix(sudo:session): session closed for user root Jul 31 12:28:05 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-4383431a-b1b8-42fb-8cc1-bc72d26da675 tempest-CreateVolumesFromImageTest-1869356007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-46232616-9e44-4137-9240-ce2362d54963 1073741824" returned: 0 in 0.574s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:28:05 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-4383431a-b1b8-42fb-8cc1-bc72d26da675 tempest-CreateVolumesFromImageTest-1869356007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-46232616-9e44-4137-9240-ce2362d54963 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:28:05 devstack sudo[104726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-46232616-9e44-4137-9240-ce2362d54963 Jul 31 12:28:05 devstack sudo[104726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:28:05 devstack sudo[104726]: pam_unix(sudo:session): session closed for user root Jul 31 12:28:05 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-4383431a-b1b8-42fb-8cc1-bc72d26da675 tempest-CreateVolumesFromImageTest-1869356007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-46232616-9e44-4137-9240-ce2362d54963" returned: 0 in 0.407s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:28:05 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-4383431a-b1b8-42fb-8cc1-bc72d26da675 tempest-CreateVolumesFromImageTest-1869356007 None] <== create_volume: return (1045ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'} {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 12:28:05 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-4383431a-b1b8-42fb-8cc1-bc72d26da675 tempest-CreateVolumesFromImageTest-1869356007 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.049s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:28:05 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-a48cd0b8-d597-43c2-85bf-d82c6f88b47a tempest-CreateVolumesFromImageTest-1869356007 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.229s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:28:05 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-a48cd0b8-d597-43c2-85bf-d82c6f88b47a tempest-CreateVolumesFromImageTest-1869356007 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:28:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1677087554',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=795115c4-8132-457c-8c39-9349dfc5b509,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1fed8ae63e04d5580661f5bb3a2f43c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:28:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:28:03Z,use_quota=True,user_id='b1e93750c6af42bda0de3df3cac24d6e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)}" {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 12:28:05 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-a48cd0b8-d597-43c2-85bf-d82c6f88b47a tempest-CreateVolumesFromImageTest-1869356007 None] Creating volume 795115c4-8132-457c-8c39-9349dfc5b509 {{(pid=89182) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 12:28:05 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-a48cd0b8-d597-43c2-85bf-d82c6f88b47a tempest-CreateVolumesFromImageTest-1869356007 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:28:05 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-a48cd0b8-d597-43c2-85bf-d82c6f88b47a tempest-CreateVolumesFromImageTest-1869356007 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:28:05 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-a48cd0b8-d597-43c2-85bf-d82c6f88b47a tempest-CreateVolumesFromImageTest-1869356007 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:28:05 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-a48cd0b8-d597-43c2-85bf-d82c6f88b47a tempest-CreateVolumesFromImageTest-1869356007 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:28:05 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-a48cd0b8-d597-43c2-85bf-d82c6f88b47a tempest-CreateVolumesFromImageTest-1869356007 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:28:05 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-a48cd0b8-d597-43c2-85bf-d82c6f88b47a tempest-CreateVolumesFromImageTest-1869356007 None] Selected osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 as target Quobyte volume. {{(pid=89182) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 12:28:05 devstack cinder-volume[89182]: INFO cinder.volume.drivers.remotefs [None req-a48cd0b8-d597-43c2-85bf-d82c6f88b47a tempest-CreateVolumesFromImageTest-1869356007 None] casted to osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 Jul 31 12:28:05 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-a48cd0b8-d597-43c2-85bf-d82c6f88b47a tempest-CreateVolumesFromImageTest-1869356007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-795115c4-8132-457c-8c39-9349dfc5b509 1073741824 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:28:05 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-4383431a-b1b8-42fb-8cc1-bc72d26da675 tempest-CreateVolumesFromImageTest-1869356007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5da5268-5ce7-45a5-862d-90491d2953ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-46232616-9e44-4137-9240-ce2362d54963', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:28:05 devstack sudo[104729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-795115c4-8132-457c-8c39-9349dfc5b509 1073741824 Jul 31 12:28:05 devstack sudo[104729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:28:05 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-4383431a-b1b8-42fb-8cc1-bc72d26da675 tempest-CreateVolumesFromImageTest-1869356007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ee18783-bf07-46ee-a11d-edb481c8cb18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:28:05 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-4383431a-b1b8-42fb-8cc1-bc72d26da675 tempest-CreateVolumesFromImageTest-1869356007 None] Volume volume-46232616-9e44-4137-9240-ce2362d54963 (46232616-9e44-4137-9240-ce2362d54963): created successfully Jul 31 12:28:05 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-4383431a-b1b8-42fb-8cc1-bc72d26da675 tempest-CreateVolumesFromImageTest-1869356007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ee18783-bf07-46ee-a11d-edb481c8cb18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:28:05 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-4383431a-b1b8-42fb-8cc1-bc72d26da675 tempest-CreateVolumesFromImageTest-1869356007 None] Flow 'volume_create_manager' (a87412a1-026e-4906-9f92-f39474925cfd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:28:05 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-4383431a-b1b8-42fb-8cc1-bc72d26da675 tempest-CreateVolumesFromImageTest-1869356007 None] Created volume successfully. Jul 31 12:28:06 devstack sudo[104729]: pam_unix(sudo:session): session closed for user root Jul 31 12:28:06 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-a48cd0b8-d597-43c2-85bf-d82c6f88b47a tempest-CreateVolumesFromImageTest-1869356007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-795115c4-8132-457c-8c39-9349dfc5b509 1073741824" returned: 0 in 0.722s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:28:06 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-a48cd0b8-d597-43c2-85bf-d82c6f88b47a tempest-CreateVolumesFromImageTest-1869356007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-795115c4-8132-457c-8c39-9349dfc5b509 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:28:06 devstack sudo[104736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-795115c4-8132-457c-8c39-9349dfc5b509 Jul 31 12:28:06 devstack sudo[104736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:28:06 devstack sudo[104736]: pam_unix(sudo:session): session closed for user root Jul 31 12:28:06 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-a48cd0b8-d597-43c2-85bf-d82c6f88b47a tempest-CreateVolumesFromImageTest-1869356007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-795115c4-8132-457c-8c39-9349dfc5b509" returned: 0 in 0.327s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:28:06 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-a48cd0b8-d597-43c2-85bf-d82c6f88b47a tempest-CreateVolumesFromImageTest-1869356007 None] <== create_volume: return (1112ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'} {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 12:28:06 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-a48cd0b8-d597-43c2-85bf-d82c6f88b47a tempest-CreateVolumesFromImageTest-1869356007 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.117s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:28:06 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-a48cd0b8-d597-43c2-85bf-d82c6f88b47a tempest-CreateVolumesFromImageTest-1869356007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53415f2b-d11c-4afc-afcd-12a7afb5edec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-795115c4-8132-457c-8c39-9349dfc5b509', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:28:06 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-a48cd0b8-d597-43c2-85bf-d82c6f88b47a tempest-CreateVolumesFromImageTest-1869356007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21eaaf23-1cde-4acd-b298-aa33f6fb259f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:28:06 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-a48cd0b8-d597-43c2-85bf-d82c6f88b47a tempest-CreateVolumesFromImageTest-1869356007 None] Volume volume-795115c4-8132-457c-8c39-9349dfc5b509 (795115c4-8132-457c-8c39-9349dfc5b509): created successfully Jul 31 12:28:06 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-a48cd0b8-d597-43c2-85bf-d82c6f88b47a tempest-CreateVolumesFromImageTest-1869356007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21eaaf23-1cde-4acd-b298-aa33f6fb259f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:28:06 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-a48cd0b8-d597-43c2-85bf-d82c6f88b47a tempest-CreateVolumesFromImageTest-1869356007 None] Flow 'volume_create_manager' (b9b76ee1-16a9-47b2-9556-f50a5e32e46e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:28:06 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-a48cd0b8-d597-43c2-85bf-d82c6f88b47a tempest-CreateVolumesFromImageTest-1869356007 None] Created volume successfully. Jul 31 12:28:07 devstack cinder-volume[89182]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac5f56f8-ca03-4a2f-b2b0-2a9deed1449a tempest-VolumesMetadataTest-1535386500 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89182) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 12:28:07 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-ac5f56f8-ca03-4a2f-b2b0-2a9deed1449a tempest-VolumesMetadataTest-1535386500 None] Flow 'volume_create_manager' (32404a87-8be6-4874-ad5b-712b62db683b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:28:07 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-ac5f56f8-ca03-4a2f-b2b0-2a9deed1449a tempest-VolumesMetadataTest-1535386500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5056718-03b2-4046-a627-6faaec3b7fed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:28:07 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-ac5f56f8-ca03-4a2f-b2b0-2a9deed1449a tempest-VolumesMetadataTest-1535386500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5056718-03b2-4046-a627-6faaec3b7fed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:28:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-621237216',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c8ca720-6498-4228-9274-6b918b5f9319,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10ed31df0d69410c8961ea6ebb9cda2f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:28:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:28:07Z,use_quota=True,user_id='bdcc8e35c4e646c7be2490f4afa43599',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:28:07 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-ac5f56f8-ca03-4a2f-b2b0-2a9deed1449a tempest-VolumesMetadataTest-1535386500 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81329f5a-d439-4e1f-8054-1f151e129244) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:28:07 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-ac5f56f8-ca03-4a2f-b2b0-2a9deed1449a tempest-VolumesMetadataTest-1535386500 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81329f5a-d439-4e1f-8054-1f151e129244) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:28:07 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-ac5f56f8-ca03-4a2f-b2b0-2a9deed1449a tempest-VolumesMetadataTest-1535386500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (335d2e35-576d-47c4-bd21-0949647877eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:28:07 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-ac5f56f8-ca03-4a2f-b2b0-2a9deed1449a tempest-VolumesMetadataTest-1535386500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (335d2e35-576d-47c4-bd21-0949647877eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4c8ca720-6498-4228-9274-6b918b5f9319', 'volume_name': 'volume-4c8ca720-6498-4228-9274-6b918b5f9319', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:28:07 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-ac5f56f8-ca03-4a2f-b2b0-2a9deed1449a tempest-VolumesMetadataTest-1535386500 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17a1709c-d0ee-45a6-81f4-387aff8afd81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:28:07 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-ac5f56f8-ca03-4a2f-b2b0-2a9deed1449a tempest-VolumesMetadataTest-1535386500 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17a1709c-d0ee-45a6-81f4-387aff8afd81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:28:07 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-ac5f56f8-ca03-4a2f-b2b0-2a9deed1449a tempest-VolumesMetadataTest-1535386500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb6f416a-3653-494e-9fc0-57ff0013e07d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:28:07 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-ac5f56f8-ca03-4a2f-b2b0-2a9deed1449a tempest-VolumesMetadataTest-1535386500 None] Volume 4c8ca720-6498-4228-9274-6b918b5f9319: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4c8ca720-6498-4228-9274-6b918b5f9319', 'volume_size': 1} Jul 31 12:28:07 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-ac5f56f8-ca03-4a2f-b2b0-2a9deed1449a tempest-VolumesMetadataTest-1535386500 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:28:07 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-ac5f56f8-ca03-4a2f-b2b0-2a9deed1449a tempest-VolumesMetadataTest-1535386500 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:28:07 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-ac5f56f8-ca03-4a2f-b2b0-2a9deed1449a tempest-VolumesMetadataTest-1535386500 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:28:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-621237216',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c8ca720-6498-4228-9274-6b918b5f9319,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10ed31df0d69410c8961ea6ebb9cda2f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:28:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:28:07Z,use_quota=True,user_id='bdcc8e35c4e646c7be2490f4afa43599',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)}" {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 12:28:07 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-ac5f56f8-ca03-4a2f-b2b0-2a9deed1449a tempest-VolumesMetadataTest-1535386500 None] Creating volume 4c8ca720-6498-4228-9274-6b918b5f9319 {{(pid=89182) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 12:28:07 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-ac5f56f8-ca03-4a2f-b2b0-2a9deed1449a tempest-VolumesMetadataTest-1535386500 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:28:07 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-ac5f56f8-ca03-4a2f-b2b0-2a9deed1449a tempest-VolumesMetadataTest-1535386500 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:28:07 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-ac5f56f8-ca03-4a2f-b2b0-2a9deed1449a tempest-VolumesMetadataTest-1535386500 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:28:07 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-ac5f56f8-ca03-4a2f-b2b0-2a9deed1449a tempest-VolumesMetadataTest-1535386500 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:28:07 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-ac5f56f8-ca03-4a2f-b2b0-2a9deed1449a tempest-VolumesMetadataTest-1535386500 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:28:07 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-ac5f56f8-ca03-4a2f-b2b0-2a9deed1449a tempest-VolumesMetadataTest-1535386500 None] Selected osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 as target Quobyte volume. {{(pid=89182) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 12:28:07 devstack cinder-volume[89182]: INFO cinder.volume.drivers.remotefs [None req-ac5f56f8-ca03-4a2f-b2b0-2a9deed1449a tempest-VolumesMetadataTest-1535386500 None] casted to osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 Jul 31 12:28:07 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-ac5f56f8-ca03-4a2f-b2b0-2a9deed1449a tempest-VolumesMetadataTest-1535386500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-4c8ca720-6498-4228-9274-6b918b5f9319 1073741824 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:28:07 devstack sudo[104740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-4c8ca720-6498-4228-9274-6b918b5f9319 1073741824 Jul 31 12:28:07 devstack sudo[104740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:28:07 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-bf625930-0819-4e09-b1c3-01a46f8c5d8c tempest-CreateVolumesFromImageTest-1869356007 None] Acquiring lock "cinder-795115c4-8132-457c-8c39-9349dfc5b509-delete_volume" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:28:07 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-bf625930-0819-4e09-b1c3-01a46f8c5d8c tempest-CreateVolumesFromImageTest-1869356007 None] Lock "cinder-795115c4-8132-457c-8c39-9349dfc5b509-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:28:08 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-bf625930-0819-4e09-b1c3-01a46f8c5d8c tempest-CreateVolumesFromImageTest-1869356007 None] Acquiring lock "cinder-quobyte-795115c4-8132-457c-8c39-9349dfc5b509" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:28:08 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-bf625930-0819-4e09-b1c3-01a46f8c5d8c tempest-CreateVolumesFromImageTest-1869356007 None] Lock "cinder-quobyte-795115c4-8132-457c-8c39-9349dfc5b509" acquired by "delete_volume" :: waited 0.027s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:28:08 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[511a092f-2f98-4f25-8359-6974fc8b1cd9]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:28:08 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-bf625930-0819-4e09-b1c3-01a46f8c5d8c tempest-CreateVolumesFromImageTest-1869356007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-795115c4-8132-457c-8c39-9349dfc5b509 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:28:08 devstack sudo[104740]: pam_unix(sudo:session): session closed for user root Jul 31 12:28:08 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-ac5f56f8-ca03-4a2f-b2b0-2a9deed1449a tempest-VolumesMetadataTest-1535386500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-4c8ca720-6498-4228-9274-6b918b5f9319 1073741824" returned: 0 in 0.598s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:28:08 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-ac5f56f8-ca03-4a2f-b2b0-2a9deed1449a tempest-VolumesMetadataTest-1535386500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-4c8ca720-6498-4228-9274-6b918b5f9319 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:28:08 devstack sudo[104747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-4c8ca720-6498-4228-9274-6b918b5f9319 Jul 31 12:28:08 devstack sudo[104747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:28:08 devstack sudo[104746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-795115c4-8132-457c-8c39-9349dfc5b509 Jul 31 12:28:08 devstack sudo[104746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:28:08 devstack sudo[104747]: pam_unix(sudo:session): session closed for user root Jul 31 12:28:08 devstack sudo[104746]: pam_unix(sudo:session): session closed for user root Jul 31 12:28:08 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-ac5f56f8-ca03-4a2f-b2b0-2a9deed1449a tempest-VolumesMetadataTest-1535386500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-4c8ca720-6498-4228-9274-6b918b5f9319" returned: 0 in 0.380s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:28:08 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-ac5f56f8-ca03-4a2f-b2b0-2a9deed1449a tempest-VolumesMetadataTest-1535386500 None] <== create_volume: return (1038ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'} {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 12:28:08 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-ac5f56f8-ca03-4a2f-b2b0-2a9deed1449a tempest-VolumesMetadataTest-1535386500 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.041s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:28:08 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-bf625930-0819-4e09-b1c3-01a46f8c5d8c tempest-CreateVolumesFromImageTest-1869356007 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-795115c4-8132-457c-8c39-9349dfc5b509" returned: 0 in 0.462s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:28:08 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-bf625930-0819-4e09-b1c3-01a46f8c5d8c tempest-CreateVolumesFromImageTest-1869356007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-795115c4-8132-457c-8c39-9349dfc5b509 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:28:08 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-ac5f56f8-ca03-4a2f-b2b0-2a9deed1449a tempest-VolumesMetadataTest-1535386500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb6f416a-3653-494e-9fc0-57ff0013e07d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4c8ca720-6498-4228-9274-6b918b5f9319', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:28:08 devstack sudo[104754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-795115c4-8132-457c-8c39-9349dfc5b509 Jul 31 12:28:08 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-ac5f56f8-ca03-4a2f-b2b0-2a9deed1449a tempest-VolumesMetadataTest-1535386500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25c91cdc-12ed-482c-a10c-6af9228f74e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:28:08 devstack sudo[104754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:28:08 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-ac5f56f8-ca03-4a2f-b2b0-2a9deed1449a tempest-VolumesMetadataTest-1535386500 None] Volume volume-4c8ca720-6498-4228-9274-6b918b5f9319 (4c8ca720-6498-4228-9274-6b918b5f9319): created successfully Jul 31 12:28:08 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-ac5f56f8-ca03-4a2f-b2b0-2a9deed1449a tempest-VolumesMetadataTest-1535386500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25c91cdc-12ed-482c-a10c-6af9228f74e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:28:08 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-ac5f56f8-ca03-4a2f-b2b0-2a9deed1449a tempest-VolumesMetadataTest-1535386500 None] Flow 'volume_create_manager' (32404a87-8be6-4874-ad5b-712b62db683b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:28:08 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-ac5f56f8-ca03-4a2f-b2b0-2a9deed1449a tempest-VolumesMetadataTest-1535386500 None] Created volume successfully. Jul 31 12:28:08 devstack sudo[104754]: pam_unix(sudo:session): session closed for user root Jul 31 12:28:08 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-bf625930-0819-4e09-b1c3-01a46f8c5d8c tempest-CreateVolumesFromImageTest-1869356007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-795115c4-8132-457c-8c39-9349dfc5b509" returned: 0 in 0.298s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:28:08 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-bf625930-0819-4e09-b1c3-01a46f8c5d8c tempest-CreateVolumesFromImageTest-1869356007 None] Lock "cinder-quobyte-795115c4-8132-457c-8c39-9349dfc5b509" released by "delete_volume" :: held 0.804s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:28:08 devstack cinder-volume[89182]: DEBUG cinder.quota [None req-bf625930-0819-4e09-b1c3-01a46f8c5d8c tempest-CreateVolumesFromImageTest-1869356007 None] Created reservations ['67fde47b-4c6d-460f-827f-0758cd21c64e', '68080434-dc7b-4a38-8b68-6948c6f1206e', '7c8f6009-299f-429f-a1e1-12a66cb9727a', 'd7ec87d4-c001-4415-9dc7-70744f24c2a9'] {{(pid=89182) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 12:28:08 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-bf625930-0819-4e09-b1c3-01a46f8c5d8c tempest-CreateVolumesFromImageTest-1869356007 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:28:08 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-bf625930-0819-4e09-b1c3-01a46f8c5d8c tempest-CreateVolumesFromImageTest-1869356007 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:28:08 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-bf625930-0819-4e09-b1c3-01a46f8c5d8c tempest-CreateVolumesFromImageTest-1869356007 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:28:09 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-bf625930-0819-4e09-b1c3-01a46f8c5d8c tempest-CreateVolumesFromImageTest-1869356007 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:28:09 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-bf625930-0819-4e09-b1c3-01a46f8c5d8c tempest-CreateVolumesFromImageTest-1869356007 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:28:09 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-bf625930-0819-4e09-b1c3-01a46f8c5d8c tempest-CreateVolumesFromImageTest-1869356007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:28:09 devstack sudo[104757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 Jul 31 12:28:09 devstack sudo[104757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:28:09 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-e69d7a97-b76b-40e1-b21a-2c018ced180d tempest-CreateVolumesFromImageTest-1869356007 None] Acquiring lock "cinder-46232616-9e44-4137-9240-ce2362d54963-delete_volume" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:28:09 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-e69d7a97-b76b-40e1-b21a-2c018ced180d tempest-CreateVolumesFromImageTest-1869356007 None] Lock "cinder-46232616-9e44-4137-9240-ce2362d54963-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:28:09 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-e69d7a97-b76b-40e1-b21a-2c018ced180d tempest-CreateVolumesFromImageTest-1869356007 None] Acquiring lock "cinder-quobyte-46232616-9e44-4137-9240-ce2362d54963" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:28:09 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-e69d7a97-b76b-40e1-b21a-2c018ced180d tempest-CreateVolumesFromImageTest-1869356007 None] Lock "cinder-quobyte-46232616-9e44-4137-9240-ce2362d54963" acquired by "delete_volume" :: waited 0.021s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:28:09 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[98c7549b-2434-4c8e-8987-b29c48cedb28]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:28:09 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-e69d7a97-b76b-40e1-b21a-2c018ced180d tempest-CreateVolumesFromImageTest-1869356007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-46232616-9e44-4137-9240-ce2362d54963 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:28:09 devstack sudo[104757]: pam_unix(sudo:session): session closed for user root Jul 31 12:28:09 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-bf625930-0819-4e09-b1c3-01a46f8c5d8c tempest-CreateVolumesFromImageTest-1869356007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2" returned: 0 in 0.303s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:28:09 devstack cinder-volume[89182]: DEBUG cinder.manager [None req-bf625930-0819-4e09-b1c3-01a46f8c5d8c tempest-CreateVolumesFromImageTest-1869356007 None] Notifying Schedulers of capabilities ... {{(pid=89182) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 12:28:09 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-bf625930-0819-4e09-b1c3-01a46f8c5d8c tempest-CreateVolumesFromImageTest-1869356007 None] Deleted volume successfully. Jul 31 12:28:09 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-bf625930-0819-4e09-b1c3-01a46f8c5d8c tempest-CreateVolumesFromImageTest-1869356007 None] Lock "cinder-795115c4-8132-457c-8c39-9349dfc5b509-delete_volume" released by "delete_volume" :: held 1.394s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:28:09 devstack sudo[104760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-46232616-9e44-4137-9240-ce2362d54963 Jul 31 12:28:09 devstack sudo[104760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:28:09 devstack sudo[104760]: pam_unix(sudo:session): session closed for user root Jul 31 12:28:09 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-e69d7a97-b76b-40e1-b21a-2c018ced180d tempest-CreateVolumesFromImageTest-1869356007 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-46232616-9e44-4137-9240-ce2362d54963" returned: 0 in 0.483s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:28:09 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-e69d7a97-b76b-40e1-b21a-2c018ced180d tempest-CreateVolumesFromImageTest-1869356007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-46232616-9e44-4137-9240-ce2362d54963 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:28:09 devstack sudo[104765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-46232616-9e44-4137-9240-ce2362d54963 Jul 31 12:28:09 devstack sudo[104765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:28:10 devstack sudo[104765]: pam_unix(sudo:session): session closed for user root Jul 31 12:28:10 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-e69d7a97-b76b-40e1-b21a-2c018ced180d tempest-CreateVolumesFromImageTest-1869356007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-46232616-9e44-4137-9240-ce2362d54963" returned: 0 in 0.311s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:28:10 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-e69d7a97-b76b-40e1-b21a-2c018ced180d tempest-CreateVolumesFromImageTest-1869356007 None] Lock "cinder-quobyte-46232616-9e44-4137-9240-ce2362d54963" released by "delete_volume" :: held 0.857s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:28:10 devstack cinder-volume[89182]: DEBUG cinder.quota [None req-e69d7a97-b76b-40e1-b21a-2c018ced180d tempest-CreateVolumesFromImageTest-1869356007 None] Created reservations ['640145b4-e5b6-4597-9af7-852bb0ea6e37', '6205dcea-6491-46e2-9d1e-8b252573ae4e', '71f0c2c0-192e-4124-87fa-e7040e793330', '38c31a00-bafe-485f-9fad-e1843a6ef1cb'] {{(pid=89182) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 12:28:10 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-e69d7a97-b76b-40e1-b21a-2c018ced180d tempest-CreateVolumesFromImageTest-1869356007 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:28:10 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-e69d7a97-b76b-40e1-b21a-2c018ced180d tempest-CreateVolumesFromImageTest-1869356007 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:28:10 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-e69d7a97-b76b-40e1-b21a-2c018ced180d tempest-CreateVolumesFromImageTest-1869356007 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:28:10 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-e69d7a97-b76b-40e1-b21a-2c018ced180d tempest-CreateVolumesFromImageTest-1869356007 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:28:10 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-e69d7a97-b76b-40e1-b21a-2c018ced180d tempest-CreateVolumesFromImageTest-1869356007 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:28:10 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-e69d7a97-b76b-40e1-b21a-2c018ced180d tempest-CreateVolumesFromImageTest-1869356007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:28:10 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-90cd67c1-8a15-4e2d-94b8-3d6001fcdc32 tempest-VolumesMetadataTest-1535386500 None] Acquiring lock "cinder-4c8ca720-6498-4228-9274-6b918b5f9319-delete_volume" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:28:10 devstack sudo[104768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 Jul 31 12:28:10 devstack sudo[104768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:28:10 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-d12235de-3dd6-40b0-90d3-65e9d465da02 tempest-CreateVolumesFromImageTest-1869356007 None] Acquiring lock "cinder-109dd3ba-34e6-4e4f-adf6-eb86b4ce43bb-delete_volume" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:28:10 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-90cd67c1-8a15-4e2d-94b8-3d6001fcdc32 tempest-VolumesMetadataTest-1535386500 None] Lock "cinder-4c8ca720-6498-4228-9274-6b918b5f9319-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:28:10 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-d12235de-3dd6-40b0-90d3-65e9d465da02 tempest-CreateVolumesFromImageTest-1869356007 None] Lock "cinder-109dd3ba-34e6-4e4f-adf6-eb86b4ce43bb-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:28:10 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-90cd67c1-8a15-4e2d-94b8-3d6001fcdc32 tempest-VolumesMetadataTest-1535386500 None] Acquiring lock "cinder-quobyte-4c8ca720-6498-4228-9274-6b918b5f9319" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:28:10 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-d12235de-3dd6-40b0-90d3-65e9d465da02 tempest-CreateVolumesFromImageTest-1869356007 None] Acquiring lock "cinder-quobyte-109dd3ba-34e6-4e4f-adf6-eb86b4ce43bb" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:28:10 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-90cd67c1-8a15-4e2d-94b8-3d6001fcdc32 tempest-VolumesMetadataTest-1535386500 None] Lock "cinder-quobyte-4c8ca720-6498-4228-9274-6b918b5f9319" acquired by "delete_volume" :: waited 0.039s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:28:10 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-d12235de-3dd6-40b0-90d3-65e9d465da02 tempest-CreateVolumesFromImageTest-1869356007 None] Lock "cinder-quobyte-109dd3ba-34e6-4e4f-adf6-eb86b4ce43bb" acquired by "delete_volume" :: waited 0.048s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:28:10 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[c157d4e4-621a-4d48-a715-fe33ea9fa83d]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:28:10 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-90cd67c1-8a15-4e2d-94b8-3d6001fcdc32 tempest-VolumesMetadataTest-1535386500 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-4c8ca720-6498-4228-9274-6b918b5f9319 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:28:10 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[c59c282a-5af7-4d80-b3db-20408a9728e5]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:28:10 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-d12235de-3dd6-40b0-90d3-65e9d465da02 tempest-CreateVolumesFromImageTest-1869356007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-109dd3ba-34e6-4e4f-adf6-eb86b4ce43bb {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:28:10 devstack sudo[104768]: pam_unix(sudo:session): session closed for user root Jul 31 12:28:10 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-e69d7a97-b76b-40e1-b21a-2c018ced180d tempest-CreateVolumesFromImageTest-1869356007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2" returned: 0 in 0.319s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:28:10 devstack cinder-volume[89182]: DEBUG cinder.manager [None req-e69d7a97-b76b-40e1-b21a-2c018ced180d tempest-CreateVolumesFromImageTest-1869356007 None] Notifying Schedulers of capabilities ... {{(pid=89182) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 12:28:10 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-e69d7a97-b76b-40e1-b21a-2c018ced180d tempest-CreateVolumesFromImageTest-1869356007 None] Deleted volume successfully. Jul 31 12:28:10 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-e69d7a97-b76b-40e1-b21a-2c018ced180d tempest-CreateVolumesFromImageTest-1869356007 None] Lock "cinder-46232616-9e44-4137-9240-ce2362d54963-delete_volume" released by "delete_volume" :: held 1.556s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:28:10 devstack sudo[104771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-4c8ca720-6498-4228-9274-6b918b5f9319 Jul 31 12:28:10 devstack sudo[104771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:28:10 devstack sudo[104772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-109dd3ba-34e6-4e4f-adf6-eb86b4ce43bb Jul 31 12:28:10 devstack sudo[104772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:28:11 devstack sudo[104771]: pam_unix(sudo:session): session closed for user root Jul 31 12:28:11 devstack sudo[104772]: pam_unix(sudo:session): session closed for user root Jul 31 12:28:11 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-90cd67c1-8a15-4e2d-94b8-3d6001fcdc32 tempest-VolumesMetadataTest-1535386500 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-4c8ca720-6498-4228-9274-6b918b5f9319" returned: 0 in 0.488s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:28:11 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-90cd67c1-8a15-4e2d-94b8-3d6001fcdc32 tempest-VolumesMetadataTest-1535386500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-4c8ca720-6498-4228-9274-6b918b5f9319 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:28:11 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-d12235de-3dd6-40b0-90d3-65e9d465da02 tempest-CreateVolumesFromImageTest-1869356007 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-109dd3ba-34e6-4e4f-adf6-eb86b4ce43bb" returned: 0 in 0.476s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:28:11 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-d12235de-3dd6-40b0-90d3-65e9d465da02 tempest-CreateVolumesFromImageTest-1869356007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-109dd3ba-34e6-4e4f-adf6-eb86b4ce43bb {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:28:11 devstack sudo[104782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-4c8ca720-6498-4228-9274-6b918b5f9319 Jul 31 12:28:11 devstack sudo[104782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:28:11 devstack sudo[104783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-109dd3ba-34e6-4e4f-adf6-eb86b4ce43bb Jul 31 12:28:11 devstack sudo[104783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:28:11 devstack sudo[104783]: pam_unix(sudo:session): session closed for user root Jul 31 12:28:11 devstack sudo[104782]: pam_unix(sudo:session): session closed for user root Jul 31 12:28:11 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-d12235de-3dd6-40b0-90d3-65e9d465da02 tempest-CreateVolumesFromImageTest-1869356007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-109dd3ba-34e6-4e4f-adf6-eb86b4ce43bb" returned: 0 in 0.302s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:28:11 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-90cd67c1-8a15-4e2d-94b8-3d6001fcdc32 tempest-VolumesMetadataTest-1535386500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-4c8ca720-6498-4228-9274-6b918b5f9319" returned: 0 in 0.324s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:28:11 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-d12235de-3dd6-40b0-90d3-65e9d465da02 tempest-CreateVolumesFromImageTest-1869356007 None] Lock "cinder-quobyte-109dd3ba-34e6-4e4f-adf6-eb86b4ce43bb" released by "delete_volume" :: held 0.861s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:28:11 devstack cinder-volume[89182]: DEBUG dbcounter [-] [89182] Writing DB stats cinder:SELECT=192,cinder:UPDATE=253,cinder:INSERT=64,cinder:DELETE=14 {{(pid=89182) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 12:28:11 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-90cd67c1-8a15-4e2d-94b8-3d6001fcdc32 tempest-VolumesMetadataTest-1535386500 None] Lock "cinder-quobyte-4c8ca720-6498-4228-9274-6b918b5f9319" released by "delete_volume" :: held 0.917s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:28:11 devstack cinder-volume[89182]: DEBUG cinder.quota [None req-d12235de-3dd6-40b0-90d3-65e9d465da02 tempest-CreateVolumesFromImageTest-1869356007 None] Created reservations ['54c2ad9c-2ad6-4f3f-8fcf-9a60e9926ab0', '7b21aaba-2695-408f-bcbc-f71e4543a0cc', 'd64d5d5c-228d-47a3-8c4f-f4c09940257d', '8eda347c-6b2f-4344-a78e-436b0e7b89c7'] {{(pid=89182) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 12:28:11 devstack cinder-volume[89182]: DEBUG cinder.quota [None req-90cd67c1-8a15-4e2d-94b8-3d6001fcdc32 tempest-VolumesMetadataTest-1535386500 None] Created reservations ['cf3197be-091e-4c2f-ac4c-6d9b71d2d550', '996607fb-f652-4a8f-af02-f052bf49e69b', '07143b14-f5bf-49f1-97f4-26c841f9ce42', '2f2322c2-c85b-409c-82fa-bd867a466126'] {{(pid=89182) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 12:28:11 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-d12235de-3dd6-40b0-90d3-65e9d465da02 tempest-CreateVolumesFromImageTest-1869356007 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:28:11 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-d12235de-3dd6-40b0-90d3-65e9d465da02 tempest-CreateVolumesFromImageTest-1869356007 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:28:11 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-d12235de-3dd6-40b0-90d3-65e9d465da02 tempest-CreateVolumesFromImageTest-1869356007 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:28:11 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-d12235de-3dd6-40b0-90d3-65e9d465da02 tempest-CreateVolumesFromImageTest-1869356007 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:28:11 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-d12235de-3dd6-40b0-90d3-65e9d465da02 tempest-CreateVolumesFromImageTest-1869356007 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:28:11 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-d12235de-3dd6-40b0-90d3-65e9d465da02 tempest-CreateVolumesFromImageTest-1869356007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:28:11 devstack sudo[104788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 Jul 31 12:28:11 devstack sudo[104788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:28:11 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-90cd67c1-8a15-4e2d-94b8-3d6001fcdc32 tempest-VolumesMetadataTest-1535386500 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:28:11 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-90cd67c1-8a15-4e2d-94b8-3d6001fcdc32 tempest-VolumesMetadataTest-1535386500 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:28:11 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-90cd67c1-8a15-4e2d-94b8-3d6001fcdc32 tempest-VolumesMetadataTest-1535386500 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:28:11 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-90cd67c1-8a15-4e2d-94b8-3d6001fcdc32 tempest-VolumesMetadataTest-1535386500 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:28:11 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-90cd67c1-8a15-4e2d-94b8-3d6001fcdc32 tempest-VolumesMetadataTest-1535386500 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:28:11 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-90cd67c1-8a15-4e2d-94b8-3d6001fcdc32 tempest-VolumesMetadataTest-1535386500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:28:11 devstack sudo[104790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 Jul 31 12:28:11 devstack sudo[104790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:28:12 devstack sudo[104788]: pam_unix(sudo:session): session closed for user root Jul 31 12:28:12 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-d12235de-3dd6-40b0-90d3-65e9d465da02 tempest-CreateVolumesFromImageTest-1869356007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2" returned: 0 in 0.276s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:28:12 devstack cinder-volume[89182]: DEBUG cinder.manager [None req-d12235de-3dd6-40b0-90d3-65e9d465da02 tempest-CreateVolumesFromImageTest-1869356007 None] Notifying Schedulers of capabilities ... {{(pid=89182) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 12:28:12 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-d12235de-3dd6-40b0-90d3-65e9d465da02 tempest-CreateVolumesFromImageTest-1869356007 None] Deleted volume successfully. Jul 31 12:28:12 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-d12235de-3dd6-40b0-90d3-65e9d465da02 tempest-CreateVolumesFromImageTest-1869356007 None] Lock "cinder-109dd3ba-34e6-4e4f-adf6-eb86b4ce43bb-delete_volume" released by "delete_volume" :: held 1.560s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:28:12 devstack sudo[104790]: pam_unix(sudo:session): session closed for user root Jul 31 12:28:12 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-90cd67c1-8a15-4e2d-94b8-3d6001fcdc32 tempest-VolumesMetadataTest-1535386500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2" returned: 0 in 0.300s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:28:12 devstack cinder-volume[89182]: DEBUG cinder.manager [None req-90cd67c1-8a15-4e2d-94b8-3d6001fcdc32 tempest-VolumesMetadataTest-1535386500 None] Notifying Schedulers of capabilities ... {{(pid=89182) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 12:28:12 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-90cd67c1-8a15-4e2d-94b8-3d6001fcdc32 tempest-VolumesMetadataTest-1535386500 None] Deleted volume successfully. Jul 31 12:28:12 devstack cinder-volume[89182]: DEBUG dbcounter [-] [89182] Writing DB stats cinder:UPDATE=251,cinder:SELECT=186,cinder:INSERT=72,cinder:DELETE=26 {{(pid=89182) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 12:28:12 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-90cd67c1-8a15-4e2d-94b8-3d6001fcdc32 tempest-VolumesMetadataTest-1535386500 None] Lock "cinder-4c8ca720-6498-4228-9274-6b918b5f9319-delete_volume" released by "delete_volume" :: held 1.669s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:28:12 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-c1c68563-5f9e-4e49-bc8c-8af5457d03a9 tempest-CreateVolumesFromImageTest-1869356007 None] Acquiring lock "cinder-8eb15d74-26f2-4c11-a552-434b1ffda38f-delete_volume" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:28:12 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-c1c68563-5f9e-4e49-bc8c-8af5457d03a9 tempest-CreateVolumesFromImageTest-1869356007 None] Lock "cinder-8eb15d74-26f2-4c11-a552-434b1ffda38f-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:28:12 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-c1c68563-5f9e-4e49-bc8c-8af5457d03a9 tempest-CreateVolumesFromImageTest-1869356007 None] Acquiring lock "cinder-quobyte-8eb15d74-26f2-4c11-a552-434b1ffda38f" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:28:12 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-c1c68563-5f9e-4e49-bc8c-8af5457d03a9 tempest-CreateVolumesFromImageTest-1869356007 None] Lock "cinder-quobyte-8eb15d74-26f2-4c11-a552-434b1ffda38f" acquired by "delete_volume" :: waited 0.025s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:28:12 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[61558081-c48e-4284-b96c-19b033cd5208]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:28:12 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-c1c68563-5f9e-4e49-bc8c-8af5457d03a9 tempest-CreateVolumesFromImageTest-1869356007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-8eb15d74-26f2-4c11-a552-434b1ffda38f {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:28:13 devstack sudo[104794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-8eb15d74-26f2-4c11-a552-434b1ffda38f Jul 31 12:28:13 devstack sudo[104794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:28:13 devstack sudo[104794]: pam_unix(sudo:session): session closed for user root Jul 31 12:28:13 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-c1c68563-5f9e-4e49-bc8c-8af5457d03a9 tempest-CreateVolumesFromImageTest-1869356007 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-8eb15d74-26f2-4c11-a552-434b1ffda38f" returned: 0 in 0.413s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:28:13 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-c1c68563-5f9e-4e49-bc8c-8af5457d03a9 tempest-CreateVolumesFromImageTest-1869356007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-8eb15d74-26f2-4c11-a552-434b1ffda38f {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:28:13 devstack sudo[104799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-8eb15d74-26f2-4c11-a552-434b1ffda38f Jul 31 12:28:13 devstack sudo[104799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:28:13 devstack sudo[104799]: pam_unix(sudo:session): session closed for user root Jul 31 12:28:13 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-c1c68563-5f9e-4e49-bc8c-8af5457d03a9 tempest-CreateVolumesFromImageTest-1869356007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-8eb15d74-26f2-4c11-a552-434b1ffda38f" returned: 0 in 0.323s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:28:13 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-c1c68563-5f9e-4e49-bc8c-8af5457d03a9 tempest-CreateVolumesFromImageTest-1869356007 None] Lock "cinder-quobyte-8eb15d74-26f2-4c11-a552-434b1ffda38f" released by "delete_volume" :: held 0.800s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:28:13 devstack cinder-volume[89182]: DEBUG cinder.quota [None req-c1c68563-5f9e-4e49-bc8c-8af5457d03a9 tempest-CreateVolumesFromImageTest-1869356007 None] Created reservations ['48576d5d-f90f-4507-81c8-40b1dd6c0851', '377d6233-4cc5-41ab-9694-de745a9adbea', 'dd3f1731-fe04-45a3-ac22-06de7a9aa0cb', '25558c28-6b97-40ef-8d3f-957c3c439769'] {{(pid=89182) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 12:28:13 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-c1c68563-5f9e-4e49-bc8c-8af5457d03a9 tempest-CreateVolumesFromImageTest-1869356007 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:28:13 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-c1c68563-5f9e-4e49-bc8c-8af5457d03a9 tempest-CreateVolumesFromImageTest-1869356007 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:28:13 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-c1c68563-5f9e-4e49-bc8c-8af5457d03a9 tempest-CreateVolumesFromImageTest-1869356007 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:28:13 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-c1c68563-5f9e-4e49-bc8c-8af5457d03a9 tempest-CreateVolumesFromImageTest-1869356007 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:28:13 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-c1c68563-5f9e-4e49-bc8c-8af5457d03a9 tempest-CreateVolumesFromImageTest-1869356007 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:28:13 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-c1c68563-5f9e-4e49-bc8c-8af5457d03a9 tempest-CreateVolumesFromImageTest-1869356007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:28:13 devstack sudo[104802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 Jul 31 12:28:13 devstack sudo[104802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:28:14 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-e51ff79c-8528-44c1-a686-eeab9968c36d tempest-CreateVolumesFromImageTest-1869356007 None] Acquiring lock "cinder-7d965740-5993-4dde-a985-04b5dacbd6ca-delete_volume" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:28:14 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-e51ff79c-8528-44c1-a686-eeab9968c36d tempest-CreateVolumesFromImageTest-1869356007 None] Lock "cinder-7d965740-5993-4dde-a985-04b5dacbd6ca-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:28:14 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-e51ff79c-8528-44c1-a686-eeab9968c36d tempest-CreateVolumesFromImageTest-1869356007 None] Acquiring lock "cinder-quobyte-7d965740-5993-4dde-a985-04b5dacbd6ca" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:28:14 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-e51ff79c-8528-44c1-a686-eeab9968c36d tempest-CreateVolumesFromImageTest-1869356007 None] Lock "cinder-quobyte-7d965740-5993-4dde-a985-04b5dacbd6ca" acquired by "delete_volume" :: waited 0.026s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:28:14 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[758ee7a5-eecd-4c75-b574-3df08327222a]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:28:14 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-e51ff79c-8528-44c1-a686-eeab9968c36d tempest-CreateVolumesFromImageTest-1869356007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-7d965740-5993-4dde-a985-04b5dacbd6ca {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:28:14 devstack sudo[104802]: pam_unix(sudo:session): session closed for user root Jul 31 12:28:14 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-c1c68563-5f9e-4e49-bc8c-8af5457d03a9 tempest-CreateVolumesFromImageTest-1869356007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2" returned: 0 in 0.366s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:28:14 devstack cinder-volume[89182]: DEBUG cinder.manager [None req-c1c68563-5f9e-4e49-bc8c-8af5457d03a9 tempest-CreateVolumesFromImageTest-1869356007 None] Notifying Schedulers of capabilities ... {{(pid=89182) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 12:28:14 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-c1c68563-5f9e-4e49-bc8c-8af5457d03a9 tempest-CreateVolumesFromImageTest-1869356007 None] Deleted volume successfully. Jul 31 12:28:14 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-c1c68563-5f9e-4e49-bc8c-8af5457d03a9 tempest-CreateVolumesFromImageTest-1869356007 None] Lock "cinder-8eb15d74-26f2-4c11-a552-434b1ffda38f-delete_volume" released by "delete_volume" :: held 1.422s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:28:14 devstack sudo[104805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-7d965740-5993-4dde-a985-04b5dacbd6ca Jul 31 12:28:14 devstack sudo[104805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:28:14 devstack sudo[104805]: pam_unix(sudo:session): session closed for user root Jul 31 12:28:14 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-e51ff79c-8528-44c1-a686-eeab9968c36d tempest-CreateVolumesFromImageTest-1869356007 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-7d965740-5993-4dde-a985-04b5dacbd6ca" returned: 0 in 0.431s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:28:14 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-e51ff79c-8528-44c1-a686-eeab9968c36d tempest-CreateVolumesFromImageTest-1869356007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-7d965740-5993-4dde-a985-04b5dacbd6ca {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:28:14 devstack sudo[104810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-7d965740-5993-4dde-a985-04b5dacbd6ca Jul 31 12:28:14 devstack sudo[104810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:28:14 devstack sudo[104810]: pam_unix(sudo:session): session closed for user root Jul 31 12:28:14 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-e51ff79c-8528-44c1-a686-eeab9968c36d tempest-CreateVolumesFromImageTest-1869356007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-7d965740-5993-4dde-a985-04b5dacbd6ca" returned: 0 in 0.302s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:28:14 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-e51ff79c-8528-44c1-a686-eeab9968c36d tempest-CreateVolumesFromImageTest-1869356007 None] Lock "cinder-quobyte-7d965740-5993-4dde-a985-04b5dacbd6ca" released by "delete_volume" :: held 0.804s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:28:15 devstack cinder-volume[89182]: DEBUG cinder.quota [None req-e51ff79c-8528-44c1-a686-eeab9968c36d tempest-CreateVolumesFromImageTest-1869356007 None] Created reservations ['5f794414-345f-41d6-b8fd-5292f3bfa1b3', 'c6cfa31e-6d5c-478f-b480-9574b4e077c5', 'ffd8d0ff-bfaf-45a7-9875-de53574012aa', 'eb2cdd04-8265-421d-9f87-a43206e50085'] {{(pid=89182) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 12:28:15 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-e51ff79c-8528-44c1-a686-eeab9968c36d tempest-CreateVolumesFromImageTest-1869356007 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:28:15 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-e51ff79c-8528-44c1-a686-eeab9968c36d tempest-CreateVolumesFromImageTest-1869356007 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:28:15 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-e51ff79c-8528-44c1-a686-eeab9968c36d tempest-CreateVolumesFromImageTest-1869356007 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:28:15 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-e51ff79c-8528-44c1-a686-eeab9968c36d tempest-CreateVolumesFromImageTest-1869356007 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:28:15 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-e51ff79c-8528-44c1-a686-eeab9968c36d tempest-CreateVolumesFromImageTest-1869356007 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:28:15 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-e51ff79c-8528-44c1-a686-eeab9968c36d tempest-CreateVolumesFromImageTest-1869356007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:28:15 devstack sudo[104813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 Jul 31 12:28:15 devstack sudo[104813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:28:15 devstack sudo[104813]: pam_unix(sudo:session): session closed for user root Jul 31 12:28:15 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-e51ff79c-8528-44c1-a686-eeab9968c36d tempest-CreateVolumesFromImageTest-1869356007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2" returned: 0 in 0.309s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:28:15 devstack cinder-volume[89182]: DEBUG cinder.manager [None req-e51ff79c-8528-44c1-a686-eeab9968c36d tempest-CreateVolumesFromImageTest-1869356007 None] Notifying Schedulers of capabilities ... {{(pid=89182) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 12:28:15 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-e51ff79c-8528-44c1-a686-eeab9968c36d tempest-CreateVolumesFromImageTest-1869356007 None] Deleted volume successfully. Jul 31 12:28:15 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-e51ff79c-8528-44c1-a686-eeab9968c36d tempest-CreateVolumesFromImageTest-1869356007 None] Lock "cinder-7d965740-5993-4dde-a985-04b5dacbd6ca-delete_volume" released by "delete_volume" :: held 1.409s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:28:21 devstack cinder-volume[89182]: DEBUG oslo_service.periodic_task [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89182) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 31 12:28:21 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:28:21 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:28:21 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:28:21 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:28:21 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:28:21 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:28:22 devstack sudo[104819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 Jul 31 12:28:22 devstack sudo[104819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:28:22 devstack sudo[104819]: pam_unix(sudo:session): session closed for user root Jul 31 12:28:22 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2" returned: 0 in 0.393s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:28:22 devstack cinder-volume[89182]: DEBUG cinder.manager [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] Notifying Schedulers of capabilities ... {{(pid=89182) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 12:28:22 devstack cinder-volume[89182]: DEBUG oslo_service.periodic_task [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] Running periodic task VolumeManager._thread_info {{(pid=89182) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 31 12:28:22 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] thread count: 28 {{(pid=89182) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 31 12:28:22 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] thread info: [<_MainThread(MainThread, started 136154603720832)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=89182) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 31 12:28:25 devstack cinder-volume[89182]: DEBUG dbcounter [-] [89182] Writing DB stats cinder:SELECT=7,cinder:INSERT=4,cinder:UPDATE=17,cinder:DELETE=1 {{(pid=89182) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 12:28:25 devstack cinder-volume[89182]: DEBUG dbcounter [-] [89182] Writing DB stats cinder:SELECT=19,cinder:INSERT=6,cinder:UPDATE=29,cinder:DELETE=2 {{(pid=89182) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 12:28:28 devstack cinder-volume[89182]: DEBUG cinder.volume.flows.manager.create_volume [None req-4279c428-89a0-4080-9ed9-7ba4e7b5da6c tempest-VolumesActionsTest-1589472443 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89182) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 12:28:28 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-4279c428-89a0-4080-9ed9-7ba4e7b5da6c tempest-VolumesActionsTest-1589472443 None] Flow 'volume_create_manager' (111bcf46-1e11-45c8-87af-fe76c0782622) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:28:28 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-4279c428-89a0-4080-9ed9-7ba4e7b5da6c tempest-VolumesActionsTest-1589472443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76dad398-f0e4-42e5-a264-5058f163f0b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:28:28 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-4279c428-89a0-4080-9ed9-7ba4e7b5da6c tempest-VolumesActionsTest-1589472443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76dad398-f0e4-42e5-a264-5058f163f0b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:28:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1394464798',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02345ec5-f983-4ef9-895e-cc9e9a06d7d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4703cf9b9224b208a161cacb4021979',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:28:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:28:29Z,use_quota=True,user_id='e11d039bb192442cbfe1346a70da6295',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:28:28 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-4279c428-89a0-4080-9ed9-7ba4e7b5da6c tempest-VolumesActionsTest-1589472443 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (319db2be-c6a3-4564-9a24-88030a223c66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:28:28 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-4279c428-89a0-4080-9ed9-7ba4e7b5da6c tempest-VolumesActionsTest-1589472443 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (319db2be-c6a3-4564-9a24-88030a223c66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:28:28 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-4279c428-89a0-4080-9ed9-7ba4e7b5da6c tempest-VolumesActionsTest-1589472443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f231e6f-1f24-4a40-8852-e38aa7e0946a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:28:28 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-4279c428-89a0-4080-9ed9-7ba4e7b5da6c tempest-VolumesActionsTest-1589472443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f231e6f-1f24-4a40-8852-e38aa7e0946a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '02345ec5-f983-4ef9-895e-cc9e9a06d7d0', 'volume_name': 'volume-02345ec5-f983-4ef9-895e-cc9e9a06d7d0', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:28:28 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-4279c428-89a0-4080-9ed9-7ba4e7b5da6c tempest-VolumesActionsTest-1589472443 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd3c23c5-110a-4942-9adb-a096bb6c58aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:28:28 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-4279c428-89a0-4080-9ed9-7ba4e7b5da6c tempest-VolumesActionsTest-1589472443 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd3c23c5-110a-4942-9adb-a096bb6c58aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:28:28 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-4279c428-89a0-4080-9ed9-7ba4e7b5da6c tempest-VolumesActionsTest-1589472443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f555d840-9e8f-438f-9e08-2bd09845710d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:28:28 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-4279c428-89a0-4080-9ed9-7ba4e7b5da6c tempest-VolumesActionsTest-1589472443 None] Volume 02345ec5-f983-4ef9-895e-cc9e9a06d7d0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-02345ec5-f983-4ef9-895e-cc9e9a06d7d0', 'volume_size': 1} Jul 31 12:28:28 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-4279c428-89a0-4080-9ed9-7ba4e7b5da6c tempest-VolumesActionsTest-1589472443 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:28:28 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-4279c428-89a0-4080-9ed9-7ba4e7b5da6c tempest-VolumesActionsTest-1589472443 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:28:28 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-4279c428-89a0-4080-9ed9-7ba4e7b5da6c tempest-VolumesActionsTest-1589472443 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:28:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1394464798',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02345ec5-f983-4ef9-895e-cc9e9a06d7d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4703cf9b9224b208a161cacb4021979',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:28:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:28:29Z,use_quota=True,user_id='e11d039bb192442cbfe1346a70da6295',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)}" {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 12:28:28 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-4279c428-89a0-4080-9ed9-7ba4e7b5da6c tempest-VolumesActionsTest-1589472443 None] Creating volume 02345ec5-f983-4ef9-895e-cc9e9a06d7d0 {{(pid=89182) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 12:28:28 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-4279c428-89a0-4080-9ed9-7ba4e7b5da6c tempest-VolumesActionsTest-1589472443 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:28:28 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-4279c428-89a0-4080-9ed9-7ba4e7b5da6c tempest-VolumesActionsTest-1589472443 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:28:28 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-4279c428-89a0-4080-9ed9-7ba4e7b5da6c tempest-VolumesActionsTest-1589472443 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:28:28 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-4279c428-89a0-4080-9ed9-7ba4e7b5da6c tempest-VolumesActionsTest-1589472443 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:28:28 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-4279c428-89a0-4080-9ed9-7ba4e7b5da6c tempest-VolumesActionsTest-1589472443 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:28:28 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-4279c428-89a0-4080-9ed9-7ba4e7b5da6c tempest-VolumesActionsTest-1589472443 None] Selected osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 as target Quobyte volume. {{(pid=89182) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 12:28:28 devstack cinder-volume[89182]: INFO cinder.volume.drivers.remotefs [None req-4279c428-89a0-4080-9ed9-7ba4e7b5da6c tempest-VolumesActionsTest-1589472443 None] casted to osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 Jul 31 12:28:28 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-4279c428-89a0-4080-9ed9-7ba4e7b5da6c tempest-VolumesActionsTest-1589472443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-02345ec5-f983-4ef9-895e-cc9e9a06d7d0 1073741824 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:28:28 devstack sudo[104841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-02345ec5-f983-4ef9-895e-cc9e9a06d7d0 1073741824 Jul 31 12:28:28 devstack sudo[104841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:28:29 devstack sudo[104841]: pam_unix(sudo:session): session closed for user root Jul 31 12:28:29 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-4279c428-89a0-4080-9ed9-7ba4e7b5da6c tempest-VolumesActionsTest-1589472443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-02345ec5-f983-4ef9-895e-cc9e9a06d7d0 1073741824" returned: 0 in 0.632s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:28:29 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-4279c428-89a0-4080-9ed9-7ba4e7b5da6c tempest-VolumesActionsTest-1589472443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-02345ec5-f983-4ef9-895e-cc9e9a06d7d0 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:28:29 devstack sudo[104848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-02345ec5-f983-4ef9-895e-cc9e9a06d7d0 Jul 31 12:28:29 devstack sudo[104848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:28:30 devstack sudo[104848]: pam_unix(sudo:session): session closed for user root Jul 31 12:28:30 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-4279c428-89a0-4080-9ed9-7ba4e7b5da6c tempest-VolumesActionsTest-1589472443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-02345ec5-f983-4ef9-895e-cc9e9a06d7d0" returned: 0 in 0.541s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:28:30 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-4279c428-89a0-4080-9ed9-7ba4e7b5da6c tempest-VolumesActionsTest-1589472443 None] <== create_volume: return (1257ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'} {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 12:28:30 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-4279c428-89a0-4080-9ed9-7ba4e7b5da6c tempest-VolumesActionsTest-1589472443 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.267s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:28:30 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-4279c428-89a0-4080-9ed9-7ba4e7b5da6c tempest-VolumesActionsTest-1589472443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f555d840-9e8f-438f-9e08-2bd09845710d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-02345ec5-f983-4ef9-895e-cc9e9a06d7d0', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:28:30 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-4279c428-89a0-4080-9ed9-7ba4e7b5da6c tempest-VolumesActionsTest-1589472443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7184256-cd12-46cb-8f70-e7361ec95829) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:28:30 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-4279c428-89a0-4080-9ed9-7ba4e7b5da6c tempest-VolumesActionsTest-1589472443 None] Volume volume-02345ec5-f983-4ef9-895e-cc9e9a06d7d0 (02345ec5-f983-4ef9-895e-cc9e9a06d7d0): created successfully Jul 31 12:28:30 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-4279c428-89a0-4080-9ed9-7ba4e7b5da6c tempest-VolumesActionsTest-1589472443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7184256-cd12-46cb-8f70-e7361ec95829) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:28:30 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-4279c428-89a0-4080-9ed9-7ba4e7b5da6c tempest-VolumesActionsTest-1589472443 None] Flow 'volume_create_manager' (111bcf46-1e11-45c8-87af-fe76c0782622) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:28:30 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-4279c428-89a0-4080-9ed9-7ba4e7b5da6c tempest-VolumesActionsTest-1589472443 None] Created volume successfully. Jul 31 12:28:34 devstack cinder-volume[89182]: DEBUG cinder.volume.flows.manager.create_volume [None req-412fa1d2-e624-48c8-b183-f87960d9d931 tempest-VolumesActionsTest-1469638287 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89182) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 12:28:34 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-412fa1d2-e624-48c8-b183-f87960d9d931 tempest-VolumesActionsTest-1469638287 None] Flow 'volume_create_manager' (db7d7d5c-d256-4807-b049-05f5cf4207b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:28:34 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-412fa1d2-e624-48c8-b183-f87960d9d931 tempest-VolumesActionsTest-1469638287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab8895ac-b992-429b-99fc-89030676aaf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:28:34 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-412fa1d2-e624-48c8-b183-f87960d9d931 tempest-VolumesActionsTest-1469638287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab8895ac-b992-429b-99fc-89030676aaf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:28:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1337454957',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e8f02c1-764c-43f6-be52-e862635ef4db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20d1858f9b8d4591aa9062ccfbda62b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:28:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:28:35Z,use_quota=True,user_id='11fa12d70eaa4b7e8c346d263f777a4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:28:34 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-412fa1d2-e624-48c8-b183-f87960d9d931 tempest-VolumesActionsTest-1469638287 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5d5f229-8e60-4e34-88e0-68eb705ba791) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:28:34 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-412fa1d2-e624-48c8-b183-f87960d9d931 tempest-VolumesActionsTest-1469638287 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5d5f229-8e60-4e34-88e0-68eb705ba791) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:28:34 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-412fa1d2-e624-48c8-b183-f87960d9d931 tempest-VolumesActionsTest-1469638287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6b6fc93-e4ba-4434-8556-e9a2500e1208) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:28:34 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-412fa1d2-e624-48c8-b183-f87960d9d931 tempest-VolumesActionsTest-1469638287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6b6fc93-e4ba-4434-8556-e9a2500e1208) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4e8f02c1-764c-43f6-be52-e862635ef4db', 'volume_name': 'volume-4e8f02c1-764c-43f6-be52-e862635ef4db', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:28:34 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-412fa1d2-e624-48c8-b183-f87960d9d931 tempest-VolumesActionsTest-1469638287 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (416e6b96-178e-4166-ae9d-e0d2fc23515a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:28:34 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-412fa1d2-e624-48c8-b183-f87960d9d931 tempest-VolumesActionsTest-1469638287 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (416e6b96-178e-4166-ae9d-e0d2fc23515a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:28:34 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-412fa1d2-e624-48c8-b183-f87960d9d931 tempest-VolumesActionsTest-1469638287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ee6d738-fae5-46bd-a31b-43000bef4f61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:28:34 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-412fa1d2-e624-48c8-b183-f87960d9d931 tempest-VolumesActionsTest-1469638287 None] Volume 4e8f02c1-764c-43f6-be52-e862635ef4db: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4e8f02c1-764c-43f6-be52-e862635ef4db', 'volume_size': 1} Jul 31 12:28:34 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-412fa1d2-e624-48c8-b183-f87960d9d931 tempest-VolumesActionsTest-1469638287 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:28:34 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-412fa1d2-e624-48c8-b183-f87960d9d931 tempest-VolumesActionsTest-1469638287 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:28:34 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-412fa1d2-e624-48c8-b183-f87960d9d931 tempest-VolumesActionsTest-1469638287 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:28:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1337454957',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e8f02c1-764c-43f6-be52-e862635ef4db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20d1858f9b8d4591aa9062ccfbda62b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:28:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:28:35Z,use_quota=True,user_id='11fa12d70eaa4b7e8c346d263f777a4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)}" {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 12:28:34 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-412fa1d2-e624-48c8-b183-f87960d9d931 tempest-VolumesActionsTest-1469638287 None] Creating volume 4e8f02c1-764c-43f6-be52-e862635ef4db {{(pid=89182) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 12:28:34 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-412fa1d2-e624-48c8-b183-f87960d9d931 tempest-VolumesActionsTest-1469638287 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:28:34 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-412fa1d2-e624-48c8-b183-f87960d9d931 tempest-VolumesActionsTest-1469638287 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:28:34 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-412fa1d2-e624-48c8-b183-f87960d9d931 tempest-VolumesActionsTest-1469638287 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:28:34 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-412fa1d2-e624-48c8-b183-f87960d9d931 tempest-VolumesActionsTest-1469638287 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:28:34 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-412fa1d2-e624-48c8-b183-f87960d9d931 tempest-VolumesActionsTest-1469638287 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:28:34 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-412fa1d2-e624-48c8-b183-f87960d9d931 tempest-VolumesActionsTest-1469638287 None] Selected osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 as target Quobyte volume. {{(pid=89182) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 12:28:34 devstack cinder-volume[89182]: INFO cinder.volume.drivers.remotefs [None req-412fa1d2-e624-48c8-b183-f87960d9d931 tempest-VolumesActionsTest-1469638287 None] casted to osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 Jul 31 12:28:34 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-412fa1d2-e624-48c8-b183-f87960d9d931 tempest-VolumesActionsTest-1469638287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-4e8f02c1-764c-43f6-be52-e862635ef4db 1073741824 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:28:34 devstack sudo[104947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-4e8f02c1-764c-43f6-be52-e862635ef4db 1073741824 Jul 31 12:28:34 devstack sudo[104947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:28:35 devstack sudo[104947]: pam_unix(sudo:session): session closed for user root Jul 31 12:28:35 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-412fa1d2-e624-48c8-b183-f87960d9d931 tempest-VolumesActionsTest-1469638287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-4e8f02c1-764c-43f6-be52-e862635ef4db 1073741824" returned: 0 in 0.821s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:28:35 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-412fa1d2-e624-48c8-b183-f87960d9d931 tempest-VolumesActionsTest-1469638287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-4e8f02c1-764c-43f6-be52-e862635ef4db {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:28:35 devstack sudo[104953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-4e8f02c1-764c-43f6-be52-e862635ef4db Jul 31 12:28:35 devstack sudo[104953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:28:36 devstack sudo[104953]: pam_unix(sudo:session): session closed for user root Jul 31 12:28:36 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-412fa1d2-e624-48c8-b183-f87960d9d931 tempest-VolumesActionsTest-1469638287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-4e8f02c1-764c-43f6-be52-e862635ef4db" returned: 0 in 0.321s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:28:36 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-412fa1d2-e624-48c8-b183-f87960d9d931 tempest-VolumesActionsTest-1469638287 None] <== create_volume: return (1229ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'} {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 12:28:36 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-412fa1d2-e624-48c8-b183-f87960d9d931 tempest-VolumesActionsTest-1469638287 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.232s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:28:36 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-412fa1d2-e624-48c8-b183-f87960d9d931 tempest-VolumesActionsTest-1469638287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ee6d738-fae5-46bd-a31b-43000bef4f61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4e8f02c1-764c-43f6-be52-e862635ef4db', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:28:36 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-412fa1d2-e624-48c8-b183-f87960d9d931 tempest-VolumesActionsTest-1469638287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8b351a1-001c-4fcc-b952-67979714cb4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:28:36 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-412fa1d2-e624-48c8-b183-f87960d9d931 tempest-VolumesActionsTest-1469638287 None] Volume volume-4e8f02c1-764c-43f6-be52-e862635ef4db (4e8f02c1-764c-43f6-be52-e862635ef4db): created successfully Jul 31 12:28:36 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-412fa1d2-e624-48c8-b183-f87960d9d931 tempest-VolumesActionsTest-1469638287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8b351a1-001c-4fcc-b952-67979714cb4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:28:36 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-412fa1d2-e624-48c8-b183-f87960d9d931 tempest-VolumesActionsTest-1469638287 None] Flow 'volume_create_manager' (db7d7d5c-d256-4807-b049-05f5cf4207b0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:28:36 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-412fa1d2-e624-48c8-b183-f87960d9d931 tempest-VolumesActionsTest-1469638287 None] Created volume successfully. Jul 31 12:28:36 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-b03f58ad-752c-4494-b37d-d4273d00d57c tempest-VolumesActionsTest-1469638287 None] Acquiring lock "cinder-4e8f02c1-764c-43f6-be52-e862635ef4db" by "attach_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:28:36 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-b03f58ad-752c-4494-b37d-d4273d00d57c tempest-VolumesActionsTest-1469638287 None] Lock "cinder-4e8f02c1-764c-43f6-be52-e862635ef4db" acquired by "attach_volume" :: waited 0.041s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:28:37 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-b03f58ad-752c-4494-b37d-d4273d00d57c tempest-VolumesActionsTest-1469638287 None] Attaching volume 4e8f02c1-764c-43f6-be52-e862635ef4db to instance 1f59530c-aeea-4c66-ad45-667541750469 at mountpoint /dev/vdb on host None. Jul 31 12:28:37 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-b03f58ad-752c-4494-b37d-d4273d00d57c tempest-VolumesActionsTest-1469638287 None] Attach volume completed successfully. Jul 31 12:28:37 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-b03f58ad-752c-4494-b37d-d4273d00d57c tempest-VolumesActionsTest-1469638287 None] Lock "cinder-4e8f02c1-764c-43f6-be52-e862635ef4db" released by "attach_volume" :: held 0.250s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:28:38 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-47e06f06-d81d-4de6-85d3-6b815f4d1ce9 tempest-VolumesActionsTest-1807317722 None] Terminate volume connection completed successfully. Jul 31 12:28:38 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-47e06f06-d81d-4de6-85d3-6b815f4d1ce9 tempest-VolumesActionsTest-1807317722 None] Acquiring lock "cinder-4e8f02c1-764c-43f6-be52-e862635ef4db-detach_volume" by "detach_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:28:38 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-47e06f06-d81d-4de6-85d3-6b815f4d1ce9 tempest-VolumesActionsTest-1807317722 None] Lock "cinder-4e8f02c1-764c-43f6-be52-e862635ef4db-detach_volume" acquired by "detach_volume" :: waited 0.028s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:28:38 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-47e06f06-d81d-4de6-85d3-6b815f4d1ce9 tempest-VolumesActionsTest-1807317722 None] Detaching volume 4e8f02c1-764c-43f6-be52-e862635ef4db from instance 1f59530c-aeea-4c66-ad45-667541750469. Jul 31 12:28:38 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-47e06f06-d81d-4de6-85d3-6b815f4d1ce9 tempest-VolumesActionsTest-1807317722 None] Detach volume completed successfully. Jul 31 12:28:38 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-47e06f06-d81d-4de6-85d3-6b815f4d1ce9 tempest-VolumesActionsTest-1807317722 None] Lock "cinder-4e8f02c1-764c-43f6-be52-e862635ef4db-detach_volume" released by "detach_volume" :: held 0.145s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:28:38 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-7c2aad9b-3bc3-4886-aa0f-89c2ecb04dbc tempest-VolumesActionsTest-1469638287 None] Acquiring lock "cinder-4e8f02c1-764c-43f6-be52-e862635ef4db-detach_volume" by "detach_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:28:38 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-7c2aad9b-3bc3-4886-aa0f-89c2ecb04dbc tempest-VolumesActionsTest-1469638287 None] Lock "cinder-4e8f02c1-764c-43f6-be52-e862635ef4db-detach_volume" acquired by "detach_volume" :: waited 0.024s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:28:38 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-7c2aad9b-3bc3-4886-aa0f-89c2ecb04dbc tempest-VolumesActionsTest-1469638287 None] Volume detach called, but volume not attached. Jul 31 12:28:38 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-7c2aad9b-3bc3-4886-aa0f-89c2ecb04dbc tempest-VolumesActionsTest-1469638287 None] Lock "cinder-4e8f02c1-764c-43f6-be52-e862635ef4db-detach_volume" released by "detach_volume" :: held 0.032s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:28:39 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-e9fff02c-411e-44e5-98d7-9b26c5d7d7db tempest-VolumesActionsTest-1469638287 None] Acquiring lock "cinder-4e8f02c1-764c-43f6-be52-e862635ef4db-delete_volume" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:28:39 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-e9fff02c-411e-44e5-98d7-9b26c5d7d7db tempest-VolumesActionsTest-1469638287 None] Lock "cinder-4e8f02c1-764c-43f6-be52-e862635ef4db-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:28:39 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-e9fff02c-411e-44e5-98d7-9b26c5d7d7db tempest-VolumesActionsTest-1469638287 None] Acquiring lock "cinder-quobyte-4e8f02c1-764c-43f6-be52-e862635ef4db" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:28:39 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-e9fff02c-411e-44e5-98d7-9b26c5d7d7db tempest-VolumesActionsTest-1469638287 None] Lock "cinder-quobyte-4e8f02c1-764c-43f6-be52-e862635ef4db" acquired by "delete_volume" :: waited 0.021s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:28:39 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[38f7adef-6127-4f3d-83ac-3bb9419f7232]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:28:39 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-e9fff02c-411e-44e5-98d7-9b26c5d7d7db tempest-VolumesActionsTest-1469638287 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-4e8f02c1-764c-43f6-be52-e862635ef4db {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:28:39 devstack sudo[104990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-4e8f02c1-764c-43f6-be52-e862635ef4db Jul 31 12:28:39 devstack sudo[104990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:28:39 devstack sudo[104990]: pam_unix(sudo:session): session closed for user root Jul 31 12:28:39 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-e9fff02c-411e-44e5-98d7-9b26c5d7d7db tempest-VolumesActionsTest-1469638287 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-4e8f02c1-764c-43f6-be52-e862635ef4db" returned: 0 in 0.703s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:28:39 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-e9fff02c-411e-44e5-98d7-9b26c5d7d7db tempest-VolumesActionsTest-1469638287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-4e8f02c1-764c-43f6-be52-e862635ef4db {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:28:39 devstack sudo[105017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-4e8f02c1-764c-43f6-be52-e862635ef4db Jul 31 12:28:39 devstack sudo[105017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:28:40 devstack sudo[105017]: pam_unix(sudo:session): session closed for user root Jul 31 12:28:40 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-e9fff02c-411e-44e5-98d7-9b26c5d7d7db tempest-VolumesActionsTest-1469638287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-4e8f02c1-764c-43f6-be52-e862635ef4db" returned: 0 in 0.697s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:28:40 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-e9fff02c-411e-44e5-98d7-9b26c5d7d7db tempest-VolumesActionsTest-1469638287 None] Lock "cinder-quobyte-4e8f02c1-764c-43f6-be52-e862635ef4db" released by "delete_volume" :: held 1.554s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:28:40 devstack cinder-volume[89182]: DEBUG cinder.quota [None req-e9fff02c-411e-44e5-98d7-9b26c5d7d7db tempest-VolumesActionsTest-1469638287 None] Created reservations ['ee78b6dc-a343-4e52-a5ea-3d7483ab6ea5', '2a5ef671-d567-44da-86ea-52c4c7767854', 'cc2572e0-4534-4ddd-ad32-136a4f01f7d3', 'e7156777-5029-4e70-9da2-e8b2f46436f8'] {{(pid=89182) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 12:28:41 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-e9fff02c-411e-44e5-98d7-9b26c5d7d7db tempest-VolumesActionsTest-1469638287 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:28:41 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-e9fff02c-411e-44e5-98d7-9b26c5d7d7db tempest-VolumesActionsTest-1469638287 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:28:41 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-e9fff02c-411e-44e5-98d7-9b26c5d7d7db tempest-VolumesActionsTest-1469638287 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:28:41 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-e9fff02c-411e-44e5-98d7-9b26c5d7d7db tempest-VolumesActionsTest-1469638287 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:28:41 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-e9fff02c-411e-44e5-98d7-9b26c5d7d7db tempest-VolumesActionsTest-1469638287 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:28:41 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-e9fff02c-411e-44e5-98d7-9b26c5d7d7db tempest-VolumesActionsTest-1469638287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:28:41 devstack sudo[105063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 Jul 31 12:28:41 devstack sudo[105063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:28:41 devstack sudo[105063]: pam_unix(sudo:session): session closed for user root Jul 31 12:28:41 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-e9fff02c-411e-44e5-98d7-9b26c5d7d7db tempest-VolumesActionsTest-1469638287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2" returned: 0 in 0.537s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:28:41 devstack cinder-volume[89182]: DEBUG cinder.manager [None req-e9fff02c-411e-44e5-98d7-9b26c5d7d7db tempest-VolumesActionsTest-1469638287 None] Notifying Schedulers of capabilities ... {{(pid=89182) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 12:28:41 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-e9fff02c-411e-44e5-98d7-9b26c5d7d7db tempest-VolumesActionsTest-1469638287 None] Deleted volume successfully. Jul 31 12:28:41 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-e9fff02c-411e-44e5-98d7-9b26c5d7d7db tempest-VolumesActionsTest-1469638287 None] Lock "cinder-4e8f02c1-764c-43f6-be52-e862635ef4db-delete_volume" released by "delete_volume" :: held 2.717s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:28:45 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-3f09d3b5-0226-4668-9c7b-80fefb44fe63 tempest-VolumesActionsTest-1589472443 None] Acquiring lock "cinder-02345ec5-f983-4ef9-895e-cc9e9a06d7d0" by "attach_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:28:45 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-3f09d3b5-0226-4668-9c7b-80fefb44fe63 tempest-VolumesActionsTest-1589472443 None] Lock "cinder-02345ec5-f983-4ef9-895e-cc9e9a06d7d0" acquired by "attach_volume" :: waited 0.058s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:28:45 devstack cinder-volume[89182]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a6faf49-a15f-4371-92f4-1dd17499eb5c tempest-VolumesActionsTest-1469638287 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89182) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 12:28:45 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-6a6faf49-a15f-4371-92f4-1dd17499eb5c tempest-VolumesActionsTest-1469638287 None] Flow 'volume_create_manager' (c536471d-565e-4ced-946a-47eb26f9cbfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:28:45 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-6a6faf49-a15f-4371-92f4-1dd17499eb5c tempest-VolumesActionsTest-1469638287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55359cf6-ce4b-4aad-9b78-ce80c412b9f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:28:45 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-6a6faf49-a15f-4371-92f4-1dd17499eb5c tempest-VolumesActionsTest-1469638287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55359cf6-ce4b-4aad-9b78-ce80c412b9f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:28:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1127733084',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79149390-5d71-4e05-b354-bcd7976e8640,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20d1858f9b8d4591aa9062ccfbda62b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:28:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:28:45Z,use_quota=True,user_id='11fa12d70eaa4b7e8c346d263f777a4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:28:45 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-6a6faf49-a15f-4371-92f4-1dd17499eb5c tempest-VolumesActionsTest-1469638287 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67b917c7-0ade-4460-a545-d8db6127d11d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:28:45 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-6a6faf49-a15f-4371-92f4-1dd17499eb5c tempest-VolumesActionsTest-1469638287 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67b917c7-0ade-4460-a545-d8db6127d11d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:28:45 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-6a6faf49-a15f-4371-92f4-1dd17499eb5c tempest-VolumesActionsTest-1469638287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c0e28d3-8a99-4cd2-8d8e-f845600ad75c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:28:45 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-6a6faf49-a15f-4371-92f4-1dd17499eb5c tempest-VolumesActionsTest-1469638287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c0e28d3-8a99-4cd2-8d8e-f845600ad75c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '79149390-5d71-4e05-b354-bcd7976e8640', 'volume_name': 'volume-79149390-5d71-4e05-b354-bcd7976e8640', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:28:45 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-6a6faf49-a15f-4371-92f4-1dd17499eb5c tempest-VolumesActionsTest-1469638287 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe0b2e8d-5fcf-4e77-aaad-b772ddd5f946) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:28:45 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-6a6faf49-a15f-4371-92f4-1dd17499eb5c tempest-VolumesActionsTest-1469638287 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe0b2e8d-5fcf-4e77-aaad-b772ddd5f946) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:28:45 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-6a6faf49-a15f-4371-92f4-1dd17499eb5c tempest-VolumesActionsTest-1469638287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dfcb8f6c-b142-49be-ad8f-b497344b9893) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:28:45 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-6a6faf49-a15f-4371-92f4-1dd17499eb5c tempest-VolumesActionsTest-1469638287 None] Volume 79149390-5d71-4e05-b354-bcd7976e8640: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-79149390-5d71-4e05-b354-bcd7976e8640', 'volume_size': 1} Jul 31 12:28:45 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-6a6faf49-a15f-4371-92f4-1dd17499eb5c tempest-VolumesActionsTest-1469638287 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:28:45 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-6a6faf49-a15f-4371-92f4-1dd17499eb5c tempest-VolumesActionsTest-1469638287 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:28:45 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-6a6faf49-a15f-4371-92f4-1dd17499eb5c tempest-VolumesActionsTest-1469638287 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:28:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1127733084',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79149390-5d71-4e05-b354-bcd7976e8640,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20d1858f9b8d4591aa9062ccfbda62b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:28:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:28:45Z,use_quota=True,user_id='11fa12d70eaa4b7e8c346d263f777a4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)}" {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 12:28:45 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-6a6faf49-a15f-4371-92f4-1dd17499eb5c tempest-VolumesActionsTest-1469638287 None] Creating volume 79149390-5d71-4e05-b354-bcd7976e8640 {{(pid=89182) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 12:28:45 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-6a6faf49-a15f-4371-92f4-1dd17499eb5c tempest-VolumesActionsTest-1469638287 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:28:45 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-6a6faf49-a15f-4371-92f4-1dd17499eb5c tempest-VolumesActionsTest-1469638287 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:28:45 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-6a6faf49-a15f-4371-92f4-1dd17499eb5c tempest-VolumesActionsTest-1469638287 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:28:45 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-6a6faf49-a15f-4371-92f4-1dd17499eb5c tempest-VolumesActionsTest-1469638287 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:28:45 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-6a6faf49-a15f-4371-92f4-1dd17499eb5c tempest-VolumesActionsTest-1469638287 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:28:45 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-6a6faf49-a15f-4371-92f4-1dd17499eb5c tempest-VolumesActionsTest-1469638287 None] Selected osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 as target Quobyte volume. {{(pid=89182) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 12:28:45 devstack cinder-volume[89182]: INFO cinder.volume.drivers.remotefs [None req-6a6faf49-a15f-4371-92f4-1dd17499eb5c tempest-VolumesActionsTest-1469638287 None] casted to osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 Jul 31 12:28:45 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-6a6faf49-a15f-4371-92f4-1dd17499eb5c tempest-VolumesActionsTest-1469638287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-79149390-5d71-4e05-b354-bcd7976e8640 1073741824 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:28:45 devstack sudo[105131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-79149390-5d71-4e05-b354-bcd7976e8640 1073741824 Jul 31 12:28:45 devstack sudo[105131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:28:45 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-3f09d3b5-0226-4668-9c7b-80fefb44fe63 tempest-VolumesActionsTest-1589472443 None] Attaching volume 02345ec5-f983-4ef9-895e-cc9e9a06d7d0 to instance a6d2e067-c573-4b70-9c28-12d9b847c14e at mountpoint /dev/vdb on host None. Jul 31 12:28:45 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-3f09d3b5-0226-4668-9c7b-80fefb44fe63 tempest-VolumesActionsTest-1589472443 None] Attach volume completed successfully. Jul 31 12:28:45 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-3f09d3b5-0226-4668-9c7b-80fefb44fe63 tempest-VolumesActionsTest-1589472443 None] Lock "cinder-02345ec5-f983-4ef9-895e-cc9e9a06d7d0" released by "attach_volume" :: held 0.283s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:28:46 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-49c543e9-f2bf-4bd4-9d85-b7026be26ee7 tempest-VolumesActionsTest-1589472443 None] Acquiring lock "cinder-02345ec5-f983-4ef9-895e-cc9e9a06d7d0-detach_volume" by "detach_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:28:46 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-49c543e9-f2bf-4bd4-9d85-b7026be26ee7 tempest-VolumesActionsTest-1589472443 None] Lock "cinder-02345ec5-f983-4ef9-895e-cc9e9a06d7d0-detach_volume" acquired by "detach_volume" :: waited 0.035s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:28:46 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-49c543e9-f2bf-4bd4-9d85-b7026be26ee7 tempest-VolumesActionsTest-1589472443 None] Detaching volume 02345ec5-f983-4ef9-895e-cc9e9a06d7d0 from instance a6d2e067-c573-4b70-9c28-12d9b847c14e. Jul 31 12:28:46 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-49c543e9-f2bf-4bd4-9d85-b7026be26ee7 tempest-VolumesActionsTest-1589472443 None] Detach volume completed successfully. Jul 31 12:28:46 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-49c543e9-f2bf-4bd4-9d85-b7026be26ee7 tempest-VolumesActionsTest-1589472443 None] Lock "cinder-02345ec5-f983-4ef9-895e-cc9e9a06d7d0-detach_volume" released by "detach_volume" :: held 0.109s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:28:46 devstack sudo[105131]: pam_unix(sudo:session): session closed for user root Jul 31 12:28:46 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-6a6faf49-a15f-4371-92f4-1dd17499eb5c tempest-VolumesActionsTest-1469638287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-79149390-5d71-4e05-b354-bcd7976e8640 1073741824" returned: 0 in 0.590s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:28:46 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-6a6faf49-a15f-4371-92f4-1dd17499eb5c tempest-VolumesActionsTest-1469638287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-79149390-5d71-4e05-b354-bcd7976e8640 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:28:46 devstack sudo[105136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-79149390-5d71-4e05-b354-bcd7976e8640 Jul 31 12:28:46 devstack sudo[105136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:28:46 devstack sudo[105136]: pam_unix(sudo:session): session closed for user root Jul 31 12:28:46 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-6a6faf49-a15f-4371-92f4-1dd17499eb5c tempest-VolumesActionsTest-1469638287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-79149390-5d71-4e05-b354-bcd7976e8640" returned: 0 in 0.559s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:28:46 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-6a6faf49-a15f-4371-92f4-1dd17499eb5c tempest-VolumesActionsTest-1469638287 None] <== create_volume: return (1219ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'} {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 12:28:46 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-6a6faf49-a15f-4371-92f4-1dd17499eb5c tempest-VolumesActionsTest-1469638287 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.228s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:28:46 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-6a6faf49-a15f-4371-92f4-1dd17499eb5c tempest-VolumesActionsTest-1469638287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dfcb8f6c-b142-49be-ad8f-b497344b9893) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-79149390-5d71-4e05-b354-bcd7976e8640', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:28:46 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-6a6faf49-a15f-4371-92f4-1dd17499eb5c tempest-VolumesActionsTest-1469638287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f864a59-4a72-49f5-a90b-b45e23367212) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:28:46 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-6a6faf49-a15f-4371-92f4-1dd17499eb5c tempest-VolumesActionsTest-1469638287 None] Volume volume-79149390-5d71-4e05-b354-bcd7976e8640 (79149390-5d71-4e05-b354-bcd7976e8640): created successfully Jul 31 12:28:46 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-6a6faf49-a15f-4371-92f4-1dd17499eb5c tempest-VolumesActionsTest-1469638287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f864a59-4a72-49f5-a90b-b45e23367212) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:28:46 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-6a6faf49-a15f-4371-92f4-1dd17499eb5c tempest-VolumesActionsTest-1469638287 None] Flow 'volume_create_manager' (c536471d-565e-4ced-946a-47eb26f9cbfa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:28:46 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-6a6faf49-a15f-4371-92f4-1dd17499eb5c tempest-VolumesActionsTest-1469638287 None] Created volume successfully. Jul 31 12:28:47 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-70ab1de2-a82b-42e6-a562-2bdb247876bb tempest-VolumesActionsTest-1807317722 None] Acquiring lock "cinder-79149390-5d71-4e05-b354-bcd7976e8640-delete_volume" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:28:47 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-70ab1de2-a82b-42e6-a562-2bdb247876bb tempest-VolumesActionsTest-1807317722 None] Lock "cinder-79149390-5d71-4e05-b354-bcd7976e8640-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:28:47 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-70ab1de2-a82b-42e6-a562-2bdb247876bb tempest-VolumesActionsTest-1807317722 None] Acquiring lock "cinder-quobyte-79149390-5d71-4e05-b354-bcd7976e8640" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:28:47 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-70ab1de2-a82b-42e6-a562-2bdb247876bb tempest-VolumesActionsTest-1807317722 None] Lock "cinder-quobyte-79149390-5d71-4e05-b354-bcd7976e8640" acquired by "delete_volume" :: waited 0.017s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:28:47 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[25f5b3bc-1a43-4038-94b2-0ab0d8ee1417]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:28:47 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-70ab1de2-a82b-42e6-a562-2bdb247876bb tempest-VolumesActionsTest-1807317722 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-79149390-5d71-4e05-b354-bcd7976e8640 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:28:48 devstack sudo[105165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-79149390-5d71-4e05-b354-bcd7976e8640 Jul 31 12:28:48 devstack sudo[105165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:28:48 devstack sudo[105165]: pam_unix(sudo:session): session closed for user root Jul 31 12:28:48 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-70ab1de2-a82b-42e6-a562-2bdb247876bb tempest-VolumesActionsTest-1807317722 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-79149390-5d71-4e05-b354-bcd7976e8640" returned: 0 in 0.444s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:28:48 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-70ab1de2-a82b-42e6-a562-2bdb247876bb tempest-VolumesActionsTest-1807317722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-79149390-5d71-4e05-b354-bcd7976e8640 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:28:48 devstack sudo[105172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-79149390-5d71-4e05-b354-bcd7976e8640 Jul 31 12:28:48 devstack sudo[105172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:28:48 devstack sudo[105172]: pam_unix(sudo:session): session closed for user root Jul 31 12:28:48 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-70ab1de2-a82b-42e6-a562-2bdb247876bb tempest-VolumesActionsTest-1807317722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-79149390-5d71-4e05-b354-bcd7976e8640" returned: 0 in 0.322s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:28:48 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-70ab1de2-a82b-42e6-a562-2bdb247876bb tempest-VolumesActionsTest-1807317722 None] Lock "cinder-quobyte-79149390-5d71-4e05-b354-bcd7976e8640" released by "delete_volume" :: held 0.814s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:28:48 devstack cinder-volume[89182]: DEBUG cinder.quota [None req-70ab1de2-a82b-42e6-a562-2bdb247876bb tempest-VolumesActionsTest-1807317722 None] Created reservations ['b21578cf-3dbd-4f28-ab0c-367935c6c6c3', '27f49808-a15e-4c3a-a084-a1426d90b9d3', '3d1182ff-4a50-4254-95cc-6f35c786ac60', '7934c112-9ad7-45f5-b8c4-cb34ede54a2a'] {{(pid=89182) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 12:28:48 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-70ab1de2-a82b-42e6-a562-2bdb247876bb tempest-VolumesActionsTest-1807317722 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:28:48 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-70ab1de2-a82b-42e6-a562-2bdb247876bb tempest-VolumesActionsTest-1807317722 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:28:48 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-70ab1de2-a82b-42e6-a562-2bdb247876bb tempest-VolumesActionsTest-1807317722 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:28:48 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-70ab1de2-a82b-42e6-a562-2bdb247876bb tempest-VolumesActionsTest-1807317722 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:28:48 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-70ab1de2-a82b-42e6-a562-2bdb247876bb tempest-VolumesActionsTest-1807317722 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:28:48 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-70ab1de2-a82b-42e6-a562-2bdb247876bb tempest-VolumesActionsTest-1807317722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:28:48 devstack sudo[105176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 Jul 31 12:28:48 devstack sudo[105176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:28:49 devstack sudo[105176]: pam_unix(sudo:session): session closed for user root Jul 31 12:28:49 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-70ab1de2-a82b-42e6-a562-2bdb247876bb tempest-VolumesActionsTest-1807317722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2" returned: 0 in 0.346s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:28:49 devstack cinder-volume[89182]: DEBUG cinder.manager [None req-70ab1de2-a82b-42e6-a562-2bdb247876bb tempest-VolumesActionsTest-1807317722 None] Notifying Schedulers of capabilities ... {{(pid=89182) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 12:28:49 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-70ab1de2-a82b-42e6-a562-2bdb247876bb tempest-VolumesActionsTest-1807317722 None] Deleted volume successfully. Jul 31 12:28:49 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-70ab1de2-a82b-42e6-a562-2bdb247876bb tempest-VolumesActionsTest-1807317722 None] Lock "cinder-79149390-5d71-4e05-b354-bcd7976e8640-delete_volume" released by "delete_volume" :: held 1.406s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:28:49 devstack cinder-volume[89182]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e194225-facd-483e-9eb9-2e3931314d67 tempest-VolumesActionsTest-1469638287 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89182) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 12:28:49 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-8e194225-facd-483e-9eb9-2e3931314d67 tempest-VolumesActionsTest-1469638287 None] Flow 'volume_create_manager' (7a1014c2-4ef9-4ec4-9977-45e503fc55d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:28:49 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-8e194225-facd-483e-9eb9-2e3931314d67 tempest-VolumesActionsTest-1469638287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f28329a6-d858-4c43-8877-12ec758bd16c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:28:49 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-8e194225-facd-483e-9eb9-2e3931314d67 tempest-VolumesActionsTest-1469638287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f28329a6-d858-4c43-8877-12ec758bd16c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:28:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-361802975',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8690c81-d480-4d73-bb38-a4bf0b7fa843,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20d1858f9b8d4591aa9062ccfbda62b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:28:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:28:50Z,use_quota=True,user_id='11fa12d70eaa4b7e8c346d263f777a4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:28:49 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-8e194225-facd-483e-9eb9-2e3931314d67 tempest-VolumesActionsTest-1469638287 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (415ac1b7-b32c-4e52-8cb8-f49c99a42c68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:28:49 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-8e194225-facd-483e-9eb9-2e3931314d67 tempest-VolumesActionsTest-1469638287 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (415ac1b7-b32c-4e52-8cb8-f49c99a42c68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:28:49 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-8e194225-facd-483e-9eb9-2e3931314d67 tempest-VolumesActionsTest-1469638287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a476db95-fa1d-459c-ba0b-79bef984f758) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:28:49 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-8e194225-facd-483e-9eb9-2e3931314d67 tempest-VolumesActionsTest-1469638287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a476db95-fa1d-459c-ba0b-79bef984f758) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c8690c81-d480-4d73-bb38-a4bf0b7fa843', 'volume_name': 'volume-c8690c81-d480-4d73-bb38-a4bf0b7fa843', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:28:49 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-8e194225-facd-483e-9eb9-2e3931314d67 tempest-VolumesActionsTest-1469638287 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c281e597-8dfc-40c5-bc59-bf331a2824c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:28:49 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-8e194225-facd-483e-9eb9-2e3931314d67 tempest-VolumesActionsTest-1469638287 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c281e597-8dfc-40c5-bc59-bf331a2824c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:28:49 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-8e194225-facd-483e-9eb9-2e3931314d67 tempest-VolumesActionsTest-1469638287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89fef33e-27af-4c66-8efd-1fe20c4384da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:28:49 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-8e194225-facd-483e-9eb9-2e3931314d67 tempest-VolumesActionsTest-1469638287 None] Volume c8690c81-d480-4d73-bb38-a4bf0b7fa843: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c8690c81-d480-4d73-bb38-a4bf0b7fa843', 'volume_size': 1} Jul 31 12:28:49 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-8e194225-facd-483e-9eb9-2e3931314d67 tempest-VolumesActionsTest-1469638287 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:28:49 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-8e194225-facd-483e-9eb9-2e3931314d67 tempest-VolumesActionsTest-1469638287 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:28:49 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-8e194225-facd-483e-9eb9-2e3931314d67 tempest-VolumesActionsTest-1469638287 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:28:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-361802975',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8690c81-d480-4d73-bb38-a4bf0b7fa843,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20d1858f9b8d4591aa9062ccfbda62b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:28:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:28:50Z,use_quota=True,user_id='11fa12d70eaa4b7e8c346d263f777a4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)}" {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 12:28:49 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-8e194225-facd-483e-9eb9-2e3931314d67 tempest-VolumesActionsTest-1469638287 None] Creating volume c8690c81-d480-4d73-bb38-a4bf0b7fa843 {{(pid=89182) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 12:28:49 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-8e194225-facd-483e-9eb9-2e3931314d67 tempest-VolumesActionsTest-1469638287 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:28:49 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-8e194225-facd-483e-9eb9-2e3931314d67 tempest-VolumesActionsTest-1469638287 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:28:49 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-8e194225-facd-483e-9eb9-2e3931314d67 tempest-VolumesActionsTest-1469638287 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:28:49 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-8e194225-facd-483e-9eb9-2e3931314d67 tempest-VolumesActionsTest-1469638287 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:28:49 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-8e194225-facd-483e-9eb9-2e3931314d67 tempest-VolumesActionsTest-1469638287 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:28:49 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-8e194225-facd-483e-9eb9-2e3931314d67 tempest-VolumesActionsTest-1469638287 None] Selected osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 as target Quobyte volume. {{(pid=89182) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 12:28:49 devstack cinder-volume[89182]: INFO cinder.volume.drivers.remotefs [None req-8e194225-facd-483e-9eb9-2e3931314d67 tempest-VolumesActionsTest-1469638287 None] casted to osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 Jul 31 12:28:49 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-8e194225-facd-483e-9eb9-2e3931314d67 tempest-VolumesActionsTest-1469638287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-c8690c81-d480-4d73-bb38-a4bf0b7fa843 1073741824 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:28:49 devstack sudo[105185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-c8690c81-d480-4d73-bb38-a4bf0b7fa843 1073741824 Jul 31 12:28:49 devstack sudo[105185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:28:50 devstack sudo[105185]: pam_unix(sudo:session): session closed for user root Jul 31 12:28:50 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-8e194225-facd-483e-9eb9-2e3931314d67 tempest-VolumesActionsTest-1469638287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-c8690c81-d480-4d73-bb38-a4bf0b7fa843 1073741824" returned: 0 in 0.491s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:28:50 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-8e194225-facd-483e-9eb9-2e3931314d67 tempest-VolumesActionsTest-1469638287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-c8690c81-d480-4d73-bb38-a4bf0b7fa843 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:28:50 devstack sudo[105191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-c8690c81-d480-4d73-bb38-a4bf0b7fa843 Jul 31 12:28:50 devstack sudo[105191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:28:50 devstack sudo[105191]: pam_unix(sudo:session): session closed for user root Jul 31 12:28:50 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-8e194225-facd-483e-9eb9-2e3931314d67 tempest-VolumesActionsTest-1469638287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-c8690c81-d480-4d73-bb38-a4bf0b7fa843" returned: 0 in 0.323s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:28:50 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-8e194225-facd-483e-9eb9-2e3931314d67 tempest-VolumesActionsTest-1469638287 None] <== create_volume: return (862ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'} {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 12:28:50 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-8e194225-facd-483e-9eb9-2e3931314d67 tempest-VolumesActionsTest-1469638287 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.867s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:28:50 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-8e194225-facd-483e-9eb9-2e3931314d67 tempest-VolumesActionsTest-1469638287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89fef33e-27af-4c66-8efd-1fe20c4384da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c8690c81-d480-4d73-bb38-a4bf0b7fa843', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:28:50 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-8e194225-facd-483e-9eb9-2e3931314d67 tempest-VolumesActionsTest-1469638287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cfc7b7d6-4e8f-407e-a5fe-b3a7b79cd3b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:28:50 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-8e194225-facd-483e-9eb9-2e3931314d67 tempest-VolumesActionsTest-1469638287 None] Volume volume-c8690c81-d480-4d73-bb38-a4bf0b7fa843 (c8690c81-d480-4d73-bb38-a4bf0b7fa843): created successfully Jul 31 12:28:50 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-8e194225-facd-483e-9eb9-2e3931314d67 tempest-VolumesActionsTest-1469638287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cfc7b7d6-4e8f-407e-a5fe-b3a7b79cd3b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:28:50 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-8e194225-facd-483e-9eb9-2e3931314d67 tempest-VolumesActionsTest-1469638287 None] Flow 'volume_create_manager' (7a1014c2-4ef9-4ec4-9977-45e503fc55d4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:28:50 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-8e194225-facd-483e-9eb9-2e3931314d67 tempest-VolumesActionsTest-1469638287 None] Created volume successfully. Jul 31 12:28:51 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-24aea43a-5ff9-492c-884a-1f7496a1786a tempest-VolumesActionsTest-1807317722 None] Acquiring lock "cinder-c8690c81-d480-4d73-bb38-a4bf0b7fa843-delete_volume" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:28:51 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-24aea43a-5ff9-492c-884a-1f7496a1786a tempest-VolumesActionsTest-1807317722 None] Lock "cinder-c8690c81-d480-4d73-bb38-a4bf0b7fa843-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:28:52 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-24aea43a-5ff9-492c-884a-1f7496a1786a tempest-VolumesActionsTest-1807317722 None] Acquiring lock "cinder-quobyte-c8690c81-d480-4d73-bb38-a4bf0b7fa843" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:28:52 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-24aea43a-5ff9-492c-884a-1f7496a1786a tempest-VolumesActionsTest-1807317722 None] Lock "cinder-quobyte-c8690c81-d480-4d73-bb38-a4bf0b7fa843" acquired by "delete_volume" :: waited 0.019s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:28:52 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[c64c233d-ca96-461a-8781-7174bba7e1f7]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:28:52 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-24aea43a-5ff9-492c-884a-1f7496a1786a tempest-VolumesActionsTest-1807317722 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-c8690c81-d480-4d73-bb38-a4bf0b7fa843 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:28:52 devstack sudo[105197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-c8690c81-d480-4d73-bb38-a4bf0b7fa843 Jul 31 12:28:52 devstack sudo[105197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:28:52 devstack sudo[105197]: pam_unix(sudo:session): session closed for user root Jul 31 12:28:52 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-24aea43a-5ff9-492c-884a-1f7496a1786a tempest-VolumesActionsTest-1807317722 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-c8690c81-d480-4d73-bb38-a4bf0b7fa843" returned: 0 in 0.470s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:28:52 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-24aea43a-5ff9-492c-884a-1f7496a1786a tempest-VolumesActionsTest-1807317722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-c8690c81-d480-4d73-bb38-a4bf0b7fa843 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:28:52 devstack sudo[105207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-c8690c81-d480-4d73-bb38-a4bf0b7fa843 Jul 31 12:28:52 devstack sudo[105207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:28:52 devstack sudo[105207]: pam_unix(sudo:session): session closed for user root Jul 31 12:28:52 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-24aea43a-5ff9-492c-884a-1f7496a1786a tempest-VolumesActionsTest-1807317722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-c8690c81-d480-4d73-bb38-a4bf0b7fa843" returned: 0 in 0.412s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:28:53 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-24aea43a-5ff9-492c-884a-1f7496a1786a tempest-VolumesActionsTest-1807317722 None] Lock "cinder-quobyte-c8690c81-d480-4d73-bb38-a4bf0b7fa843" released by "delete_volume" :: held 0.955s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:28:53 devstack cinder-volume[89182]: DEBUG cinder.quota [None req-24aea43a-5ff9-492c-884a-1f7496a1786a tempest-VolumesActionsTest-1807317722 None] Created reservations ['c939fc5b-37eb-4655-8c98-3f5d21a22976', 'a5d602fd-2d1d-4a61-b366-f0ffae09f369', '87ea1e49-d352-401f-9853-c1c5c5c66476', '1c02264c-1b22-49df-bac3-4907f6c6ca8f'] {{(pid=89182) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 12:28:53 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-24aea43a-5ff9-492c-884a-1f7496a1786a tempest-VolumesActionsTest-1807317722 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:28:53 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-24aea43a-5ff9-492c-884a-1f7496a1786a tempest-VolumesActionsTest-1807317722 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:28:53 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-24aea43a-5ff9-492c-884a-1f7496a1786a tempest-VolumesActionsTest-1807317722 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:28:53 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-24aea43a-5ff9-492c-884a-1f7496a1786a tempest-VolumesActionsTest-1807317722 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:28:53 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-24aea43a-5ff9-492c-884a-1f7496a1786a tempest-VolumesActionsTest-1807317722 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:28:53 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-24aea43a-5ff9-492c-884a-1f7496a1786a tempest-VolumesActionsTest-1807317722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:28:53 devstack sudo[105223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 Jul 31 12:28:53 devstack sudo[105223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:28:53 devstack sudo[105223]: pam_unix(sudo:session): session closed for user root Jul 31 12:28:53 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-24aea43a-5ff9-492c-884a-1f7496a1786a tempest-VolumesActionsTest-1807317722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2" returned: 0 in 0.293s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:28:53 devstack cinder-volume[89182]: DEBUG cinder.manager [None req-24aea43a-5ff9-492c-884a-1f7496a1786a tempest-VolumesActionsTest-1807317722 None] Notifying Schedulers of capabilities ... {{(pid=89182) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 12:28:53 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-24aea43a-5ff9-492c-884a-1f7496a1786a tempest-VolumesActionsTest-1807317722 None] Deleted volume successfully. Jul 31 12:28:53 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-24aea43a-5ff9-492c-884a-1f7496a1786a tempest-VolumesActionsTest-1807317722 None] Lock "cinder-c8690c81-d480-4d73-bb38-a4bf0b7fa843-delete_volume" released by "delete_volume" :: held 1.615s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:28:54 devstack cinder-volume[89182]: DEBUG cinder.volume.flows.manager.create_volume [None req-06d17b0a-36e1-4d87-8f41-d033189f2f27 tempest-VolumesActionsTest-1469638287 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89182) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 12:28:54 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-06d17b0a-36e1-4d87-8f41-d033189f2f27 tempest-VolumesActionsTest-1469638287 None] Flow 'volume_create_manager' (8f076602-6df6-491c-9b8f-3c9e4c050303) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:28:54 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-06d17b0a-36e1-4d87-8f41-d033189f2f27 tempest-VolumesActionsTest-1469638287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c74aeed-2c4a-474d-969b-9c51ffd07c28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:28:55 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-06d17b0a-36e1-4d87-8f41-d033189f2f27 tempest-VolumesActionsTest-1469638287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c74aeed-2c4a-474d-969b-9c51ffd07c28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:28:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-516566655',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97dcdbf1-7238-4d79-bbe8-330cfe887947,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20d1858f9b8d4591aa9062ccfbda62b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:28:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:28:55Z,use_quota=True,user_id='11fa12d70eaa4b7e8c346d263f777a4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:28:55 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-06d17b0a-36e1-4d87-8f41-d033189f2f27 tempest-VolumesActionsTest-1469638287 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac44f0bb-3ba0-486b-8ca8-bca22d4ea475) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:28:55 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-06d17b0a-36e1-4d87-8f41-d033189f2f27 tempest-VolumesActionsTest-1469638287 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac44f0bb-3ba0-486b-8ca8-bca22d4ea475) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:28:55 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-06d17b0a-36e1-4d87-8f41-d033189f2f27 tempest-VolumesActionsTest-1469638287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c00da596-c538-42e1-bd8d-aa0a80d1d298) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:28:55 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-06d17b0a-36e1-4d87-8f41-d033189f2f27 tempest-VolumesActionsTest-1469638287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c00da596-c538-42e1-bd8d-aa0a80d1d298) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '97dcdbf1-7238-4d79-bbe8-330cfe887947', 'volume_name': 'volume-97dcdbf1-7238-4d79-bbe8-330cfe887947', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:28:55 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-06d17b0a-36e1-4d87-8f41-d033189f2f27 tempest-VolumesActionsTest-1469638287 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce84aa91-3331-470b-8238-258191028234) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:28:55 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-06d17b0a-36e1-4d87-8f41-d033189f2f27 tempest-VolumesActionsTest-1469638287 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce84aa91-3331-470b-8238-258191028234) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:28:55 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-06d17b0a-36e1-4d87-8f41-d033189f2f27 tempest-VolumesActionsTest-1469638287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2037091d-35a5-47f6-aeba-77d1b540fcfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:28:55 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-06d17b0a-36e1-4d87-8f41-d033189f2f27 tempest-VolumesActionsTest-1469638287 None] Volume 97dcdbf1-7238-4d79-bbe8-330cfe887947: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-97dcdbf1-7238-4d79-bbe8-330cfe887947', 'volume_size': 1} Jul 31 12:28:55 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-06d17b0a-36e1-4d87-8f41-d033189f2f27 tempest-VolumesActionsTest-1469638287 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:28:55 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-06d17b0a-36e1-4d87-8f41-d033189f2f27 tempest-VolumesActionsTest-1469638287 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:28:55 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-06d17b0a-36e1-4d87-8f41-d033189f2f27 tempest-VolumesActionsTest-1469638287 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:28:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-516566655',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97dcdbf1-7238-4d79-bbe8-330cfe887947,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20d1858f9b8d4591aa9062ccfbda62b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:28:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:28:55Z,use_quota=True,user_id='11fa12d70eaa4b7e8c346d263f777a4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)}" {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 12:28:55 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-06d17b0a-36e1-4d87-8f41-d033189f2f27 tempest-VolumesActionsTest-1469638287 None] Creating volume 97dcdbf1-7238-4d79-bbe8-330cfe887947 {{(pid=89182) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 12:28:55 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-06d17b0a-36e1-4d87-8f41-d033189f2f27 tempest-VolumesActionsTest-1469638287 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:28:55 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-06d17b0a-36e1-4d87-8f41-d033189f2f27 tempest-VolumesActionsTest-1469638287 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:28:55 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-06d17b0a-36e1-4d87-8f41-d033189f2f27 tempest-VolumesActionsTest-1469638287 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:28:55 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-06d17b0a-36e1-4d87-8f41-d033189f2f27 tempest-VolumesActionsTest-1469638287 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:28:55 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-06d17b0a-36e1-4d87-8f41-d033189f2f27 tempest-VolumesActionsTest-1469638287 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:28:55 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-06d17b0a-36e1-4d87-8f41-d033189f2f27 tempest-VolumesActionsTest-1469638287 None] Selected osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 as target Quobyte volume. {{(pid=89182) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 12:28:55 devstack cinder-volume[89182]: INFO cinder.volume.drivers.remotefs [None req-06d17b0a-36e1-4d87-8f41-d033189f2f27 tempest-VolumesActionsTest-1469638287 None] casted to osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 Jul 31 12:28:55 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-06d17b0a-36e1-4d87-8f41-d033189f2f27 tempest-VolumesActionsTest-1469638287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-97dcdbf1-7238-4d79-bbe8-330cfe887947 1073741824 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:28:55 devstack sudo[105226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-97dcdbf1-7238-4d79-bbe8-330cfe887947 1073741824 Jul 31 12:28:55 devstack sudo[105226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:28:55 devstack sudo[105226]: pam_unix(sudo:session): session closed for user root Jul 31 12:28:55 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-06d17b0a-36e1-4d87-8f41-d033189f2f27 tempest-VolumesActionsTest-1469638287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-97dcdbf1-7238-4d79-bbe8-330cfe887947 1073741824" returned: 0 in 0.483s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:28:55 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-06d17b0a-36e1-4d87-8f41-d033189f2f27 tempest-VolumesActionsTest-1469638287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-97dcdbf1-7238-4d79-bbe8-330cfe887947 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:28:55 devstack sudo[105234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-97dcdbf1-7238-4d79-bbe8-330cfe887947 Jul 31 12:28:55 devstack sudo[105234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:28:55 devstack sudo[105234]: pam_unix(sudo:session): session closed for user root Jul 31 12:28:55 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-06d17b0a-36e1-4d87-8f41-d033189f2f27 tempest-VolumesActionsTest-1469638287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-97dcdbf1-7238-4d79-bbe8-330cfe887947" returned: 0 in 0.315s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:28:55 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-06d17b0a-36e1-4d87-8f41-d033189f2f27 tempest-VolumesActionsTest-1469638287 None] <== create_volume: return (862ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'} {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 12:28:55 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-06d17b0a-36e1-4d87-8f41-d033189f2f27 tempest-VolumesActionsTest-1469638287 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.865s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:28:55 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-06d17b0a-36e1-4d87-8f41-d033189f2f27 tempest-VolumesActionsTest-1469638287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2037091d-35a5-47f6-aeba-77d1b540fcfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-97dcdbf1-7238-4d79-bbe8-330cfe887947', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:28:55 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-06d17b0a-36e1-4d87-8f41-d033189f2f27 tempest-VolumesActionsTest-1469638287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d4906b7-80b3-4969-a873-133bbbe83a25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:28:55 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-06d17b0a-36e1-4d87-8f41-d033189f2f27 tempest-VolumesActionsTest-1469638287 None] Volume volume-97dcdbf1-7238-4d79-bbe8-330cfe887947 (97dcdbf1-7238-4d79-bbe8-330cfe887947): created successfully Jul 31 12:28:55 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-06d17b0a-36e1-4d87-8f41-d033189f2f27 tempest-VolumesActionsTest-1469638287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d4906b7-80b3-4969-a873-133bbbe83a25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:28:55 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-06d17b0a-36e1-4d87-8f41-d033189f2f27 tempest-VolumesActionsTest-1469638287 None] Flow 'volume_create_manager' (8f076602-6df6-491c-9b8f-3c9e4c050303) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:28:55 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-06d17b0a-36e1-4d87-8f41-d033189f2f27 tempest-VolumesActionsTest-1469638287 None] Created volume successfully. Jul 31 12:28:57 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-9900482f-388f-4465-9910-ec635188171c tempest-VolumesActionsTest-1807317722 None] Acquiring lock "cinder-97dcdbf1-7238-4d79-bbe8-330cfe887947-delete_volume" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:28:57 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-9900482f-388f-4465-9910-ec635188171c tempest-VolumesActionsTest-1807317722 None] Lock "cinder-97dcdbf1-7238-4d79-bbe8-330cfe887947-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:28:57 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-9900482f-388f-4465-9910-ec635188171c tempest-VolumesActionsTest-1807317722 None] Acquiring lock "cinder-quobyte-97dcdbf1-7238-4d79-bbe8-330cfe887947" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:28:57 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-9900482f-388f-4465-9910-ec635188171c tempest-VolumesActionsTest-1807317722 None] Lock "cinder-quobyte-97dcdbf1-7238-4d79-bbe8-330cfe887947" acquired by "delete_volume" :: waited 0.026s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:28:57 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7806853-b78f-4339-8ea0-b37ad6d11957]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:28:57 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-9900482f-388f-4465-9910-ec635188171c tempest-VolumesActionsTest-1807317722 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-97dcdbf1-7238-4d79-bbe8-330cfe887947 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:28:57 devstack sudo[105280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-97dcdbf1-7238-4d79-bbe8-330cfe887947 Jul 31 12:28:57 devstack sudo[105280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:28:58 devstack sudo[105280]: pam_unix(sudo:session): session closed for user root Jul 31 12:28:58 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-9900482f-388f-4465-9910-ec635188171c tempest-VolumesActionsTest-1807317722 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-97dcdbf1-7238-4d79-bbe8-330cfe887947" returned: 0 in 0.550s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:28:58 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-9900482f-388f-4465-9910-ec635188171c tempest-VolumesActionsTest-1807317722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-97dcdbf1-7238-4d79-bbe8-330cfe887947 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:28:58 devstack sudo[105303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-97dcdbf1-7238-4d79-bbe8-330cfe887947 Jul 31 12:28:58 devstack sudo[105303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:28:58 devstack sudo[105303]: pam_unix(sudo:session): session closed for user root Jul 31 12:28:58 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-9900482f-388f-4465-9910-ec635188171c tempest-VolumesActionsTest-1807317722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-97dcdbf1-7238-4d79-bbe8-330cfe887947" returned: 0 in 0.346s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:28:58 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-9900482f-388f-4465-9910-ec635188171c tempest-VolumesActionsTest-1807317722 None] Lock "cinder-quobyte-97dcdbf1-7238-4d79-bbe8-330cfe887947" released by "delete_volume" :: held 0.971s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:28:58 devstack cinder-volume[89182]: DEBUG cinder.quota [None req-9900482f-388f-4465-9910-ec635188171c tempest-VolumesActionsTest-1807317722 None] Created reservations ['91f83925-e573-453e-ba65-fac8740703c4', 'c7c851e0-8c57-4a12-9d75-a2a4ebe55ce6', 'f87c8e7d-4c9a-41c9-94f6-7f14205258db', 'f874be26-1075-452b-a77a-09e52ab1dae4'] {{(pid=89182) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 12:28:58 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-9900482f-388f-4465-9910-ec635188171c tempest-VolumesActionsTest-1807317722 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:28:58 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-9900482f-388f-4465-9910-ec635188171c tempest-VolumesActionsTest-1807317722 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:28:58 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-9900482f-388f-4465-9910-ec635188171c tempest-VolumesActionsTest-1807317722 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:28:58 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-9900482f-388f-4465-9910-ec635188171c tempest-VolumesActionsTest-1807317722 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:28:58 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-9900482f-388f-4465-9910-ec635188171c tempest-VolumesActionsTest-1807317722 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:28:58 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-9900482f-388f-4465-9910-ec635188171c tempest-VolumesActionsTest-1807317722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:28:58 devstack sudo[105326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 Jul 31 12:28:58 devstack sudo[105326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:28:59 devstack sudo[105326]: pam_unix(sudo:session): session closed for user root Jul 31 12:28:59 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-9900482f-388f-4465-9910-ec635188171c tempest-VolumesActionsTest-1807317722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2" returned: 0 in 0.370s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:28:59 devstack cinder-volume[89182]: DEBUG cinder.manager [None req-9900482f-388f-4465-9910-ec635188171c tempest-VolumesActionsTest-1807317722 None] Notifying Schedulers of capabilities ... {{(pid=89182) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 12:28:59 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-9900482f-388f-4465-9910-ec635188171c tempest-VolumesActionsTest-1807317722 None] Deleted volume successfully. Jul 31 12:28:59 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-9900482f-388f-4465-9910-ec635188171c tempest-VolumesActionsTest-1807317722 None] Lock "cinder-97dcdbf1-7238-4d79-bbe8-330cfe887947-delete_volume" released by "delete_volume" :: held 1.692s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:29:00 devstack cinder-volume[89182]: DEBUG cinder.volume.flows.manager.create_volume [None req-dce3ef67-0772-4374-a4ce-c91d163acc32 tempest-VolumesActionsTest-1469638287 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89182) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 12:29:00 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-dce3ef67-0772-4374-a4ce-c91d163acc32 tempest-VolumesActionsTest-1469638287 None] Flow 'volume_create_manager' (dd975f00-a0ff-488a-b4e8-ebd152bb3982) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:29:00 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-dce3ef67-0772-4374-a4ce-c91d163acc32 tempest-VolumesActionsTest-1469638287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28e70c6f-8c5d-455c-bc6c-d9c0ad812717) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:29:00 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-dce3ef67-0772-4374-a4ce-c91d163acc32 tempest-VolumesActionsTest-1469638287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28e70c6f-8c5d-455c-bc6c-d9c0ad812717) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:29:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-549082238',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65b6f734-c5b3-467a-86f1-91dc7305c6f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20d1858f9b8d4591aa9062ccfbda62b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:29:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:29:00Z,use_quota=True,user_id='11fa12d70eaa4b7e8c346d263f777a4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:29:00 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-dce3ef67-0772-4374-a4ce-c91d163acc32 tempest-VolumesActionsTest-1469638287 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64938b0d-5868-40e2-948e-8f60dfc06a8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:29:00 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-dce3ef67-0772-4374-a4ce-c91d163acc32 tempest-VolumesActionsTest-1469638287 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64938b0d-5868-40e2-948e-8f60dfc06a8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:29:00 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-dce3ef67-0772-4374-a4ce-c91d163acc32 tempest-VolumesActionsTest-1469638287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65b5d059-6cd4-4263-bdcc-5adbcec7efa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:29:00 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-dce3ef67-0772-4374-a4ce-c91d163acc32 tempest-VolumesActionsTest-1469638287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65b5d059-6cd4-4263-bdcc-5adbcec7efa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '65b6f734-c5b3-467a-86f1-91dc7305c6f3', 'volume_name': 'volume-65b6f734-c5b3-467a-86f1-91dc7305c6f3', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:29:00 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-dce3ef67-0772-4374-a4ce-c91d163acc32 tempest-VolumesActionsTest-1469638287 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0af0e269-53fb-49df-8a97-c3cd15f29743) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:29:00 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-dce3ef67-0772-4374-a4ce-c91d163acc32 tempest-VolumesActionsTest-1469638287 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0af0e269-53fb-49df-8a97-c3cd15f29743) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:29:00 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-dce3ef67-0772-4374-a4ce-c91d163acc32 tempest-VolumesActionsTest-1469638287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6174da21-4b9b-4e9c-bb4b-11962ea53cba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:29:00 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-dce3ef67-0772-4374-a4ce-c91d163acc32 tempest-VolumesActionsTest-1469638287 None] Volume 65b6f734-c5b3-467a-86f1-91dc7305c6f3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-65b6f734-c5b3-467a-86f1-91dc7305c6f3', 'volume_size': 1} Jul 31 12:29:00 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-dce3ef67-0772-4374-a4ce-c91d163acc32 tempest-VolumesActionsTest-1469638287 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:29:00 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-dce3ef67-0772-4374-a4ce-c91d163acc32 tempest-VolumesActionsTest-1469638287 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:29:00 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-dce3ef67-0772-4374-a4ce-c91d163acc32 tempest-VolumesActionsTest-1469638287 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:29:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-549082238',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65b6f734-c5b3-467a-86f1-91dc7305c6f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20d1858f9b8d4591aa9062ccfbda62b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:29:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:29:00Z,use_quota=True,user_id='11fa12d70eaa4b7e8c346d263f777a4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)}" {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 12:29:00 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-dce3ef67-0772-4374-a4ce-c91d163acc32 tempest-VolumesActionsTest-1469638287 None] Creating volume 65b6f734-c5b3-467a-86f1-91dc7305c6f3 {{(pid=89182) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 12:29:00 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-dce3ef67-0772-4374-a4ce-c91d163acc32 tempest-VolumesActionsTest-1469638287 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:29:00 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-dce3ef67-0772-4374-a4ce-c91d163acc32 tempest-VolumesActionsTest-1469638287 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:29:00 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-dce3ef67-0772-4374-a4ce-c91d163acc32 tempest-VolumesActionsTest-1469638287 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:29:00 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-dce3ef67-0772-4374-a4ce-c91d163acc32 tempest-VolumesActionsTest-1469638287 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:29:00 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-dce3ef67-0772-4374-a4ce-c91d163acc32 tempest-VolumesActionsTest-1469638287 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:29:00 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-dce3ef67-0772-4374-a4ce-c91d163acc32 tempest-VolumesActionsTest-1469638287 None] Selected osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 as target Quobyte volume. {{(pid=89182) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 12:29:00 devstack cinder-volume[89182]: INFO cinder.volume.drivers.remotefs [None req-dce3ef67-0772-4374-a4ce-c91d163acc32 tempest-VolumesActionsTest-1469638287 None] casted to osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 Jul 31 12:29:00 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-dce3ef67-0772-4374-a4ce-c91d163acc32 tempest-VolumesActionsTest-1469638287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-65b6f734-c5b3-467a-86f1-91dc7305c6f3 1073741824 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:29:00 devstack sudo[105330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-65b6f734-c5b3-467a-86f1-91dc7305c6f3 1073741824 Jul 31 12:29:00 devstack sudo[105330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:29:01 devstack sudo[105330]: pam_unix(sudo:session): session closed for user root Jul 31 12:29:01 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-dce3ef67-0772-4374-a4ce-c91d163acc32 tempest-VolumesActionsTest-1469638287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-65b6f734-c5b3-467a-86f1-91dc7305c6f3 1073741824" returned: 0 in 0.763s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:29:01 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-dce3ef67-0772-4374-a4ce-c91d163acc32 tempest-VolumesActionsTest-1469638287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-65b6f734-c5b3-467a-86f1-91dc7305c6f3 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:29:01 devstack sudo[105339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-65b6f734-c5b3-467a-86f1-91dc7305c6f3 Jul 31 12:29:01 devstack sudo[105339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:29:01 devstack sudo[105339]: pam_unix(sudo:session): session closed for user root Jul 31 12:29:01 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-dce3ef67-0772-4374-a4ce-c91d163acc32 tempest-VolumesActionsTest-1469638287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-65b6f734-c5b3-467a-86f1-91dc7305c6f3" returned: 0 in 0.404s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:29:01 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-dce3ef67-0772-4374-a4ce-c91d163acc32 tempest-VolumesActionsTest-1469638287 None] <== create_volume: return (1271ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'} {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 12:29:01 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-dce3ef67-0772-4374-a4ce-c91d163acc32 tempest-VolumesActionsTest-1469638287 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.274s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:29:01 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-dce3ef67-0772-4374-a4ce-c91d163acc32 tempest-VolumesActionsTest-1469638287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6174da21-4b9b-4e9c-bb4b-11962ea53cba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-65b6f734-c5b3-467a-86f1-91dc7305c6f3', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:29:01 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-dce3ef67-0772-4374-a4ce-c91d163acc32 tempest-VolumesActionsTest-1469638287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f36fe2b-4f4d-4783-82ef-0ce285e7c64c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:29:01 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-dce3ef67-0772-4374-a4ce-c91d163acc32 tempest-VolumesActionsTest-1469638287 None] Volume volume-65b6f734-c5b3-467a-86f1-91dc7305c6f3 (65b6f734-c5b3-467a-86f1-91dc7305c6f3): created successfully Jul 31 12:29:01 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-dce3ef67-0772-4374-a4ce-c91d163acc32 tempest-VolumesActionsTest-1469638287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f36fe2b-4f4d-4783-82ef-0ce285e7c64c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:29:01 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-dce3ef67-0772-4374-a4ce-c91d163acc32 tempest-VolumesActionsTest-1469638287 None] Flow 'volume_create_manager' (dd975f00-a0ff-488a-b4e8-ebd152bb3982) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:29:01 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-dce3ef67-0772-4374-a4ce-c91d163acc32 tempest-VolumesActionsTest-1469638287 None] Created volume successfully. Jul 31 12:29:03 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-14a1ddcb-d82f-49b8-939c-ddcd0b49ac31 tempest-VolumesActionsTest-1807317722 None] Acquiring lock "cinder-65b6f734-c5b3-467a-86f1-91dc7305c6f3-delete_volume" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:29:03 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-14a1ddcb-d82f-49b8-939c-ddcd0b49ac31 tempest-VolumesActionsTest-1807317722 None] Lock "cinder-65b6f734-c5b3-467a-86f1-91dc7305c6f3-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:29:03 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-14a1ddcb-d82f-49b8-939c-ddcd0b49ac31 tempest-VolumesActionsTest-1807317722 None] Acquiring lock "cinder-quobyte-65b6f734-c5b3-467a-86f1-91dc7305c6f3" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:29:03 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-14a1ddcb-d82f-49b8-939c-ddcd0b49ac31 tempest-VolumesActionsTest-1807317722 None] Lock "cinder-quobyte-65b6f734-c5b3-467a-86f1-91dc7305c6f3" acquired by "delete_volume" :: waited 0.022s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:29:03 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7444f17-eace-4dd6-81d2-f9a9cecce67e]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:29:03 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-14a1ddcb-d82f-49b8-939c-ddcd0b49ac31 tempest-VolumesActionsTest-1807317722 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-65b6f734-c5b3-467a-86f1-91dc7305c6f3 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:29:03 devstack sudo[105344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-65b6f734-c5b3-467a-86f1-91dc7305c6f3 Jul 31 12:29:03 devstack sudo[105344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:29:03 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-a2dfb990-60d7-4c58-8058-42a0b5bdc76f tempest-VolumesActionsTest-1589472443 None] Acquiring lock "cinder-02345ec5-f983-4ef9-895e-cc9e9a06d7d0" by "attach_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:29:03 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-a2dfb990-60d7-4c58-8058-42a0b5bdc76f tempest-VolumesActionsTest-1589472443 None] Lock "cinder-02345ec5-f983-4ef9-895e-cc9e9a06d7d0" acquired by "attach_volume" :: waited 0.022s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:29:03 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-a2dfb990-60d7-4c58-8058-42a0b5bdc76f tempest-VolumesActionsTest-1589472443 None] Attaching volume 02345ec5-f983-4ef9-895e-cc9e9a06d7d0 to instance e61fa5aa-19af-4628-b867-211bae479809 at mountpoint /dev/vdb on host None. Jul 31 12:29:03 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-a2dfb990-60d7-4c58-8058-42a0b5bdc76f tempest-VolumesActionsTest-1589472443 None] Attach volume completed successfully. Jul 31 12:29:03 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-a2dfb990-60d7-4c58-8058-42a0b5bdc76f tempest-VolumesActionsTest-1589472443 None] Lock "cinder-02345ec5-f983-4ef9-895e-cc9e9a06d7d0" released by "attach_volume" :: held 0.165s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:29:03 devstack sudo[105344]: pam_unix(sudo:session): session closed for user root Jul 31 12:29:03 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-14a1ddcb-d82f-49b8-939c-ddcd0b49ac31 tempest-VolumesActionsTest-1807317722 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-65b6f734-c5b3-467a-86f1-91dc7305c6f3" returned: 0 in 0.513s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:29:03 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-14a1ddcb-d82f-49b8-939c-ddcd0b49ac31 tempest-VolumesActionsTest-1807317722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-65b6f734-c5b3-467a-86f1-91dc7305c6f3 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:29:03 devstack sudo[105350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-65b6f734-c5b3-467a-86f1-91dc7305c6f3 Jul 31 12:29:03 devstack sudo[105350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:29:03 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-949451a2-bfb0-475e-b275-f7fa4f38ed31 tempest-VolumesActionsTest-1589472443 None] Acquiring lock "cinder-02345ec5-f983-4ef9-895e-cc9e9a06d7d0-detach_volume" by "detach_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:29:03 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-949451a2-bfb0-475e-b275-f7fa4f38ed31 tempest-VolumesActionsTest-1589472443 None] Lock "cinder-02345ec5-f983-4ef9-895e-cc9e9a06d7d0-detach_volume" acquired by "detach_volume" :: waited 0.025s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:29:03 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-949451a2-bfb0-475e-b275-f7fa4f38ed31 tempest-VolumesActionsTest-1589472443 None] Detaching volume 02345ec5-f983-4ef9-895e-cc9e9a06d7d0 from instance e61fa5aa-19af-4628-b867-211bae479809. Jul 31 12:29:03 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-949451a2-bfb0-475e-b275-f7fa4f38ed31 tempest-VolumesActionsTest-1589472443 None] Detach volume completed successfully. Jul 31 12:29:04 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-949451a2-bfb0-475e-b275-f7fa4f38ed31 tempest-VolumesActionsTest-1589472443 None] Lock "cinder-02345ec5-f983-4ef9-895e-cc9e9a06d7d0-detach_volume" released by "detach_volume" :: held 0.117s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:29:04 devstack sudo[105350]: pam_unix(sudo:session): session closed for user root Jul 31 12:29:04 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-14a1ddcb-d82f-49b8-939c-ddcd0b49ac31 tempest-VolumesActionsTest-1807317722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-65b6f734-c5b3-467a-86f1-91dc7305c6f3" returned: 0 in 0.353s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:29:04 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-14a1ddcb-d82f-49b8-939c-ddcd0b49ac31 tempest-VolumesActionsTest-1807317722 None] Lock "cinder-quobyte-65b6f734-c5b3-467a-86f1-91dc7305c6f3" released by "delete_volume" :: held 0.951s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:29:04 devstack cinder-volume[89182]: DEBUG cinder.quota [None req-14a1ddcb-d82f-49b8-939c-ddcd0b49ac31 tempest-VolumesActionsTest-1807317722 None] Created reservations ['f7762061-bfcf-4de1-893e-fcbc5e05b3ed', 'fa3028a8-48b2-43d8-981d-d37388d8f308', 'e0852ab4-94e3-4603-a388-31dab5c734ff', 'fd9dff7e-210e-4361-954b-b6002bd0c67f'] {{(pid=89182) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 12:29:04 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-14a1ddcb-d82f-49b8-939c-ddcd0b49ac31 tempest-VolumesActionsTest-1807317722 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:29:04 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-14a1ddcb-d82f-49b8-939c-ddcd0b49ac31 tempest-VolumesActionsTest-1807317722 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:29:04 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-14a1ddcb-d82f-49b8-939c-ddcd0b49ac31 tempest-VolumesActionsTest-1807317722 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:29:04 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-14a1ddcb-d82f-49b8-939c-ddcd0b49ac31 tempest-VolumesActionsTest-1807317722 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:29:04 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-14a1ddcb-d82f-49b8-939c-ddcd0b49ac31 tempest-VolumesActionsTest-1807317722 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:29:04 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-14a1ddcb-d82f-49b8-939c-ddcd0b49ac31 tempest-VolumesActionsTest-1807317722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:29:04 devstack sudo[105353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 Jul 31 12:29:04 devstack sudo[105353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:29:04 devstack sudo[105353]: pam_unix(sudo:session): session closed for user root Jul 31 12:29:04 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-14a1ddcb-d82f-49b8-939c-ddcd0b49ac31 tempest-VolumesActionsTest-1807317722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2" returned: 0 in 0.384s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:29:04 devstack cinder-volume[89182]: DEBUG cinder.manager [None req-14a1ddcb-d82f-49b8-939c-ddcd0b49ac31 tempest-VolumesActionsTest-1807317722 None] Notifying Schedulers of capabilities ... {{(pid=89182) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 12:29:04 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-14a1ddcb-d82f-49b8-939c-ddcd0b49ac31 tempest-VolumesActionsTest-1807317722 None] Deleted volume successfully. Jul 31 12:29:04 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-14a1ddcb-d82f-49b8-939c-ddcd0b49ac31 tempest-VolumesActionsTest-1807317722 None] Lock "cinder-65b6f734-c5b3-467a-86f1-91dc7305c6f3-delete_volume" released by "delete_volume" :: held 1.692s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:29:06 devstack cinder-volume[89182]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d12a102-9149-419a-b123-05385e0997cb tempest-VolumesActionsTest-1469638287 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89182) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 12:29:06 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-9d12a102-9149-419a-b123-05385e0997cb tempest-VolumesActionsTest-1469638287 None] Flow 'volume_create_manager' (22e71b96-39f1-4808-9b7f-b5800b72a4ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:29:06 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-9d12a102-9149-419a-b123-05385e0997cb tempest-VolumesActionsTest-1469638287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73ae3f61-6ed6-4fac-aff7-3d11d13c80cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:29:06 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-9d12a102-9149-419a-b123-05385e0997cb tempest-VolumesActionsTest-1469638287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73ae3f61-6ed6-4fac-aff7-3d11d13c80cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:29:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2033927240',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b1e330d-5b38-48df-a889-58fee5614f35,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20d1858f9b8d4591aa9062ccfbda62b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:29:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:29:06Z,use_quota=True,user_id='11fa12d70eaa4b7e8c346d263f777a4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:29:06 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-9d12a102-9149-419a-b123-05385e0997cb tempest-VolumesActionsTest-1469638287 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bc647b6-70ee-4ef9-8522-ca629b7bac92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:29:06 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-9d12a102-9149-419a-b123-05385e0997cb tempest-VolumesActionsTest-1469638287 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bc647b6-70ee-4ef9-8522-ca629b7bac92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:29:06 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-9d12a102-9149-419a-b123-05385e0997cb tempest-VolumesActionsTest-1469638287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8708b51-c1bd-4031-8650-230ec3ba6ef2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:29:06 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-9d12a102-9149-419a-b123-05385e0997cb tempest-VolumesActionsTest-1469638287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8708b51-c1bd-4031-8650-230ec3ba6ef2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7b1e330d-5b38-48df-a889-58fee5614f35', 'volume_name': 'volume-7b1e330d-5b38-48df-a889-58fee5614f35', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:29:06 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-9d12a102-9149-419a-b123-05385e0997cb tempest-VolumesActionsTest-1469638287 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (841370a1-8193-4b4c-93c2-60f80c130152) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:29:06 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-9d12a102-9149-419a-b123-05385e0997cb tempest-VolumesActionsTest-1469638287 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (841370a1-8193-4b4c-93c2-60f80c130152) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:29:06 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-9d12a102-9149-419a-b123-05385e0997cb tempest-VolumesActionsTest-1469638287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca3f3269-bd59-42a5-91b0-43efc11c04bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:29:06 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-9d12a102-9149-419a-b123-05385e0997cb tempest-VolumesActionsTest-1469638287 None] Volume 7b1e330d-5b38-48df-a889-58fee5614f35: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7b1e330d-5b38-48df-a889-58fee5614f35', 'volume_size': 1} Jul 31 12:29:06 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-9d12a102-9149-419a-b123-05385e0997cb tempest-VolumesActionsTest-1469638287 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:29:06 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-9d12a102-9149-419a-b123-05385e0997cb tempest-VolumesActionsTest-1469638287 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:29:06 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-9d12a102-9149-419a-b123-05385e0997cb tempest-VolumesActionsTest-1469638287 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:29:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2033927240',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b1e330d-5b38-48df-a889-58fee5614f35,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20d1858f9b8d4591aa9062ccfbda62b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:29:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:29:06Z,use_quota=True,user_id='11fa12d70eaa4b7e8c346d263f777a4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)}" {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 12:29:06 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-9d12a102-9149-419a-b123-05385e0997cb tempest-VolumesActionsTest-1469638287 None] Creating volume 7b1e330d-5b38-48df-a889-58fee5614f35 {{(pid=89182) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 12:29:06 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-9d12a102-9149-419a-b123-05385e0997cb tempest-VolumesActionsTest-1469638287 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:29:06 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-9d12a102-9149-419a-b123-05385e0997cb tempest-VolumesActionsTest-1469638287 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:29:06 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-9d12a102-9149-419a-b123-05385e0997cb tempest-VolumesActionsTest-1469638287 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:29:06 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-9d12a102-9149-419a-b123-05385e0997cb tempest-VolumesActionsTest-1469638287 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:29:06 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-9d12a102-9149-419a-b123-05385e0997cb tempest-VolumesActionsTest-1469638287 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:29:06 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-9d12a102-9149-419a-b123-05385e0997cb tempest-VolumesActionsTest-1469638287 None] Selected osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 as target Quobyte volume. {{(pid=89182) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 12:29:06 devstack cinder-volume[89182]: INFO cinder.volume.drivers.remotefs [None req-9d12a102-9149-419a-b123-05385e0997cb tempest-VolumesActionsTest-1469638287 None] casted to osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 Jul 31 12:29:06 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-9d12a102-9149-419a-b123-05385e0997cb tempest-VolumesActionsTest-1469638287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-7b1e330d-5b38-48df-a889-58fee5614f35 1073741824 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:29:06 devstack sudo[105388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-7b1e330d-5b38-48df-a889-58fee5614f35 1073741824 Jul 31 12:29:06 devstack sudo[105388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:29:06 devstack sudo[105388]: pam_unix(sudo:session): session closed for user root Jul 31 12:29:06 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-9d12a102-9149-419a-b123-05385e0997cb tempest-VolumesActionsTest-1469638287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-7b1e330d-5b38-48df-a889-58fee5614f35 1073741824" returned: 0 in 0.589s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:29:06 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-9d12a102-9149-419a-b123-05385e0997cb tempest-VolumesActionsTest-1469638287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-7b1e330d-5b38-48df-a889-58fee5614f35 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:29:06 devstack sudo[105399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-7b1e330d-5b38-48df-a889-58fee5614f35 Jul 31 12:29:06 devstack sudo[105399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:29:07 devstack sudo[105399]: pam_unix(sudo:session): session closed for user root Jul 31 12:29:07 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-9d12a102-9149-419a-b123-05385e0997cb tempest-VolumesActionsTest-1469638287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-7b1e330d-5b38-48df-a889-58fee5614f35" returned: 0 in 0.324s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:29:07 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-9d12a102-9149-419a-b123-05385e0997cb tempest-VolumesActionsTest-1469638287 None] <== create_volume: return (975ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'} {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 12:29:07 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-9d12a102-9149-419a-b123-05385e0997cb tempest-VolumesActionsTest-1469638287 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.978s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:29:07 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-9d12a102-9149-419a-b123-05385e0997cb tempest-VolumesActionsTest-1469638287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca3f3269-bd59-42a5-91b0-43efc11c04bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7b1e330d-5b38-48df-a889-58fee5614f35', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:29:07 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-9d12a102-9149-419a-b123-05385e0997cb tempest-VolumesActionsTest-1469638287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30fceb13-79a7-4a3f-a522-c86e6bb5d148) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:29:07 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-9d12a102-9149-419a-b123-05385e0997cb tempest-VolumesActionsTest-1469638287 None] Volume volume-7b1e330d-5b38-48df-a889-58fee5614f35 (7b1e330d-5b38-48df-a889-58fee5614f35): created successfully Jul 31 12:29:07 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-9d12a102-9149-419a-b123-05385e0997cb tempest-VolumesActionsTest-1469638287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30fceb13-79a7-4a3f-a522-c86e6bb5d148) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:29:07 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-9d12a102-9149-419a-b123-05385e0997cb tempest-VolumesActionsTest-1469638287 None] Flow 'volume_create_manager' (22e71b96-39f1-4808-9b7f-b5800b72a4ac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:29:07 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-9d12a102-9149-419a-b123-05385e0997cb tempest-VolumesActionsTest-1469638287 None] Created volume successfully. Jul 31 12:29:08 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-c124d296-a0d8-413c-8c9a-d998cf7464b4 tempest-VolumesActionsTest-1469638287 None] Acquiring lock "cinder-7b1e330d-5b38-48df-a889-58fee5614f35-delete_volume" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:29:08 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-c124d296-a0d8-413c-8c9a-d998cf7464b4 tempest-VolumesActionsTest-1469638287 None] Lock "cinder-7b1e330d-5b38-48df-a889-58fee5614f35-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:29:08 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-c124d296-a0d8-413c-8c9a-d998cf7464b4 tempest-VolumesActionsTest-1469638287 None] Acquiring lock "cinder-quobyte-7b1e330d-5b38-48df-a889-58fee5614f35" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:29:08 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-c124d296-a0d8-413c-8c9a-d998cf7464b4 tempest-VolumesActionsTest-1469638287 None] Lock "cinder-quobyte-7b1e330d-5b38-48df-a889-58fee5614f35" acquired by "delete_volume" :: waited 0.020s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:29:08 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[a09766df-ac81-48ac-b9c7-ee74d56598b9]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:29:08 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-c124d296-a0d8-413c-8c9a-d998cf7464b4 tempest-VolumesActionsTest-1469638287 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-7b1e330d-5b38-48df-a889-58fee5614f35 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:29:09 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-551228a5-06e8-4f9f-be59-076b6e2e6bf3 tempest-VolumesActionsTest-1589472443 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:29:09 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-551228a5-06e8-4f9f-be59-076b6e2e6bf3 tempest-VolumesActionsTest-1589472443 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:29:09 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[43496549-ce63-4420-b623-79c35de5508a]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:29:09 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-551228a5-06e8-4f9f-be59-076b6e2e6bf3 tempest-VolumesActionsTest-1589472443 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-02345ec5-f983-4ef9-895e-cc9e9a06d7d0 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:29:09 devstack sudo[105415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-7b1e330d-5b38-48df-a889-58fee5614f35 Jul 31 12:29:09 devstack sudo[105415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:29:09 devstack sudo[105417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-02345ec5-f983-4ef9-895e-cc9e9a06d7d0 Jul 31 12:29:09 devstack sudo[105417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:29:09 devstack sudo[105415]: pam_unix(sudo:session): session closed for user root Jul 31 12:29:09 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-c124d296-a0d8-413c-8c9a-d998cf7464b4 tempest-VolumesActionsTest-1469638287 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-7b1e330d-5b38-48df-a889-58fee5614f35" returned: 0 in 0.471s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:29:09 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-c124d296-a0d8-413c-8c9a-d998cf7464b4 tempest-VolumesActionsTest-1469638287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-7b1e330d-5b38-48df-a889-58fee5614f35 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:29:09 devstack sudo[105434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-7b1e330d-5b38-48df-a889-58fee5614f35 Jul 31 12:29:09 devstack sudo[105434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:29:09 devstack sudo[105417]: pam_unix(sudo:session): session closed for user root Jul 31 12:29:09 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-551228a5-06e8-4f9f-be59-076b6e2e6bf3 tempest-VolumesActionsTest-1589472443 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-02345ec5-f983-4ef9-895e-cc9e9a06d7d0" returned: 0 in 0.583s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:29:09 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d6293a4-63c1-4443-a3b5-d1725aca4609]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:29:09 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-551228a5-06e8-4f9f-be59-076b6e2e6bf3 tempest-VolumesActionsTest-1589472443 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-02345ec5-f983-4ef9-895e-cc9e9a06d7d0 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:29:09 devstack sudo[105456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-02345ec5-f983-4ef9-895e-cc9e9a06d7d0 Jul 31 12:29:09 devstack sudo[105456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:29:09 devstack sudo[105434]: pam_unix(sudo:session): session closed for user root Jul 31 12:29:09 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-c124d296-a0d8-413c-8c9a-d998cf7464b4 tempest-VolumesActionsTest-1469638287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-7b1e330d-5b38-48df-a889-58fee5614f35" returned: 0 in 0.446s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:29:09 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-c124d296-a0d8-413c-8c9a-d998cf7464b4 tempest-VolumesActionsTest-1469638287 None] Lock "cinder-quobyte-7b1e330d-5b38-48df-a889-58fee5614f35" released by "delete_volume" :: held 0.978s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:29:10 devstack cinder-volume[89182]: DEBUG cinder.quota [None req-c124d296-a0d8-413c-8c9a-d998cf7464b4 tempest-VolumesActionsTest-1469638287 None] Created reservations ['e7ca92c2-8fa8-4e94-aefb-7b9cef8d5a03', 'd5c2a45d-01f4-421f-b67c-a09534d07640', '13ae1a94-6342-46fa-b668-e7373141905f', '53dd58f5-5542-490a-a288-9aba21a7d2a6'] {{(pid=89182) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 12:29:10 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-c124d296-a0d8-413c-8c9a-d998cf7464b4 tempest-VolumesActionsTest-1469638287 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:29:10 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-c124d296-a0d8-413c-8c9a-d998cf7464b4 tempest-VolumesActionsTest-1469638287 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:29:10 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-c124d296-a0d8-413c-8c9a-d998cf7464b4 tempest-VolumesActionsTest-1469638287 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:29:10 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-c124d296-a0d8-413c-8c9a-d998cf7464b4 tempest-VolumesActionsTest-1469638287 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:29:10 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-c124d296-a0d8-413c-8c9a-d998cf7464b4 tempest-VolumesActionsTest-1469638287 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:29:10 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-c124d296-a0d8-413c-8c9a-d998cf7464b4 tempest-VolumesActionsTest-1469638287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:29:10 devstack sudo[105479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 Jul 31 12:29:10 devstack sudo[105479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:29:10 devstack sudo[105456]: pam_unix(sudo:session): session closed for user root Jul 31 12:29:10 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-551228a5-06e8-4f9f-be59-076b6e2e6bf3 tempest-VolumesActionsTest-1589472443 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-02345ec5-f983-4ef9-895e-cc9e9a06d7d0" returned: 0 in 0.683s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:29:10 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-551228a5-06e8-4f9f-be59-076b6e2e6bf3 tempest-VolumesActionsTest-1589472443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-02345ec5-f983-4ef9-895e-cc9e9a06d7d0 /opt/stack/data/cinder/conversion/02345ec5-f983-4ef9-895e-cc9e9a06d7d0.temp_image.7dc7d29f-64c4-437c-86dd-7385f79f00a9mor3fxud.img {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:29:10 devstack sudo[105488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-02345ec5-f983-4ef9-895e-cc9e9a06d7d0 /opt/stack/data/cinder/conversion/02345ec5-f983-4ef9-895e-cc9e9a06d7d0.temp_image.7dc7d29f-64c4-437c-86dd-7385f79f00a9mor3fxud.img Jul 31 12:29:10 devstack sudo[105488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:29:10 devstack sudo[105479]: pam_unix(sudo:session): session closed for user root Jul 31 12:29:10 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-c124d296-a0d8-413c-8c9a-d998cf7464b4 tempest-VolumesActionsTest-1469638287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2" returned: 0 in 0.420s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:29:10 devstack cinder-volume[89182]: DEBUG cinder.manager [None req-c124d296-a0d8-413c-8c9a-d998cf7464b4 tempest-VolumesActionsTest-1469638287 None] Notifying Schedulers of capabilities ... {{(pid=89182) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 12:29:10 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-c124d296-a0d8-413c-8c9a-d998cf7464b4 tempest-VolumesActionsTest-1469638287 None] Deleted volume successfully. Jul 31 12:29:10 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-c124d296-a0d8-413c-8c9a-d998cf7464b4 tempest-VolumesActionsTest-1469638287 None] Lock "cinder-7b1e330d-5b38-48df-a889-58fee5614f35-delete_volume" released by "delete_volume" :: held 1.806s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:29:16 devstack sudo[105488]: pam_unix(sudo:session): session closed for user root Jul 31 12:29:16 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-551228a5-06e8-4f9f-be59-076b6e2e6bf3 tempest-VolumesActionsTest-1589472443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-02345ec5-f983-4ef9-895e-cc9e9a06d7d0 /opt/stack/data/cinder/conversion/02345ec5-f983-4ef9-895e-cc9e9a06d7d0.temp_image.7dc7d29f-64c4-437c-86dd-7385f79f00a9mor3fxud.img" returned: 0 in 6.420s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:29:16 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[559c74ea-eca1-474b-800a-f37a97eb9206]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:29:16 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-551228a5-06e8-4f9f-be59-076b6e2e6bf3 tempest-VolumesActionsTest-1589472443 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-02345ec5-f983-4ef9-895e-cc9e9a06d7d0 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:29:16 devstack sudo[105534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-02345ec5-f983-4ef9-895e-cc9e9a06d7d0 Jul 31 12:29:16 devstack sudo[105534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:29:17 devstack sudo[105534]: pam_unix(sudo:session): session closed for user root Jul 31 12:29:17 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-551228a5-06e8-4f9f-be59-076b6e2e6bf3 tempest-VolumesActionsTest-1589472443 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-02345ec5-f983-4ef9-895e-cc9e9a06d7d0" returned: 0 in 0.693s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:29:17 devstack cinder-volume[89182]: DEBUG cinder.image.image_utils [None req-551228a5-06e8-4f9f-be59-076b6e2e6bf3 tempest-VolumesActionsTest-1589472443 None] Image conversion details: src /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-02345ec5-f983-4ef9-895e-cc9e9a06d7d0, size 1024.00 MB, duration 6.42 sec, destination /opt/stack/data/cinder/conversion/02345ec5-f983-4ef9-895e-cc9e9a06d7d0.temp_image.7dc7d29f-64c4-437c-86dd-7385f79f00a9mor3fxud.img {{(pid=89182) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 31 12:29:17 devstack cinder-volume[89182]: INFO cinder.image.image_utils [None req-551228a5-06e8-4f9f-be59-076b6e2e6bf3 tempest-VolumesActionsTest-1589472443 None] Converted 1024.00 MB image at 159.47 MB/s Jul 31 12:29:17 devstack cinder-volume[89182]: DEBUG cinder.image.image_utils [None req-551228a5-06e8-4f9f-be59-076b6e2e6bf3 tempest-VolumesActionsTest-1589472443 None] 7dc7d29f-64c4-437c-86dd-7385f79f00a9 was raw, no need to convert to raw {{(pid=89182) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Jul 31 12:29:21 devstack cinder-volume[89182]: DEBUG oslo_service.periodic_task [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89182) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 31 12:29:21 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:29:21 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:29:21 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:29:21 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:29:21 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:29:21 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:29:22 devstack sudo[105544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 Jul 31 12:29:22 devstack sudo[105544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:29:22 devstack sudo[105544]: pam_unix(sudo:session): session closed for user root Jul 31 12:29:22 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2" returned: 0 in 0.405s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:29:22 devstack cinder-volume[89182]: DEBUG cinder.manager [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] Notifying Schedulers of capabilities ... {{(pid=89182) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 12:29:22 devstack cinder-volume[89182]: DEBUG oslo_service.periodic_task [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] Running periodic task VolumeManager._thread_info {{(pid=89182) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 31 12:29:22 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] thread count: 28 {{(pid=89182) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 31 12:29:22 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] thread info: [<_MainThread(MainThread, started 136154603720832)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=89182) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 31 12:29:32 devstack cinder-volume[89182]: DEBUG dbcounter [-] [89182] Writing DB stats cinder:SELECT=67,cinder:UPDATE=80,cinder:DELETE=4,cinder:INSERT=13 {{(pid=89182) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 12:29:33 devstack cinder-volume[89182]: DEBUG dbcounter [-] [89182] Writing DB stats cinder:UPDATE=78,cinder:INSERT=24,cinder:SELECT=66,cinder:DELETE=9 {{(pid=89182) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 12:29:36 devstack cinder-volume[89182]: DEBUG cinder.volume.flows.manager.create_volume [None req-93fadbfe-cc2b-4d93-aafe-1bfebb4bcedf tempest-VolumesTransfersTest-1777655949 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89182) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 12:29:36 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-93fadbfe-cc2b-4d93-aafe-1bfebb4bcedf tempest-VolumesTransfersTest-1777655949 None] Flow 'volume_create_manager' (19dc2c5c-ec0e-4f31-94c8-ee1322523e33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:29:36 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-93fadbfe-cc2b-4d93-aafe-1bfebb4bcedf tempest-VolumesTransfersTest-1777655949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3ea2105-c9b4-416a-9c3a-2258b83fe5c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:29:36 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-93fadbfe-cc2b-4d93-aafe-1bfebb4bcedf tempest-VolumesTransfersTest-1777655949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3ea2105-c9b4-416a-9c3a-2258b83fe5c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:29:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-44168636',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e1c537f-c4c0-41f2-b4c1-9109fc6a2825,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb2929105f5e4917b121fee66c2c7b51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:29:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:29:37Z,use_quota=True,user_id='f91302de8118447b8f51fec32d308548',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:29:36 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-93fadbfe-cc2b-4d93-aafe-1bfebb4bcedf tempest-VolumesTransfersTest-1777655949 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63d9aa5e-5c66-4953-856e-db1a32279217) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:29:36 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-93fadbfe-cc2b-4d93-aafe-1bfebb4bcedf tempest-VolumesTransfersTest-1777655949 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63d9aa5e-5c66-4953-856e-db1a32279217) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:29:36 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-93fadbfe-cc2b-4d93-aafe-1bfebb4bcedf tempest-VolumesTransfersTest-1777655949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4a7eb34-bd84-4158-a52d-cf3f7e79f2b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:29:36 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-93fadbfe-cc2b-4d93-aafe-1bfebb4bcedf tempest-VolumesTransfersTest-1777655949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4a7eb34-bd84-4158-a52d-cf3f7e79f2b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2e1c537f-c4c0-41f2-b4c1-9109fc6a2825', 'volume_name': 'volume-2e1c537f-c4c0-41f2-b4c1-9109fc6a2825', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:29:36 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-93fadbfe-cc2b-4d93-aafe-1bfebb4bcedf tempest-VolumesTransfersTest-1777655949 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa398e2a-7f02-434c-965e-4d6ce01e7c39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:29:36 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-93fadbfe-cc2b-4d93-aafe-1bfebb4bcedf tempest-VolumesTransfersTest-1777655949 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa398e2a-7f02-434c-965e-4d6ce01e7c39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:29:36 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-93fadbfe-cc2b-4d93-aafe-1bfebb4bcedf tempest-VolumesTransfersTest-1777655949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ddaa55c0-93a4-40f5-9319-dc02d377c965) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:29:36 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-93fadbfe-cc2b-4d93-aafe-1bfebb4bcedf tempest-VolumesTransfersTest-1777655949 None] Volume 2e1c537f-c4c0-41f2-b4c1-9109fc6a2825: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2e1c537f-c4c0-41f2-b4c1-9109fc6a2825', 'volume_size': 1} Jul 31 12:29:36 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-93fadbfe-cc2b-4d93-aafe-1bfebb4bcedf tempest-VolumesTransfersTest-1777655949 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:29:39 devstack cinder-volume[89182]: DEBUG cinder.volume.flows.manager.create_volume [None req-f44746ae-5cda-410c-b206-c341f194ff37 tempest-SnapshotDataIntegrityTests-113348013 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89182) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 12:29:39 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-f44746ae-5cda-410c-b206-c341f194ff37 tempest-SnapshotDataIntegrityTests-113348013 None] Flow 'volume_create_manager' (97678da4-0ffa-44fe-bb7d-7681290141c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:29:39 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-f44746ae-5cda-410c-b206-c341f194ff37 tempest-SnapshotDataIntegrityTests-113348013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f496a4c2-22b0-425d-afe9-a2bcc51fc69a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:29:39 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-f44746ae-5cda-410c-b206-c341f194ff37 tempest-SnapshotDataIntegrityTests-113348013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f496a4c2-22b0-425d-afe9-a2bcc51fc69a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:29:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDataIntegrityTests-volume-41203561',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ef75942-d7b9-4102-a4ca-651a1de7d88a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b7de7a8b3bf64f6b8012ee3189eeaff8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:29:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:29:39Z,use_quota=True,user_id='00b607dae7d54b56a52ba547d8a1ab16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:29:39 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-f44746ae-5cda-410c-b206-c341f194ff37 tempest-SnapshotDataIntegrityTests-113348013 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65b3975b-13b7-4e52-b3bd-e8a1556f9d4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:29:39 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-f44746ae-5cda-410c-b206-c341f194ff37 tempest-SnapshotDataIntegrityTests-113348013 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65b3975b-13b7-4e52-b3bd-e8a1556f9d4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:29:39 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-f44746ae-5cda-410c-b206-c341f194ff37 tempest-SnapshotDataIntegrityTests-113348013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2efb819c-07e1-4067-82c9-67cce4869621) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:29:39 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-f44746ae-5cda-410c-b206-c341f194ff37 tempest-SnapshotDataIntegrityTests-113348013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2efb819c-07e1-4067-82c9-67cce4869621) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8ef75942-d7b9-4102-a4ca-651a1de7d88a', 'volume_name': 'volume-8ef75942-d7b9-4102-a4ca-651a1de7d88a', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:29:39 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-f44746ae-5cda-410c-b206-c341f194ff37 tempest-SnapshotDataIntegrityTests-113348013 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45408050-c5ab-4c89-a697-8ade46a29c37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:29:39 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-f44746ae-5cda-410c-b206-c341f194ff37 tempest-SnapshotDataIntegrityTests-113348013 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45408050-c5ab-4c89-a697-8ade46a29c37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:29:39 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-f44746ae-5cda-410c-b206-c341f194ff37 tempest-SnapshotDataIntegrityTests-113348013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e070049d-6e4f-4ef1-aece-f1131792fd75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:29:39 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-f44746ae-5cda-410c-b206-c341f194ff37 tempest-SnapshotDataIntegrityTests-113348013 None] Volume 8ef75942-d7b9-4102-a4ca-651a1de7d88a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8ef75942-d7b9-4102-a4ca-651a1de7d88a', 'volume_size': 1} Jul 31 12:29:39 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-f44746ae-5cda-410c-b206-c341f194ff37 tempest-SnapshotDataIntegrityTests-113348013 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:29:40 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-551228a5-06e8-4f9f-be59-076b6e2e6bf3 tempest-VolumesActionsTest-1589472443 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 31.360s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:29:40 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-551228a5-06e8-4f9f-be59-076b6e2e6bf3 tempest-VolumesActionsTest-1589472443 None] Uploaded volume to glance image-id: 7dc7d29f-64c4-437c-86dd-7385f79f00a9. {{(pid=89182) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jul 31 12:29:40 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-93fadbfe-cc2b-4d93-aafe-1bfebb4bcedf tempest-VolumesTransfersTest-1777655949 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.454s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:29:40 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-93fadbfe-cc2b-4d93-aafe-1bfebb4bcedf tempest-VolumesTransfersTest-1777655949 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:29:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-44168636',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e1c537f-c4c0-41f2-b4c1-9109fc6a2825,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb2929105f5e4917b121fee66c2c7b51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:29:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:29:37Z,use_quota=True,user_id='f91302de8118447b8f51fec32d308548',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)}" {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 12:29:40 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-93fadbfe-cc2b-4d93-aafe-1bfebb4bcedf tempest-VolumesTransfersTest-1777655949 None] Creating volume 2e1c537f-c4c0-41f2-b4c1-9109fc6a2825 {{(pid=89182) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 12:29:40 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-93fadbfe-cc2b-4d93-aafe-1bfebb4bcedf tempest-VolumesTransfersTest-1777655949 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:29:40 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-93fadbfe-cc2b-4d93-aafe-1bfebb4bcedf tempest-VolumesTransfersTest-1777655949 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:29:40 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-93fadbfe-cc2b-4d93-aafe-1bfebb4bcedf tempest-VolumesTransfersTest-1777655949 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:29:40 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-93fadbfe-cc2b-4d93-aafe-1bfebb4bcedf tempest-VolumesTransfersTest-1777655949 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:29:40 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-93fadbfe-cc2b-4d93-aafe-1bfebb4bcedf tempest-VolumesTransfersTest-1777655949 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:29:40 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-93fadbfe-cc2b-4d93-aafe-1bfebb4bcedf tempest-VolumesTransfersTest-1777655949 None] Selected osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 as target Quobyte volume. {{(pid=89182) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 12:29:40 devstack cinder-volume[89182]: INFO cinder.volume.drivers.remotefs [None req-93fadbfe-cc2b-4d93-aafe-1bfebb4bcedf tempest-VolumesTransfersTest-1777655949 None] casted to osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 Jul 31 12:29:40 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-93fadbfe-cc2b-4d93-aafe-1bfebb4bcedf tempest-VolumesTransfersTest-1777655949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-2e1c537f-c4c0-41f2-b4c1-9109fc6a2825 1073741824 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:29:40 devstack sudo[105620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-2e1c537f-c4c0-41f2-b4c1-9109fc6a2825 1073741824 Jul 31 12:29:40 devstack sudo[105620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:29:40 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-551228a5-06e8-4f9f-be59-076b6e2e6bf3 tempest-VolumesActionsTest-1589472443 None] Copy volume to image completed successfully. Jul 31 12:29:40 devstack sudo[105620]: pam_unix(sudo:session): session closed for user root Jul 31 12:29:40 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-93fadbfe-cc2b-4d93-aafe-1bfebb4bcedf tempest-VolumesTransfersTest-1777655949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-2e1c537f-c4c0-41f2-b4c1-9109fc6a2825 1073741824" returned: 0 in 0.435s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:29:40 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-93fadbfe-cc2b-4d93-aafe-1bfebb4bcedf tempest-VolumesTransfersTest-1777655949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-2e1c537f-c4c0-41f2-b4c1-9109fc6a2825 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:29:40 devstack sudo[105625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-2e1c537f-c4c0-41f2-b4c1-9109fc6a2825 Jul 31 12:29:40 devstack sudo[105625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:29:41 devstack sudo[105625]: pam_unix(sudo:session): session closed for user root Jul 31 12:29:41 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-93fadbfe-cc2b-4d93-aafe-1bfebb4bcedf tempest-VolumesTransfersTest-1777655949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-2e1c537f-c4c0-41f2-b4c1-9109fc6a2825" returned: 0 in 0.265s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:29:41 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-93fadbfe-cc2b-4d93-aafe-1bfebb4bcedf tempest-VolumesTransfersTest-1777655949 None] <== create_volume: return (741ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'} {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 12:29:41 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-93fadbfe-cc2b-4d93-aafe-1bfebb4bcedf tempest-VolumesTransfersTest-1777655949 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.745s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:29:41 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-f44746ae-5cda-410c-b206-c341f194ff37 tempest-SnapshotDataIntegrityTests-113348013 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.980s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:29:41 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-f44746ae-5cda-410c-b206-c341f194ff37 tempest-SnapshotDataIntegrityTests-113348013 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:29:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDataIntegrityTests-volume-41203561',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ef75942-d7b9-4102-a4ca-651a1de7d88a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b7de7a8b3bf64f6b8012ee3189eeaff8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:29:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:29:39Z,use_quota=True,user_id='00b607dae7d54b56a52ba547d8a1ab16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)}" {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 12:29:41 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-f44746ae-5cda-410c-b206-c341f194ff37 tempest-SnapshotDataIntegrityTests-113348013 None] Creating volume 8ef75942-d7b9-4102-a4ca-651a1de7d88a {{(pid=89182) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 12:29:41 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-f44746ae-5cda-410c-b206-c341f194ff37 tempest-SnapshotDataIntegrityTests-113348013 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:29:41 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-f44746ae-5cda-410c-b206-c341f194ff37 tempest-SnapshotDataIntegrityTests-113348013 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:29:41 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-f44746ae-5cda-410c-b206-c341f194ff37 tempest-SnapshotDataIntegrityTests-113348013 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:29:41 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-f44746ae-5cda-410c-b206-c341f194ff37 tempest-SnapshotDataIntegrityTests-113348013 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:29:41 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-f44746ae-5cda-410c-b206-c341f194ff37 tempest-SnapshotDataIntegrityTests-113348013 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:29:41 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-f44746ae-5cda-410c-b206-c341f194ff37 tempest-SnapshotDataIntegrityTests-113348013 None] Selected osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 as target Quobyte volume. {{(pid=89182) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 12:29:41 devstack cinder-volume[89182]: INFO cinder.volume.drivers.remotefs [None req-f44746ae-5cda-410c-b206-c341f194ff37 tempest-SnapshotDataIntegrityTests-113348013 None] casted to osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 Jul 31 12:29:41 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-f44746ae-5cda-410c-b206-c341f194ff37 tempest-SnapshotDataIntegrityTests-113348013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-8ef75942-d7b9-4102-a4ca-651a1de7d88a 1073741824 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:29:41 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-93fadbfe-cc2b-4d93-aafe-1bfebb4bcedf tempest-VolumesTransfersTest-1777655949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ddaa55c0-93a4-40f5-9319-dc02d377c965) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2e1c537f-c4c0-41f2-b4c1-9109fc6a2825', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:29:41 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-93fadbfe-cc2b-4d93-aafe-1bfebb4bcedf tempest-VolumesTransfersTest-1777655949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4176e29f-52ec-402d-af02-b1668f5cd1c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:29:41 devstack sudo[105628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-8ef75942-d7b9-4102-a4ca-651a1de7d88a 1073741824 Jul 31 12:29:41 devstack sudo[105628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:29:41 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-93fadbfe-cc2b-4d93-aafe-1bfebb4bcedf tempest-VolumesTransfersTest-1777655949 None] Volume volume-2e1c537f-c4c0-41f2-b4c1-9109fc6a2825 (2e1c537f-c4c0-41f2-b4c1-9109fc6a2825): created successfully Jul 31 12:29:41 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-93fadbfe-cc2b-4d93-aafe-1bfebb4bcedf tempest-VolumesTransfersTest-1777655949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4176e29f-52ec-402d-af02-b1668f5cd1c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:29:41 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-93fadbfe-cc2b-4d93-aafe-1bfebb4bcedf tempest-VolumesTransfersTest-1777655949 None] Flow 'volume_create_manager' (19dc2c5c-ec0e-4f31-94c8-ee1322523e33) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:29:41 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-93fadbfe-cc2b-4d93-aafe-1bfebb4bcedf tempest-VolumesTransfersTest-1777655949 None] Created volume successfully. Jul 31 12:29:41 devstack sudo[105628]: pam_unix(sudo:session): session closed for user root Jul 31 12:29:41 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-f44746ae-5cda-410c-b206-c341f194ff37 tempest-SnapshotDataIntegrityTests-113348013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-8ef75942-d7b9-4102-a4ca-651a1de7d88a 1073741824" returned: 0 in 0.466s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:29:41 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-f44746ae-5cda-410c-b206-c341f194ff37 tempest-SnapshotDataIntegrityTests-113348013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-8ef75942-d7b9-4102-a4ca-651a1de7d88a {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:29:41 devstack sudo[105633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-8ef75942-d7b9-4102-a4ca-651a1de7d88a Jul 31 12:29:41 devstack sudo[105633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:29:41 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-7ea20d5b-c579-48a2-a4eb-dc456147cd27 tempest-VolumesActionsTest-1589472443 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:29:41 devstack sudo[105633]: pam_unix(sudo:session): session closed for user root Jul 31 12:29:41 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-f44746ae-5cda-410c-b206-c341f194ff37 tempest-SnapshotDataIntegrityTests-113348013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-8ef75942-d7b9-4102-a4ca-651a1de7d88a" returned: 0 in 0.263s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:29:41 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-f44746ae-5cda-410c-b206-c341f194ff37 tempest-SnapshotDataIntegrityTests-113348013 None] <== create_volume: return (768ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'} {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 12:29:41 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-f44746ae-5cda-410c-b206-c341f194ff37 tempest-SnapshotDataIntegrityTests-113348013 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.771s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:29:41 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-7ea20d5b-c579-48a2-a4eb-dc456147cd27 tempest-VolumesActionsTest-1589472443 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.047s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:29:41 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-f44746ae-5cda-410c-b206-c341f194ff37 tempest-SnapshotDataIntegrityTests-113348013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e070049d-6e4f-4ef1-aece-f1131792fd75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8ef75942-d7b9-4102-a4ca-651a1de7d88a', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:29:41 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-f44746ae-5cda-410c-b206-c341f194ff37 tempest-SnapshotDataIntegrityTests-113348013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26574e9f-b4b1-42a3-9afa-826164e98927) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:29:41 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[efbbaae4-ef3e-4deb-8137-91e536a9f450]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:29:41 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-7ea20d5b-c579-48a2-a4eb-dc456147cd27 tempest-VolumesActionsTest-1589472443 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-02345ec5-f983-4ef9-895e-cc9e9a06d7d0 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:29:41 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-f44746ae-5cda-410c-b206-c341f194ff37 tempest-SnapshotDataIntegrityTests-113348013 None] Volume volume-8ef75942-d7b9-4102-a4ca-651a1de7d88a (8ef75942-d7b9-4102-a4ca-651a1de7d88a): created successfully Jul 31 12:29:41 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-f44746ae-5cda-410c-b206-c341f194ff37 tempest-SnapshotDataIntegrityTests-113348013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26574e9f-b4b1-42a3-9afa-826164e98927) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:29:41 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-f44746ae-5cda-410c-b206-c341f194ff37 tempest-SnapshotDataIntegrityTests-113348013 None] Flow 'volume_create_manager' (97678da4-0ffa-44fe-bb7d-7681290141c8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:29:41 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-f44746ae-5cda-410c-b206-c341f194ff37 tempest-SnapshotDataIntegrityTests-113348013 None] Created volume successfully. Jul 31 12:29:42 devstack sudo[105636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-02345ec5-f983-4ef9-895e-cc9e9a06d7d0 Jul 31 12:29:42 devstack sudo[105636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:29:42 devstack sudo[105636]: pam_unix(sudo:session): session closed for user root Jul 31 12:29:42 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-7ea20d5b-c579-48a2-a4eb-dc456147cd27 tempest-VolumesActionsTest-1589472443 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-02345ec5-f983-4ef9-895e-cc9e9a06d7d0" returned: 0 in 0.370s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:29:42 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[f19bc716-c825-4745-864f-b478ab7d1546]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:29:42 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-7ea20d5b-c579-48a2-a4eb-dc456147cd27 tempest-VolumesActionsTest-1589472443 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-02345ec5-f983-4ef9-895e-cc9e9a06d7d0 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:29:42 devstack sudo[105641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-02345ec5-f983-4ef9-895e-cc9e9a06d7d0 Jul 31 12:29:42 devstack sudo[105641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:29:42 devstack sudo[105641]: pam_unix(sudo:session): session closed for user root Jul 31 12:29:42 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-7ea20d5b-c579-48a2-a4eb-dc456147cd27 tempest-VolumesActionsTest-1589472443 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-02345ec5-f983-4ef9-895e-cc9e9a06d7d0" returned: 0 in 0.425s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:29:42 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-7ea20d5b-c579-48a2-a4eb-dc456147cd27 tempest-VolumesActionsTest-1589472443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-02345ec5-f983-4ef9-895e-cc9e9a06d7d0 /opt/stack/data/cinder/conversion/02345ec5-f983-4ef9-895e-cc9e9a06d7d0.temp_image.1127d713-9d36-4820-9c59-ffe3c850d386vbpuww8j.img {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:29:42 devstack sudo[105651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-02345ec5-f983-4ef9-895e-cc9e9a06d7d0 /opt/stack/data/cinder/conversion/02345ec5-f983-4ef9-895e-cc9e9a06d7d0.temp_image.1127d713-9d36-4820-9c59-ffe3c850d386vbpuww8j.img Jul 31 12:29:42 devstack sudo[105651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:29:42 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-7d0104cd-d682-496a-b8be-7437ae3a43f3 tempest-VolumesTransfersTest-1659865461 None] Transfer volume completed successfully. Jul 31 12:29:44 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-87381376-7f9b-4388-8952-d4ad5d4dbc6f tempest-VolumesTransfersTest-1127868605 None] Acquiring lock "cinder-2e1c537f-c4c0-41f2-b4c1-9109fc6a2825-delete_volume" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:29:44 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-87381376-7f9b-4388-8952-d4ad5d4dbc6f tempest-VolumesTransfersTest-1127868605 None] Lock "cinder-2e1c537f-c4c0-41f2-b4c1-9109fc6a2825-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:29:44 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-87381376-7f9b-4388-8952-d4ad5d4dbc6f tempest-VolumesTransfersTest-1127868605 None] Acquiring lock "cinder-quobyte-2e1c537f-c4c0-41f2-b4c1-9109fc6a2825" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:29:44 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-87381376-7f9b-4388-8952-d4ad5d4dbc6f tempest-VolumesTransfersTest-1127868605 None] Lock "cinder-quobyte-2e1c537f-c4c0-41f2-b4c1-9109fc6a2825" acquired by "delete_volume" :: waited 0.035s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:29:44 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[8661f8ce-2c6e-4799-960d-e3e90b27ad7a]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:29:44 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-87381376-7f9b-4388-8952-d4ad5d4dbc6f tempest-VolumesTransfersTest-1127868605 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-2e1c537f-c4c0-41f2-b4c1-9109fc6a2825 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:29:44 devstack sudo[105666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-2e1c537f-c4c0-41f2-b4c1-9109fc6a2825 Jul 31 12:29:44 devstack sudo[105666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:29:45 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [req-cfb1faf6-8872-4a57-afd6-333c82eccc88 req-32cce76c-4cb8-43be-b6a7-86292d09f700 tempest-SnapshotDataIntegrityTests-113348013 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:29:45 devstack sudo[105666]: pam_unix(sudo:session): session closed for user root Jul 31 12:29:45 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-87381376-7f9b-4388-8952-d4ad5d4dbc6f tempest-VolumesTransfersTest-1127868605 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-2e1c537f-c4c0-41f2-b4c1-9109fc6a2825" returned: 0 in 0.910s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:29:45 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-87381376-7f9b-4388-8952-d4ad5d4dbc6f tempest-VolumesTransfersTest-1127868605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-2e1c537f-c4c0-41f2-b4c1-9109fc6a2825 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:29:45 devstack sudo[105680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-2e1c537f-c4c0-41f2-b4c1-9109fc6a2825 Jul 31 12:29:45 devstack sudo[105680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:29:45 devstack sudo[105680]: pam_unix(sudo:session): session closed for user root Jul 31 12:29:45 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-87381376-7f9b-4388-8952-d4ad5d4dbc6f tempest-VolumesTransfersTest-1127868605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-2e1c537f-c4c0-41f2-b4c1-9109fc6a2825" returned: 0 in 0.562s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:29:45 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-87381376-7f9b-4388-8952-d4ad5d4dbc6f tempest-VolumesTransfersTest-1127868605 None] Lock "cinder-quobyte-2e1c537f-c4c0-41f2-b4c1-9109fc6a2825" released by "delete_volume" :: held 1.602s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:29:45 devstack cinder-volume[89182]: DEBUG cinder.quota [None req-87381376-7f9b-4388-8952-d4ad5d4dbc6f tempest-VolumesTransfersTest-1127868605 None] Created reservations ['d5667aca-be84-46da-9302-aed25b44a3b5', '1beddf38-124e-4fdc-9c27-34483b33b2fd', 'aa521f53-a5f7-4709-8d21-3169e149db82', '067214a2-40bd-4e7c-a865-7a05b5c31626'] {{(pid=89182) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 12:29:46 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-87381376-7f9b-4388-8952-d4ad5d4dbc6f tempest-VolumesTransfersTest-1127868605 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:29:46 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-87381376-7f9b-4388-8952-d4ad5d4dbc6f tempest-VolumesTransfersTest-1127868605 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:29:46 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-87381376-7f9b-4388-8952-d4ad5d4dbc6f tempest-VolumesTransfersTest-1127868605 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:29:46 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-87381376-7f9b-4388-8952-d4ad5d4dbc6f tempest-VolumesTransfersTest-1127868605 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:29:46 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-87381376-7f9b-4388-8952-d4ad5d4dbc6f tempest-VolumesTransfersTest-1127868605 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:29:46 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-87381376-7f9b-4388-8952-d4ad5d4dbc6f tempest-VolumesTransfersTest-1127868605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:29:46 devstack sudo[105684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 Jul 31 12:29:46 devstack sudo[105684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:29:46 devstack sudo[105684]: pam_unix(sudo:session): session closed for user root Jul 31 12:29:46 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-87381376-7f9b-4388-8952-d4ad5d4dbc6f tempest-VolumesTransfersTest-1127868605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2" returned: 0 in 0.425s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:29:46 devstack cinder-volume[89182]: DEBUG cinder.manager [None req-87381376-7f9b-4388-8952-d4ad5d4dbc6f tempest-VolumesTransfersTest-1127868605 None] Notifying Schedulers of capabilities ... {{(pid=89182) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 12:29:46 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-87381376-7f9b-4388-8952-d4ad5d4dbc6f tempest-VolumesTransfersTest-1127868605 None] Deleted volume successfully. Jul 31 12:29:46 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-87381376-7f9b-4388-8952-d4ad5d4dbc6f tempest-VolumesTransfersTest-1127868605 None] Lock "cinder-2e1c537f-c4c0-41f2-b4c1-9109fc6a2825-delete_volume" released by "delete_volume" :: held 2.462s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:29:47 devstack cinder-volume[89182]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e8e5b05-03cc-4fe0-b923-c5857b3df041 tempest-VolumesTransfersTest-1777655949 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89182) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 12:29:47 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-7e8e5b05-03cc-4fe0-b923-c5857b3df041 tempest-VolumesTransfersTest-1777655949 None] Flow 'volume_create_manager' (a3bae2ea-8a79-4f28-9bd4-f71c7cec4edb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:29:47 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-7e8e5b05-03cc-4fe0-b923-c5857b3df041 tempest-VolumesTransfersTest-1777655949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a1c3757-d828-437a-b641-5eec76f8556e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:29:47 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-7e8e5b05-03cc-4fe0-b923-c5857b3df041 tempest-VolumesTransfersTest-1777655949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a1c3757-d828-437a-b641-5eec76f8556e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:29:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-863524636',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=199ff528-5297-4c47-979e-9f190c408799,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb2929105f5e4917b121fee66c2c7b51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:29:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:29:47Z,use_quota=True,user_id='f91302de8118447b8f51fec32d308548',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:29:47 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-7e8e5b05-03cc-4fe0-b923-c5857b3df041 tempest-VolumesTransfersTest-1777655949 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7b77fa9-621d-49fb-972c-2dc3cd7bf544) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:29:47 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-7e8e5b05-03cc-4fe0-b923-c5857b3df041 tempest-VolumesTransfersTest-1777655949 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7b77fa9-621d-49fb-972c-2dc3cd7bf544) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:29:47 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-7e8e5b05-03cc-4fe0-b923-c5857b3df041 tempest-VolumesTransfersTest-1777655949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b48e0919-3f69-4c75-8504-2d8ea27e987c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:29:47 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-7e8e5b05-03cc-4fe0-b923-c5857b3df041 tempest-VolumesTransfersTest-1777655949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b48e0919-3f69-4c75-8504-2d8ea27e987c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '199ff528-5297-4c47-979e-9f190c408799', 'volume_name': 'volume-199ff528-5297-4c47-979e-9f190c408799', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:29:47 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-7e8e5b05-03cc-4fe0-b923-c5857b3df041 tempest-VolumesTransfersTest-1777655949 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (630d8860-5c49-48ff-859a-06fc8b116359) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:29:47 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-7e8e5b05-03cc-4fe0-b923-c5857b3df041 tempest-VolumesTransfersTest-1777655949 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (630d8860-5c49-48ff-859a-06fc8b116359) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:29:47 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-7e8e5b05-03cc-4fe0-b923-c5857b3df041 tempest-VolumesTransfersTest-1777655949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26ec13db-9038-44c2-b838-9c6a02084028) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:29:47 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-7e8e5b05-03cc-4fe0-b923-c5857b3df041 tempest-VolumesTransfersTest-1777655949 None] Volume 199ff528-5297-4c47-979e-9f190c408799: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-199ff528-5297-4c47-979e-9f190c408799', 'volume_size': 1} Jul 31 12:29:47 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-7e8e5b05-03cc-4fe0-b923-c5857b3df041 tempest-VolumesTransfersTest-1777655949 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:29:47 devstack sudo[105651]: pam_unix(sudo:session): session closed for user root Jul 31 12:29:47 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-7ea20d5b-c579-48a2-a4eb-dc456147cd27 tempest-VolumesActionsTest-1589472443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-02345ec5-f983-4ef9-895e-cc9e9a06d7d0 /opt/stack/data/cinder/conversion/02345ec5-f983-4ef9-895e-cc9e9a06d7d0.temp_image.1127d713-9d36-4820-9c59-ffe3c850d386vbpuww8j.img" returned: 0 in 5.029s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:29:47 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a29611c-8117-4d9d-bac8-d36ed24bb029]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:29:47 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-7ea20d5b-c579-48a2-a4eb-dc456147cd27 tempest-VolumesActionsTest-1589472443 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-02345ec5-f983-4ef9-895e-cc9e9a06d7d0 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:29:47 devstack sudo[105688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-02345ec5-f983-4ef9-895e-cc9e9a06d7d0 Jul 31 12:29:47 devstack sudo[105688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:29:48 devstack sudo[105688]: pam_unix(sudo:session): session closed for user root Jul 31 12:29:48 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-7ea20d5b-c579-48a2-a4eb-dc456147cd27 tempest-VolumesActionsTest-1589472443 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-02345ec5-f983-4ef9-895e-cc9e9a06d7d0" returned: 0 in 0.546s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:29:48 devstack cinder-volume[89182]: DEBUG cinder.image.image_utils [None req-7ea20d5b-c579-48a2-a4eb-dc456147cd27 tempest-VolumesActionsTest-1589472443 None] Image conversion details: src /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-02345ec5-f983-4ef9-895e-cc9e9a06d7d0, size 1024.00 MB, duration 5.03 sec, destination /opt/stack/data/cinder/conversion/02345ec5-f983-4ef9-895e-cc9e9a06d7d0.temp_image.1127d713-9d36-4820-9c59-ffe3c850d386vbpuww8j.img {{(pid=89182) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 31 12:29:48 devstack cinder-volume[89182]: INFO cinder.image.image_utils [None req-7ea20d5b-c579-48a2-a4eb-dc456147cd27 tempest-VolumesActionsTest-1589472443 None] Converted 1024.00 MB image at 203.54 MB/s Jul 31 12:29:48 devstack cinder-volume[89182]: DEBUG cinder.image.image_utils [None req-7ea20d5b-c579-48a2-a4eb-dc456147cd27 tempest-VolumesActionsTest-1589472443 None] 1127d713-9d36-4820-9c59-ffe3c850d386 was raw, converting to qcow2 {{(pid=89182) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}} Jul 31 12:29:48 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dd045b9-0b9b-4df5-8af0-17c55484a65c]: (4, 'raw') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:29:48 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-7ea20d5b-c579-48a2-a4eb-dc456147cd27 tempest-VolumesActionsTest-1589472443 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/02345ec5-f983-4ef9-895e-cc9e9a06d7d0.temp_image.1127d713-9d36-4820-9c59-ffe3c850d386vbpuww8j.img {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:29:48 devstack sudo[105693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/02345ec5-f983-4ef9-895e-cc9e9a06d7d0.temp_image.1127d713-9d36-4820-9c59-ffe3c850d386vbpuww8j.img Jul 31 12:29:48 devstack sudo[105693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:29:48 devstack sudo[105693]: pam_unix(sudo:session): session closed for user root Jul 31 12:29:48 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-7ea20d5b-c579-48a2-a4eb-dc456147cd27 tempest-VolumesActionsTest-1589472443 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/02345ec5-f983-4ef9-895e-cc9e9a06d7d0.temp_image.1127d713-9d36-4820-9c59-ffe3c850d386vbpuww8j.img" returned: 0 in 0.316s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:29:48 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-7ea20d5b-c579-48a2-a4eb-dc456147cd27 tempest-VolumesActionsTest-1589472443 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/02345ec5-f983-4ef9-895e-cc9e9a06d7d0.temp_image.1127d713-9d36-4820-9c59-ffe3c850d386vbpuww8j.img {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:29:48 devstack sudo[105697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/02345ec5-f983-4ef9-895e-cc9e9a06d7d0.temp_image.1127d713-9d36-4820-9c59-ffe3c850d386vbpuww8j.img Jul 31 12:29:48 devstack sudo[105697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:29:49 devstack sudo[105697]: pam_unix(sudo:session): session closed for user root Jul 31 12:29:49 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-7ea20d5b-c579-48a2-a4eb-dc456147cd27 tempest-VolumesActionsTest-1589472443 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/02345ec5-f983-4ef9-895e-cc9e9a06d7d0.temp_image.1127d713-9d36-4820-9c59-ffe3c850d386vbpuww8j.img" returned: 1 in 0.339s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:29:49 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-7ea20d5b-c579-48a2-a4eb-dc456147cd27 tempest-VolumesActionsTest-1589472443 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/02345ec5-f983-4ef9-895e-cc9e9a06d7d0.temp_image.1127d713-9d36-4820-9c59-ffe3c850d386vbpuww8j.img' failed. Not Retrying. {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 31 12:29:49 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-7ea20d5b-c579-48a2-a4eb-dc456147cd27 tempest-VolumesActionsTest-1589472443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/02345ec5-f983-4ef9-895e-cc9e9a06d7d0.temp_image.1127d713-9d36-4820-9c59-ffe3c850d386vbpuww8j.img /opt/stack/data/cinder/conversion/vol_upload_5qwic9ki {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:29:49 devstack sudo[105702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/02345ec5-f983-4ef9-895e-cc9e9a06d7d0.temp_image.1127d713-9d36-4820-9c59-ffe3c850d386vbpuww8j.img /opt/stack/data/cinder/conversion/vol_upload_5qwic9ki Jul 31 12:29:49 devstack sudo[105702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:29:49 devstack sudo[105702]: pam_unix(sudo:session): session closed for user root Jul 31 12:29:49 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-7ea20d5b-c579-48a2-a4eb-dc456147cd27 tempest-VolumesActionsTest-1589472443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/02345ec5-f983-4ef9-895e-cc9e9a06d7d0.temp_image.1127d713-9d36-4820-9c59-ffe3c850d386vbpuww8j.img /opt/stack/data/cinder/conversion/vol_upload_5qwic9ki" returned: 0 in 0.257s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:29:49 devstack cinder-volume[89182]: DEBUG cinder.image.image_utils [None req-7ea20d5b-c579-48a2-a4eb-dc456147cd27 tempest-VolumesActionsTest-1589472443 None] Image conversion details: src /opt/stack/data/cinder/conversion/02345ec5-f983-4ef9-895e-cc9e9a06d7d0.temp_image.1127d713-9d36-4820-9c59-ffe3c850d386vbpuww8j.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_5qwic9ki {{(pid=89182) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 31 12:29:49 devstack cinder-volume[89182]: INFO cinder.image.image_utils [None req-7ea20d5b-c579-48a2-a4eb-dc456147cd27 tempest-VolumesActionsTest-1589472443 None] Converted 1024.00 MB image at 1024.00 MB/s Jul 31 12:29:49 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc670130-7dd6-4936-a9f7-51322fc33d50]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:29:49 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-7ea20d5b-c579-48a2-a4eb-dc456147cd27 tempest-VolumesActionsTest-1589472443 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_5qwic9ki {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:29:49 devstack sudo[105713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_5qwic9ki Jul 31 12:29:49 devstack sudo[105713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:29:49 devstack sudo[105713]: pam_unix(sudo:session): session closed for user root Jul 31 12:29:49 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-7ea20d5b-c579-48a2-a4eb-dc456147cd27 tempest-VolumesActionsTest-1589472443 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_5qwic9ki" returned: 0 in 0.320s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:29:50 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-7ea20d5b-c579-48a2-a4eb-dc456147cd27 tempest-VolumesActionsTest-1589472443 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 8.912s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:29:50 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-7ea20d5b-c579-48a2-a4eb-dc456147cd27 tempest-VolumesActionsTest-1589472443 None] Uploaded volume to glance image-id: 1127d713-9d36-4820-9c59-ffe3c850d386. {{(pid=89182) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jul 31 12:29:50 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [req-cfb1faf6-8872-4a57-afd6-333c82eccc88 req-32cce76c-4cb8-43be-b6a7-86292d09f700 tempest-SnapshotDataIntegrityTests-113348013 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 5.754s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:29:50 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [req-cfb1faf6-8872-4a57-afd6-333c82eccc88 req-32cce76c-4cb8-43be-b6a7-86292d09f700 tempest-SnapshotDataIntegrityTests-113348013 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:29:50 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-7e8e5b05-03cc-4fe0-b923-c5857b3df041 tempest-VolumesTransfersTest-1777655949 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.364s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:29:50 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-7e8e5b05-03cc-4fe0-b923-c5857b3df041 tempest-VolumesTransfersTest-1777655949 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:29:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-863524636',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=199ff528-5297-4c47-979e-9f190c408799,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb2929105f5e4917b121fee66c2c7b51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:29:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:29:47Z,use_quota=True,user_id='f91302de8118447b8f51fec32d308548',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)}" {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 12:29:50 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-7e8e5b05-03cc-4fe0-b923-c5857b3df041 tempest-VolumesTransfersTest-1777655949 None] Creating volume 199ff528-5297-4c47-979e-9f190c408799 {{(pid=89182) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 12:29:50 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-7e8e5b05-03cc-4fe0-b923-c5857b3df041 tempest-VolumesTransfersTest-1777655949 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:29:50 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-7e8e5b05-03cc-4fe0-b923-c5857b3df041 tempest-VolumesTransfersTest-1777655949 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:29:50 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-7e8e5b05-03cc-4fe0-b923-c5857b3df041 tempest-VolumesTransfersTest-1777655949 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:29:50 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-7e8e5b05-03cc-4fe0-b923-c5857b3df041 tempest-VolumesTransfersTest-1777655949 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:29:50 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-7e8e5b05-03cc-4fe0-b923-c5857b3df041 tempest-VolumesTransfersTest-1777655949 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:29:50 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-7e8e5b05-03cc-4fe0-b923-c5857b3df041 tempest-VolumesTransfersTest-1777655949 None] Selected osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 as target Quobyte volume. {{(pid=89182) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 12:29:50 devstack cinder-volume[89182]: INFO cinder.volume.drivers.remotefs [None req-7e8e5b05-03cc-4fe0-b923-c5857b3df041 tempest-VolumesTransfersTest-1777655949 None] casted to osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 Jul 31 12:29:50 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-7e8e5b05-03cc-4fe0-b923-c5857b3df041 tempest-VolumesTransfersTest-1777655949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-199ff528-5297-4c47-979e-9f190c408799 1073741824 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:29:50 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-7ea20d5b-c579-48a2-a4eb-dc456147cd27 tempest-VolumesActionsTest-1589472443 None] Copy volume to image completed successfully. Jul 31 12:29:50 devstack sudo[105718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-199ff528-5297-4c47-979e-9f190c408799 1073741824 Jul 31 12:29:50 devstack sudo[105718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:29:50 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [req-cfb1faf6-8872-4a57-afd6-333c82eccc88 req-32cce76c-4cb8-43be-b6a7-86292d09f700 tempest-SnapshotDataIntegrityTests-113348013 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88', 'name': 'volume-8ef75942-d7b9-4102-a4ca-651a1de7d88a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7cf32a9d-8f6f-4147-a3c4-25b3b4012f78', 'enforce_multipath': True} {{(pid=89182) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 31 12:29:50 devstack cinder-volume[89182]: INFO cinder.volume.manager [req-cfb1faf6-8872-4a57-afd6-333c82eccc88 req-32cce76c-4cb8-43be-b6a7-86292d09f700 tempest-SnapshotDataIntegrityTests-113348013 None] attachment_update completed successfully. Jul 31 12:29:51 devstack sudo[105718]: pam_unix(sudo:session): session closed for user root Jul 31 12:29:51 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-7e8e5b05-03cc-4fe0-b923-c5857b3df041 tempest-VolumesTransfersTest-1777655949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-199ff528-5297-4c47-979e-9f190c408799 1073741824" returned: 0 in 0.459s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:29:51 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-7e8e5b05-03cc-4fe0-b923-c5857b3df041 tempest-VolumesTransfersTest-1777655949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-199ff528-5297-4c47-979e-9f190c408799 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:29:51 devstack sudo[106106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-199ff528-5297-4c47-979e-9f190c408799 Jul 31 12:29:51 devstack sudo[106106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:29:51 devstack sudo[106106]: pam_unix(sudo:session): session closed for user root Jul 31 12:29:51 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-7e8e5b05-03cc-4fe0-b923-c5857b3df041 tempest-VolumesTransfersTest-1777655949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-199ff528-5297-4c47-979e-9f190c408799" returned: 0 in 0.289s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:29:51 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-7e8e5b05-03cc-4fe0-b923-c5857b3df041 tempest-VolumesTransfersTest-1777655949 None] <== create_volume: return (789ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'} {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 12:29:51 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-7e8e5b05-03cc-4fe0-b923-c5857b3df041 tempest-VolumesTransfersTest-1777655949 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.792s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:29:51 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-7e8e5b05-03cc-4fe0-b923-c5857b3df041 tempest-VolumesTransfersTest-1777655949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26ec13db-9038-44c2-b838-9c6a02084028) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-199ff528-5297-4c47-979e-9f190c408799', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:29:51 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-7e8e5b05-03cc-4fe0-b923-c5857b3df041 tempest-VolumesTransfersTest-1777655949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56cb15bd-0a33-4c6b-8215-6bafb5e93ca7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:29:51 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-7e8e5b05-03cc-4fe0-b923-c5857b3df041 tempest-VolumesTransfersTest-1777655949 None] Volume volume-199ff528-5297-4c47-979e-9f190c408799 (199ff528-5297-4c47-979e-9f190c408799): created successfully Jul 31 12:29:51 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-7e8e5b05-03cc-4fe0-b923-c5857b3df041 tempest-VolumesTransfersTest-1777655949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56cb15bd-0a33-4c6b-8215-6bafb5e93ca7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:29:51 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-7e8e5b05-03cc-4fe0-b923-c5857b3df041 tempest-VolumesTransfersTest-1777655949 None] Flow 'volume_create_manager' (a3bae2ea-8a79-4f28-9bd4-f71c7cec4edb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:29:51 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-7e8e5b05-03cc-4fe0-b923-c5857b3df041 tempest-VolumesTransfersTest-1777655949 None] Created volume successfully. Jul 31 12:29:52 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-41e3da3d-d9ca-4449-919c-f53020811f84 tempest-VolumesActionsTest-1589472443 None] Acquiring lock "cinder-02345ec5-f983-4ef9-895e-cc9e9a06d7d0-delete_volume" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:29:52 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-41e3da3d-d9ca-4449-919c-f53020811f84 tempest-VolumesActionsTest-1589472443 None] Lock "cinder-02345ec5-f983-4ef9-895e-cc9e9a06d7d0-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:29:52 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-41e3da3d-d9ca-4449-919c-f53020811f84 tempest-VolumesActionsTest-1589472443 None] Acquiring lock "cinder-quobyte-02345ec5-f983-4ef9-895e-cc9e9a06d7d0" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:29:52 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-41e3da3d-d9ca-4449-919c-f53020811f84 tempest-VolumesActionsTest-1589472443 None] Lock "cinder-quobyte-02345ec5-f983-4ef9-895e-cc9e9a06d7d0" acquired by "delete_volume" :: waited 0.017s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:29:52 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[766008f1-5e97-415e-93bc-7d9710858835]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:29:52 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-41e3da3d-d9ca-4449-919c-f53020811f84 tempest-VolumesActionsTest-1589472443 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-02345ec5-f983-4ef9-895e-cc9e9a06d7d0 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:29:52 devstack sudo[106112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-02345ec5-f983-4ef9-895e-cc9e9a06d7d0 Jul 31 12:29:52 devstack sudo[106112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:29:52 devstack sudo[106112]: pam_unix(sudo:session): session closed for user root Jul 31 12:29:52 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-41e3da3d-d9ca-4449-919c-f53020811f84 tempest-VolumesActionsTest-1589472443 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-02345ec5-f983-4ef9-895e-cc9e9a06d7d0" returned: 0 in 0.385s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:29:52 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-41e3da3d-d9ca-4449-919c-f53020811f84 tempest-VolumesActionsTest-1589472443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-02345ec5-f983-4ef9-895e-cc9e9a06d7d0 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:29:52 devstack sudo[106125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-02345ec5-f983-4ef9-895e-cc9e9a06d7d0 Jul 31 12:29:52 devstack sudo[106125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:29:52 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-06ce6e4b-c585-4783-b0a8-31afc2c95385 tempest-VolumesTransfersTest-1127868605 None] Acquiring lock "cinder-199ff528-5297-4c47-979e-9f190c408799-delete_volume" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:29:52 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-06ce6e4b-c585-4783-b0a8-31afc2c95385 tempest-VolumesTransfersTest-1127868605 None] Lock "cinder-199ff528-5297-4c47-979e-9f190c408799-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:29:52 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-06ce6e4b-c585-4783-b0a8-31afc2c95385 tempest-VolumesTransfersTest-1127868605 None] Acquiring lock "cinder-quobyte-199ff528-5297-4c47-979e-9f190c408799" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:29:52 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-06ce6e4b-c585-4783-b0a8-31afc2c95385 tempest-VolumesTransfersTest-1127868605 None] Lock "cinder-quobyte-199ff528-5297-4c47-979e-9f190c408799" acquired by "delete_volume" :: waited 0.017s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:29:52 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[75e30594-c5ad-40cc-905b-f2d1f9966a1d]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:29:52 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-06ce6e4b-c585-4783-b0a8-31afc2c95385 tempest-VolumesTransfersTest-1127868605 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-199ff528-5297-4c47-979e-9f190c408799 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:29:52 devstack sudo[106125]: pam_unix(sudo:session): session closed for user root Jul 31 12:29:52 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-41e3da3d-d9ca-4449-919c-f53020811f84 tempest-VolumesActionsTest-1589472443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-02345ec5-f983-4ef9-895e-cc9e9a06d7d0" returned: 0 in 0.295s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:29:52 devstack sudo[106129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-199ff528-5297-4c47-979e-9f190c408799 Jul 31 12:29:52 devstack sudo[106129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:29:52 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-41e3da3d-d9ca-4449-919c-f53020811f84 tempest-VolumesActionsTest-1589472443 None] Lock "cinder-quobyte-02345ec5-f983-4ef9-895e-cc9e9a06d7d0" released by "delete_volume" :: held 0.723s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:29:52 devstack cinder-volume[89182]: DEBUG cinder.quota [None req-41e3da3d-d9ca-4449-919c-f53020811f84 tempest-VolumesActionsTest-1589472443 None] Created reservations ['515a3ab2-98eb-457a-a81e-e53a8f27b2e6', '7d196728-3499-4983-99b3-aa066b7acb34', '49f749df-72e7-46e6-985f-520813e0aa64', 'fce3452d-64f4-43ff-b56d-051a648c4cc0'] {{(pid=89182) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 12:29:53 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-41e3da3d-d9ca-4449-919c-f53020811f84 tempest-VolumesActionsTest-1589472443 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:29:53 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-41e3da3d-d9ca-4449-919c-f53020811f84 tempest-VolumesActionsTest-1589472443 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:29:53 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-41e3da3d-d9ca-4449-919c-f53020811f84 tempest-VolumesActionsTest-1589472443 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:29:53 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-41e3da3d-d9ca-4449-919c-f53020811f84 tempest-VolumesActionsTest-1589472443 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:29:53 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-41e3da3d-d9ca-4449-919c-f53020811f84 tempest-VolumesActionsTest-1589472443 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:29:53 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-41e3da3d-d9ca-4449-919c-f53020811f84 tempest-VolumesActionsTest-1589472443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:29:53 devstack sudo[106143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 Jul 31 12:29:53 devstack sudo[106143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:29:53 devstack sudo[106129]: pam_unix(sudo:session): session closed for user root Jul 31 12:29:53 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-06ce6e4b-c585-4783-b0a8-31afc2c95385 tempest-VolumesTransfersTest-1127868605 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-199ff528-5297-4c47-979e-9f190c408799" returned: 0 in 0.414s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:29:53 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-06ce6e4b-c585-4783-b0a8-31afc2c95385 tempest-VolumesTransfersTest-1127868605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-199ff528-5297-4c47-979e-9f190c408799 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:29:53 devstack sudo[106152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-199ff528-5297-4c47-979e-9f190c408799 Jul 31 12:29:53 devstack sudo[106152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:29:53 devstack sudo[106143]: pam_unix(sudo:session): session closed for user root Jul 31 12:29:53 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-41e3da3d-d9ca-4449-919c-f53020811f84 tempest-VolumesActionsTest-1589472443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2" returned: 0 in 0.284s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:29:53 devstack cinder-volume[89182]: DEBUG cinder.manager [None req-41e3da3d-d9ca-4449-919c-f53020811f84 tempest-VolumesActionsTest-1589472443 None] Notifying Schedulers of capabilities ... {{(pid=89182) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 12:29:53 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-41e3da3d-d9ca-4449-919c-f53020811f84 tempest-VolumesActionsTest-1589472443 None] Deleted volume successfully. Jul 31 12:29:53 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-41e3da3d-d9ca-4449-919c-f53020811f84 tempest-VolumesActionsTest-1589472443 None] Lock "cinder-02345ec5-f983-4ef9-895e-cc9e9a06d7d0-delete_volume" released by "delete_volume" :: held 1.219s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:29:53 devstack sudo[106152]: pam_unix(sudo:session): session closed for user root Jul 31 12:29:53 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-06ce6e4b-c585-4783-b0a8-31afc2c95385 tempest-VolumesTransfersTest-1127868605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-199ff528-5297-4c47-979e-9f190c408799" returned: 0 in 0.289s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:29:53 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-06ce6e4b-c585-4783-b0a8-31afc2c95385 tempest-VolumesTransfersTest-1127868605 None] Lock "cinder-quobyte-199ff528-5297-4c47-979e-9f190c408799" released by "delete_volume" :: held 0.772s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:29:53 devstack cinder-volume[89182]: DEBUG cinder.quota [None req-06ce6e4b-c585-4783-b0a8-31afc2c95385 tempest-VolumesTransfersTest-1127868605 None] Created reservations ['b825fbc1-5164-4db9-8087-0ee1efafaa7c', '2c1290c9-e9ab-40f9-bfd7-1001f1a6eb06', 'a3bc62c6-c416-4ac9-9b6d-40e30edb28a8', 'a4c1b6b3-8e67-4f21-9bf4-fb483e471343'] {{(pid=89182) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 12:29:53 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-06ce6e4b-c585-4783-b0a8-31afc2c95385 tempest-VolumesTransfersTest-1127868605 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:29:53 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-06ce6e4b-c585-4783-b0a8-31afc2c95385 tempest-VolumesTransfersTest-1127868605 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:29:53 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-06ce6e4b-c585-4783-b0a8-31afc2c95385 tempest-VolumesTransfersTest-1127868605 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:29:53 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-06ce6e4b-c585-4783-b0a8-31afc2c95385 tempest-VolumesTransfersTest-1127868605 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:29:53 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-06ce6e4b-c585-4783-b0a8-31afc2c95385 tempest-VolumesTransfersTest-1127868605 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:29:53 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-06ce6e4b-c585-4783-b0a8-31afc2c95385 tempest-VolumesTransfersTest-1127868605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:29:53 devstack sudo[106158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 Jul 31 12:29:53 devstack sudo[106158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:29:53 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-ee43a3aa-9805-4129-ac1a-c1ea14940635 tempest-SnapshotDataIntegrityTests-113348013 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:29:53 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-ee43a3aa-9805-4129-ac1a-c1ea14940635 tempest-SnapshotDataIntegrityTests-113348013 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:29:53 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-ee43a3aa-9805-4129-ac1a-c1ea14940635 tempest-SnapshotDataIntegrityTests-113348013 None] Creating online snapshot b8369f85-c94c-4c5c-9b7e-1f6060bee802 of volume 8ef75942-d7b9-4102-a4ca-651a1de7d88a {{(pid=89182) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 31 12:29:53 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[6884fbed-6ca5-4572-b85d-edc7edce82a5]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:29:53 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-ee43a3aa-9805-4129-ac1a-c1ea14940635 tempest-SnapshotDataIntegrityTests-113348013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-8ef75942-d7b9-4102-a4ca-651a1de7d88a {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:29:53 devstack sudo[106158]: pam_unix(sudo:session): session closed for user root Jul 31 12:29:53 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-06ce6e4b-c585-4783-b0a8-31afc2c95385 tempest-VolumesTransfersTest-1127868605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2" returned: 0 in 0.292s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:29:53 devstack cinder-volume[89182]: DEBUG cinder.manager [None req-06ce6e4b-c585-4783-b0a8-31afc2c95385 tempest-VolumesTransfersTest-1127868605 None] Notifying Schedulers of capabilities ... {{(pid=89182) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 12:29:53 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-06ce6e4b-c585-4783-b0a8-31afc2c95385 tempest-VolumesTransfersTest-1127868605 None] Deleted volume successfully. Jul 31 12:29:54 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-06ce6e4b-c585-4783-b0a8-31afc2c95385 tempest-VolumesTransfersTest-1127868605 None] Lock "cinder-199ff528-5297-4c47-979e-9f190c408799-delete_volume" released by "delete_volume" :: held 1.326s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:29:54 devstack sudo[106161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-8ef75942-d7b9-4102-a4ca-651a1de7d88a Jul 31 12:29:54 devstack sudo[106161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:29:54 devstack sudo[106161]: pam_unix(sudo:session): session closed for user root Jul 31 12:29:54 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-ee43a3aa-9805-4129-ac1a-c1ea14940635 tempest-SnapshotDataIntegrityTests-113348013 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-8ef75942-d7b9-4102-a4ca-651a1de7d88a" returned: 0 in 0.488s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:29:54 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-ee43a3aa-9805-4129-ac1a-c1ea14940635 tempest-SnapshotDataIntegrityTests-113348013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-8ef75942-d7b9-4102-a4ca-651a1de7d88a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-8ef75942-d7b9-4102-a4ca-651a1de7d88a.b8369f85-c94c-4c5c-9b7e-1f6060bee802 1G {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:29:54 devstack sudo[106168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-8ef75942-d7b9-4102-a4ca-651a1de7d88a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-8ef75942-d7b9-4102-a4ca-651a1de7d88a.b8369f85-c94c-4c5c-9b7e-1f6060bee802 1G Jul 31 12:29:54 devstack sudo[106168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:29:54 devstack sudo[106168]: pam_unix(sudo:session): session closed for user root Jul 31 12:29:54 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-ee43a3aa-9805-4129-ac1a-c1ea14940635 tempest-SnapshotDataIntegrityTests-113348013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-8ef75942-d7b9-4102-a4ca-651a1de7d88a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-8ef75942-d7b9-4102-a4ca-651a1de7d88a.b8369f85-c94c-4c5c-9b7e-1f6060bee802 1G" returned: 0 in 0.499s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:29:54 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-ee43a3aa-9805-4129-ac1a-c1ea14940635 tempest-SnapshotDataIntegrityTests-113348013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8ef75942-d7b9-4102-a4ca-651a1de7d88a -F qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-8ef75942-d7b9-4102-a4ca-651a1de7d88a.b8369f85-c94c-4c5c-9b7e-1f6060bee802 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:29:54 devstack sudo[106174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8ef75942-d7b9-4102-a4ca-651a1de7d88a -F qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-8ef75942-d7b9-4102-a4ca-651a1de7d88a.b8369f85-c94c-4c5c-9b7e-1f6060bee802 Jul 31 12:29:54 devstack sudo[106174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:29:55 devstack sudo[106174]: pam_unix(sudo:session): session closed for user root Jul 31 12:29:55 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-ee43a3aa-9805-4129-ac1a-c1ea14940635 tempest-SnapshotDataIntegrityTests-113348013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8ef75942-d7b9-4102-a4ca-651a1de7d88a -F qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-8ef75942-d7b9-4102-a4ca-651a1de7d88a.b8369f85-c94c-4c5c-9b7e-1f6060bee802" returned: 0 in 0.375s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:29:55 devstack cinder-volume[89182]: WARNING cinder.volume.drivers.remotefs [None req-ee43a3aa-9805-4129-ac1a-c1ea14940635 tempest-SnapshotDataIntegrityTests-113348013 None] /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-8ef75942-d7b9-4102-a4ca-651a1de7d88a.b8369f85-c94c-4c5c-9b7e-1f6060bee802 is being set with open permissions: ugo+rw Jul 31 12:29:55 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-ee43a3aa-9805-4129-ac1a-c1ea14940635 tempest-SnapshotDataIntegrityTests-113348013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-8ef75942-d7b9-4102-a4ca-651a1de7d88a.b8369f85-c94c-4c5c-9b7e-1f6060bee802 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:29:55 devstack sudo[106181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-8ef75942-d7b9-4102-a4ca-651a1de7d88a.b8369f85-c94c-4c5c-9b7e-1f6060bee802 Jul 31 12:29:55 devstack sudo[106181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:29:55 devstack sudo[106181]: pam_unix(sudo:session): session closed for user root Jul 31 12:29:55 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-ee43a3aa-9805-4129-ac1a-c1ea14940635 tempest-SnapshotDataIntegrityTests-113348013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-8ef75942-d7b9-4102-a4ca-651a1de7d88a.b8369f85-c94c-4c5c-9b7e-1f6060bee802" returned: 0 in 0.303s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:29:55 devstack cinder-volume[89182]: DEBUG cinder.compute.nova [None req-ee43a3aa-9805-4129-ac1a-c1ea14940635 tempest-SnapshotDataIntegrityTests-113348013 None] Creating Keystone auth plugin from conf {{(pid=89182) novaclient /opt/stack/cinder/cinder/compute/nova.py:99}} Jul 31 12:29:55 devstack cinder-volume[89182]: DEBUG novaclient.v2.client [None req-ee43a3aa-9805-4129-ac1a-c1ea14940635 tempest-SnapshotDataIntegrityTests-113348013 None] REQ: curl -g -i -X POST http://192.168.122.21/compute/v2.1/os-assisted-volume-snapshots -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}7b853748c447ceae7636020030815f0e094072e0f4faf2af420584f904ebcef4" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-ee43a3aa-9805-4129-ac1a-c1ea14940635" -H "X-Service-Token: {SHA256}02a8645ba5bc7d3f7d0a93a9d02f784466607492168e4b335483720fa1daddd6" -d '{"snapshot": {"volume_id": "8ef75942-d7b9-4102-a4ca-651a1de7d88a", "create_info": {"type": "qcow2", "new_file": "volume-8ef75942-d7b9-4102-a4ca-651a1de7d88a.b8369f85-c94c-4c5c-9b7e-1f6060bee802", "snapshot_id": "b8369f85-c94c-4c5c-9b7e-1f6060bee802"}}}' {{(pid=89182) _http_log_request /opt/stack/data/venv/lib/python3.12/site-packages/keystoneauth1/session.py:575}} Jul 31 12:29:55 devstack cinder-volume[89182]: DEBUG novaclient.v2.client [None req-ee43a3aa-9805-4129-ac1a-c1ea14940635 tempest-SnapshotDataIntegrityTests-113348013 None] RESP: [200] Connection: close Content-Length: 78 Content-Type: application/json Date: Fri, 31 Jul 2026 10:29:55 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.58 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-78a0f52f-7c2e-4244-a78a-91f53aac4a7c x-openstack-request-id: req-78a0f52f-7c2e-4244-a78a-91f53aac4a7c {{(pid=89182) _http_log_response /opt/stack/data/venv/lib/python3.12/site-packages/keystoneauth1/session.py:616}} Jul 31 12:29:55 devstack cinder-volume[89182]: DEBUG novaclient.v2.client [None req-ee43a3aa-9805-4129-ac1a-c1ea14940635 tempest-SnapshotDataIntegrityTests-113348013 None] RESP BODY: {"snapshot": {"id": null, "volumeId": "8ef75942-d7b9-4102-a4ca-651a1de7d88a"}} {{(pid=89182) _http_log_response /opt/stack/data/venv/lib/python3.12/site-packages/keystoneauth1/session.py:651}} Jul 31 12:29:55 devstack cinder-volume[89182]: DEBUG novaclient.v2.client [None req-ee43a3aa-9805-4129-ac1a-c1ea14940635 tempest-SnapshotDataIntegrityTests-113348013 None] POST call to compute for http://192.168.122.21/compute/v2.1/os-assisted-volume-snapshots used request id req-78a0f52f-7c2e-4244-a78a-91f53aac4a7c {{(pid=89182) request /opt/stack/data/venv/lib/python3.12/site-packages/keystoneauth1/session.py:1076}} Jul 31 12:29:55 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-ee43a3aa-9805-4129-ac1a-c1ea14940635 tempest-SnapshotDataIntegrityTests-113348013 None] nova call result: None {{(pid=89182) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1910}} Jul 31 12:29:55 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-ee43a3aa-9805-4129-ac1a-c1ea14940635 tempest-SnapshotDataIntegrityTests-113348013 None] Status of snapshot b8369f85-c94c-4c5c-9b7e-1f6060bee802 is now creating {{(pid=89182) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Jul 31 12:29:56 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-ee43a3aa-9805-4129-ac1a-c1ea14940635 tempest-SnapshotDataIntegrityTests-113348013 None] Status of snapshot b8369f85-c94c-4c5c-9b7e-1f6060bee802 is now creating {{(pid=89182) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Jul 31 12:29:57 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-ee43a3aa-9805-4129-ac1a-c1ea14940635 tempest-SnapshotDataIntegrityTests-113348013 None] Status of snapshot b8369f85-c94c-4c5c-9b7e-1f6060bee802 is now creating {{(pid=89182) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Jul 31 12:29:58 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-ee43a3aa-9805-4129-ac1a-c1ea14940635 tempest-SnapshotDataIntegrityTests-113348013 None] Status of snapshot b8369f85-c94c-4c5c-9b7e-1f6060bee802 is now creating {{(pid=89182) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Jul 31 12:30:00 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-ee43a3aa-9805-4129-ac1a-c1ea14940635 tempest-SnapshotDataIntegrityTests-113348013 None] Status of snapshot b8369f85-c94c-4c5c-9b7e-1f6060bee802 is now creating {{(pid=89182) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Jul 31 12:30:00 devstack cinder-volume[89182]: DEBUG cinder.volume.flows.manager.create_volume [None req-12c11eae-ff70-4b80-a306-38ded2248f6a tempest-VolumesCloneTest-259757594 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89182) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 12:30:00 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-12c11eae-ff70-4b80-a306-38ded2248f6a tempest-VolumesCloneTest-259757594 None] Flow 'volume_create_manager' (506fcc72-c1e0-49f8-a515-44f722166bdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:30:00 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-12c11eae-ff70-4b80-a306-38ded2248f6a tempest-VolumesCloneTest-259757594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a40400e-61d3-445b-af44-1b3c52f78692) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:30:00 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-12c11eae-ff70-4b80-a306-38ded2248f6a tempest-VolumesCloneTest-259757594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a40400e-61d3-445b-af44-1b3c52f78692) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:30:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-610398585',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90198634-c6ee-4b01-a615-5a6a8a93e129,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f800e74e2ae64891887d8f7f0191875e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:30:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:30:00Z,use_quota=True,user_id='26fdfa74040a494cb9eb6100073483c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:30:00 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-12c11eae-ff70-4b80-a306-38ded2248f6a tempest-VolumesCloneTest-259757594 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (211aab14-571e-47df-a596-82c5da01e018) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:30:00 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-12c11eae-ff70-4b80-a306-38ded2248f6a tempest-VolumesCloneTest-259757594 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (211aab14-571e-47df-a596-82c5da01e018) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:30:00 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-12c11eae-ff70-4b80-a306-38ded2248f6a tempest-VolumesCloneTest-259757594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f47d51c2-3915-43ca-b96d-6de720016a46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:30:00 devstack cinder-volume[89182]: DEBUG cinder.image.glance [None req-12c11eae-ff70-4b80-a306-38ded2248f6a tempest-VolumesCloneTest-259757594 None] Creating Keystone auth plugin from conf {{(pid=89182) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 31 12:30:00 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-12c11eae-ff70-4b80-a306-38ded2248f6a tempest-VolumesCloneTest-259757594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f47d51c2-3915-43ca-b96d-6de720016a46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '90198634-c6ee-4b01-a615-5a6a8a93e129', 'volume_name': 'volume-90198634-c6ee-4b01-a615-5a6a8a93e129', 'volume_size': 1, 'image_id': '4cbd0fd2-77a8-43ca-bc93-b0249d6daea0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4cbd0fd2-77a8-43ca-bc93-b0249d6daea0', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3f77cb0dad9a46948c9357c65b22aef5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4cbd0fd2-77a8-43ca-bc93-b0249d6daea0', 'created_at': datetime.datetime(2026, 7, 31, 10, 8, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 31, 10, 8, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4cbd0fd2-77a8-43ca-bc93-b0249d6daea0/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:30:00 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-12c11eae-ff70-4b80-a306-38ded2248f6a tempest-VolumesCloneTest-259757594 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4af44949-3bb7-4c2b-821a-91868bc63c03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:30:00 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-12c11eae-ff70-4b80-a306-38ded2248f6a tempest-VolumesCloneTest-259757594 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4af44949-3bb7-4c2b-821a-91868bc63c03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:30:00 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-12c11eae-ff70-4b80-a306-38ded2248f6a tempest-VolumesCloneTest-259757594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9860582-6d42-48b6-8c82-461c98753980) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:30:00 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-12c11eae-ff70-4b80-a306-38ded2248f6a tempest-VolumesCloneTest-259757594 None] Volume 90198634-c6ee-4b01-a615-5a6a8a93e129: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-90198634-c6ee-4b01-a615-5a6a8a93e129', 'volume_size': 1, 'image_id': '4cbd0fd2-77a8-43ca-bc93-b0249d6daea0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4cbd0fd2-77a8-43ca-bc93-b0249d6daea0', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3f77cb0dad9a46948c9357c65b22aef5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4cbd0fd2-77a8-43ca-bc93-b0249d6daea0', 'created_at': datetime.datetime(2026, 7, 31, 10, 8, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 31, 10, 8, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4cbd0fd2-77a8-43ca-bc93-b0249d6daea0/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 31 12:30:00 devstack cinder-volume[89182]: DEBUG cinder.volume.flows.manager.create_volume [None req-12c11eae-ff70-4b80-a306-38ded2248f6a tempest-VolumesCloneTest-259757594 None] Trying to clone 90198634-c6ee-4b01-a615-5a6a8a93e129 from image 4cbd0fd2-77a8-43ca-bc93-b0249d6daea0 at location (None, [{'url': 'file:///opt/stack/data/glance/images/4cbd0fd2-77a8-43ca-bc93-b0249d6daea0', 'metadata': {}}]). {{(pid=89182) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 31 12:30:00 devstack cinder-volume[89182]: DEBUG cinder.image.image_utils [None req-12c11eae-ff70-4b80-a306-38ded2248f6a tempest-VolumesCloneTest-259757594 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_4cbd0fd2-77a8-43ca-bc93-b0249d6daea0_uq7xv3rxdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=89182) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 31 12:30:00 devstack cinder-volume[89182]: INFO cinder.image.image_utils [None req-12c11eae-ff70-4b80-a306-38ded2248f6a tempest-VolumesCloneTest-259757594 None] Image download 20.69 MB at 20.69 MB/s Jul 31 12:30:00 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[0877f5a0-2b78-4167-91d4-a470d63e6a9e]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:30:00 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-12c11eae-ff70-4b80-a306-38ded2248f6a tempest-VolumesCloneTest-259757594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4cbd0fd2-77a8-43ca-bc93-b0249d6daea0_uq7xv3rxdevstack@QuobyteHD {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:30:01 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-ee43a3aa-9805-4129-ac1a-c1ea14940635 tempest-SnapshotDataIntegrityTests-113348013 None] Status of snapshot b8369f85-c94c-4c5c-9b7e-1f6060bee802 is now creating {{(pid=89182) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Jul 31 12:30:01 devstack sudo[106192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4cbd0fd2-77a8-43ca-bc93-b0249d6daea0_uq7xv3rxdevstack@QuobyteHD Jul 31 12:30:01 devstack sudo[106192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:30:01 devstack cinder-volume[89182]: DEBUG cinder.volume.flows.manager.create_volume [None req-c260a312-f9ff-49a6-912d-66196a905dc3 tempest-VolumesTransfersV355Test-1800660154 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89182) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 12:30:01 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-c260a312-f9ff-49a6-912d-66196a905dc3 tempest-VolumesTransfersV355Test-1800660154 None] Flow 'volume_create_manager' (03a84e1b-74d8-4f8d-965f-311679a93c9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:30:01 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-c260a312-f9ff-49a6-912d-66196a905dc3 tempest-VolumesTransfersV355Test-1800660154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0429ce1-2d8d-49da-8c7c-164e0c08a5f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:30:01 devstack sudo[106192]: pam_unix(sudo:session): session closed for user root Jul 31 12:30:01 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-c260a312-f9ff-49a6-912d-66196a905dc3 tempest-VolumesTransfersV355Test-1800660154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0429ce1-2d8d-49da-8c7c-164e0c08a5f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:30:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1347571954',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7cef427-8a4b-4d38-a8bf-055e86cc4b47,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='febf5e806acc4f9095803c7a9b4164d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:30:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:30:01Z,use_quota=True,user_id='6e7de857bb414e808332b6143efb8157',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:30:01 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-c260a312-f9ff-49a6-912d-66196a905dc3 tempest-VolumesTransfersV355Test-1800660154 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a79c400-b97f-4def-98ed-88a117abdbf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:30:01 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-c260a312-f9ff-49a6-912d-66196a905dc3 tempest-VolumesTransfersV355Test-1800660154 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a79c400-b97f-4def-98ed-88a117abdbf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:30:01 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-c260a312-f9ff-49a6-912d-66196a905dc3 tempest-VolumesTransfersV355Test-1800660154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47151330-c093-4452-a4b8-a557af11b4ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:30:01 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-c260a312-f9ff-49a6-912d-66196a905dc3 tempest-VolumesTransfersV355Test-1800660154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47151330-c093-4452-a4b8-a557af11b4ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f7cef427-8a4b-4d38-a8bf-055e86cc4b47', 'volume_name': 'volume-f7cef427-8a4b-4d38-a8bf-055e86cc4b47', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:30:01 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-c260a312-f9ff-49a6-912d-66196a905dc3 tempest-VolumesTransfersV355Test-1800660154 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64b5e8e4-9c68-4e79-b73f-f48d8899237a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:30:01 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-c260a312-f9ff-49a6-912d-66196a905dc3 tempest-VolumesTransfersV355Test-1800660154 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64b5e8e4-9c68-4e79-b73f-f48d8899237a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:30:01 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-c260a312-f9ff-49a6-912d-66196a905dc3 tempest-VolumesTransfersV355Test-1800660154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (824dd589-4516-45d0-a762-ab823a536a53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:30:01 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-c260a312-f9ff-49a6-912d-66196a905dc3 tempest-VolumesTransfersV355Test-1800660154 None] Volume f7cef427-8a4b-4d38-a8bf-055e86cc4b47: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f7cef427-8a4b-4d38-a8bf-055e86cc4b47', 'volume_size': 1} Jul 31 12:30:01 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-c260a312-f9ff-49a6-912d-66196a905dc3 tempest-VolumesTransfersV355Test-1800660154 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:30:01 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-12c11eae-ff70-4b80-a306-38ded2248f6a tempest-VolumesCloneTest-259757594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4cbd0fd2-77a8-43ca-bc93-b0249d6daea0_uq7xv3rxdevstack@QuobyteHD" returned: 0 in 0.418s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:30:01 devstack cinder-volume[89182]: DEBUG cinder.image.image_utils [None req-12c11eae-ff70-4b80-a306-38ded2248f6a tempest-VolumesCloneTest-259757594 None] Temporary image 4cbd0fd2-77a8-43ca-bc93-b0249d6daea0 is fetched for user 26fdfa74040a494cb9eb6100073483c3. {{(pid=89182) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 31 12:30:01 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[f581d866-8047-47c9-993f-15adb5380a3b]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:30:01 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-12c11eae-ff70-4b80-a306-38ded2248f6a tempest-VolumesCloneTest-259757594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4cbd0fd2-77a8-43ca-bc93-b0249d6daea0_uq7xv3rxdevstack@QuobyteHD {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:30:01 devstack sudo[106197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4cbd0fd2-77a8-43ca-bc93-b0249d6daea0_uq7xv3rxdevstack@QuobyteHD Jul 31 12:30:01 devstack sudo[106197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:30:01 devstack sudo[106197]: pam_unix(sudo:session): session closed for user root Jul 31 12:30:01 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-12c11eae-ff70-4b80-a306-38ded2248f6a tempest-VolumesCloneTest-259757594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4cbd0fd2-77a8-43ca-bc93-b0249d6daea0_uq7xv3rxdevstack@QuobyteHD" returned: 0 in 0.336s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:30:01 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-12c11eae-ff70-4b80-a306-38ded2248f6a tempest-VolumesCloneTest-259757594 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:30:02 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-ee43a3aa-9805-4129-ac1a-c1ea14940635 tempest-SnapshotDataIntegrityTests-113348013 None] Status of snapshot b8369f85-c94c-4c5c-9b7e-1f6060bee802 is now creating {{(pid=89182) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Jul 31 12:30:03 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-ee43a3aa-9805-4129-ac1a-c1ea14940635 tempest-SnapshotDataIntegrityTests-113348013 None] Status of snapshot b8369f85-c94c-4c5c-9b7e-1f6060bee802 is now creating {{(pid=89182) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Jul 31 12:30:04 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-ee43a3aa-9805-4129-ac1a-c1ea14940635 tempest-SnapshotDataIntegrityTests-113348013 None] Status of snapshot b8369f85-c94c-4c5c-9b7e-1f6060bee802 is now creating {{(pid=89182) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Jul 31 12:30:05 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-ee43a3aa-9805-4129-ac1a-c1ea14940635 tempest-SnapshotDataIntegrityTests-113348013 None] Status of snapshot b8369f85-c94c-4c5c-9b7e-1f6060bee802 is now creating {{(pid=89182) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Jul 31 12:30:06 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-ee43a3aa-9805-4129-ac1a-c1ea14940635 tempest-SnapshotDataIntegrityTests-113348013 None] Status of snapshot b8369f85-c94c-4c5c-9b7e-1f6060bee802 is now creating {{(pid=89182) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Jul 31 12:30:07 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-ee43a3aa-9805-4129-ac1a-c1ea14940635 tempest-SnapshotDataIntegrityTests-113348013 None] Status of snapshot b8369f85-c94c-4c5c-9b7e-1f6060bee802 is now creating {{(pid=89182) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Jul 31 12:30:09 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-ee43a3aa-9805-4129-ac1a-c1ea14940635 tempest-SnapshotDataIntegrityTests-113348013 None] Status of snapshot b8369f85-c94c-4c5c-9b7e-1f6060bee802 is now creating {{(pid=89182) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Jul 31 12:30:11 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-ee43a3aa-9805-4129-ac1a-c1ea14940635 tempest-SnapshotDataIntegrityTests-113348013 None] Status of snapshot b8369f85-c94c-4c5c-9b7e-1f6060bee802 is now creating {{(pid=89182) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Jul 31 12:30:13 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-ee43a3aa-9805-4129-ac1a-c1ea14940635 tempest-SnapshotDataIntegrityTests-113348013 None] Status of snapshot b8369f85-c94c-4c5c-9b7e-1f6060bee802 is now creating {{(pid=89182) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Jul 31 12:30:13 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-ee43a3aa-9805-4129-ac1a-c1ea14940635 tempest-SnapshotDataIntegrityTests-113348013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-8ef75942-d7b9-4102-a4ca-651a1de7d88a.info {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:30:13 devstack sudo[106234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-8ef75942-d7b9-4102-a4ca-651a1de7d88a.info Jul 31 12:30:13 devstack sudo[106234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:30:13 devstack sudo[106234]: pam_unix(sudo:session): session closed for user root Jul 31 12:30:13 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-ee43a3aa-9805-4129-ac1a-c1ea14940635 tempest-SnapshotDataIntegrityTests-113348013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-8ef75942-d7b9-4102-a4ca-651a1de7d88a.info" returned: 0 in 0.262s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:30:13 devstack cinder-volume[89182]: WARNING cinder.volume.drivers.remotefs [None req-ee43a3aa-9805-4129-ac1a-c1ea14940635 tempest-SnapshotDataIntegrityTests-113348013 None] /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-8ef75942-d7b9-4102-a4ca-651a1de7d88a.info is being set with open permissions: ugo+rw Jul 31 12:30:13 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-ee43a3aa-9805-4129-ac1a-c1ea14940635 tempest-SnapshotDataIntegrityTests-113348013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-8ef75942-d7b9-4102-a4ca-651a1de7d88a.info {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:30:13 devstack sudo[106237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-8ef75942-d7b9-4102-a4ca-651a1de7d88a.info Jul 31 12:30:13 devstack sudo[106237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:30:13 devstack sudo[106237]: pam_unix(sudo:session): session closed for user root Jul 31 12:30:13 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-ee43a3aa-9805-4129-ac1a-c1ea14940635 tempest-SnapshotDataIntegrityTests-113348013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-8ef75942-d7b9-4102-a4ca-651a1de7d88a.info" returned: 0 in 0.248s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:30:13 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-ee43a3aa-9805-4129-ac1a-c1ea14940635 tempest-SnapshotDataIntegrityTests-113348013 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 19.860s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:30:13 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-c260a312-f9ff-49a6-912d-66196a905dc3 tempest-VolumesTransfersV355Test-1800660154 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.293s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:30:13 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-c260a312-f9ff-49a6-912d-66196a905dc3 tempest-VolumesTransfersV355Test-1800660154 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:30:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1347571954',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7cef427-8a4b-4d38-a8bf-055e86cc4b47,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='febf5e806acc4f9095803c7a9b4164d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:30:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:30:01Z,use_quota=True,user_id='6e7de857bb414e808332b6143efb8157',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)}" {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 12:30:13 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-c260a312-f9ff-49a6-912d-66196a905dc3 tempest-VolumesTransfersV355Test-1800660154 None] Creating volume f7cef427-8a4b-4d38-a8bf-055e86cc4b47 {{(pid=89182) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 12:30:13 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-c260a312-f9ff-49a6-912d-66196a905dc3 tempest-VolumesTransfersV355Test-1800660154 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:30:13 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-c260a312-f9ff-49a6-912d-66196a905dc3 tempest-VolumesTransfersV355Test-1800660154 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:30:13 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-c260a312-f9ff-49a6-912d-66196a905dc3 tempest-VolumesTransfersV355Test-1800660154 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:30:13 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-c260a312-f9ff-49a6-912d-66196a905dc3 tempest-VolumesTransfersV355Test-1800660154 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:30:13 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-c260a312-f9ff-49a6-912d-66196a905dc3 tempest-VolumesTransfersV355Test-1800660154 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:30:13 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-c260a312-f9ff-49a6-912d-66196a905dc3 tempest-VolumesTransfersV355Test-1800660154 None] Selected osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 as target Quobyte volume. {{(pid=89182) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 12:30:13 devstack cinder-volume[89182]: INFO cinder.volume.drivers.remotefs [None req-c260a312-f9ff-49a6-912d-66196a905dc3 tempest-VolumesTransfersV355Test-1800660154 None] casted to osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 Jul 31 12:30:13 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-c260a312-f9ff-49a6-912d-66196a905dc3 tempest-VolumesTransfersV355Test-1800660154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-f7cef427-8a4b-4d38-a8bf-055e86cc4b47 1073741824 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:30:13 devstack sudo[106240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-f7cef427-8a4b-4d38-a8bf-055e86cc4b47 1073741824 Jul 31 12:30:13 devstack sudo[106240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:30:13 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-ee43a3aa-9805-4129-ac1a-c1ea14940635 tempest-SnapshotDataIntegrityTests-113348013 None] Create snapshot completed successfully Jul 31 12:30:14 devstack sudo[106240]: pam_unix(sudo:session): session closed for user root Jul 31 12:30:14 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-c260a312-f9ff-49a6-912d-66196a905dc3 tempest-VolumesTransfersV355Test-1800660154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-f7cef427-8a4b-4d38-a8bf-055e86cc4b47 1073741824" returned: 0 in 0.451s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:30:14 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-c260a312-f9ff-49a6-912d-66196a905dc3 tempest-VolumesTransfersV355Test-1800660154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-f7cef427-8a4b-4d38-a8bf-055e86cc4b47 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:30:14 devstack sudo[106245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-f7cef427-8a4b-4d38-a8bf-055e86cc4b47 Jul 31 12:30:14 devstack sudo[106245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:30:14 devstack sudo[106245]: pam_unix(sudo:session): session closed for user root Jul 31 12:30:14 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-c260a312-f9ff-49a6-912d-66196a905dc3 tempest-VolumesTransfersV355Test-1800660154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-f7cef427-8a4b-4d38-a8bf-055e86cc4b47" returned: 0 in 0.259s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:30:14 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-c260a312-f9ff-49a6-912d-66196a905dc3 tempest-VolumesTransfersV355Test-1800660154 None] <== create_volume: return (748ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'} {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 12:30:14 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-c260a312-f9ff-49a6-912d-66196a905dc3 tempest-VolumesTransfersV355Test-1800660154 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.752s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:30:14 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-12c11eae-ff70-4b80-a306-38ded2248f6a tempest-VolumesCloneTest-259757594 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.653s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:30:14 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-12c11eae-ff70-4b80-a306-38ded2248f6a tempest-VolumesCloneTest-259757594 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:30:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-610398585',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90198634-c6ee-4b01-a615-5a6a8a93e129,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f800e74e2ae64891887d8f7f0191875e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:30:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:30:00Z,use_quota=True,user_id='26fdfa74040a494cb9eb6100073483c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)}" {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 12:30:14 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-12c11eae-ff70-4b80-a306-38ded2248f6a tempest-VolumesCloneTest-259757594 None] Creating volume 90198634-c6ee-4b01-a615-5a6a8a93e129 {{(pid=89182) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 12:30:14 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-12c11eae-ff70-4b80-a306-38ded2248f6a tempest-VolumesCloneTest-259757594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:30:14 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-12c11eae-ff70-4b80-a306-38ded2248f6a tempest-VolumesCloneTest-259757594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:30:14 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-12c11eae-ff70-4b80-a306-38ded2248f6a tempest-VolumesCloneTest-259757594 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:30:14 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-12c11eae-ff70-4b80-a306-38ded2248f6a tempest-VolumesCloneTest-259757594 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:30:14 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-12c11eae-ff70-4b80-a306-38ded2248f6a tempest-VolumesCloneTest-259757594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:30:14 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-12c11eae-ff70-4b80-a306-38ded2248f6a tempest-VolumesCloneTest-259757594 None] Selected osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 as target Quobyte volume. {{(pid=89182) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 12:30:14 devstack cinder-volume[89182]: INFO cinder.volume.drivers.remotefs [None req-12c11eae-ff70-4b80-a306-38ded2248f6a tempest-VolumesCloneTest-259757594 None] casted to osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 Jul 31 12:30:14 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-12c11eae-ff70-4b80-a306-38ded2248f6a tempest-VolumesCloneTest-259757594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-90198634-c6ee-4b01-a615-5a6a8a93e129 1073741824 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:30:14 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-c260a312-f9ff-49a6-912d-66196a905dc3 tempest-VolumesTransfersV355Test-1800660154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (824dd589-4516-45d0-a762-ab823a536a53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f7cef427-8a4b-4d38-a8bf-055e86cc4b47', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:30:14 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-c260a312-f9ff-49a6-912d-66196a905dc3 tempest-VolumesTransfersV355Test-1800660154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (022bfe1e-3061-415b-9633-5abab891d9ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:30:14 devstack sudo[106250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-90198634-c6ee-4b01-a615-5a6a8a93e129 1073741824 Jul 31 12:30:14 devstack sudo[106250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:30:14 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-c260a312-f9ff-49a6-912d-66196a905dc3 tempest-VolumesTransfersV355Test-1800660154 None] Volume volume-f7cef427-8a4b-4d38-a8bf-055e86cc4b47 (f7cef427-8a4b-4d38-a8bf-055e86cc4b47): created successfully Jul 31 12:30:14 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-c260a312-f9ff-49a6-912d-66196a905dc3 tempest-VolumesTransfersV355Test-1800660154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (022bfe1e-3061-415b-9633-5abab891d9ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:30:14 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-c260a312-f9ff-49a6-912d-66196a905dc3 tempest-VolumesTransfersV355Test-1800660154 None] Flow 'volume_create_manager' (03a84e1b-74d8-4f8d-965f-311679a93c9f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:30:14 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-c260a312-f9ff-49a6-912d-66196a905dc3 tempest-VolumesTransfersV355Test-1800660154 None] Created volume successfully. Jul 31 12:30:14 devstack sudo[106250]: pam_unix(sudo:session): session closed for user root Jul 31 12:30:14 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-12c11eae-ff70-4b80-a306-38ded2248f6a tempest-VolumesCloneTest-259757594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-90198634-c6ee-4b01-a615-5a6a8a93e129 1073741824" returned: 0 in 0.456s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:30:14 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-12c11eae-ff70-4b80-a306-38ded2248f6a tempest-VolumesCloneTest-259757594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-90198634-c6ee-4b01-a615-5a6a8a93e129 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:30:14 devstack sudo[106264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-90198634-c6ee-4b01-a615-5a6a8a93e129 Jul 31 12:30:14 devstack sudo[106264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:30:15 devstack sudo[106264]: pam_unix(sudo:session): session closed for user root Jul 31 12:30:15 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-12c11eae-ff70-4b80-a306-38ded2248f6a tempest-VolumesCloneTest-259757594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-90198634-c6ee-4b01-a615-5a6a8a93e129" returned: 0 in 0.310s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:30:15 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-12c11eae-ff70-4b80-a306-38ded2248f6a tempest-VolumesCloneTest-259757594 None] <== create_volume: return (807ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'} {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 12:30:15 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-12c11eae-ff70-4b80-a306-38ded2248f6a tempest-VolumesCloneTest-259757594 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.810s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:30:15 devstack cinder-volume[89182]: DEBUG cinder.volume.volume_utils [None req-12c11eae-ff70-4b80-a306-38ded2248f6a tempest-VolumesCloneTest-259757594 None] Attempting download of 4cbd0fd2-77a8-43ca-bc93-b0249d6daea0 ((None, [{'url': 'file:///opt/stack/data/glance/images/4cbd0fd2-77a8-43ca-bc93-b0249d6daea0', 'metadata': {}}])) to volume 90198634-c6ee-4b01-a615-5a6a8a93e129. {{(pid=89182) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 31 12:30:15 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee9833d1-9cb4-47ba-8038-c86ae1310e90]: (4, 'raw') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:30:15 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-12c11eae-ff70-4b80-a306-38ded2248f6a tempest-VolumesCloneTest-259757594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4cbd0fd2-77a8-43ca-bc93-b0249d6daea0_fsxsvbt2 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:30:15 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-81f32b01-dc28-4124-a965-52c38be53adc tempest-SnapshotDataIntegrityTests-113348013 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:30:15 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-81f32b01-dc28-4124-a965-52c38be53adc tempest-SnapshotDataIntegrityTests-113348013 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:30:15 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-81f32b01-dc28-4124-a965-52c38be53adc tempest-SnapshotDataIntegrityTests-113348013 None] Creating online snapshot 7f584107-b1e4-435e-bc1d-5f9b2004ba6e of volume 8ef75942-d7b9-4102-a4ca-651a1de7d88a {{(pid=89182) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 31 12:30:15 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[9671722b-7e0d-4cd5-882e-b8e029bc234f]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:30:15 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-81f32b01-dc28-4124-a965-52c38be53adc tempest-SnapshotDataIntegrityTests-113348013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-8ef75942-d7b9-4102-a4ca-651a1de7d88a.b8369f85-c94c-4c5c-9b7e-1f6060bee802 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:30:15 devstack sudo[106267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4cbd0fd2-77a8-43ca-bc93-b0249d6daea0_fsxsvbt2 Jul 31 12:30:15 devstack sudo[106267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:30:15 devstack sudo[106268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-8ef75942-d7b9-4102-a4ca-651a1de7d88a.b8369f85-c94c-4c5c-9b7e-1f6060bee802 Jul 31 12:30:15 devstack sudo[106268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:30:15 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-c27c7847-7040-4c21-b0bb-eef40b29c268 tempest-VolumesTransfersV355Test-888110869 None] Transfer volume completed successfully. Jul 31 12:30:15 devstack sudo[106267]: pam_unix(sudo:session): session closed for user root Jul 31 12:30:15 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-12c11eae-ff70-4b80-a306-38ded2248f6a tempest-VolumesCloneTest-259757594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4cbd0fd2-77a8-43ca-bc93-b0249d6daea0_fsxsvbt2" returned: 0 in 0.374s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:30:15 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-12c11eae-ff70-4b80-a306-38ded2248f6a tempest-VolumesCloneTest-259757594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4cbd0fd2-77a8-43ca-bc93-b0249d6daea0_fsxsvbt2 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:30:15 devstack sudo[106273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4cbd0fd2-77a8-43ca-bc93-b0249d6daea0_fsxsvbt2 Jul 31 12:30:15 devstack sudo[106273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:30:15 devstack sudo[106268]: pam_unix(sudo:session): session closed for user root Jul 31 12:30:15 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-81f32b01-dc28-4124-a965-52c38be53adc tempest-SnapshotDataIntegrityTests-113348013 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-8ef75942-d7b9-4102-a4ca-651a1de7d88a.b8369f85-c94c-4c5c-9b7e-1f6060bee802" returned: 0 in 0.446s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:30:15 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-81f32b01-dc28-4124-a965-52c38be53adc tempest-SnapshotDataIntegrityTests-113348013 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8ef75942-d7b9-4102-a4ca-651a1de7d88a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89182) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 12:30:15 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-81f32b01-dc28-4124-a965-52c38be53adc tempest-SnapshotDataIntegrityTests-113348013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-8ef75942-d7b9-4102-a4ca-651a1de7d88a.b8369f85-c94c-4c5c-9b7e-1f6060bee802,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-8ef75942-d7b9-4102-a4ca-651a1de7d88a.7f584107-b1e4-435e-bc1d-5f9b2004ba6e 1G {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:30:15 devstack sudo[106278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-8ef75942-d7b9-4102-a4ca-651a1de7d88a.b8369f85-c94c-4c5c-9b7e-1f6060bee802,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-8ef75942-d7b9-4102-a4ca-651a1de7d88a.7f584107-b1e4-435e-bc1d-5f9b2004ba6e 1G Jul 31 12:30:15 devstack sudo[106278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:30:16 devstack sudo[106273]: pam_unix(sudo:session): session closed for user root Jul 31 12:30:16 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-12c11eae-ff70-4b80-a306-38ded2248f6a tempest-VolumesCloneTest-259757594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4cbd0fd2-77a8-43ca-bc93-b0249d6daea0_fsxsvbt2" returned: 1 in 0.366s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:30:16 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-12c11eae-ff70-4b80-a306-38ded2248f6a tempest-VolumesCloneTest-259757594 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4cbd0fd2-77a8-43ca-bc93-b0249d6daea0_fsxsvbt2' failed. Not Retrying. {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 31 12:30:16 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[4077b3db-edf2-4566-94ca-ddbaed21d4f4]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:30:16 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-12c11eae-ff70-4b80-a306-38ded2248f6a tempest-VolumesCloneTest-259757594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4cbd0fd2-77a8-43ca-bc93-b0249d6daea0_uq7xv3rxdevstack@QuobyteHD {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:30:16 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-d60ab36b-db1d-43fe-8bc8-73d66f85fac0 tempest-VolumesTransfersV355Test-2081148321 None] Acquiring lock "cinder-f7cef427-8a4b-4d38-a8bf-055e86cc4b47-delete_volume" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:30:16 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-d60ab36b-db1d-43fe-8bc8-73d66f85fac0 tempest-VolumesTransfersV355Test-2081148321 None] Lock "cinder-f7cef427-8a4b-4d38-a8bf-055e86cc4b47-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:30:16 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-d60ab36b-db1d-43fe-8bc8-73d66f85fac0 tempest-VolumesTransfersV355Test-2081148321 None] Acquiring lock "cinder-quobyte-f7cef427-8a4b-4d38-a8bf-055e86cc4b47" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:30:16 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-d60ab36b-db1d-43fe-8bc8-73d66f85fac0 tempest-VolumesTransfersV355Test-2081148321 None] Lock "cinder-quobyte-f7cef427-8a4b-4d38-a8bf-055e86cc4b47" acquired by "delete_volume" :: waited 0.020s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:30:16 devstack sudo[106282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4cbd0fd2-77a8-43ca-bc93-b0249d6daea0_uq7xv3rxdevstack@QuobyteHD Jul 31 12:30:16 devstack sudo[106282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:30:16 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[3484f45e-8ffb-4d18-b913-fabe8c7f83a3]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:30:16 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-d60ab36b-db1d-43fe-8bc8-73d66f85fac0 tempest-VolumesTransfersV355Test-2081148321 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-f7cef427-8a4b-4d38-a8bf-055e86cc4b47 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:30:16 devstack sudo[106287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-f7cef427-8a4b-4d38-a8bf-055e86cc4b47 Jul 31 12:30:16 devstack sudo[106287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:30:16 devstack sudo[106278]: pam_unix(sudo:session): session closed for user root Jul 31 12:30:16 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-81f32b01-dc28-4124-a965-52c38be53adc tempest-SnapshotDataIntegrityTests-113348013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-8ef75942-d7b9-4102-a4ca-651a1de7d88a.b8369f85-c94c-4c5c-9b7e-1f6060bee802,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-8ef75942-d7b9-4102-a4ca-651a1de7d88a.7f584107-b1e4-435e-bc1d-5f9b2004ba6e 1G" returned: 0 in 0.485s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:30:16 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-81f32b01-dc28-4124-a965-52c38be53adc tempest-SnapshotDataIntegrityTests-113348013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8ef75942-d7b9-4102-a4ca-651a1de7d88a.b8369f85-c94c-4c5c-9b7e-1f6060bee802 -F qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-8ef75942-d7b9-4102-a4ca-651a1de7d88a.7f584107-b1e4-435e-bc1d-5f9b2004ba6e {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:30:16 devstack sudo[106290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8ef75942-d7b9-4102-a4ca-651a1de7d88a.b8369f85-c94c-4c5c-9b7e-1f6060bee802 -F qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-8ef75942-d7b9-4102-a4ca-651a1de7d88a.7f584107-b1e4-435e-bc1d-5f9b2004ba6e Jul 31 12:30:16 devstack sudo[106290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:30:16 devstack sudo[106282]: pam_unix(sudo:session): session closed for user root Jul 31 12:30:16 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-12c11eae-ff70-4b80-a306-38ded2248f6a tempest-VolumesCloneTest-259757594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4cbd0fd2-77a8-43ca-bc93-b0249d6daea0_uq7xv3rxdevstack@QuobyteHD" returned: 0 in 0.386s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:30:16 devstack cinder-volume[89182]: DEBUG cinder.image.image_utils [None req-12c11eae-ff70-4b80-a306-38ded2248f6a tempest-VolumesCloneTest-259757594 None] 4cbd0fd2-77a8-43ca-bc93-b0249d6daea0 was qcow2, converting to qcow2 {{(pid=89182) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 31 12:30:16 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-12c11eae-ff70-4b80-a306-38ded2248f6a tempest-VolumesCloneTest-259757594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4cbd0fd2-77a8-43ca-bc93-b0249d6daea0_uq7xv3rxdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-90198634-c6ee-4b01-a615-5a6a8a93e129 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:30:16 devstack sudo[106295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4cbd0fd2-77a8-43ca-bc93-b0249d6daea0_uq7xv3rxdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-90198634-c6ee-4b01-a615-5a6a8a93e129 Jul 31 12:30:16 devstack sudo[106295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:30:16 devstack sudo[106287]: pam_unix(sudo:session): session closed for user root Jul 31 12:30:16 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-d60ab36b-db1d-43fe-8bc8-73d66f85fac0 tempest-VolumesTransfersV355Test-2081148321 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-f7cef427-8a4b-4d38-a8bf-055e86cc4b47" returned: 0 in 0.410s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:30:16 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-d60ab36b-db1d-43fe-8bc8-73d66f85fac0 tempest-VolumesTransfersV355Test-2081148321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-f7cef427-8a4b-4d38-a8bf-055e86cc4b47 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:30:16 devstack sudo[106303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-f7cef427-8a4b-4d38-a8bf-055e86cc4b47 Jul 31 12:30:16 devstack sudo[106303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:30:16 devstack sudo[106290]: pam_unix(sudo:session): session closed for user root Jul 31 12:30:16 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-81f32b01-dc28-4124-a965-52c38be53adc tempest-SnapshotDataIntegrityTests-113348013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8ef75942-d7b9-4102-a4ca-651a1de7d88a.b8369f85-c94c-4c5c-9b7e-1f6060bee802 -F qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-8ef75942-d7b9-4102-a4ca-651a1de7d88a.7f584107-b1e4-435e-bc1d-5f9b2004ba6e" returned: 0 in 0.329s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:30:16 devstack cinder-volume[89182]: WARNING cinder.volume.drivers.remotefs [None req-81f32b01-dc28-4124-a965-52c38be53adc tempest-SnapshotDataIntegrityTests-113348013 None] /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-8ef75942-d7b9-4102-a4ca-651a1de7d88a.7f584107-b1e4-435e-bc1d-5f9b2004ba6e is being set with open permissions: ugo+rw Jul 31 12:30:16 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-81f32b01-dc28-4124-a965-52c38be53adc tempest-SnapshotDataIntegrityTests-113348013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-8ef75942-d7b9-4102-a4ca-651a1de7d88a.7f584107-b1e4-435e-bc1d-5f9b2004ba6e {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:30:16 devstack sudo[106309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-8ef75942-d7b9-4102-a4ca-651a1de7d88a.7f584107-b1e4-435e-bc1d-5f9b2004ba6e Jul 31 12:30:16 devstack sudo[106309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:30:16 devstack sudo[106303]: pam_unix(sudo:session): session closed for user root Jul 31 12:30:16 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-d60ab36b-db1d-43fe-8bc8-73d66f85fac0 tempest-VolumesTransfersV355Test-2081148321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-f7cef427-8a4b-4d38-a8bf-055e86cc4b47" returned: 0 in 0.299s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:30:17 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-d60ab36b-db1d-43fe-8bc8-73d66f85fac0 tempest-VolumesTransfersV355Test-2081148321 None] Lock "cinder-quobyte-f7cef427-8a4b-4d38-a8bf-055e86cc4b47" released by "delete_volume" :: held 0.757s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:30:17 devstack sudo[106309]: pam_unix(sudo:session): session closed for user root Jul 31 12:30:17 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-81f32b01-dc28-4124-a965-52c38be53adc tempest-SnapshotDataIntegrityTests-113348013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-8ef75942-d7b9-4102-a4ca-651a1de7d88a.7f584107-b1e4-435e-bc1d-5f9b2004ba6e" returned: 0 in 0.270s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:30:17 devstack cinder-volume[89182]: DEBUG cinder.compute.nova [None req-81f32b01-dc28-4124-a965-52c38be53adc tempest-SnapshotDataIntegrityTests-113348013 None] Creating Keystone auth plugin from conf {{(pid=89182) novaclient /opt/stack/cinder/cinder/compute/nova.py:99}} Jul 31 12:30:17 devstack cinder-volume[89182]: DEBUG cinder.quota [None req-d60ab36b-db1d-43fe-8bc8-73d66f85fac0 tempest-VolumesTransfersV355Test-2081148321 None] Created reservations ['88d4f160-daeb-4092-bab4-e1d69dd0472b', 'e0f9adeb-a929-4e58-882a-874a1de74a40', '0f845366-e0c7-4f4b-bb61-e39b292818fa', 'e348f9cf-6986-45e0-b09c-cee0287fb1d1'] {{(pid=89182) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 12:30:17 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-d60ab36b-db1d-43fe-8bc8-73d66f85fac0 tempest-VolumesTransfersV355Test-2081148321 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:30:17 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-d60ab36b-db1d-43fe-8bc8-73d66f85fac0 tempest-VolumesTransfersV355Test-2081148321 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:30:17 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-d60ab36b-db1d-43fe-8bc8-73d66f85fac0 tempest-VolumesTransfersV355Test-2081148321 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:30:17 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-d60ab36b-db1d-43fe-8bc8-73d66f85fac0 tempest-VolumesTransfersV355Test-2081148321 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:30:17 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-d60ab36b-db1d-43fe-8bc8-73d66f85fac0 tempest-VolumesTransfersV355Test-2081148321 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:30:17 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-d60ab36b-db1d-43fe-8bc8-73d66f85fac0 tempest-VolumesTransfersV355Test-2081148321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:30:17 devstack sudo[106315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 Jul 31 12:30:17 devstack sudo[106315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:30:17 devstack cinder-volume[89182]: DEBUG novaclient.v2.client [None req-81f32b01-dc28-4124-a965-52c38be53adc tempest-SnapshotDataIntegrityTests-113348013 None] REQ: curl -g -i -X POST http://192.168.122.21/compute/v2.1/os-assisted-volume-snapshots -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}b7a131773788e324066a73a0fa8a7dc34cba9af90be5eb733aeb3c7c921ff817" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-81f32b01-dc28-4124-a965-52c38be53adc" -H "X-Service-Token: {SHA256}02a8645ba5bc7d3f7d0a93a9d02f784466607492168e4b335483720fa1daddd6" -d '{"snapshot": {"volume_id": "8ef75942-d7b9-4102-a4ca-651a1de7d88a", "create_info": {"type": "qcow2", "new_file": "volume-8ef75942-d7b9-4102-a4ca-651a1de7d88a.7f584107-b1e4-435e-bc1d-5f9b2004ba6e", "snapshot_id": "7f584107-b1e4-435e-bc1d-5f9b2004ba6e"}}}' {{(pid=89182) _http_log_request /opt/stack/data/venv/lib/python3.12/site-packages/keystoneauth1/session.py:575}} Jul 31 12:30:17 devstack cinder-volume[89182]: DEBUG novaclient.v2.client [None req-81f32b01-dc28-4124-a965-52c38be53adc tempest-SnapshotDataIntegrityTests-113348013 None] RESP: [200] Connection: close Content-Length: 78 Content-Type: application/json Date: Fri, 31 Jul 2026 10:30:17 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.58 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-a581b83f-6ce0-4dfc-922e-b202846980ea x-openstack-request-id: req-a581b83f-6ce0-4dfc-922e-b202846980ea {{(pid=89182) _http_log_response /opt/stack/data/venv/lib/python3.12/site-packages/keystoneauth1/session.py:616}} Jul 31 12:30:17 devstack cinder-volume[89182]: DEBUG novaclient.v2.client [None req-81f32b01-dc28-4124-a965-52c38be53adc tempest-SnapshotDataIntegrityTests-113348013 None] RESP BODY: {"snapshot": {"id": null, "volumeId": "8ef75942-d7b9-4102-a4ca-651a1de7d88a"}} {{(pid=89182) _http_log_response /opt/stack/data/venv/lib/python3.12/site-packages/keystoneauth1/session.py:651}} Jul 31 12:30:17 devstack cinder-volume[89182]: DEBUG novaclient.v2.client [None req-81f32b01-dc28-4124-a965-52c38be53adc tempest-SnapshotDataIntegrityTests-113348013 None] POST call to compute for http://192.168.122.21/compute/v2.1/os-assisted-volume-snapshots used request id req-a581b83f-6ce0-4dfc-922e-b202846980ea {{(pid=89182) request /opt/stack/data/venv/lib/python3.12/site-packages/keystoneauth1/session.py:1076}} Jul 31 12:30:17 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-81f32b01-dc28-4124-a965-52c38be53adc tempest-SnapshotDataIntegrityTests-113348013 None] nova call result: None {{(pid=89182) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1910}} Jul 31 12:30:17 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-81f32b01-dc28-4124-a965-52c38be53adc tempest-SnapshotDataIntegrityTests-113348013 None] Status of snapshot 7f584107-b1e4-435e-bc1d-5f9b2004ba6e is now creating {{(pid=89182) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Jul 31 12:30:17 devstack sudo[106315]: pam_unix(sudo:session): session closed for user root Jul 31 12:30:17 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-d60ab36b-db1d-43fe-8bc8-73d66f85fac0 tempest-VolumesTransfersV355Test-2081148321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2" returned: 0 in 0.345s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:30:17 devstack cinder-volume[89182]: DEBUG cinder.manager [None req-d60ab36b-db1d-43fe-8bc8-73d66f85fac0 tempest-VolumesTransfersV355Test-2081148321 None] Notifying Schedulers of capabilities ... {{(pid=89182) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 12:30:17 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-d60ab36b-db1d-43fe-8bc8-73d66f85fac0 tempest-VolumesTransfersV355Test-2081148321 None] Deleted volume successfully. Jul 31 12:30:17 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-d60ab36b-db1d-43fe-8bc8-73d66f85fac0 tempest-VolumesTransfersV355Test-2081148321 None] Lock "cinder-f7cef427-8a4b-4d38-a8bf-055e86cc4b47-delete_volume" released by "delete_volume" :: held 1.473s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:30:17 devstack cinder-volume[89182]: DEBUG cinder.volume.flows.manager.create_volume [None req-7eab2ce8-b817-4b8e-88c3-2512ea503628 tempest-VolumesTransfersV355Test-1800660154 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89182) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 12:30:17 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-7eab2ce8-b817-4b8e-88c3-2512ea503628 tempest-VolumesTransfersV355Test-1800660154 None] Flow 'volume_create_manager' (b7257ad2-d39b-49b1-8d4e-bc16c4088fdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:30:17 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-7eab2ce8-b817-4b8e-88c3-2512ea503628 tempest-VolumesTransfersV355Test-1800660154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b65e34cd-4fe9-40bf-942e-7b3a17a28b23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:30:18 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-7eab2ce8-b817-4b8e-88c3-2512ea503628 tempest-VolumesTransfersV355Test-1800660154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b65e34cd-4fe9-40bf-942e-7b3a17a28b23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:30:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1604944689',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64a6d5f8-3cc6-4130-be3b-17d9a85f140e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='febf5e806acc4f9095803c7a9b4164d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:30:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:30:18Z,use_quota=True,user_id='6e7de857bb414e808332b6143efb8157',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:30:18 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-7eab2ce8-b817-4b8e-88c3-2512ea503628 tempest-VolumesTransfersV355Test-1800660154 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (007b9801-ecdf-4d10-9ebe-79bd7b3bf289) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:30:18 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-7eab2ce8-b817-4b8e-88c3-2512ea503628 tempest-VolumesTransfersV355Test-1800660154 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (007b9801-ecdf-4d10-9ebe-79bd7b3bf289) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:30:18 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-7eab2ce8-b817-4b8e-88c3-2512ea503628 tempest-VolumesTransfersV355Test-1800660154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82b1d780-736f-42de-ae77-0e23f6123450) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:30:18 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-7eab2ce8-b817-4b8e-88c3-2512ea503628 tempest-VolumesTransfersV355Test-1800660154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82b1d780-736f-42de-ae77-0e23f6123450) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '64a6d5f8-3cc6-4130-be3b-17d9a85f140e', 'volume_name': 'volume-64a6d5f8-3cc6-4130-be3b-17d9a85f140e', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:30:18 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-7eab2ce8-b817-4b8e-88c3-2512ea503628 tempest-VolumesTransfersV355Test-1800660154 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ecd90ec8-96e8-4f36-871d-18b95753d4a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:30:18 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-7eab2ce8-b817-4b8e-88c3-2512ea503628 tempest-VolumesTransfersV355Test-1800660154 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ecd90ec8-96e8-4f36-871d-18b95753d4a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:30:18 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-7eab2ce8-b817-4b8e-88c3-2512ea503628 tempest-VolumesTransfersV355Test-1800660154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d0bfe80-72c8-4673-a5d2-65eb11459af6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:30:18 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-7eab2ce8-b817-4b8e-88c3-2512ea503628 tempest-VolumesTransfersV355Test-1800660154 None] Volume 64a6d5f8-3cc6-4130-be3b-17d9a85f140e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-64a6d5f8-3cc6-4130-be3b-17d9a85f140e', 'volume_size': 1} Jul 31 12:30:18 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-7eab2ce8-b817-4b8e-88c3-2512ea503628 tempest-VolumesTransfersV355Test-1800660154 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:30:18 devstack sudo[106295]: pam_unix(sudo:session): session closed for user root Jul 31 12:30:18 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-12c11eae-ff70-4b80-a306-38ded2248f6a tempest-VolumesCloneTest-259757594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4cbd0fd2-77a8-43ca-bc93-b0249d6daea0_uq7xv3rxdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-90198634-c6ee-4b01-a615-5a6a8a93e129" returned: 0 in 1.877s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:30:18 devstack cinder-volume[89182]: DEBUG cinder.image.image_utils [None req-12c11eae-ff70-4b80-a306-38ded2248f6a tempest-VolumesCloneTest-259757594 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_4cbd0fd2-77a8-43ca-bc93-b0249d6daea0_uq7xv3rxdevstack@QuobyteHD, size 112.00 MB, duration 1.88 sec, destination /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-90198634-c6ee-4b01-a615-5a6a8a93e129 {{(pid=89182) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 31 12:30:18 devstack cinder-volume[89182]: INFO cinder.image.image_utils [None req-12c11eae-ff70-4b80-a306-38ded2248f6a tempest-VolumesCloneTest-259757594 None] Converted 112.00 MB image at 59.65 MB/s Jul 31 12:30:18 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-12c11eae-ff70-4b80-a306-38ded2248f6a tempest-VolumesCloneTest-259757594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-90198634-c6ee-4b01-a615-5a6a8a93e129 1G {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:30:18 devstack sudo[106323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-90198634-c6ee-4b01-a615-5a6a8a93e129 1G Jul 31 12:30:18 devstack sudo[106323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:30:18 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-81f32b01-dc28-4124-a965-52c38be53adc tempest-SnapshotDataIntegrityTests-113348013 None] Status of snapshot 7f584107-b1e4-435e-bc1d-5f9b2004ba6e is now creating {{(pid=89182) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Jul 31 12:30:18 devstack sudo[106323]: pam_unix(sudo:session): session closed for user root Jul 31 12:30:18 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-12c11eae-ff70-4b80-a306-38ded2248f6a tempest-VolumesCloneTest-259757594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-90198634-c6ee-4b01-a615-5a6a8a93e129 1G" returned: 0 in 0.324s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:30:18 devstack cinder-volume[89182]: DEBUG cinder.volume.volume_utils [None req-12c11eae-ff70-4b80-a306-38ded2248f6a tempest-VolumesCloneTest-259757594 None] Downloaded image 4cbd0fd2-77a8-43ca-bc93-b0249d6daea0 ((None, [{'url': 'file:///opt/stack/data/glance/images/4cbd0fd2-77a8-43ca-bc93-b0249d6daea0', 'metadata': {}}])) to volume 90198634-c6ee-4b01-a615-5a6a8a93e129 successfully. {{(pid=89182) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 31 12:30:18 devstack cinder-volume[89182]: DEBUG cinder.image.image_utils [None req-12c11eae-ff70-4b80-a306-38ded2248f6a tempest-VolumesCloneTest-259757594 None] Temporary image 4cbd0fd2-77a8-43ca-bc93-b0249d6daea0 for user 26fdfa74040a494cb9eb6100073483c3 is deleted. {{(pid=89182) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 31 12:30:18 devstack cinder-volume[89182]: DEBUG cinder.volume.volume_utils [None req-12c11eae-ff70-4b80-a306-38ded2248f6a tempest-VolumesCloneTest-259757594 None] Marking volume 90198634-c6ee-4b01-a615-5a6a8a93e129 as bootable. {{(pid=89182) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 31 12:30:18 devstack cinder-volume[89182]: DEBUG cinder.volume.flows.manager.create_volume [None req-12c11eae-ff70-4b80-a306-38ded2248f6a tempest-VolumesCloneTest-259757594 None] Copying metadata from image 4cbd0fd2-77a8-43ca-bc93-b0249d6daea0 to 90198634-c6ee-4b01-a615-5a6a8a93e129. {{(pid=89182) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 31 12:30:18 devstack cinder-volume[89182]: DEBUG cinder.volume.flows.manager.create_volume [None req-12c11eae-ff70-4b80-a306-38ded2248f6a tempest-VolumesCloneTest-259757594 None] Creating volume glance metadata for volume 90198634-c6ee-4b01-a615-5a6a8a93e129 backed by image 4cbd0fd2-77a8-43ca-bc93-b0249d6daea0 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '4cbd0fd2-77a8-43ca-bc93-b0249d6daea0', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=89182) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 31 12:30:18 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-12c11eae-ff70-4b80-a306-38ded2248f6a tempest-VolumesCloneTest-259757594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9860582-6d42-48b6-8c82-461c98753980) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-90198634-c6ee-4b01-a615-5a6a8a93e129', 'volume_size': 1, 'image_id': '4cbd0fd2-77a8-43ca-bc93-b0249d6daea0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4cbd0fd2-77a8-43ca-bc93-b0249d6daea0', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3f77cb0dad9a46948c9357c65b22aef5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4cbd0fd2-77a8-43ca-bc93-b0249d6daea0', 'created_at': datetime.datetime(2026, 7, 31, 10, 8, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 31, 10, 8, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4cbd0fd2-77a8-43ca-bc93-b0249d6daea0/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:30:18 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-12c11eae-ff70-4b80-a306-38ded2248f6a tempest-VolumesCloneTest-259757594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2fc320f3-39e1-4c62-9fba-8eae2eb90fe5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:30:18 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-12c11eae-ff70-4b80-a306-38ded2248f6a tempest-VolumesCloneTest-259757594 None] Volume volume-90198634-c6ee-4b01-a615-5a6a8a93e129 (90198634-c6ee-4b01-a615-5a6a8a93e129): created successfully Jul 31 12:30:18 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-12c11eae-ff70-4b80-a306-38ded2248f6a tempest-VolumesCloneTest-259757594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2fc320f3-39e1-4c62-9fba-8eae2eb90fe5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:30:18 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-12c11eae-ff70-4b80-a306-38ded2248f6a tempest-VolumesCloneTest-259757594 None] Flow 'volume_create_manager' (506fcc72-c1e0-49f8-a515-44f722166bdb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:30:18 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-12c11eae-ff70-4b80-a306-38ded2248f6a tempest-VolumesCloneTest-259757594 None] Created volume successfully. Jul 31 12:30:19 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-81f32b01-dc28-4124-a965-52c38be53adc tempest-SnapshotDataIntegrityTests-113348013 None] Status of snapshot 7f584107-b1e4-435e-bc1d-5f9b2004ba6e is now creating {{(pid=89182) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Jul 31 12:30:19 devstack cinder-volume[89182]: DEBUG cinder.volume.flows.manager.create_volume [None req-66de8b65-cbf9-4f07-8468-2913a6a79d08 tempest-VolumesCloneTest-259757594 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89182) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 12:30:19 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-66de8b65-cbf9-4f07-8468-2913a6a79d08 tempest-VolumesCloneTest-259757594 None] Flow 'volume_create_manager' (c6b2d1f3-869c-4fe2-be5b-20a402ec71c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:30:19 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-66de8b65-cbf9-4f07-8468-2913a6a79d08 tempest-VolumesCloneTest-259757594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16fd2d50-5c77-40ba-b841-fe378e8ee326) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:30:19 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-66de8b65-cbf9-4f07-8468-2913a6a79d08 tempest-VolumesCloneTest-259757594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16fd2d50-5c77-40ba-b841-fe378e8ee326) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=True,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:30:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1854534249',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99830eb2-e5a2-410b-abbc-4312e9fb272e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f800e74e2ae64891887d8f7f0191875e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:30:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=90198634-c6ee-4b01-a615-5a6a8a93e129,status='creating',terminated_at=None,updated_at=2026-07-31T10:30:20Z,use_quota=True,user_id='26fdfa74040a494cb9eb6100073483c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:30:19 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-66de8b65-cbf9-4f07-8468-2913a6a79d08 tempest-VolumesCloneTest-259757594 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2be62829-4d90-47e6-a859-12329a2ea0ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:30:19 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-66de8b65-cbf9-4f07-8468-2913a6a79d08 tempest-VolumesCloneTest-259757594 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2be62829-4d90-47e6-a859-12329a2ea0ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:30:19 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-66de8b65-cbf9-4f07-8468-2913a6a79d08 tempest-VolumesCloneTest-259757594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d45431db-a9c1-4b59-8aea-8fd8ebe077b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:30:19 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-66de8b65-cbf9-4f07-8468-2913a6a79d08 tempest-VolumesCloneTest-259757594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d45431db-a9c1-4b59-8aea-8fd8ebe077b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '99830eb2-e5a2-410b-abbc-4312e9fb272e', 'volume_name': 'volume-99830eb2-e5a2-410b-abbc-4312e9fb272e', 'volume_size': 1, 'source_volid': '90198634-c6ee-4b01-a615-5a6a8a93e129', 'source_volstatus': 'available'}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:30:19 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-66de8b65-cbf9-4f07-8468-2913a6a79d08 tempest-VolumesCloneTest-259757594 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff7db7b2-4972-4719-b281-9e1475547521) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:30:19 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-66de8b65-cbf9-4f07-8468-2913a6a79d08 tempest-VolumesCloneTest-259757594 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff7db7b2-4972-4719-b281-9e1475547521) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:30:19 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-66de8b65-cbf9-4f07-8468-2913a6a79d08 tempest-VolumesCloneTest-259757594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b731952-37ae-47c7-ac4a-a7269d701507) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:30:19 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-66de8b65-cbf9-4f07-8468-2913a6a79d08 tempest-VolumesCloneTest-259757594 None] Volume 99830eb2-e5a2-410b-abbc-4312e9fb272e: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-99830eb2-e5a2-410b-abbc-4312e9fb272e', 'volume_size': 1, 'source_volid': '90198634-c6ee-4b01-a615-5a6a8a93e129', 'source_volstatus': 'available'} Jul 31 12:30:19 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-66de8b65-cbf9-4f07-8468-2913a6a79d08 tempest-VolumesCloneTest-259757594 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:30:20 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-81f32b01-dc28-4124-a965-52c38be53adc tempest-SnapshotDataIntegrityTests-113348013 None] Status of snapshot 7f584107-b1e4-435e-bc1d-5f9b2004ba6e is now creating {{(pid=89182) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Jul 31 12:30:21 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-81f32b01-dc28-4124-a965-52c38be53adc tempest-SnapshotDataIntegrityTests-113348013 None] Status of snapshot 7f584107-b1e4-435e-bc1d-5f9b2004ba6e is now creating {{(pid=89182) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Jul 31 12:30:21 devstack cinder-volume[89182]: DEBUG oslo_service.periodic_task [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89182) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 31 12:30:21 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:30:21 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:30:21 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:30:21 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:30:21 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:30:21 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:30:22 devstack sudo[106328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 Jul 31 12:30:22 devstack sudo[106328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:30:22 devstack sudo[106328]: pam_unix(sudo:session): session closed for user root Jul 31 12:30:22 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2" returned: 0 in 0.245s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:30:22 devstack cinder-volume[89182]: DEBUG cinder.manager [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] Notifying Schedulers of capabilities ... {{(pid=89182) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 12:30:22 devstack cinder-volume[89182]: DEBUG oslo_service.periodic_task [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] Running periodic task VolumeManager._thread_info {{(pid=89182) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 31 12:30:22 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] thread count: 28 {{(pid=89182) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 31 12:30:22 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] thread info: [<_MainThread(MainThread, started 136154603720832)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=89182) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 31 12:30:22 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-81f32b01-dc28-4124-a965-52c38be53adc tempest-SnapshotDataIntegrityTests-113348013 None] Status of snapshot 7f584107-b1e4-435e-bc1d-5f9b2004ba6e is now creating {{(pid=89182) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Jul 31 12:30:23 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-81f32b01-dc28-4124-a965-52c38be53adc tempest-SnapshotDataIntegrityTests-113348013 None] Status of snapshot 7f584107-b1e4-435e-bc1d-5f9b2004ba6e is now creating {{(pid=89182) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Jul 31 12:30:24 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-81f32b01-dc28-4124-a965-52c38be53adc tempest-SnapshotDataIntegrityTests-113348013 None] Status of snapshot 7f584107-b1e4-435e-bc1d-5f9b2004ba6e is now creating {{(pid=89182) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Jul 31 12:30:25 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-81f32b01-dc28-4124-a965-52c38be53adc tempest-SnapshotDataIntegrityTests-113348013 None] Status of snapshot 7f584107-b1e4-435e-bc1d-5f9b2004ba6e is now creating {{(pid=89182) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Jul 31 12:30:26 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-81f32b01-dc28-4124-a965-52c38be53adc tempest-SnapshotDataIntegrityTests-113348013 None] Status of snapshot 7f584107-b1e4-435e-bc1d-5f9b2004ba6e is now creating {{(pid=89182) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Jul 31 12:30:27 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-81f32b01-dc28-4124-a965-52c38be53adc tempest-SnapshotDataIntegrityTests-113348013 None] Status of snapshot 7f584107-b1e4-435e-bc1d-5f9b2004ba6e is now creating {{(pid=89182) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Jul 31 12:30:28 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-81f32b01-dc28-4124-a965-52c38be53adc tempest-SnapshotDataIntegrityTests-113348013 None] Status of snapshot 7f584107-b1e4-435e-bc1d-5f9b2004ba6e is now creating {{(pid=89182) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Jul 31 12:30:30 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-81f32b01-dc28-4124-a965-52c38be53adc tempest-SnapshotDataIntegrityTests-113348013 None] Status of snapshot 7f584107-b1e4-435e-bc1d-5f9b2004ba6e is now creating {{(pid=89182) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Jul 31 12:30:32 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-81f32b01-dc28-4124-a965-52c38be53adc tempest-SnapshotDataIntegrityTests-113348013 None] Status of snapshot 7f584107-b1e4-435e-bc1d-5f9b2004ba6e is now creating {{(pid=89182) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Jul 31 12:30:34 devstack cinder-volume[89182]: DEBUG dbcounter [-] [89182] Writing DB stats cinder:SELECT=70,cinder:UPDATE=50,cinder:DELETE=5,cinder:INSERT=16 {{(pid=89182) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 12:30:34 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-81f32b01-dc28-4124-a965-52c38be53adc tempest-SnapshotDataIntegrityTests-113348013 None] Status of snapshot 7f584107-b1e4-435e-bc1d-5f9b2004ba6e is now creating {{(pid=89182) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Jul 31 12:30:34 devstack cinder-volume[89182]: DEBUG dbcounter [-] [89182] Writing DB stats cinder:SELECT=72,cinder:UPDATE=60,cinder:INSERT=19,cinder:DELETE=5 {{(pid=89182) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 12:30:34 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-81f32b01-dc28-4124-a965-52c38be53adc tempest-SnapshotDataIntegrityTests-113348013 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 19.356s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:30:34 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-7eab2ce8-b817-4b8e-88c3-2512ea503628 tempest-VolumesTransfersV355Test-1800660154 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 16.741s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:30:34 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-7eab2ce8-b817-4b8e-88c3-2512ea503628 tempest-VolumesTransfersV355Test-1800660154 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:30:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1604944689',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64a6d5f8-3cc6-4130-be3b-17d9a85f140e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='febf5e806acc4f9095803c7a9b4164d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:30:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:30:18Z,use_quota=True,user_id='6e7de857bb414e808332b6143efb8157',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)}" {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 12:30:34 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-7eab2ce8-b817-4b8e-88c3-2512ea503628 tempest-VolumesTransfersV355Test-1800660154 None] Creating volume 64a6d5f8-3cc6-4130-be3b-17d9a85f140e {{(pid=89182) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 12:30:34 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-7eab2ce8-b817-4b8e-88c3-2512ea503628 tempest-VolumesTransfersV355Test-1800660154 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:30:34 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-7eab2ce8-b817-4b8e-88c3-2512ea503628 tempest-VolumesTransfersV355Test-1800660154 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:30:34 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-7eab2ce8-b817-4b8e-88c3-2512ea503628 tempest-VolumesTransfersV355Test-1800660154 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:30:34 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-7eab2ce8-b817-4b8e-88c3-2512ea503628 tempest-VolumesTransfersV355Test-1800660154 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:30:34 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-7eab2ce8-b817-4b8e-88c3-2512ea503628 tempest-VolumesTransfersV355Test-1800660154 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:30:34 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-7eab2ce8-b817-4b8e-88c3-2512ea503628 tempest-VolumesTransfersV355Test-1800660154 None] Selected osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 as target Quobyte volume. {{(pid=89182) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 12:30:34 devstack cinder-volume[89182]: INFO cinder.volume.drivers.remotefs [None req-7eab2ce8-b817-4b8e-88c3-2512ea503628 tempest-VolumesTransfersV355Test-1800660154 None] casted to osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 Jul 31 12:30:34 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-7eab2ce8-b817-4b8e-88c3-2512ea503628 tempest-VolumesTransfersV355Test-1800660154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-64a6d5f8-3cc6-4130-be3b-17d9a85f140e 1073741824 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:30:34 devstack sudo[106333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-64a6d5f8-3cc6-4130-be3b-17d9a85f140e 1073741824 Jul 31 12:30:34 devstack sudo[106333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:30:34 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-81f32b01-dc28-4124-a965-52c38be53adc tempest-SnapshotDataIntegrityTests-113348013 None] Create snapshot completed successfully Jul 31 12:30:35 devstack sudo[106333]: pam_unix(sudo:session): session closed for user root Jul 31 12:30:35 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-7eab2ce8-b817-4b8e-88c3-2512ea503628 tempest-VolumesTransfersV355Test-1800660154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-64a6d5f8-3cc6-4130-be3b-17d9a85f140e 1073741824" returned: 0 in 0.432s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:30:35 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-7eab2ce8-b817-4b8e-88c3-2512ea503628 tempest-VolumesTransfersV355Test-1800660154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-64a6d5f8-3cc6-4130-be3b-17d9a85f140e {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:30:35 devstack sudo[106343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-64a6d5f8-3cc6-4130-be3b-17d9a85f140e Jul 31 12:30:35 devstack sudo[106343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:30:35 devstack sudo[106343]: pam_unix(sudo:session): session closed for user root Jul 31 12:30:35 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-7eab2ce8-b817-4b8e-88c3-2512ea503628 tempest-VolumesTransfersV355Test-1800660154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-64a6d5f8-3cc6-4130-be3b-17d9a85f140e" returned: 0 in 0.290s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:30:35 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-7eab2ce8-b817-4b8e-88c3-2512ea503628 tempest-VolumesTransfersV355Test-1800660154 None] <== create_volume: return (762ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'} {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 12:30:35 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-7eab2ce8-b817-4b8e-88c3-2512ea503628 tempest-VolumesTransfersV355Test-1800660154 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.765s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:30:35 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-66de8b65-cbf9-4f07-8468-2913a6a79d08 tempest-VolumesCloneTest-259757594 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 15.606s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:30:35 devstack cinder-volume[89182]: INFO cinder.volume.drivers.remotefs [None req-66de8b65-cbf9-4f07-8468-2913a6a79d08 tempest-VolumesCloneTest-259757594 None] Cloning volume 90198634-c6ee-4b01-a615-5a6a8a93e129 to volume 99830eb2-e5a2-410b-abbc-4312e9fb272e Jul 31 12:30:35 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-7eab2ce8-b817-4b8e-88c3-2512ea503628 tempest-VolumesTransfersV355Test-1800660154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d0bfe80-72c8-4673-a5d2-65eb11459af6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-64a6d5f8-3cc6-4130-be3b-17d9a85f140e', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:30:35 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-7eab2ce8-b817-4b8e-88c3-2512ea503628 tempest-VolumesTransfersV355Test-1800660154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d435d64-fa9f-46eb-88b0-8c3184437ffa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:30:35 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-66de8b65-cbf9-4f07-8468-2913a6a79d08 tempest-VolumesCloneTest-259757594 None] Creating offline snapshot a5e8aee4-5e82-409b-ab12-455655f39b49 of volume 90198634-c6ee-4b01-a615-5a6a8a93e129 {{(pid=89182) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 31 12:30:35 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-7eab2ce8-b817-4b8e-88c3-2512ea503628 tempest-VolumesTransfersV355Test-1800660154 None] Volume volume-64a6d5f8-3cc6-4130-be3b-17d9a85f140e (64a6d5f8-3cc6-4130-be3b-17d9a85f140e): created successfully Jul 31 12:30:35 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-7eab2ce8-b817-4b8e-88c3-2512ea503628 tempest-VolumesTransfersV355Test-1800660154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d435d64-fa9f-46eb-88b0-8c3184437ffa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:30:35 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-7eab2ce8-b817-4b8e-88c3-2512ea503628 tempest-VolumesTransfersV355Test-1800660154 None] Flow 'volume_create_manager' (b7257ad2-d39b-49b1-8d4e-bc16c4088fdc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:30:35 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6d0d8b8-05ce-4875-9a04-a0d13e9e5654]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:30:35 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-66de8b65-cbf9-4f07-8468-2913a6a79d08 tempest-VolumesCloneTest-259757594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-90198634-c6ee-4b01-a615-5a6a8a93e129 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:30:35 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-7eab2ce8-b817-4b8e-88c3-2512ea503628 tempest-VolumesTransfersV355Test-1800660154 None] Created volume successfully. Jul 31 12:30:35 devstack sudo[106356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-90198634-c6ee-4b01-a615-5a6a8a93e129 Jul 31 12:30:35 devstack sudo[106356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:30:36 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-a8336ac6-9698-4a80-9181-e18a1e1e6ccf tempest-SnapshotDataIntegrityTests-113348013 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:30:36 devstack sudo[106356]: pam_unix(sudo:session): session closed for user root Jul 31 12:30:36 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-66de8b65-cbf9-4f07-8468-2913a6a79d08 tempest-VolumesCloneTest-259757594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-90198634-c6ee-4b01-a615-5a6a8a93e129" returned: 0 in 0.464s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:30:36 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-66de8b65-cbf9-4f07-8468-2913a6a79d08 tempest-VolumesCloneTest-259757594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-90198634-c6ee-4b01-a615-5a6a8a93e129,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-90198634-c6ee-4b01-a615-5a6a8a93e129.a5e8aee4-5e82-409b-ab12-455655f39b49 1G {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:30:36 devstack sudo[106365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-90198634-c6ee-4b01-a615-5a6a8a93e129,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-90198634-c6ee-4b01-a615-5a6a8a93e129.a5e8aee4-5e82-409b-ab12-455655f39b49 1G Jul 31 12:30:36 devstack sudo[106365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:30:36 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-58fc7a78-a047-4135-9f01-7bbfedd3c1e7 tempest-VolumesTransfersV355Test-2081148321 None] Acquiring lock "cinder-64a6d5f8-3cc6-4130-be3b-17d9a85f140e-delete_volume" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:30:36 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-58fc7a78-a047-4135-9f01-7bbfedd3c1e7 tempest-VolumesTransfersV355Test-2081148321 None] Lock "cinder-64a6d5f8-3cc6-4130-be3b-17d9a85f140e-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:30:36 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-58fc7a78-a047-4135-9f01-7bbfedd3c1e7 tempest-VolumesTransfersV355Test-2081148321 None] Acquiring lock "cinder-quobyte-64a6d5f8-3cc6-4130-be3b-17d9a85f140e" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:30:36 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-58fc7a78-a047-4135-9f01-7bbfedd3c1e7 tempest-VolumesTransfersV355Test-2081148321 None] Lock "cinder-quobyte-64a6d5f8-3cc6-4130-be3b-17d9a85f140e" acquired by "delete_volume" :: waited 0.014s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:30:36 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ba0983f-0d23-45eb-86c8-4b79f8453b17]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:30:36 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-58fc7a78-a047-4135-9f01-7bbfedd3c1e7 tempest-VolumesTransfersV355Test-2081148321 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-64a6d5f8-3cc6-4130-be3b-17d9a85f140e {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:30:36 devstack sudo[106369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-64a6d5f8-3cc6-4130-be3b-17d9a85f140e Jul 31 12:30:36 devstack sudo[106369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:30:36 devstack sudo[106365]: pam_unix(sudo:session): session closed for user root Jul 31 12:30:36 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-66de8b65-cbf9-4f07-8468-2913a6a79d08 tempest-VolumesCloneTest-259757594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-90198634-c6ee-4b01-a615-5a6a8a93e129,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-90198634-c6ee-4b01-a615-5a6a8a93e129.a5e8aee4-5e82-409b-ab12-455655f39b49 1G" returned: 0 in 0.460s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:30:36 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-66de8b65-cbf9-4f07-8468-2913a6a79d08 tempest-VolumesCloneTest-259757594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-90198634-c6ee-4b01-a615-5a6a8a93e129 -F qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-90198634-c6ee-4b01-a615-5a6a8a93e129.a5e8aee4-5e82-409b-ab12-455655f39b49 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:30:36 devstack sudo[106373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-90198634-c6ee-4b01-a615-5a6a8a93e129 -F qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-90198634-c6ee-4b01-a615-5a6a8a93e129.a5e8aee4-5e82-409b-ab12-455655f39b49 Jul 31 12:30:36 devstack sudo[106373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:30:36 devstack sudo[106369]: pam_unix(sudo:session): session closed for user root Jul 31 12:30:36 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-58fc7a78-a047-4135-9f01-7bbfedd3c1e7 tempest-VolumesTransfersV355Test-2081148321 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-64a6d5f8-3cc6-4130-be3b-17d9a85f140e" returned: 0 in 0.396s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:30:36 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-58fc7a78-a047-4135-9f01-7bbfedd3c1e7 tempest-VolumesTransfersV355Test-2081148321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-64a6d5f8-3cc6-4130-be3b-17d9a85f140e {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:30:36 devstack sudo[106378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-64a6d5f8-3cc6-4130-be3b-17d9a85f140e Jul 31 12:30:36 devstack sudo[106378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:30:36 devstack sudo[106373]: pam_unix(sudo:session): session closed for user root Jul 31 12:30:36 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-66de8b65-cbf9-4f07-8468-2913a6a79d08 tempest-VolumesCloneTest-259757594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-90198634-c6ee-4b01-a615-5a6a8a93e129 -F qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-90198634-c6ee-4b01-a615-5a6a8a93e129.a5e8aee4-5e82-409b-ab12-455655f39b49" returned: 0 in 0.300s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:30:36 devstack cinder-volume[89182]: WARNING cinder.volume.drivers.remotefs [None req-66de8b65-cbf9-4f07-8468-2913a6a79d08 tempest-VolumesCloneTest-259757594 None] /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-90198634-c6ee-4b01-a615-5a6a8a93e129.a5e8aee4-5e82-409b-ab12-455655f39b49 is being set with open permissions: ugo+rw Jul 31 12:30:36 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-66de8b65-cbf9-4f07-8468-2913a6a79d08 tempest-VolumesCloneTest-259757594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-90198634-c6ee-4b01-a615-5a6a8a93e129.a5e8aee4-5e82-409b-ab12-455655f39b49 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:30:36 devstack sudo[106384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-90198634-c6ee-4b01-a615-5a6a8a93e129.a5e8aee4-5e82-409b-ab12-455655f39b49 Jul 31 12:30:36 devstack sudo[106384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:30:37 devstack sudo[106378]: pam_unix(sudo:session): session closed for user root Jul 31 12:30:37 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-58fc7a78-a047-4135-9f01-7bbfedd3c1e7 tempest-VolumesTransfersV355Test-2081148321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-64a6d5f8-3cc6-4130-be3b-17d9a85f140e" returned: 0 in 0.245s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:30:37 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-58fc7a78-a047-4135-9f01-7bbfedd3c1e7 tempest-VolumesTransfersV355Test-2081148321 None] Lock "cinder-quobyte-64a6d5f8-3cc6-4130-be3b-17d9a85f140e" released by "delete_volume" :: held 0.684s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:30:37 devstack cinder-volume[89182]: DEBUG cinder.quota [None req-58fc7a78-a047-4135-9f01-7bbfedd3c1e7 tempest-VolumesTransfersV355Test-2081148321 None] Created reservations ['0367b6f5-6e52-47a4-b6e3-b83116344c76', 'a00a1f62-c49e-4b35-a24c-eab80b2520d6', 'e3c035cc-d0a1-4bfb-bde0-626a61ecbd7d', '8cdf0909-9b1b-4d55-a970-af1e8dfb290e'] {{(pid=89182) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 12:30:37 devstack sudo[106384]: pam_unix(sudo:session): session closed for user root Jul 31 12:30:37 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-66de8b65-cbf9-4f07-8468-2913a6a79d08 tempest-VolumesCloneTest-259757594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-90198634-c6ee-4b01-a615-5a6a8a93e129.a5e8aee4-5e82-409b-ab12-455655f39b49" returned: 0 in 0.257s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:30:37 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-58fc7a78-a047-4135-9f01-7bbfedd3c1e7 tempest-VolumesTransfersV355Test-2081148321 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:30:37 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-58fc7a78-a047-4135-9f01-7bbfedd3c1e7 tempest-VolumesTransfersV355Test-2081148321 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:30:37 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-58fc7a78-a047-4135-9f01-7bbfedd3c1e7 tempest-VolumesTransfersV355Test-2081148321 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:30:37 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-58fc7a78-a047-4135-9f01-7bbfedd3c1e7 tempest-VolumesTransfersV355Test-2081148321 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:30:37 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-58fc7a78-a047-4135-9f01-7bbfedd3c1e7 tempest-VolumesTransfersV355Test-2081148321 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:30:37 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-58fc7a78-a047-4135-9f01-7bbfedd3c1e7 tempest-VolumesTransfersV355Test-2081148321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:30:37 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-66de8b65-cbf9-4f07-8468-2913a6a79d08 tempest-VolumesCloneTest-259757594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-90198634-c6ee-4b01-a615-5a6a8a93e129.info {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:30:37 devstack sudo[106388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 Jul 31 12:30:37 devstack sudo[106388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:30:37 devstack sudo[106389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-90198634-c6ee-4b01-a615-5a6a8a93e129.info Jul 31 12:30:37 devstack sudo[106389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:30:37 devstack sudo[106388]: pam_unix(sudo:session): session closed for user root Jul 31 12:30:37 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-58fc7a78-a047-4135-9f01-7bbfedd3c1e7 tempest-VolumesTransfersV355Test-2081148321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2" returned: 0 in 0.258s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:30:37 devstack cinder-volume[89182]: DEBUG cinder.manager [None req-58fc7a78-a047-4135-9f01-7bbfedd3c1e7 tempest-VolumesTransfersV355Test-2081148321 None] Notifying Schedulers of capabilities ... {{(pid=89182) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 12:30:37 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-58fc7a78-a047-4135-9f01-7bbfedd3c1e7 tempest-VolumesTransfersV355Test-2081148321 None] Deleted volume successfully. Jul 31 12:30:37 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-58fc7a78-a047-4135-9f01-7bbfedd3c1e7 tempest-VolumesTransfersV355Test-2081148321 None] Lock "cinder-64a6d5f8-3cc6-4130-be3b-17d9a85f140e-delete_volume" released by "delete_volume" :: held 1.167s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:30:37 devstack sudo[106389]: pam_unix(sudo:session): session closed for user root Jul 31 12:30:37 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-66de8b65-cbf9-4f07-8468-2913a6a79d08 tempest-VolumesCloneTest-259757594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-90198634-c6ee-4b01-a615-5a6a8a93e129.info" returned: 0 in 0.283s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:30:37 devstack cinder-volume[89182]: WARNING cinder.volume.drivers.remotefs [None req-66de8b65-cbf9-4f07-8468-2913a6a79d08 tempest-VolumesCloneTest-259757594 None] /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-90198634-c6ee-4b01-a615-5a6a8a93e129.info is being set with open permissions: ugo+rw Jul 31 12:30:37 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-66de8b65-cbf9-4f07-8468-2913a6a79d08 tempest-VolumesCloneTest-259757594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-90198634-c6ee-4b01-a615-5a6a8a93e129.info {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:30:37 devstack sudo[106394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-90198634-c6ee-4b01-a615-5a6a8a93e129.info Jul 31 12:30:37 devstack sudo[106394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:30:37 devstack sudo[106394]: pam_unix(sudo:session): session closed for user root Jul 31 12:30:37 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-66de8b65-cbf9-4f07-8468-2913a6a79d08 tempest-VolumesCloneTest-259757594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-90198634-c6ee-4b01-a615-5a6a8a93e129.info" returned: 0 in 0.260s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:30:37 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-66de8b65-cbf9-4f07-8468-2913a6a79d08 tempest-VolumesCloneTest-259757594 None] Acquiring lock "cinder-quobyte-99830eb2-e5a2-410b-abbc-4312e9fb272e" by "_copy_volume_from_snapshot" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:30:37 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-66de8b65-cbf9-4f07-8468-2913a6a79d08 tempest-VolumesCloneTest-259757594 None] Lock "cinder-quobyte-99830eb2-e5a2-410b-abbc-4312e9fb272e" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:30:37 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-66de8b65-cbf9-4f07-8468-2913a6a79d08 tempest-VolumesCloneTest-259757594 None] snapshot: a5e8aee4-5e82-409b-ab12-455655f39b49, volume: 99830eb2-e5a2-410b-abbc-4312e9fb272e, {{(pid=89182) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Jul 31 12:30:37 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-66de8b65-cbf9-4f07-8468-2913a6a79d08 tempest-VolumesCloneTest-259757594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:30:37 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-66de8b65-cbf9-4f07-8468-2913a6a79d08 tempest-VolumesCloneTest-259757594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:30:37 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-66de8b65-cbf9-4f07-8468-2913a6a79d08 tempest-VolumesCloneTest-259757594 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:30:37 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-66de8b65-cbf9-4f07-8468-2913a6a79d08 tempest-VolumesCloneTest-259757594 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:30:37 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-66de8b65-cbf9-4f07-8468-2913a6a79d08 tempest-VolumesCloneTest-259757594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:30:37 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2102b17-e60a-47d9-8553-175f397f0c9c]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:30:37 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-66de8b65-cbf9-4f07-8468-2913a6a79d08 tempest-VolumesCloneTest-259757594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-90198634-c6ee-4b01-a615-5a6a8a93e129.a5e8aee4-5e82-409b-ab12-455655f39b49 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:30:37 devstack sudo[106397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-90198634-c6ee-4b01-a615-5a6a8a93e129.a5e8aee4-5e82-409b-ab12-455655f39b49 Jul 31 12:30:37 devstack sudo[106397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:30:38 devstack sudo[106397]: pam_unix(sudo:session): session closed for user root Jul 31 12:30:38 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-66de8b65-cbf9-4f07-8468-2913a6a79d08 tempest-VolumesCloneTest-259757594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-90198634-c6ee-4b01-a615-5a6a8a93e129.a5e8aee4-5e82-409b-ab12-455655f39b49" returned: 0 in 0.378s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:30:38 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-66de8b65-cbf9-4f07-8468-2913a6a79d08 tempest-VolumesCloneTest-259757594 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-90198634-c6ee-4b01-a615-5a6a8a93e129(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89182) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 12:30:38 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3d62c9b-43a4-44bf-ae77-3f9dabfa5a38]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:30:38 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-66de8b65-cbf9-4f07-8468-2913a6a79d08 tempest-VolumesCloneTest-259757594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-90198634-c6ee-4b01-a615-5a6a8a93e129 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:30:38 devstack sudo[106402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-90198634-c6ee-4b01-a615-5a6a8a93e129 Jul 31 12:30:38 devstack sudo[106402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:30:38 devstack sudo[106402]: pam_unix(sudo:session): session closed for user root Jul 31 12:30:38 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-66de8b65-cbf9-4f07-8468-2913a6a79d08 tempest-VolumesCloneTest-259757594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-90198634-c6ee-4b01-a615-5a6a8a93e129" returned: 0 in 0.365s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:30:38 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-66de8b65-cbf9-4f07-8468-2913a6a79d08 tempest-VolumesCloneTest-259757594 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-90198634-c6ee-4b01-a615-5a6a8a93e129 {{(pid=89182) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Jul 31 12:30:38 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-66de8b65-cbf9-4f07-8468-2913a6a79d08 tempest-VolumesCloneTest-259757594 None] Creating direct copy from snapshot {{(pid=89182) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Jul 31 12:30:38 devstack cinder-volume[89182]: DEBUG cinder.utils [None req-66de8b65-cbf9-4f07-8468-2913a6a79d08 tempest-VolumesCloneTest-259757594 None] Path /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-99830eb2-e5a2-410b-abbc-4312e9fb272e not found in is_blk_device check {{(pid=89182) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 31 12:30:38 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-66de8b65-cbf9-4f07-8468-2913a6a79d08 tempest-VolumesCloneTest-259757594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-90198634-c6ee-4b01-a615-5a6a8a93e129 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-99830eb2-e5a2-410b-abbc-4312e9fb272e {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:30:38 devstack sudo[106407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-90198634-c6ee-4b01-a615-5a6a8a93e129 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-99830eb2-e5a2-410b-abbc-4312e9fb272e Jul 31 12:30:38 devstack sudo[106407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:30:39 devstack sudo[106407]: pam_unix(sudo:session): session closed for user root Jul 31 12:30:39 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-66de8b65-cbf9-4f07-8468-2913a6a79d08 tempest-VolumesCloneTest-259757594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-90198634-c6ee-4b01-a615-5a6a8a93e129 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-99830eb2-e5a2-410b-abbc-4312e9fb272e" returned: 0 in 1.266s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:30:39 devstack cinder-volume[89182]: DEBUG cinder.image.image_utils [None req-66de8b65-cbf9-4f07-8468-2913a6a79d08 tempest-VolumesCloneTest-259757594 None] Image conversion details: src /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-90198634-c6ee-4b01-a615-5a6a8a93e129, size 1024.00 MB, duration 1.27 sec, destination /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-99830eb2-e5a2-410b-abbc-4312e9fb272e {{(pid=89182) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 31 12:30:39 devstack cinder-volume[89182]: INFO cinder.image.image_utils [None req-66de8b65-cbf9-4f07-8468-2913a6a79d08 tempest-VolumesCloneTest-259757594 None] Converted 1024.00 MB image at 807.84 MB/s Jul 31 12:30:39 devstack cinder-volume[89182]: WARNING cinder.volume.drivers.remotefs [None req-66de8b65-cbf9-4f07-8468-2913a6a79d08 tempest-VolumesCloneTest-259757594 None] /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-99830eb2-e5a2-410b-abbc-4312e9fb272e is being set with open permissions: ugo+rw Jul 31 12:30:39 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-66de8b65-cbf9-4f07-8468-2913a6a79d08 tempest-VolumesCloneTest-259757594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-99830eb2-e5a2-410b-abbc-4312e9fb272e {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:30:39 devstack sudo[106416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-99830eb2-e5a2-410b-abbc-4312e9fb272e Jul 31 12:30:39 devstack sudo[106416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:30:40 devstack sudo[106416]: pam_unix(sudo:session): session closed for user root Jul 31 12:30:40 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-66de8b65-cbf9-4f07-8468-2913a6a79d08 tempest-VolumesCloneTest-259757594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-99830eb2-e5a2-410b-abbc-4312e9fb272e" returned: 0 in 0.254s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:30:40 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-66de8b65-cbf9-4f07-8468-2913a6a79d08 tempest-VolumesCloneTest-259757594 None] Lock "cinder-quobyte-99830eb2-e5a2-410b-abbc-4312e9fb272e" released by "_copy_volume_from_snapshot" :: held 2.329s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:30:40 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-66de8b65-cbf9-4f07-8468-2913a6a79d08 tempest-VolumesCloneTest-259757594 None] Acquiring lock "cinder-quobyte-a5e8aee4-5e82-409b-ab12-455655f39b49" by "_delete_snapshot" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:30:40 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-66de8b65-cbf9-4f07-8468-2913a6a79d08 tempest-VolumesCloneTest-259757594 None] Lock "cinder-quobyte-a5e8aee4-5e82-409b-ab12-455655f39b49" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:30:40 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-66de8b65-cbf9-4f07-8468-2913a6a79d08 tempest-VolumesCloneTest-259757594 None] Deleting offline snapshot a5e8aee4-5e82-409b-ab12-455655f39b49 of volume 90198634-c6ee-4b01-a615-5a6a8a93e129 {{(pid=89182) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 31 12:30:40 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-66de8b65-cbf9-4f07-8468-2913a6a79d08 tempest-VolumesCloneTest-259757594 None] snapshot_file for this snap is: volume-90198634-c6ee-4b01-a615-5a6a8a93e129.a5e8aee4-5e82-409b-ab12-455655f39b49 {{(pid=89182) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 31 12:30:40 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b378e31-f7c5-4deb-9997-e5b2c0c6b2f0]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:30:40 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-66de8b65-cbf9-4f07-8468-2913a6a79d08 tempest-VolumesCloneTest-259757594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-90198634-c6ee-4b01-a615-5a6a8a93e129.a5e8aee4-5e82-409b-ab12-455655f39b49 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:30:40 devstack sudo[106422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-90198634-c6ee-4b01-a615-5a6a8a93e129.a5e8aee4-5e82-409b-ab12-455655f39b49 Jul 31 12:30:40 devstack sudo[106422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:30:40 devstack sudo[106422]: pam_unix(sudo:session): session closed for user root Jul 31 12:30:40 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-66de8b65-cbf9-4f07-8468-2913a6a79d08 tempest-VolumesCloneTest-259757594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-90198634-c6ee-4b01-a615-5a6a8a93e129.a5e8aee4-5e82-409b-ab12-455655f39b49" returned: 0 in 0.441s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:30:40 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-66de8b65-cbf9-4f07-8468-2913a6a79d08 tempest-VolumesCloneTest-259757594 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-90198634-c6ee-4b01-a615-5a6a8a93e129(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89182) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 12:30:40 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2a81fda-264e-4357-a856-fde49f7b87d9]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:30:40 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-66de8b65-cbf9-4f07-8468-2913a6a79d08 tempest-VolumesCloneTest-259757594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-90198634-c6ee-4b01-a615-5a6a8a93e129 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:30:40 devstack sudo[106460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-90198634-c6ee-4b01-a615-5a6a8a93e129 Jul 31 12:30:40 devstack sudo[106460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:30:40 devstack sudo[106460]: pam_unix(sudo:session): session closed for user root Jul 31 12:30:40 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-66de8b65-cbf9-4f07-8468-2913a6a79d08 tempest-VolumesCloneTest-259757594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-90198634-c6ee-4b01-a615-5a6a8a93e129" returned: 0 in 0.377s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:30:40 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-66de8b65-cbf9-4f07-8468-2913a6a79d08 tempest-VolumesCloneTest-259757594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-90198634-c6ee-4b01-a615-5a6a8a93e129.a5e8aee4-5e82-409b-ab12-455655f39b49 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:30:41 devstack sudo[106465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-90198634-c6ee-4b01-a615-5a6a8a93e129.a5e8aee4-5e82-409b-ab12-455655f39b49 Jul 31 12:30:41 devstack sudo[106465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:30:41 devstack sudo[106465]: pam_unix(sudo:session): session closed for user root Jul 31 12:30:41 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-66de8b65-cbf9-4f07-8468-2913a6a79d08 tempest-VolumesCloneTest-259757594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-90198634-c6ee-4b01-a615-5a6a8a93e129.a5e8aee4-5e82-409b-ab12-455655f39b49" returned: 0 in 0.368s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:30:41 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-66de8b65-cbf9-4f07-8468-2913a6a79d08 tempest-VolumesCloneTest-259757594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-90198634-c6ee-4b01-a615-5a6a8a93e129.a5e8aee4-5e82-409b-ab12-455655f39b49 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:30:41 devstack sudo[106471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-90198634-c6ee-4b01-a615-5a6a8a93e129.a5e8aee4-5e82-409b-ab12-455655f39b49 Jul 31 12:30:41 devstack sudo[106471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:30:41 devstack sudo[106471]: pam_unix(sudo:session): session closed for user root Jul 31 12:30:41 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-66de8b65-cbf9-4f07-8468-2913a6a79d08 tempest-VolumesCloneTest-259757594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-90198634-c6ee-4b01-a615-5a6a8a93e129.a5e8aee4-5e82-409b-ab12-455655f39b49" returned: 0 in 0.253s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:30:41 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-66de8b65-cbf9-4f07-8468-2913a6a79d08 tempest-VolumesCloneTest-259757594 None] Lock "cinder-quobyte-a5e8aee4-5e82-409b-ab12-455655f39b49" released by "_delete_snapshot" :: held 1.540s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:30:41 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-66de8b65-cbf9-4f07-8468-2913a6a79d08 tempest-VolumesCloneTest-259757594 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 6.132s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:30:41 devstack cinder-volume[89182]: DEBUG cinder.volume.volume_utils [None req-66de8b65-cbf9-4f07-8468-2913a6a79d08 tempest-VolumesCloneTest-259757594 None] Marking volume 99830eb2-e5a2-410b-abbc-4312e9fb272e as bootable. {{(pid=89182) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 31 12:30:41 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-a8336ac6-9698-4a80-9181-e18a1e1e6ccf tempest-SnapshotDataIntegrityTests-113348013 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.646s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:30:41 devstack cinder-volume[89182]: DEBUG cinder.volume.flows.manager.create_volume [None req-66de8b65-cbf9-4f07-8468-2913a6a79d08 tempest-VolumesCloneTest-259757594 None] Copying metadata from source volume 90198634-c6ee-4b01-a615-5a6a8a93e129 to 99830eb2-e5a2-410b-abbc-4312e9fb272e. {{(pid=89182) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:438}} Jul 31 12:30:41 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-a8336ac6-9698-4a80-9181-e18a1e1e6ccf tempest-SnapshotDataIntegrityTests-113348013 None] Creating online snapshot 449abdff-86c6-4340-aa7c-dc571b705c1b of volume 8ef75942-d7b9-4102-a4ca-651a1de7d88a {{(pid=89182) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 31 12:30:41 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ac8de19-c750-43c9-bda8-9cb70a5cd857]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:30:41 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-a8336ac6-9698-4a80-9181-e18a1e1e6ccf tempest-SnapshotDataIntegrityTests-113348013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-8ef75942-d7b9-4102-a4ca-651a1de7d88a.7f584107-b1e4-435e-bc1d-5f9b2004ba6e {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:30:41 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-66de8b65-cbf9-4f07-8468-2913a6a79d08 tempest-VolumesCloneTest-259757594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b731952-37ae-47c7-ac4a-a7269d701507) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-99830eb2-e5a2-410b-abbc-4312e9fb272e', 'volume_size': 1, 'source_volid': '90198634-c6ee-4b01-a615-5a6a8a93e129', 'source_volstatus': 'available'}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:30:41 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-66de8b65-cbf9-4f07-8468-2913a6a79d08 tempest-VolumesCloneTest-259757594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8cde50fe-97f5-41f2-bb8f-d6a3ce326ad2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:30:41 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-66de8b65-cbf9-4f07-8468-2913a6a79d08 tempest-VolumesCloneTest-259757594 None] Volume volume-99830eb2-e5a2-410b-abbc-4312e9fb272e (99830eb2-e5a2-410b-abbc-4312e9fb272e): created successfully Jul 31 12:30:41 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-66de8b65-cbf9-4f07-8468-2913a6a79d08 tempest-VolumesCloneTest-259757594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8cde50fe-97f5-41f2-bb8f-d6a3ce326ad2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:30:41 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-66de8b65-cbf9-4f07-8468-2913a6a79d08 tempest-VolumesCloneTest-259757594 None] Flow 'volume_create_manager' (c6b2d1f3-869c-4fe2-be5b-20a402ec71c3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:30:41 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-66de8b65-cbf9-4f07-8468-2913a6a79d08 tempest-VolumesCloneTest-259757594 None] Created volume successfully. Jul 31 12:30:41 devstack sudo[106474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-8ef75942-d7b9-4102-a4ca-651a1de7d88a.7f584107-b1e4-435e-bc1d-5f9b2004ba6e Jul 31 12:30:41 devstack sudo[106474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:30:42 devstack sudo[106474]: pam_unix(sudo:session): session closed for user root Jul 31 12:30:42 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-a8336ac6-9698-4a80-9181-e18a1e1e6ccf tempest-SnapshotDataIntegrityTests-113348013 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-8ef75942-d7b9-4102-a4ca-651a1de7d88a.7f584107-b1e4-435e-bc1d-5f9b2004ba6e" returned: 0 in 0.372s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:30:42 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-a8336ac6-9698-4a80-9181-e18a1e1e6ccf tempest-SnapshotDataIntegrityTests-113348013 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8ef75942-d7b9-4102-a4ca-651a1de7d88a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89182) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 12:30:42 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-a8336ac6-9698-4a80-9181-e18a1e1e6ccf tempest-SnapshotDataIntegrityTests-113348013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-8ef75942-d7b9-4102-a4ca-651a1de7d88a.7f584107-b1e4-435e-bc1d-5f9b2004ba6e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-8ef75942-d7b9-4102-a4ca-651a1de7d88a.449abdff-86c6-4340-aa7c-dc571b705c1b 1G {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:30:42 devstack sudo[106479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-8ef75942-d7b9-4102-a4ca-651a1de7d88a.7f584107-b1e4-435e-bc1d-5f9b2004ba6e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-8ef75942-d7b9-4102-a4ca-651a1de7d88a.449abdff-86c6-4340-aa7c-dc571b705c1b 1G Jul 31 12:30:42 devstack sudo[106479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:30:42 devstack sudo[106479]: pam_unix(sudo:session): session closed for user root Jul 31 12:30:42 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-a8336ac6-9698-4a80-9181-e18a1e1e6ccf tempest-SnapshotDataIntegrityTests-113348013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-8ef75942-d7b9-4102-a4ca-651a1de7d88a.7f584107-b1e4-435e-bc1d-5f9b2004ba6e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-8ef75942-d7b9-4102-a4ca-651a1de7d88a.449abdff-86c6-4340-aa7c-dc571b705c1b 1G" returned: 0 in 0.514s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:30:42 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-a8336ac6-9698-4a80-9181-e18a1e1e6ccf tempest-SnapshotDataIntegrityTests-113348013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8ef75942-d7b9-4102-a4ca-651a1de7d88a.7f584107-b1e4-435e-bc1d-5f9b2004ba6e -F qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-8ef75942-d7b9-4102-a4ca-651a1de7d88a.449abdff-86c6-4340-aa7c-dc571b705c1b {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:30:42 devstack sudo[106485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8ef75942-d7b9-4102-a4ca-651a1de7d88a.7f584107-b1e4-435e-bc1d-5f9b2004ba6e -F qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-8ef75942-d7b9-4102-a4ca-651a1de7d88a.449abdff-86c6-4340-aa7c-dc571b705c1b Jul 31 12:30:42 devstack sudo[106485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:30:42 devstack sudo[106485]: pam_unix(sudo:session): session closed for user root Jul 31 12:30:42 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-a8336ac6-9698-4a80-9181-e18a1e1e6ccf tempest-SnapshotDataIntegrityTests-113348013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8ef75942-d7b9-4102-a4ca-651a1de7d88a.7f584107-b1e4-435e-bc1d-5f9b2004ba6e -F qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-8ef75942-d7b9-4102-a4ca-651a1de7d88a.449abdff-86c6-4340-aa7c-dc571b705c1b" returned: 0 in 0.314s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:30:42 devstack cinder-volume[89182]: WARNING cinder.volume.drivers.remotefs [None req-a8336ac6-9698-4a80-9181-e18a1e1e6ccf tempest-SnapshotDataIntegrityTests-113348013 None] /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-8ef75942-d7b9-4102-a4ca-651a1de7d88a.449abdff-86c6-4340-aa7c-dc571b705c1b is being set with open permissions: ugo+rw Jul 31 12:30:42 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-a8336ac6-9698-4a80-9181-e18a1e1e6ccf tempest-SnapshotDataIntegrityTests-113348013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-8ef75942-d7b9-4102-a4ca-651a1de7d88a.449abdff-86c6-4340-aa7c-dc571b705c1b {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:30:43 devstack sudo[106490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-8ef75942-d7b9-4102-a4ca-651a1de7d88a.449abdff-86c6-4340-aa7c-dc571b705c1b Jul 31 12:30:43 devstack sudo[106490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:30:43 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-9deff429-3f6f-4329-ab2e-d88957c35ecc tempest-VolumesCloneTest-259757594 None] Acquiring lock "cinder-99830eb2-e5a2-410b-abbc-4312e9fb272e-delete_volume" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:30:43 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-9deff429-3f6f-4329-ab2e-d88957c35ecc tempest-VolumesCloneTest-259757594 None] Lock "cinder-99830eb2-e5a2-410b-abbc-4312e9fb272e-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:30:43 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-9deff429-3f6f-4329-ab2e-d88957c35ecc tempest-VolumesCloneTest-259757594 None] Acquiring lock "cinder-quobyte-99830eb2-e5a2-410b-abbc-4312e9fb272e" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:30:43 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-9deff429-3f6f-4329-ab2e-d88957c35ecc tempest-VolumesCloneTest-259757594 None] Lock "cinder-quobyte-99830eb2-e5a2-410b-abbc-4312e9fb272e" acquired by "delete_volume" :: waited 0.021s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:30:43 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[d871f31f-c5b2-4038-ad78-272cac9b510e]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:30:43 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-9deff429-3f6f-4329-ab2e-d88957c35ecc tempest-VolumesCloneTest-259757594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-99830eb2-e5a2-410b-abbc-4312e9fb272e {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:30:43 devstack sudo[106490]: pam_unix(sudo:session): session closed for user root Jul 31 12:30:43 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-a8336ac6-9698-4a80-9181-e18a1e1e6ccf tempest-SnapshotDataIntegrityTests-113348013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-8ef75942-d7b9-4102-a4ca-651a1de7d88a.449abdff-86c6-4340-aa7c-dc571b705c1b" returned: 0 in 0.297s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:30:43 devstack cinder-volume[89182]: DEBUG cinder.compute.nova [None req-a8336ac6-9698-4a80-9181-e18a1e1e6ccf tempest-SnapshotDataIntegrityTests-113348013 None] Creating Keystone auth plugin from conf {{(pid=89182) novaclient /opt/stack/cinder/cinder/compute/nova.py:99}} Jul 31 12:30:43 devstack sudo[106492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-99830eb2-e5a2-410b-abbc-4312e9fb272e Jul 31 12:30:43 devstack sudo[106492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:30:43 devstack cinder-volume[89182]: DEBUG novaclient.v2.client [None req-a8336ac6-9698-4a80-9181-e18a1e1e6ccf tempest-SnapshotDataIntegrityTests-113348013 None] REQ: curl -g -i -X POST http://192.168.122.21/compute/v2.1/os-assisted-volume-snapshots -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}8db796721a4dd8106e260bfd7df16c10fac5a5236b1726c18fce797a9da5486b" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-a8336ac6-9698-4a80-9181-e18a1e1e6ccf" -H "X-Service-Token: {SHA256}02a8645ba5bc7d3f7d0a93a9d02f784466607492168e4b335483720fa1daddd6" -d '{"snapshot": {"volume_id": "8ef75942-d7b9-4102-a4ca-651a1de7d88a", "create_info": {"type": "qcow2", "new_file": "volume-8ef75942-d7b9-4102-a4ca-651a1de7d88a.449abdff-86c6-4340-aa7c-dc571b705c1b", "snapshot_id": "449abdff-86c6-4340-aa7c-dc571b705c1b"}}}' {{(pid=89182) _http_log_request /opt/stack/data/venv/lib/python3.12/site-packages/keystoneauth1/session.py:575}} Jul 31 12:30:43 devstack cinder-volume[89182]: DEBUG cinder.volume.flows.manager.create_volume [None req-c6886ed8-c591-4058-9515-113097630912 tempest-VolumesExtendTest-1157568027 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89182) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 12:30:43 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-c6886ed8-c591-4058-9515-113097630912 tempest-VolumesExtendTest-1157568027 None] Flow 'volume_create_manager' (309d6bb5-1c29-4a8c-a42d-583a83dcf15b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:30:43 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-c6886ed8-c591-4058-9515-113097630912 tempest-VolumesExtendTest-1157568027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3876cd7f-671d-4075-bf5e-13f1486cecab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:30:43 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-c6886ed8-c591-4058-9515-113097630912 tempest-VolumesExtendTest-1157568027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3876cd7f-671d-4075-bf5e-13f1486cecab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:30:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-837526146',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98c78d9a-133c-442a-a8f6-472946b0d0ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0dd736d01df468bb04ac8c0ee27a4ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:30:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:30:43Z,use_quota=True,user_id='b6e5fb63ba30434eb41a770ba1c207ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:30:43 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-c6886ed8-c591-4058-9515-113097630912 tempest-VolumesExtendTest-1157568027 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c65fd84-e92b-460c-935c-050c45de097b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:30:43 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-c6886ed8-c591-4058-9515-113097630912 tempest-VolumesExtendTest-1157568027 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c65fd84-e92b-460c-935c-050c45de097b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:30:43 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-c6886ed8-c591-4058-9515-113097630912 tempest-VolumesExtendTest-1157568027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dab21d68-660f-462f-9e13-3496ec4782f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:30:43 devstack cinder-volume[89182]: DEBUG cinder.image.glance [None req-c6886ed8-c591-4058-9515-113097630912 tempest-VolumesExtendTest-1157568027 None] Creating Keystone auth plugin from conf {{(pid=89182) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 31 12:30:43 devstack cinder-volume[89182]: DEBUG novaclient.v2.client [None req-a8336ac6-9698-4a80-9181-e18a1e1e6ccf tempest-SnapshotDataIntegrityTests-113348013 None] RESP: [200] Connection: close Content-Length: 78 Content-Type: application/json Date: Fri, 31 Jul 2026 10:30:43 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.58 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-f3437bb9-ad5a-438b-996a-f09a3e96c875 x-openstack-request-id: req-f3437bb9-ad5a-438b-996a-f09a3e96c875 {{(pid=89182) _http_log_response /opt/stack/data/venv/lib/python3.12/site-packages/keystoneauth1/session.py:616}} Jul 31 12:30:43 devstack cinder-volume[89182]: DEBUG novaclient.v2.client [None req-a8336ac6-9698-4a80-9181-e18a1e1e6ccf tempest-SnapshotDataIntegrityTests-113348013 None] RESP BODY: {"snapshot": {"id": null, "volumeId": "8ef75942-d7b9-4102-a4ca-651a1de7d88a"}} {{(pid=89182) _http_log_response /opt/stack/data/venv/lib/python3.12/site-packages/keystoneauth1/session.py:651}} Jul 31 12:30:43 devstack cinder-volume[89182]: DEBUG novaclient.v2.client [None req-a8336ac6-9698-4a80-9181-e18a1e1e6ccf tempest-SnapshotDataIntegrityTests-113348013 None] POST call to compute for http://192.168.122.21/compute/v2.1/os-assisted-volume-snapshots used request id req-f3437bb9-ad5a-438b-996a-f09a3e96c875 {{(pid=89182) request /opt/stack/data/venv/lib/python3.12/site-packages/keystoneauth1/session.py:1076}} Jul 31 12:30:43 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-a8336ac6-9698-4a80-9181-e18a1e1e6ccf tempest-SnapshotDataIntegrityTests-113348013 None] nova call result: None {{(pid=89182) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1910}} Jul 31 12:30:43 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-a8336ac6-9698-4a80-9181-e18a1e1e6ccf tempest-SnapshotDataIntegrityTests-113348013 None] Status of snapshot 449abdff-86c6-4340-aa7c-dc571b705c1b is now creating {{(pid=89182) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Jul 31 12:30:43 devstack sudo[106492]: pam_unix(sudo:session): session closed for user root Jul 31 12:30:43 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-9deff429-3f6f-4329-ab2e-d88957c35ecc tempest-VolumesCloneTest-259757594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-99830eb2-e5a2-410b-abbc-4312e9fb272e" returned: 0 in 0.418s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:30:43 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-9deff429-3f6f-4329-ab2e-d88957c35ecc tempest-VolumesCloneTest-259757594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-99830eb2-e5a2-410b-abbc-4312e9fb272e {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:30:43 devstack sudo[106498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-99830eb2-e5a2-410b-abbc-4312e9fb272e Jul 31 12:30:43 devstack sudo[106498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:30:43 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-c6886ed8-c591-4058-9515-113097630912 tempest-VolumesExtendTest-1157568027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dab21d68-660f-462f-9e13-3496ec4782f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '98c78d9a-133c-442a-a8f6-472946b0d0ee', 'volume_name': 'volume-98c78d9a-133c-442a-a8f6-472946b0d0ee', 'volume_size': 1, 'image_id': '4cbd0fd2-77a8-43ca-bc93-b0249d6daea0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4cbd0fd2-77a8-43ca-bc93-b0249d6daea0', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3f77cb0dad9a46948c9357c65b22aef5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4cbd0fd2-77a8-43ca-bc93-b0249d6daea0', 'created_at': datetime.datetime(2026, 7, 31, 10, 8, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 31, 10, 8, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4cbd0fd2-77a8-43ca-bc93-b0249d6daea0/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:30:43 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-c6886ed8-c591-4058-9515-113097630912 tempest-VolumesExtendTest-1157568027 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d078ae58-db5c-48dc-8e4b-241f52c16119) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:30:43 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-c6886ed8-c591-4058-9515-113097630912 tempest-VolumesExtendTest-1157568027 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d078ae58-db5c-48dc-8e4b-241f52c16119) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:30:43 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-c6886ed8-c591-4058-9515-113097630912 tempest-VolumesExtendTest-1157568027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (209fd272-9097-4616-97d2-46d9badbbddc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:30:43 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-c6886ed8-c591-4058-9515-113097630912 tempest-VolumesExtendTest-1157568027 None] Volume 98c78d9a-133c-442a-a8f6-472946b0d0ee: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-98c78d9a-133c-442a-a8f6-472946b0d0ee', 'volume_size': 1, 'image_id': '4cbd0fd2-77a8-43ca-bc93-b0249d6daea0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4cbd0fd2-77a8-43ca-bc93-b0249d6daea0', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3f77cb0dad9a46948c9357c65b22aef5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4cbd0fd2-77a8-43ca-bc93-b0249d6daea0', 'created_at': datetime.datetime(2026, 7, 31, 10, 8, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 31, 10, 8, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4cbd0fd2-77a8-43ca-bc93-b0249d6daea0/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 31 12:30:43 devstack cinder-volume[89182]: DEBUG cinder.volume.flows.manager.create_volume [None req-c6886ed8-c591-4058-9515-113097630912 tempest-VolumesExtendTest-1157568027 None] Trying to clone 98c78d9a-133c-442a-a8f6-472946b0d0ee from image 4cbd0fd2-77a8-43ca-bc93-b0249d6daea0 at location (None, [{'url': 'file:///opt/stack/data/glance/images/4cbd0fd2-77a8-43ca-bc93-b0249d6daea0', 'metadata': {}}]). {{(pid=89182) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 31 12:30:43 devstack sudo[106498]: pam_unix(sudo:session): session closed for user root Jul 31 12:30:43 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-9deff429-3f6f-4329-ab2e-d88957c35ecc tempest-VolumesCloneTest-259757594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-99830eb2-e5a2-410b-abbc-4312e9fb272e" returned: 0 in 0.274s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:30:43 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-9deff429-3f6f-4329-ab2e-d88957c35ecc tempest-VolumesCloneTest-259757594 None] Lock "cinder-quobyte-99830eb2-e5a2-410b-abbc-4312e9fb272e" released by "delete_volume" :: held 0.759s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:30:44 devstack cinder-volume[89182]: DEBUG cinder.quota [None req-9deff429-3f6f-4329-ab2e-d88957c35ecc tempest-VolumesCloneTest-259757594 None] Created reservations ['7314c6e2-ef22-48f1-8878-448353be7415', '7d6b18b1-b024-40b1-98c4-1fc81a92d760', '4df81e2a-77db-4980-bf8c-3c1a33fa95f9', '9db75ba5-fdaf-44ab-acd2-0acd0c8f50f0'] {{(pid=89182) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 12:30:44 devstack cinder-volume[89182]: DEBUG cinder.image.image_utils [None req-c6886ed8-c591-4058-9515-113097630912 tempest-VolumesExtendTest-1157568027 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_4cbd0fd2-77a8-43ca-bc93-b0249d6daea0_2zj1m_codevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=89182) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 31 12:30:44 devstack cinder-volume[89182]: INFO cinder.image.image_utils [None req-c6886ed8-c591-4058-9515-113097630912 tempest-VolumesExtendTest-1157568027 None] Image download 20.69 MB at 20.69 MB/s Jul 31 12:30:44 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd58b376-446f-44d8-8189-026b9d015df9]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:30:44 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-c6886ed8-c591-4058-9515-113097630912 tempest-VolumesExtendTest-1157568027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4cbd0fd2-77a8-43ca-bc93-b0249d6daea0_2zj1m_codevstack@QuobyteHD {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:30:44 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-9deff429-3f6f-4329-ab2e-d88957c35ecc tempest-VolumesCloneTest-259757594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:30:44 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-9deff429-3f6f-4329-ab2e-d88957c35ecc tempest-VolumesCloneTest-259757594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:30:44 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-9deff429-3f6f-4329-ab2e-d88957c35ecc tempest-VolumesCloneTest-259757594 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:30:44 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-9deff429-3f6f-4329-ab2e-d88957c35ecc tempest-VolumesCloneTest-259757594 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:30:44 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-9deff429-3f6f-4329-ab2e-d88957c35ecc tempest-VolumesCloneTest-259757594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:30:44 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-9deff429-3f6f-4329-ab2e-d88957c35ecc tempest-VolumesCloneTest-259757594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:30:44 devstack sudo[106508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 Jul 31 12:30:44 devstack sudo[106508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:30:44 devstack sudo[106507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4cbd0fd2-77a8-43ca-bc93-b0249d6daea0_2zj1m_codevstack@QuobyteHD Jul 31 12:30:44 devstack sudo[106507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:30:44 devstack sudo[106508]: pam_unix(sudo:session): session closed for user root Jul 31 12:30:44 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-9deff429-3f6f-4329-ab2e-d88957c35ecc tempest-VolumesCloneTest-259757594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2" returned: 0 in 0.280s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:30:44 devstack cinder-volume[89182]: DEBUG cinder.manager [None req-9deff429-3f6f-4329-ab2e-d88957c35ecc tempest-VolumesCloneTest-259757594 None] Notifying Schedulers of capabilities ... {{(pid=89182) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 12:30:44 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-9deff429-3f6f-4329-ab2e-d88957c35ecc tempest-VolumesCloneTest-259757594 None] Deleted volume successfully. Jul 31 12:30:44 devstack sudo[106507]: pam_unix(sudo:session): session closed for user root Jul 31 12:30:44 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-c6886ed8-c591-4058-9515-113097630912 tempest-VolumesExtendTest-1157568027 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4cbd0fd2-77a8-43ca-bc93-b0249d6daea0_2zj1m_codevstack@QuobyteHD" returned: 0 in 0.371s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:30:44 devstack cinder-volume[89182]: DEBUG cinder.image.image_utils [None req-c6886ed8-c591-4058-9515-113097630912 tempest-VolumesExtendTest-1157568027 None] Temporary image 4cbd0fd2-77a8-43ca-bc93-b0249d6daea0 is fetched for user b6e5fb63ba30434eb41a770ba1c207ae. {{(pid=89182) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 31 12:30:44 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-9deff429-3f6f-4329-ab2e-d88957c35ecc tempest-VolumesCloneTest-259757594 None] Lock "cinder-99830eb2-e5a2-410b-abbc-4312e9fb272e-delete_volume" released by "delete_volume" :: held 1.467s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:30:44 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-a8336ac6-9698-4a80-9181-e18a1e1e6ccf tempest-SnapshotDataIntegrityTests-113348013 None] Status of snapshot 449abdff-86c6-4340-aa7c-dc571b705c1b is now creating {{(pid=89182) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Jul 31 12:30:44 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c954b97-1cc5-4f1a-8178-7354b227c240]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:30:44 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-c6886ed8-c591-4058-9515-113097630912 tempest-VolumesExtendTest-1157568027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4cbd0fd2-77a8-43ca-bc93-b0249d6daea0_2zj1m_codevstack@QuobyteHD {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:30:44 devstack sudo[106516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4cbd0fd2-77a8-43ca-bc93-b0249d6daea0_2zj1m_codevstack@QuobyteHD Jul 31 12:30:44 devstack sudo[106516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:30:44 devstack sudo[106516]: pam_unix(sudo:session): session closed for user root Jul 31 12:30:44 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-c6886ed8-c591-4058-9515-113097630912 tempest-VolumesExtendTest-1157568027 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4cbd0fd2-77a8-43ca-bc93-b0249d6daea0_2zj1m_codevstack@QuobyteHD" returned: 0 in 0.320s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:30:44 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-c6886ed8-c591-4058-9515-113097630912 tempest-VolumesExtendTest-1157568027 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:30:45 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-0381330b-7e81-4a4b-bf35-71ddbd5b84e2 tempest-VolumesCloneTest-259757594 None] Acquiring lock "cinder-90198634-c6ee-4b01-a615-5a6a8a93e129-delete_volume" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:30:45 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-0381330b-7e81-4a4b-bf35-71ddbd5b84e2 tempest-VolumesCloneTest-259757594 None] Lock "cinder-90198634-c6ee-4b01-a615-5a6a8a93e129-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:30:45 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-0381330b-7e81-4a4b-bf35-71ddbd5b84e2 tempest-VolumesCloneTest-259757594 None] Acquiring lock "cinder-quobyte-90198634-c6ee-4b01-a615-5a6a8a93e129" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:30:45 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-0381330b-7e81-4a4b-bf35-71ddbd5b84e2 tempest-VolumesCloneTest-259757594 None] Lock "cinder-quobyte-90198634-c6ee-4b01-a615-5a6a8a93e129" acquired by "delete_volume" :: waited 0.015s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:30:45 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcb81996-378f-4815-8ed3-7b9575713536]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:30:45 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-0381330b-7e81-4a4b-bf35-71ddbd5b84e2 tempest-VolumesCloneTest-259757594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-90198634-c6ee-4b01-a615-5a6a8a93e129 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:30:45 devstack sudo[106521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-90198634-c6ee-4b01-a615-5a6a8a93e129 Jul 31 12:30:45 devstack sudo[106521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:30:45 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-a8336ac6-9698-4a80-9181-e18a1e1e6ccf tempest-SnapshotDataIntegrityTests-113348013 None] Status of snapshot 449abdff-86c6-4340-aa7c-dc571b705c1b is now creating {{(pid=89182) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Jul 31 12:30:45 devstack sudo[106521]: pam_unix(sudo:session): session closed for user root Jul 31 12:30:45 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-0381330b-7e81-4a4b-bf35-71ddbd5b84e2 tempest-VolumesCloneTest-259757594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-90198634-c6ee-4b01-a615-5a6a8a93e129" returned: 0 in 0.355s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:30:45 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-0381330b-7e81-4a4b-bf35-71ddbd5b84e2 tempest-VolumesCloneTest-259757594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-90198634-c6ee-4b01-a615-5a6a8a93e129 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:30:45 devstack sudo[106526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-90198634-c6ee-4b01-a615-5a6a8a93e129 Jul 31 12:30:45 devstack sudo[106526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:30:46 devstack sudo[106526]: pam_unix(sudo:session): session closed for user root Jul 31 12:30:46 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-0381330b-7e81-4a4b-bf35-71ddbd5b84e2 tempest-VolumesCloneTest-259757594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-90198634-c6ee-4b01-a615-5a6a8a93e129" returned: 0 in 0.244s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:30:46 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-0381330b-7e81-4a4b-bf35-71ddbd5b84e2 tempest-VolumesCloneTest-259757594 None] Lock "cinder-quobyte-90198634-c6ee-4b01-a615-5a6a8a93e129" released by "delete_volume" :: held 0.657s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:30:46 devstack cinder-volume[89182]: DEBUG cinder.quota [None req-0381330b-7e81-4a4b-bf35-71ddbd5b84e2 tempest-VolumesCloneTest-259757594 None] Created reservations ['23ee22ec-c841-4bc4-a660-fd56fca8db6d', 'ecee2a0e-d8e5-4e3f-ab98-1a028d53e19b', '60c44cff-5a67-48c2-bbf1-6788c638ca50', '9565fa5c-4495-4df6-83af-be71fe2767e1'] {{(pid=89182) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 12:30:46 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-0381330b-7e81-4a4b-bf35-71ddbd5b84e2 tempest-VolumesCloneTest-259757594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:30:46 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-0381330b-7e81-4a4b-bf35-71ddbd5b84e2 tempest-VolumesCloneTest-259757594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:30:46 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-0381330b-7e81-4a4b-bf35-71ddbd5b84e2 tempest-VolumesCloneTest-259757594 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:30:46 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-0381330b-7e81-4a4b-bf35-71ddbd5b84e2 tempest-VolumesCloneTest-259757594 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:30:46 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-0381330b-7e81-4a4b-bf35-71ddbd5b84e2 tempest-VolumesCloneTest-259757594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:30:46 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-0381330b-7e81-4a4b-bf35-71ddbd5b84e2 tempest-VolumesCloneTest-259757594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:30:46 devstack sudo[106529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 Jul 31 12:30:46 devstack sudo[106529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:30:46 devstack sudo[106529]: pam_unix(sudo:session): session closed for user root Jul 31 12:30:46 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-0381330b-7e81-4a4b-bf35-71ddbd5b84e2 tempest-VolumesCloneTest-259757594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2" returned: 0 in 0.261s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:30:46 devstack cinder-volume[89182]: DEBUG cinder.manager [None req-0381330b-7e81-4a4b-bf35-71ddbd5b84e2 tempest-VolumesCloneTest-259757594 None] Notifying Schedulers of capabilities ... {{(pid=89182) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 12:30:46 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-0381330b-7e81-4a4b-bf35-71ddbd5b84e2 tempest-VolumesCloneTest-259757594 None] Deleted volume successfully. Jul 31 12:30:46 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-0381330b-7e81-4a4b-bf35-71ddbd5b84e2 tempest-VolumesCloneTest-259757594 None] Lock "cinder-90198634-c6ee-4b01-a615-5a6a8a93e129-delete_volume" released by "delete_volume" :: held 1.132s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:30:46 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-a8336ac6-9698-4a80-9181-e18a1e1e6ccf tempest-SnapshotDataIntegrityTests-113348013 None] Status of snapshot 449abdff-86c6-4340-aa7c-dc571b705c1b is now creating {{(pid=89182) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Jul 31 12:30:46 devstack cinder-volume[89182]: DEBUG cinder.volume.flows.manager.create_volume [None req-a0338169-abd2-45eb-9861-f2711c9d4486 tempest-VolumesCloneTest-259757594 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89182) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 12:30:46 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-a0338169-abd2-45eb-9861-f2711c9d4486 tempest-VolumesCloneTest-259757594 None] Flow 'volume_create_manager' (a32f7c39-c039-47d1-8acd-ece23e9d7a42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:30:46 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-a0338169-abd2-45eb-9861-f2711c9d4486 tempest-VolumesCloneTest-259757594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c5c0769-9068-47de-9f12-50579d0fc01a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:30:47 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-a0338169-abd2-45eb-9861-f2711c9d4486 tempest-VolumesCloneTest-259757594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c5c0769-9068-47de-9f12-50579d0fc01a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:30:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1533994944',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c17ca16-8703-42fc-9ddb-ad1109315a82,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f800e74e2ae64891887d8f7f0191875e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:30:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:30:47Z,use_quota=True,user_id='26fdfa74040a494cb9eb6100073483c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:30:47 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-a0338169-abd2-45eb-9861-f2711c9d4486 tempest-VolumesCloneTest-259757594 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd3cb541-e39f-4f69-b3b4-8111aad4818c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:30:47 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-a0338169-abd2-45eb-9861-f2711c9d4486 tempest-VolumesCloneTest-259757594 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd3cb541-e39f-4f69-b3b4-8111aad4818c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:30:47 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-a0338169-abd2-45eb-9861-f2711c9d4486 tempest-VolumesCloneTest-259757594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a03ee99-184e-4dc7-beba-36fa895024c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:30:47 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-a0338169-abd2-45eb-9861-f2711c9d4486 tempest-VolumesCloneTest-259757594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a03ee99-184e-4dc7-beba-36fa895024c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1c17ca16-8703-42fc-9ddb-ad1109315a82', 'volume_name': 'volume-1c17ca16-8703-42fc-9ddb-ad1109315a82', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:30:47 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-a0338169-abd2-45eb-9861-f2711c9d4486 tempest-VolumesCloneTest-259757594 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e78efc2-cf99-4e74-bc1d-623ec48b68f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:30:47 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-a0338169-abd2-45eb-9861-f2711c9d4486 tempest-VolumesCloneTest-259757594 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e78efc2-cf99-4e74-bc1d-623ec48b68f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:30:47 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-a0338169-abd2-45eb-9861-f2711c9d4486 tempest-VolumesCloneTest-259757594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7896b038-3861-45f9-94a2-f71ba29da408) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:30:47 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-a0338169-abd2-45eb-9861-f2711c9d4486 tempest-VolumesCloneTest-259757594 None] Volume 1c17ca16-8703-42fc-9ddb-ad1109315a82: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1c17ca16-8703-42fc-9ddb-ad1109315a82', 'volume_size': 1} Jul 31 12:30:47 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-a0338169-abd2-45eb-9861-f2711c9d4486 tempest-VolumesCloneTest-259757594 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:30:47 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-a8336ac6-9698-4a80-9181-e18a1e1e6ccf tempest-SnapshotDataIntegrityTests-113348013 None] Status of snapshot 449abdff-86c6-4340-aa7c-dc571b705c1b is now creating {{(pid=89182) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Jul 31 12:30:48 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-a8336ac6-9698-4a80-9181-e18a1e1e6ccf tempest-SnapshotDataIntegrityTests-113348013 None] Status of snapshot 449abdff-86c6-4340-aa7c-dc571b705c1b is now creating {{(pid=89182) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Jul 31 12:30:49 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-a8336ac6-9698-4a80-9181-e18a1e1e6ccf tempest-SnapshotDataIntegrityTests-113348013 None] Status of snapshot 449abdff-86c6-4340-aa7c-dc571b705c1b is now creating {{(pid=89182) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Jul 31 12:30:50 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-a8336ac6-9698-4a80-9181-e18a1e1e6ccf tempest-SnapshotDataIntegrityTests-113348013 None] Status of snapshot 449abdff-86c6-4340-aa7c-dc571b705c1b is now creating {{(pid=89182) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Jul 31 12:30:51 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-a8336ac6-9698-4a80-9181-e18a1e1e6ccf tempest-SnapshotDataIntegrityTests-113348013 None] Status of snapshot 449abdff-86c6-4340-aa7c-dc571b705c1b is now creating {{(pid=89182) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Jul 31 12:30:52 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-a8336ac6-9698-4a80-9181-e18a1e1e6ccf tempest-SnapshotDataIntegrityTests-113348013 None] Status of snapshot 449abdff-86c6-4340-aa7c-dc571b705c1b is now creating {{(pid=89182) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Jul 31 12:30:53 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-a8336ac6-9698-4a80-9181-e18a1e1e6ccf tempest-SnapshotDataIntegrityTests-113348013 None] Status of snapshot 449abdff-86c6-4340-aa7c-dc571b705c1b is now creating {{(pid=89182) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Jul 31 12:30:54 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-a8336ac6-9698-4a80-9181-e18a1e1e6ccf tempest-SnapshotDataIntegrityTests-113348013 None] Status of snapshot 449abdff-86c6-4340-aa7c-dc571b705c1b is now creating {{(pid=89182) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Jul 31 12:30:56 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-a8336ac6-9698-4a80-9181-e18a1e1e6ccf tempest-SnapshotDataIntegrityTests-113348013 None] Status of snapshot 449abdff-86c6-4340-aa7c-dc571b705c1b is now creating {{(pid=89182) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Jul 31 12:30:58 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-a8336ac6-9698-4a80-9181-e18a1e1e6ccf tempest-SnapshotDataIntegrityTests-113348013 None] Status of snapshot 449abdff-86c6-4340-aa7c-dc571b705c1b is now creating {{(pid=89182) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Jul 31 12:31:00 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-a8336ac6-9698-4a80-9181-e18a1e1e6ccf tempest-SnapshotDataIntegrityTests-113348013 None] Status of snapshot 449abdff-86c6-4340-aa7c-dc571b705c1b is now creating {{(pid=89182) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Jul 31 12:31:00 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-a8336ac6-9698-4a80-9181-e18a1e1e6ccf tempest-SnapshotDataIntegrityTests-113348013 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 19.113s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:31:00 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-c6886ed8-c591-4058-9515-113097630912 tempest-VolumesExtendTest-1157568027 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 15.841s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:31:00 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-c6886ed8-c591-4058-9515-113097630912 tempest-VolumesExtendTest-1157568027 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:30:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-837526146',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98c78d9a-133c-442a-a8f6-472946b0d0ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0dd736d01df468bb04ac8c0ee27a4ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:30:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:30:43Z,use_quota=True,user_id='b6e5fb63ba30434eb41a770ba1c207ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)}" {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 12:31:00 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-c6886ed8-c591-4058-9515-113097630912 tempest-VolumesExtendTest-1157568027 None] Creating volume 98c78d9a-133c-442a-a8f6-472946b0d0ee {{(pid=89182) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 12:31:00 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-c6886ed8-c591-4058-9515-113097630912 tempest-VolumesExtendTest-1157568027 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:31:00 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-c6886ed8-c591-4058-9515-113097630912 tempest-VolumesExtendTest-1157568027 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:31:00 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-c6886ed8-c591-4058-9515-113097630912 tempest-VolumesExtendTest-1157568027 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:31:00 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-c6886ed8-c591-4058-9515-113097630912 tempest-VolumesExtendTest-1157568027 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:31:00 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-c6886ed8-c591-4058-9515-113097630912 tempest-VolumesExtendTest-1157568027 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:31:00 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-c6886ed8-c591-4058-9515-113097630912 tempest-VolumesExtendTest-1157568027 None] Selected osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 as target Quobyte volume. {{(pid=89182) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 12:31:00 devstack cinder-volume[89182]: INFO cinder.volume.drivers.remotefs [None req-c6886ed8-c591-4058-9515-113097630912 tempest-VolumesExtendTest-1157568027 None] casted to osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 Jul 31 12:31:00 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-c6886ed8-c591-4058-9515-113097630912 tempest-VolumesExtendTest-1157568027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-98c78d9a-133c-442a-a8f6-472946b0d0ee 1073741824 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:31:00 devstack sudo[106541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-98c78d9a-133c-442a-a8f6-472946b0d0ee 1073741824 Jul 31 12:31:00 devstack sudo[106541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:31:00 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-a8336ac6-9698-4a80-9181-e18a1e1e6ccf tempest-SnapshotDataIntegrityTests-113348013 None] Create snapshot completed successfully Jul 31 12:31:01 devstack sudo[106541]: pam_unix(sudo:session): session closed for user root Jul 31 12:31:01 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-c6886ed8-c591-4058-9515-113097630912 tempest-VolumesExtendTest-1157568027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-98c78d9a-133c-442a-a8f6-472946b0d0ee 1073741824" returned: 0 in 0.437s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:31:01 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-c6886ed8-c591-4058-9515-113097630912 tempest-VolumesExtendTest-1157568027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-98c78d9a-133c-442a-a8f6-472946b0d0ee {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:31:01 devstack sudo[106547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-98c78d9a-133c-442a-a8f6-472946b0d0ee Jul 31 12:31:01 devstack sudo[106547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:31:01 devstack sudo[106547]: pam_unix(sudo:session): session closed for user root Jul 31 12:31:01 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-c6886ed8-c591-4058-9515-113097630912 tempest-VolumesExtendTest-1157568027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-98c78d9a-133c-442a-a8f6-472946b0d0ee" returned: 0 in 0.246s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:31:01 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-c6886ed8-c591-4058-9515-113097630912 tempest-VolumesExtendTest-1157568027 None] <== create_volume: return (728ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'} {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 12:31:01 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-c6886ed8-c591-4058-9515-113097630912 tempest-VolumesExtendTest-1157568027 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.731s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:31:01 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-a0338169-abd2-45eb-9861-f2711c9d4486 tempest-VolumesCloneTest-259757594 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 14.503s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:31:01 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-a0338169-abd2-45eb-9861-f2711c9d4486 tempest-VolumesCloneTest-259757594 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:30:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1533994944',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c17ca16-8703-42fc-9ddb-ad1109315a82,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f800e74e2ae64891887d8f7f0191875e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:30:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:30:47Z,use_quota=True,user_id='26fdfa74040a494cb9eb6100073483c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)}" {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 12:31:01 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-a0338169-abd2-45eb-9861-f2711c9d4486 tempest-VolumesCloneTest-259757594 None] Creating volume 1c17ca16-8703-42fc-9ddb-ad1109315a82 {{(pid=89182) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 12:31:01 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-a0338169-abd2-45eb-9861-f2711c9d4486 tempest-VolumesCloneTest-259757594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:31:01 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-a0338169-abd2-45eb-9861-f2711c9d4486 tempest-VolumesCloneTest-259757594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:31:01 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-a0338169-abd2-45eb-9861-f2711c9d4486 tempest-VolumesCloneTest-259757594 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:31:01 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-a0338169-abd2-45eb-9861-f2711c9d4486 tempest-VolumesCloneTest-259757594 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:31:01 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-a0338169-abd2-45eb-9861-f2711c9d4486 tempest-VolumesCloneTest-259757594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:31:01 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-a0338169-abd2-45eb-9861-f2711c9d4486 tempest-VolumesCloneTest-259757594 None] Selected osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 as target Quobyte volume. {{(pid=89182) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 12:31:01 devstack cinder-volume[89182]: INFO cinder.volume.drivers.remotefs [None req-a0338169-abd2-45eb-9861-f2711c9d4486 tempest-VolumesCloneTest-259757594 None] casted to osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 Jul 31 12:31:01 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-a0338169-abd2-45eb-9861-f2711c9d4486 tempest-VolumesCloneTest-259757594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-1c17ca16-8703-42fc-9ddb-ad1109315a82 1073741824 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:31:01 devstack sudo[106550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-1c17ca16-8703-42fc-9ddb-ad1109315a82 1073741824 Jul 31 12:31:01 devstack sudo[106550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:31:01 devstack cinder-volume[89182]: DEBUG cinder.volume.volume_utils [None req-c6886ed8-c591-4058-9515-113097630912 tempest-VolumesExtendTest-1157568027 None] Attempting download of 4cbd0fd2-77a8-43ca-bc93-b0249d6daea0 ((None, [{'url': 'file:///opt/stack/data/glance/images/4cbd0fd2-77a8-43ca-bc93-b0249d6daea0', 'metadata': {}}])) to volume 98c78d9a-133c-442a-a8f6-472946b0d0ee. {{(pid=89182) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 31 12:31:01 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[b51f0278-69be-4b39-a7a1-38ac6761aca6]: (4, 'raw') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:31:01 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-c6886ed8-c591-4058-9515-113097630912 tempest-VolumesExtendTest-1157568027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4cbd0fd2-77a8-43ca-bc93-b0249d6daea0_97fjt1b4 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:31:01 devstack sudo[106552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4cbd0fd2-77a8-43ca-bc93-b0249d6daea0_97fjt1b4 Jul 31 12:31:01 devstack sudo[106552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:31:01 devstack sudo[106552]: pam_unix(sudo:session): session closed for user root Jul 31 12:31:01 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-c6886ed8-c591-4058-9515-113097630912 tempest-VolumesExtendTest-1157568027 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4cbd0fd2-77a8-43ca-bc93-b0249d6daea0_97fjt1b4" returned: 0 in 0.348s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:31:02 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-c6886ed8-c591-4058-9515-113097630912 tempest-VolumesExtendTest-1157568027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4cbd0fd2-77a8-43ca-bc93-b0249d6daea0_97fjt1b4 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:31:02 devstack sudo[106550]: pam_unix(sudo:session): session closed for user root Jul 31 12:31:02 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-a0338169-abd2-45eb-9861-f2711c9d4486 tempest-VolumesCloneTest-259757594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-1c17ca16-8703-42fc-9ddb-ad1109315a82 1073741824" returned: 0 in 0.453s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:31:02 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-a0338169-abd2-45eb-9861-f2711c9d4486 tempest-VolumesCloneTest-259757594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-1c17ca16-8703-42fc-9ddb-ad1109315a82 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:31:02 devstack sudo[106561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-1c17ca16-8703-42fc-9ddb-ad1109315a82 Jul 31 12:31:02 devstack sudo[106561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:31:02 devstack sudo[106560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4cbd0fd2-77a8-43ca-bc93-b0249d6daea0_97fjt1b4 Jul 31 12:31:02 devstack sudo[106560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:31:02 devstack sudo[106561]: pam_unix(sudo:session): session closed for user root Jul 31 12:31:02 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-a0338169-abd2-45eb-9861-f2711c9d4486 tempest-VolumesCloneTest-259757594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-1c17ca16-8703-42fc-9ddb-ad1109315a82" returned: 0 in 0.281s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:31:02 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-a0338169-abd2-45eb-9861-f2711c9d4486 tempest-VolumesCloneTest-259757594 None] <== create_volume: return (789ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'} {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 12:31:02 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-a0338169-abd2-45eb-9861-f2711c9d4486 tempest-VolumesCloneTest-259757594 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.793s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:31:02 devstack sudo[106560]: pam_unix(sudo:session): session closed for user root Jul 31 12:31:02 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-a0338169-abd2-45eb-9861-f2711c9d4486 tempest-VolumesCloneTest-259757594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7896b038-3861-45f9-94a2-f71ba29da408) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1c17ca16-8703-42fc-9ddb-ad1109315a82', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:31:02 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-a0338169-abd2-45eb-9861-f2711c9d4486 tempest-VolumesCloneTest-259757594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77841ad7-f0db-4ed7-acc2-b8dca3400a37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:31:02 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-c6886ed8-c591-4058-9515-113097630912 tempest-VolumesExtendTest-1157568027 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4cbd0fd2-77a8-43ca-bc93-b0249d6daea0_97fjt1b4" returned: 1 in 0.370s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:31:02 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-c6886ed8-c591-4058-9515-113097630912 tempest-VolumesExtendTest-1157568027 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4cbd0fd2-77a8-43ca-bc93-b0249d6daea0_97fjt1b4' failed. Not Retrying. {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 31 12:31:02 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[d511a23c-b10b-4896-b3b4-78724f38ea6f]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:31:02 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-c6886ed8-c591-4058-9515-113097630912 tempest-VolumesExtendTest-1157568027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4cbd0fd2-77a8-43ca-bc93-b0249d6daea0_2zj1m_codevstack@QuobyteHD {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:31:02 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-a0338169-abd2-45eb-9861-f2711c9d4486 tempest-VolumesCloneTest-259757594 None] Volume volume-1c17ca16-8703-42fc-9ddb-ad1109315a82 (1c17ca16-8703-42fc-9ddb-ad1109315a82): created successfully Jul 31 12:31:02 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-a0338169-abd2-45eb-9861-f2711c9d4486 tempest-VolumesCloneTest-259757594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77841ad7-f0db-4ed7-acc2-b8dca3400a37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:31:02 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-a0338169-abd2-45eb-9861-f2711c9d4486 tempest-VolumesCloneTest-259757594 None] Flow 'volume_create_manager' (a32f7c39-c039-47d1-8acd-ece23e9d7a42) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:31:02 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-a0338169-abd2-45eb-9861-f2711c9d4486 tempest-VolumesCloneTest-259757594 None] Created volume successfully. Jul 31 12:31:02 devstack sudo[106567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4cbd0fd2-77a8-43ca-bc93-b0249d6daea0_2zj1m_codevstack@QuobyteHD Jul 31 12:31:02 devstack sudo[106567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:31:02 devstack cinder-volume[89182]: INFO cinder.volume.manager [req-b54260d2-155e-4662-b50a-4ea9f16a550f req-b94741f0-7192-47d2-a9dc-cd8f580eb9fa tempest-SnapshotDataIntegrityTests-113348013 None] Terminate volume connection completed successfully. Jul 31 12:31:02 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [req-b54260d2-155e-4662-b50a-4ea9f16a550f req-b94741f0-7192-47d2-a9dc-cd8f580eb9fa tempest-SnapshotDataIntegrityTests-113348013 None] Deleting attachment 7cf32a9d-8f6f-4147-a3c4-25b3b4012f78. {{(pid=89182) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 31 12:31:02 devstack sudo[106567]: pam_unix(sudo:session): session closed for user root Jul 31 12:31:02 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-c6886ed8-c591-4058-9515-113097630912 tempest-VolumesExtendTest-1157568027 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4cbd0fd2-77a8-43ca-bc93-b0249d6daea0_2zj1m_codevstack@QuobyteHD" returned: 0 in 0.379s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:31:02 devstack cinder-volume[89182]: DEBUG cinder.image.image_utils [None req-c6886ed8-c591-4058-9515-113097630912 tempest-VolumesExtendTest-1157568027 None] 4cbd0fd2-77a8-43ca-bc93-b0249d6daea0 was qcow2, converting to qcow2 {{(pid=89182) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 31 12:31:02 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-c6886ed8-c591-4058-9515-113097630912 tempest-VolumesExtendTest-1157568027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4cbd0fd2-77a8-43ca-bc93-b0249d6daea0_2zj1m_codevstack@QuobyteHD /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-98c78d9a-133c-442a-a8f6-472946b0d0ee {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:31:02 devstack sudo[106578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4cbd0fd2-77a8-43ca-bc93-b0249d6daea0_2zj1m_codevstack@QuobyteHD /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-98c78d9a-133c-442a-a8f6-472946b0d0ee Jul 31 12:31:02 devstack sudo[106578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:31:03 devstack cinder-volume[89182]: DEBUG cinder.volume.flows.manager.create_volume [None req-83291511-7911-4a24-a4e2-a5389fea2391 tempest-VolumesCloneTest-259757594 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89182) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 12:31:03 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-83291511-7911-4a24-a4e2-a5389fea2391 tempest-VolumesCloneTest-259757594 None] Flow 'volume_create_manager' (d30cacf4-5239-4067-ab3a-e993d5731492) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:31:03 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-83291511-7911-4a24-a4e2-a5389fea2391 tempest-VolumesCloneTest-259757594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5beec01b-50af-404e-a64f-596d3ccd1db7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:31:03 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-83291511-7911-4a24-a4e2-a5389fea2391 tempest-VolumesCloneTest-259757594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5beec01b-50af-404e-a64f-596d3ccd1db7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:31:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1530222253',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a96fa0b-69b1-4269-a771-1135fca9ecca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f800e74e2ae64891887d8f7f0191875e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:31:03Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=1c17ca16-8703-42fc-9ddb-ad1109315a82,status='creating',terminated_at=None,updated_at=2026-07-31T10:31:03Z,use_quota=True,user_id='26fdfa74040a494cb9eb6100073483c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:31:03 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-83291511-7911-4a24-a4e2-a5389fea2391 tempest-VolumesCloneTest-259757594 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d24d0484-95a0-4686-931d-c7e7843f0218) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:31:03 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-83291511-7911-4a24-a4e2-a5389fea2391 tempest-VolumesCloneTest-259757594 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d24d0484-95a0-4686-931d-c7e7843f0218) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:31:03 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-83291511-7911-4a24-a4e2-a5389fea2391 tempest-VolumesCloneTest-259757594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c4d6bf8-8f50-46d4-8a98-ef7ef927897e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:31:03 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-83291511-7911-4a24-a4e2-a5389fea2391 tempest-VolumesCloneTest-259757594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c4d6bf8-8f50-46d4-8a98-ef7ef927897e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '7a96fa0b-69b1-4269-a771-1135fca9ecca', 'volume_name': 'volume-7a96fa0b-69b1-4269-a771-1135fca9ecca', 'volume_size': 2, 'source_volid': '1c17ca16-8703-42fc-9ddb-ad1109315a82', 'source_volstatus': 'available'}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:31:03 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-83291511-7911-4a24-a4e2-a5389fea2391 tempest-VolumesCloneTest-259757594 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b55442f0-5696-4348-af2f-1d0d54f37d84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:31:03 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-83291511-7911-4a24-a4e2-a5389fea2391 tempest-VolumesCloneTest-259757594 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b55442f0-5696-4348-af2f-1d0d54f37d84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:31:03 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-83291511-7911-4a24-a4e2-a5389fea2391 tempest-VolumesCloneTest-259757594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9daab79a-c7fb-4e08-9bc5-726c811a03a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:31:03 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-83291511-7911-4a24-a4e2-a5389fea2391 tempest-VolumesCloneTest-259757594 None] Volume 7a96fa0b-69b1-4269-a771-1135fca9ecca: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-7a96fa0b-69b1-4269-a771-1135fca9ecca', 'volume_size': 2, 'source_volid': '1c17ca16-8703-42fc-9ddb-ad1109315a82', 'source_volstatus': 'available'} Jul 31 12:31:03 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-83291511-7911-4a24-a4e2-a5389fea2391 tempest-VolumesCloneTest-259757594 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:31:03 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-83291511-7911-4a24-a4e2-a5389fea2391 tempest-VolumesCloneTest-259757594 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:31:03 devstack cinder-volume[89182]: INFO cinder.volume.drivers.remotefs [None req-83291511-7911-4a24-a4e2-a5389fea2391 tempest-VolumesCloneTest-259757594 None] Cloning volume 1c17ca16-8703-42fc-9ddb-ad1109315a82 to volume 7a96fa0b-69b1-4269-a771-1135fca9ecca Jul 31 12:31:03 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-83291511-7911-4a24-a4e2-a5389fea2391 tempest-VolumesCloneTest-259757594 None] Creating offline snapshot 8fa011da-3f07-4c5c-8475-29ec1e80ab83 of volume 1c17ca16-8703-42fc-9ddb-ad1109315a82 {{(pid=89182) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 31 12:31:03 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[79a8dc25-49ae-4cde-9397-1865723cbbb6]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:31:03 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-83291511-7911-4a24-a4e2-a5389fea2391 tempest-VolumesCloneTest-259757594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-1c17ca16-8703-42fc-9ddb-ad1109315a82 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:31:03 devstack sudo[106587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-1c17ca16-8703-42fc-9ddb-ad1109315a82 Jul 31 12:31:03 devstack sudo[106587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:31:03 devstack cinder-volume[89182]: DEBUG cinder.volume.flows.manager.create_volume [None req-93a68ef3-545c-4cec-b5b5-7b4671d30b23 tempest-SnapshotDataIntegrityTests-113348013 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89182) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 12:31:03 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-93a68ef3-545c-4cec-b5b5-7b4671d30b23 tempest-SnapshotDataIntegrityTests-113348013 None] Flow 'volume_create_manager' (3ca1b24c-b5c4-49e8-ad7d-521b31693d24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:31:03 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-93a68ef3-545c-4cec-b5b5-7b4671d30b23 tempest-SnapshotDataIntegrityTests-113348013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0838312-a0e2-4ff5-89c2-3e1d44179f95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:31:03 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-93a68ef3-545c-4cec-b5b5-7b4671d30b23 tempest-SnapshotDataIntegrityTests-113348013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0838312-a0e2-4ff5-89c2-3e1d44179f95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:31:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDataIntegrityTests-volume-281814857',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52b3dce3-91b8-4da0-99fe-4c0919ab8b11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b7de7a8b3bf64f6b8012ee3189eeaff8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:31:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=b8369f85-c94c-4c5c-9b7e-1f6060bee802,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:31:04Z,use_quota=True,user_id='00b607dae7d54b56a52ba547d8a1ab16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:31:03 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-93a68ef3-545c-4cec-b5b5-7b4671d30b23 tempest-SnapshotDataIntegrityTests-113348013 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (daccd7eb-b7bd-48fd-827d-0946ea08db98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:31:03 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-93a68ef3-545c-4cec-b5b5-7b4671d30b23 tempest-SnapshotDataIntegrityTests-113348013 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (daccd7eb-b7bd-48fd-827d-0946ea08db98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:31:04 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-93a68ef3-545c-4cec-b5b5-7b4671d30b23 tempest-SnapshotDataIntegrityTests-113348013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e195d4a-09a0-404b-8f36-0a41e8d44324) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:31:04 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-93a68ef3-545c-4cec-b5b5-7b4671d30b23 tempest-SnapshotDataIntegrityTests-113348013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e195d4a-09a0-404b-8f36-0a41e8d44324) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '52b3dce3-91b8-4da0-99fe-4c0919ab8b11', 'volume_name': 'volume-52b3dce3-91b8-4da0-99fe-4c0919ab8b11', 'volume_size': 1, 'snapshot_id': 'b8369f85-c94c-4c5c-9b7e-1f6060bee802'}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:31:04 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-93a68ef3-545c-4cec-b5b5-7b4671d30b23 tempest-SnapshotDataIntegrityTests-113348013 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f2eedf4-d88e-4843-9154-d2bf03a20417) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:31:04 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-93a68ef3-545c-4cec-b5b5-7b4671d30b23 tempest-SnapshotDataIntegrityTests-113348013 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f2eedf4-d88e-4843-9154-d2bf03a20417) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:31:04 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-93a68ef3-545c-4cec-b5b5-7b4671d30b23 tempest-SnapshotDataIntegrityTests-113348013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a92df8a-6475-4d45-81f1-c00634ad8817) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:31:04 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-93a68ef3-545c-4cec-b5b5-7b4671d30b23 tempest-SnapshotDataIntegrityTests-113348013 None] Volume 52b3dce3-91b8-4da0-99fe-4c0919ab8b11: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-52b3dce3-91b8-4da0-99fe-4c0919ab8b11', 'volume_size': 1, 'snapshot_id': 'b8369f85-c94c-4c5c-9b7e-1f6060bee802'} Jul 31 12:31:04 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-93a68ef3-545c-4cec-b5b5-7b4671d30b23 tempest-SnapshotDataIntegrityTests-113348013 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:31:04 devstack sudo[106587]: pam_unix(sudo:session): session closed for user root Jul 31 12:31:04 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-83291511-7911-4a24-a4e2-a5389fea2391 tempest-VolumesCloneTest-259757594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-1c17ca16-8703-42fc-9ddb-ad1109315a82" returned: 0 in 0.508s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:31:04 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-83291511-7911-4a24-a4e2-a5389fea2391 tempest-VolumesCloneTest-259757594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-1c17ca16-8703-42fc-9ddb-ad1109315a82,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-1c17ca16-8703-42fc-9ddb-ad1109315a82.8fa011da-3f07-4c5c-8475-29ec1e80ab83 1G {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:31:04 devstack sudo[106592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-1c17ca16-8703-42fc-9ddb-ad1109315a82,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-1c17ca16-8703-42fc-9ddb-ad1109315a82.8fa011da-3f07-4c5c-8475-29ec1e80ab83 1G Jul 31 12:31:04 devstack sudo[106592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:31:04 devstack sudo[106578]: pam_unix(sudo:session): session closed for user root Jul 31 12:31:04 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-c6886ed8-c591-4058-9515-113097630912 tempest-VolumesExtendTest-1157568027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4cbd0fd2-77a8-43ca-bc93-b0249d6daea0_2zj1m_codevstack@QuobyteHD /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-98c78d9a-133c-442a-a8f6-472946b0d0ee" returned: 0 in 1.845s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:31:04 devstack cinder-volume[89182]: DEBUG cinder.image.image_utils [None req-c6886ed8-c591-4058-9515-113097630912 tempest-VolumesExtendTest-1157568027 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_4cbd0fd2-77a8-43ca-bc93-b0249d6daea0_2zj1m_codevstack@QuobyteHD, size 112.00 MB, duration 1.85 sec, destination /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-98c78d9a-133c-442a-a8f6-472946b0d0ee {{(pid=89182) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 31 12:31:04 devstack cinder-volume[89182]: INFO cinder.image.image_utils [None req-c6886ed8-c591-4058-9515-113097630912 tempest-VolumesExtendTest-1157568027 None] Converted 112.00 MB image at 60.65 MB/s Jul 31 12:31:04 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-c6886ed8-c591-4058-9515-113097630912 tempest-VolumesExtendTest-1157568027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-98c78d9a-133c-442a-a8f6-472946b0d0ee 1G {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:31:04 devstack sudo[106592]: pam_unix(sudo:session): session closed for user root Jul 31 12:31:04 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-83291511-7911-4a24-a4e2-a5389fea2391 tempest-VolumesCloneTest-259757594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-1c17ca16-8703-42fc-9ddb-ad1109315a82,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-1c17ca16-8703-42fc-9ddb-ad1109315a82.8fa011da-3f07-4c5c-8475-29ec1e80ab83 1G" returned: 0 in 0.459s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:31:04 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-83291511-7911-4a24-a4e2-a5389fea2391 tempest-VolumesCloneTest-259757594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1c17ca16-8703-42fc-9ddb-ad1109315a82 -F qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-1c17ca16-8703-42fc-9ddb-ad1109315a82.8fa011da-3f07-4c5c-8475-29ec1e80ab83 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:31:04 devstack sudo[106598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-98c78d9a-133c-442a-a8f6-472946b0d0ee 1G Jul 31 12:31:04 devstack sudo[106598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:31:04 devstack sudo[106599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1c17ca16-8703-42fc-9ddb-ad1109315a82 -F qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-1c17ca16-8703-42fc-9ddb-ad1109315a82.8fa011da-3f07-4c5c-8475-29ec1e80ab83 Jul 31 12:31:04 devstack sudo[106599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:31:04 devstack sudo[106599]: pam_unix(sudo:session): session closed for user root Jul 31 12:31:04 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-83291511-7911-4a24-a4e2-a5389fea2391 tempest-VolumesCloneTest-259757594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1c17ca16-8703-42fc-9ddb-ad1109315a82 -F qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-1c17ca16-8703-42fc-9ddb-ad1109315a82.8fa011da-3f07-4c5c-8475-29ec1e80ab83" returned: 0 in 0.283s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:31:04 devstack cinder-volume[89182]: WARNING cinder.volume.drivers.remotefs [None req-83291511-7911-4a24-a4e2-a5389fea2391 tempest-VolumesCloneTest-259757594 None] /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-1c17ca16-8703-42fc-9ddb-ad1109315a82.8fa011da-3f07-4c5c-8475-29ec1e80ab83 is being set with open permissions: ugo+rw Jul 31 12:31:04 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-83291511-7911-4a24-a4e2-a5389fea2391 tempest-VolumesCloneTest-259757594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-1c17ca16-8703-42fc-9ddb-ad1109315a82.8fa011da-3f07-4c5c-8475-29ec1e80ab83 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:31:04 devstack sudo[106598]: pam_unix(sudo:session): session closed for user root Jul 31 12:31:04 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-c6886ed8-c591-4058-9515-113097630912 tempest-VolumesExtendTest-1157568027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-98c78d9a-133c-442a-a8f6-472946b0d0ee 1G" returned: 0 in 0.315s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:31:04 devstack cinder-volume[89182]: DEBUG cinder.volume.volume_utils [None req-c6886ed8-c591-4058-9515-113097630912 tempest-VolumesExtendTest-1157568027 None] Downloaded image 4cbd0fd2-77a8-43ca-bc93-b0249d6daea0 ((None, [{'url': 'file:///opt/stack/data/glance/images/4cbd0fd2-77a8-43ca-bc93-b0249d6daea0', 'metadata': {}}])) to volume 98c78d9a-133c-442a-a8f6-472946b0d0ee successfully. {{(pid=89182) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 31 12:31:04 devstack cinder-volume[89182]: DEBUG cinder.image.image_utils [None req-c6886ed8-c591-4058-9515-113097630912 tempest-VolumesExtendTest-1157568027 None] Temporary image 4cbd0fd2-77a8-43ca-bc93-b0249d6daea0 for user b6e5fb63ba30434eb41a770ba1c207ae is deleted. {{(pid=89182) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 31 12:31:04 devstack cinder-volume[89182]: DEBUG cinder.volume.volume_utils [None req-c6886ed8-c591-4058-9515-113097630912 tempest-VolumesExtendTest-1157568027 None] Marking volume 98c78d9a-133c-442a-a8f6-472946b0d0ee as bootable. {{(pid=89182) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 31 12:31:04 devstack sudo[106608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-1c17ca16-8703-42fc-9ddb-ad1109315a82.8fa011da-3f07-4c5c-8475-29ec1e80ab83 Jul 31 12:31:04 devstack sudo[106608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:31:04 devstack cinder-volume[89182]: DEBUG cinder.volume.flows.manager.create_volume [None req-c6886ed8-c591-4058-9515-113097630912 tempest-VolumesExtendTest-1157568027 None] Copying metadata from image 4cbd0fd2-77a8-43ca-bc93-b0249d6daea0 to 98c78d9a-133c-442a-a8f6-472946b0d0ee. {{(pid=89182) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 31 12:31:04 devstack cinder-volume[89182]: DEBUG cinder.volume.flows.manager.create_volume [None req-c6886ed8-c591-4058-9515-113097630912 tempest-VolumesExtendTest-1157568027 None] Creating volume glance metadata for volume 98c78d9a-133c-442a-a8f6-472946b0d0ee backed by image 4cbd0fd2-77a8-43ca-bc93-b0249d6daea0 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '4cbd0fd2-77a8-43ca-bc93-b0249d6daea0', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=89182) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 31 12:31:05 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-c6886ed8-c591-4058-9515-113097630912 tempest-VolumesExtendTest-1157568027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (209fd272-9097-4616-97d2-46d9badbbddc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-98c78d9a-133c-442a-a8f6-472946b0d0ee', 'volume_size': 1, 'image_id': '4cbd0fd2-77a8-43ca-bc93-b0249d6daea0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4cbd0fd2-77a8-43ca-bc93-b0249d6daea0', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3f77cb0dad9a46948c9357c65b22aef5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4cbd0fd2-77a8-43ca-bc93-b0249d6daea0', 'created_at': datetime.datetime(2026, 7, 31, 10, 8, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 31, 10, 8, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4cbd0fd2-77a8-43ca-bc93-b0249d6daea0/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:31:05 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-c6886ed8-c591-4058-9515-113097630912 tempest-VolumesExtendTest-1157568027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa87988b-42e6-440e-8be7-f4e0a8e23855) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:31:05 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-c6886ed8-c591-4058-9515-113097630912 tempest-VolumesExtendTest-1157568027 None] Volume volume-98c78d9a-133c-442a-a8f6-472946b0d0ee (98c78d9a-133c-442a-a8f6-472946b0d0ee): created successfully Jul 31 12:31:05 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-c6886ed8-c591-4058-9515-113097630912 tempest-VolumesExtendTest-1157568027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa87988b-42e6-440e-8be7-f4e0a8e23855) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:31:05 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-c6886ed8-c591-4058-9515-113097630912 tempest-VolumesExtendTest-1157568027 None] Flow 'volume_create_manager' (309d6bb5-1c29-4a8c-a42d-583a83dcf15b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:31:05 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-c6886ed8-c591-4058-9515-113097630912 tempest-VolumesExtendTest-1157568027 None] Created volume successfully. Jul 31 12:31:05 devstack sudo[106608]: pam_unix(sudo:session): session closed for user root Jul 31 12:31:05 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-83291511-7911-4a24-a4e2-a5389fea2391 tempest-VolumesCloneTest-259757594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-1c17ca16-8703-42fc-9ddb-ad1109315a82.8fa011da-3f07-4c5c-8475-29ec1e80ab83" returned: 0 in 0.256s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:31:05 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-83291511-7911-4a24-a4e2-a5389fea2391 tempest-VolumesCloneTest-259757594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-1c17ca16-8703-42fc-9ddb-ad1109315a82.info {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:31:05 devstack sudo[106611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-1c17ca16-8703-42fc-9ddb-ad1109315a82.info Jul 31 12:31:05 devstack sudo[106611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:31:05 devstack sudo[106611]: pam_unix(sudo:session): session closed for user root Jul 31 12:31:05 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-83291511-7911-4a24-a4e2-a5389fea2391 tempest-VolumesCloneTest-259757594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-1c17ca16-8703-42fc-9ddb-ad1109315a82.info" returned: 0 in 0.243s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:31:05 devstack cinder-volume[89182]: WARNING cinder.volume.drivers.remotefs [None req-83291511-7911-4a24-a4e2-a5389fea2391 tempest-VolumesCloneTest-259757594 None] /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-1c17ca16-8703-42fc-9ddb-ad1109315a82.info is being set with open permissions: ugo+rw Jul 31 12:31:05 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-83291511-7911-4a24-a4e2-a5389fea2391 tempest-VolumesCloneTest-259757594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-1c17ca16-8703-42fc-9ddb-ad1109315a82.info {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:31:05 devstack sudo[106614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-1c17ca16-8703-42fc-9ddb-ad1109315a82.info Jul 31 12:31:05 devstack sudo[106614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:31:05 devstack sudo[106614]: pam_unix(sudo:session): session closed for user root Jul 31 12:31:05 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-83291511-7911-4a24-a4e2-a5389fea2391 tempest-VolumesCloneTest-259757594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-1c17ca16-8703-42fc-9ddb-ad1109315a82.info" returned: 0 in 0.246s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:31:05 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-83291511-7911-4a24-a4e2-a5389fea2391 tempest-VolumesCloneTest-259757594 None] Acquiring lock "cinder-quobyte-7a96fa0b-69b1-4269-a771-1135fca9ecca" by "_copy_volume_from_snapshot" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:31:05 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-83291511-7911-4a24-a4e2-a5389fea2391 tempest-VolumesCloneTest-259757594 None] Lock "cinder-quobyte-7a96fa0b-69b1-4269-a771-1135fca9ecca" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:31:05 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-83291511-7911-4a24-a4e2-a5389fea2391 tempest-VolumesCloneTest-259757594 None] snapshot: 8fa011da-3f07-4c5c-8475-29ec1e80ab83, volume: 7a96fa0b-69b1-4269-a771-1135fca9ecca, {{(pid=89182) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Jul 31 12:31:05 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-83291511-7911-4a24-a4e2-a5389fea2391 tempest-VolumesCloneTest-259757594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:31:05 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-83291511-7911-4a24-a4e2-a5389fea2391 tempest-VolumesCloneTest-259757594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:31:05 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-83291511-7911-4a24-a4e2-a5389fea2391 tempest-VolumesCloneTest-259757594 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:31:05 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-83291511-7911-4a24-a4e2-a5389fea2391 tempest-VolumesCloneTest-259757594 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:31:05 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-83291511-7911-4a24-a4e2-a5389fea2391 tempest-VolumesCloneTest-259757594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:31:05 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-639009d6-450b-4324-a5cf-f4d95370015b tempest-VolumesExtendTest-1157568027 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:31:05 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4529e54-b1ee-4aa1-83ad-dab03c6e7736]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:31:05 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-83291511-7911-4a24-a4e2-a5389fea2391 tempest-VolumesCloneTest-259757594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-1c17ca16-8703-42fc-9ddb-ad1109315a82.8fa011da-3f07-4c5c-8475-29ec1e80ab83 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:31:05 devstack sudo[106617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-1c17ca16-8703-42fc-9ddb-ad1109315a82.8fa011da-3f07-4c5c-8475-29ec1e80ab83 Jul 31 12:31:05 devstack sudo[106617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:31:06 devstack sudo[106617]: pam_unix(sudo:session): session closed for user root Jul 31 12:31:06 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-83291511-7911-4a24-a4e2-a5389fea2391 tempest-VolumesCloneTest-259757594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-1c17ca16-8703-42fc-9ddb-ad1109315a82.8fa011da-3f07-4c5c-8475-29ec1e80ab83" returned: 0 in 0.351s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:31:06 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-83291511-7911-4a24-a4e2-a5389fea2391 tempest-VolumesCloneTest-259757594 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1c17ca16-8703-42fc-9ddb-ad1109315a82(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89182) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 12:31:06 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c6f9d73-e425-4da9-8c5c-83ebc31fa53e]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:31:06 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-83291511-7911-4a24-a4e2-a5389fea2391 tempest-VolumesCloneTest-259757594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-1c17ca16-8703-42fc-9ddb-ad1109315a82 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:31:06 devstack sudo[106624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-1c17ca16-8703-42fc-9ddb-ad1109315a82 Jul 31 12:31:06 devstack sudo[106624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:31:06 devstack sudo[106624]: pam_unix(sudo:session): session closed for user root Jul 31 12:31:06 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-83291511-7911-4a24-a4e2-a5389fea2391 tempest-VolumesCloneTest-259757594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-1c17ca16-8703-42fc-9ddb-ad1109315a82" returned: 0 in 0.349s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:31:06 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-83291511-7911-4a24-a4e2-a5389fea2391 tempest-VolumesCloneTest-259757594 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-1c17ca16-8703-42fc-9ddb-ad1109315a82 {{(pid=89182) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Jul 31 12:31:06 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-83291511-7911-4a24-a4e2-a5389fea2391 tempest-VolumesCloneTest-259757594 None] Creating direct copy from snapshot {{(pid=89182) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Jul 31 12:31:06 devstack cinder-volume[89182]: DEBUG cinder.utils [None req-83291511-7911-4a24-a4e2-a5389fea2391 tempest-VolumesCloneTest-259757594 None] Path /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-7a96fa0b-69b1-4269-a771-1135fca9ecca not found in is_blk_device check {{(pid=89182) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 31 12:31:06 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-83291511-7911-4a24-a4e2-a5389fea2391 tempest-VolumesCloneTest-259757594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-1c17ca16-8703-42fc-9ddb-ad1109315a82 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-7a96fa0b-69b1-4269-a771-1135fca9ecca {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:31:06 devstack sudo[106629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-1c17ca16-8703-42fc-9ddb-ad1109315a82 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-7a96fa0b-69b1-4269-a771-1135fca9ecca Jul 31 12:31:06 devstack sudo[106629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:31:10 devstack sudo[106629]: pam_unix(sudo:session): session closed for user root Jul 31 12:31:10 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-83291511-7911-4a24-a4e2-a5389fea2391 tempest-VolumesCloneTest-259757594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-1c17ca16-8703-42fc-9ddb-ad1109315a82 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-7a96fa0b-69b1-4269-a771-1135fca9ecca" returned: 0 in 4.126s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:31:10 devstack cinder-volume[89182]: DEBUG cinder.image.image_utils [None req-83291511-7911-4a24-a4e2-a5389fea2391 tempest-VolumesCloneTest-259757594 None] Image conversion details: src /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-1c17ca16-8703-42fc-9ddb-ad1109315a82, size 1024.00 MB, duration 4.13 sec, destination /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-7a96fa0b-69b1-4269-a771-1135fca9ecca {{(pid=89182) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 31 12:31:10 devstack cinder-volume[89182]: INFO cinder.image.image_utils [None req-83291511-7911-4a24-a4e2-a5389fea2391 tempest-VolumesCloneTest-259757594 None] Converted 1024.00 MB image at 248.13 MB/s Jul 31 12:31:10 devstack cinder-volume[89182]: WARNING cinder.volume.drivers.remotefs [None req-83291511-7911-4a24-a4e2-a5389fea2391 tempest-VolumesCloneTest-259757594 None] /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-7a96fa0b-69b1-4269-a771-1135fca9ecca is being set with open permissions: ugo+rw Jul 31 12:31:10 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-83291511-7911-4a24-a4e2-a5389fea2391 tempest-VolumesCloneTest-259757594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-7a96fa0b-69b1-4269-a771-1135fca9ecca {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:31:10 devstack sudo[106643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-7a96fa0b-69b1-4269-a771-1135fca9ecca Jul 31 12:31:10 devstack sudo[106643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:31:10 devstack sudo[106643]: pam_unix(sudo:session): session closed for user root Jul 31 12:31:10 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-83291511-7911-4a24-a4e2-a5389fea2391 tempest-VolumesCloneTest-259757594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-7a96fa0b-69b1-4269-a771-1135fca9ecca" returned: 0 in 0.244s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:31:10 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-83291511-7911-4a24-a4e2-a5389fea2391 tempest-VolumesCloneTest-259757594 None] Lock "cinder-quobyte-7a96fa0b-69b1-4269-a771-1135fca9ecca" released by "_copy_volume_from_snapshot" :: held 5.156s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:31:10 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-83291511-7911-4a24-a4e2-a5389fea2391 tempest-VolumesCloneTest-259757594 None] Acquiring lock "cinder-quobyte-8fa011da-3f07-4c5c-8475-29ec1e80ab83" by "_delete_snapshot" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:31:10 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-83291511-7911-4a24-a4e2-a5389fea2391 tempest-VolumesCloneTest-259757594 None] Lock "cinder-quobyte-8fa011da-3f07-4c5c-8475-29ec1e80ab83" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:31:10 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-83291511-7911-4a24-a4e2-a5389fea2391 tempest-VolumesCloneTest-259757594 None] Deleting offline snapshot 8fa011da-3f07-4c5c-8475-29ec1e80ab83 of volume 1c17ca16-8703-42fc-9ddb-ad1109315a82 {{(pid=89182) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 31 12:31:10 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-83291511-7911-4a24-a4e2-a5389fea2391 tempest-VolumesCloneTest-259757594 None] snapshot_file for this snap is: volume-1c17ca16-8703-42fc-9ddb-ad1109315a82.8fa011da-3f07-4c5c-8475-29ec1e80ab83 {{(pid=89182) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 31 12:31:10 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab40f815-c40a-4620-af5b-410950c943f0]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:31:10 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-83291511-7911-4a24-a4e2-a5389fea2391 tempest-VolumesCloneTest-259757594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-1c17ca16-8703-42fc-9ddb-ad1109315a82.8fa011da-3f07-4c5c-8475-29ec1e80ab83 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:31:11 devstack sudo[106646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-1c17ca16-8703-42fc-9ddb-ad1109315a82.8fa011da-3f07-4c5c-8475-29ec1e80ab83 Jul 31 12:31:11 devstack sudo[106646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:31:11 devstack sudo[106646]: pam_unix(sudo:session): session closed for user root Jul 31 12:31:11 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-83291511-7911-4a24-a4e2-a5389fea2391 tempest-VolumesCloneTest-259757594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-1c17ca16-8703-42fc-9ddb-ad1109315a82.8fa011da-3f07-4c5c-8475-29ec1e80ab83" returned: 0 in 0.351s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:31:11 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-83291511-7911-4a24-a4e2-a5389fea2391 tempest-VolumesCloneTest-259757594 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1c17ca16-8703-42fc-9ddb-ad1109315a82(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89182) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 12:31:11 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[d28f9599-0a97-40e6-b45f-58e041d0e1fc]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:31:11 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-83291511-7911-4a24-a4e2-a5389fea2391 tempest-VolumesCloneTest-259757594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-1c17ca16-8703-42fc-9ddb-ad1109315a82 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:31:11 devstack sudo[106651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-1c17ca16-8703-42fc-9ddb-ad1109315a82 Jul 31 12:31:11 devstack sudo[106651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:31:11 devstack sudo[106651]: pam_unix(sudo:session): session closed for user root Jul 31 12:31:11 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-83291511-7911-4a24-a4e2-a5389fea2391 tempest-VolumesCloneTest-259757594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-1c17ca16-8703-42fc-9ddb-ad1109315a82" returned: 0 in 0.554s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:31:11 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-83291511-7911-4a24-a4e2-a5389fea2391 tempest-VolumesCloneTest-259757594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-1c17ca16-8703-42fc-9ddb-ad1109315a82.8fa011da-3f07-4c5c-8475-29ec1e80ab83 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:31:11 devstack sudo[106657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-1c17ca16-8703-42fc-9ddb-ad1109315a82.8fa011da-3f07-4c5c-8475-29ec1e80ab83 Jul 31 12:31:11 devstack sudo[106657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:31:12 devstack sudo[106657]: pam_unix(sudo:session): session closed for user root Jul 31 12:31:12 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-83291511-7911-4a24-a4e2-a5389fea2391 tempest-VolumesCloneTest-259757594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-1c17ca16-8703-42fc-9ddb-ad1109315a82.8fa011da-3f07-4c5c-8475-29ec1e80ab83" returned: 0 in 0.333s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:31:12 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-83291511-7911-4a24-a4e2-a5389fea2391 tempest-VolumesCloneTest-259757594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-1c17ca16-8703-42fc-9ddb-ad1109315a82.8fa011da-3f07-4c5c-8475-29ec1e80ab83 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:31:12 devstack sudo[106663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-1c17ca16-8703-42fc-9ddb-ad1109315a82.8fa011da-3f07-4c5c-8475-29ec1e80ab83 Jul 31 12:31:12 devstack sudo[106663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:31:12 devstack sudo[106663]: pam_unix(sudo:session): session closed for user root Jul 31 12:31:12 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-83291511-7911-4a24-a4e2-a5389fea2391 tempest-VolumesCloneTest-259757594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-1c17ca16-8703-42fc-9ddb-ad1109315a82.8fa011da-3f07-4c5c-8475-29ec1e80ab83" returned: 0 in 0.242s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:31:12 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-83291511-7911-4a24-a4e2-a5389fea2391 tempest-VolumesCloneTest-259757594 None] Lock "cinder-quobyte-8fa011da-3f07-4c5c-8475-29ec1e80ab83" released by "_delete_snapshot" :: held 1.570s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:31:12 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-83291511-7911-4a24-a4e2-a5389fea2391 tempest-VolumesCloneTest-259757594 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 8.943s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:31:12 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-93a68ef3-545c-4cec-b5b5-7b4671d30b23 tempest-SnapshotDataIntegrityTests-113348013 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 8.477s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:31:12 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-93a68ef3-545c-4cec-b5b5-7b4671d30b23 tempest-SnapshotDataIntegrityTests-113348013 None] Acquiring lock "cinder-quobyte-b8369f85-c94c-4c5c-9b7e-1f6060bee802-52b3dce3-91b8-4da0-99fe-4c0919ab8b11" by "_create_volume_from_snapshot" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:31:12 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-83291511-7911-4a24-a4e2-a5389fea2391 tempest-VolumesCloneTest-259757594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9daab79a-c7fb-4e08-9bc5-726c811a03a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7a96fa0b-69b1-4269-a771-1135fca9ecca', 'volume_size': 2, 'source_volid': '1c17ca16-8703-42fc-9ddb-ad1109315a82', 'source_volstatus': 'available'}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:31:12 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-83291511-7911-4a24-a4e2-a5389fea2391 tempest-VolumesCloneTest-259757594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b8e48aa-96da-43ab-8d94-68d6c27e0884) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:31:12 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-93a68ef3-545c-4cec-b5b5-7b4671d30b23 tempest-SnapshotDataIntegrityTests-113348013 None] Lock "cinder-quobyte-b8369f85-c94c-4c5c-9b7e-1f6060bee802-52b3dce3-91b8-4da0-99fe-4c0919ab8b11" acquired by "_create_volume_from_snapshot" :: waited 0.037s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:31:12 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-93a68ef3-545c-4cec-b5b5-7b4671d30b23 tempest-SnapshotDataIntegrityTests-113348013 None] Creating volume 52b3dce3-91b8-4da0-99fe-4c0919ab8b11 from snapshot b8369f85-c94c-4c5c-9b7e-1f6060bee802 {{(pid=89182) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 31 12:31:12 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-93a68ef3-545c-4cec-b5b5-7b4671d30b23 tempest-SnapshotDataIntegrityTests-113348013 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:31:12 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-93a68ef3-545c-4cec-b5b5-7b4671d30b23 tempest-SnapshotDataIntegrityTests-113348013 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:31:12 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-93a68ef3-545c-4cec-b5b5-7b4671d30b23 tempest-SnapshotDataIntegrityTests-113348013 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:31:12 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-93a68ef3-545c-4cec-b5b5-7b4671d30b23 tempest-SnapshotDataIntegrityTests-113348013 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:31:12 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-93a68ef3-545c-4cec-b5b5-7b4671d30b23 tempest-SnapshotDataIntegrityTests-113348013 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:31:12 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-93a68ef3-545c-4cec-b5b5-7b4671d30b23 tempest-SnapshotDataIntegrityTests-113348013 None] Selected osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 as target Quobyte volume. {{(pid=89182) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 12:31:12 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-93a68ef3-545c-4cec-b5b5-7b4671d30b23 tempest-SnapshotDataIntegrityTests-113348013 None] Acquiring lock "cinder-quobyte-52b3dce3-91b8-4da0-99fe-4c0919ab8b11" by "_copy_volume_from_snapshot" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:31:12 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-83291511-7911-4a24-a4e2-a5389fea2391 tempest-VolumesCloneTest-259757594 None] Volume volume-7a96fa0b-69b1-4269-a771-1135fca9ecca (7a96fa0b-69b1-4269-a771-1135fca9ecca): created successfully Jul 31 12:31:12 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-83291511-7911-4a24-a4e2-a5389fea2391 tempest-VolumesCloneTest-259757594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b8e48aa-96da-43ab-8d94-68d6c27e0884) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:31:12 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-83291511-7911-4a24-a4e2-a5389fea2391 tempest-VolumesCloneTest-259757594 None] Flow 'volume_create_manager' (d30cacf4-5239-4067-ab3a-e993d5731492) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:31:12 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-93a68ef3-545c-4cec-b5b5-7b4671d30b23 tempest-SnapshotDataIntegrityTests-113348013 None] Lock "cinder-quobyte-52b3dce3-91b8-4da0-99fe-4c0919ab8b11" acquired by "_copy_volume_from_snapshot" :: waited 0.023s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:31:12 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-93a68ef3-545c-4cec-b5b5-7b4671d30b23 tempest-SnapshotDataIntegrityTests-113348013 None] snapshot: b8369f85-c94c-4c5c-9b7e-1f6060bee802, volume: 52b3dce3-91b8-4da0-99fe-4c0919ab8b11, {{(pid=89182) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Jul 31 12:31:12 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-93a68ef3-545c-4cec-b5b5-7b4671d30b23 tempest-SnapshotDataIntegrityTests-113348013 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:31:12 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-93a68ef3-545c-4cec-b5b5-7b4671d30b23 tempest-SnapshotDataIntegrityTests-113348013 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:31:12 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-93a68ef3-545c-4cec-b5b5-7b4671d30b23 tempest-SnapshotDataIntegrityTests-113348013 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:31:12 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-93a68ef3-545c-4cec-b5b5-7b4671d30b23 tempest-SnapshotDataIntegrityTests-113348013 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:31:12 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-93a68ef3-545c-4cec-b5b5-7b4671d30b23 tempest-SnapshotDataIntegrityTests-113348013 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:31:12 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-83291511-7911-4a24-a4e2-a5389fea2391 tempest-VolumesCloneTest-259757594 None] Created volume successfully. Jul 31 12:31:12 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[4856c8ea-fe38-45d2-b8c3-b5c8e789827a]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:31:12 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-93a68ef3-545c-4cec-b5b5-7b4671d30b23 tempest-SnapshotDataIntegrityTests-113348013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-8ef75942-d7b9-4102-a4ca-651a1de7d88a.b8369f85-c94c-4c5c-9b7e-1f6060bee802 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:31:12 devstack sudo[106666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-8ef75942-d7b9-4102-a4ca-651a1de7d88a.b8369f85-c94c-4c5c-9b7e-1f6060bee802 Jul 31 12:31:12 devstack sudo[106666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:31:12 devstack sudo[106666]: pam_unix(sudo:session): session closed for user root Jul 31 12:31:13 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-93a68ef3-545c-4cec-b5b5-7b4671d30b23 tempest-SnapshotDataIntegrityTests-113348013 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-8ef75942-d7b9-4102-a4ca-651a1de7d88a.b8369f85-c94c-4c5c-9b7e-1f6060bee802" returned: 0 in 0.366s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:31:13 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-93a68ef3-545c-4cec-b5b5-7b4671d30b23 tempest-SnapshotDataIntegrityTests-113348013 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8ef75942-d7b9-4102-a4ca-651a1de7d88a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89182) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 12:31:13 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae2487fe-6acf-46a6-9c2a-0f1dea8f19ae]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:31:13 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-93a68ef3-545c-4cec-b5b5-7b4671d30b23 tempest-SnapshotDataIntegrityTests-113348013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-8ef75942-d7b9-4102-a4ca-651a1de7d88a {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:31:13 devstack sudo[106671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-8ef75942-d7b9-4102-a4ca-651a1de7d88a Jul 31 12:31:13 devstack sudo[106671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:31:13 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-36eae04a-f5f5-4347-9471-ee97e2600c82 tempest-VolumesCloneTest-259757594 None] Acquiring lock "cinder-7a96fa0b-69b1-4269-a771-1135fca9ecca-delete_volume" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:31:13 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-36eae04a-f5f5-4347-9471-ee97e2600c82 tempest-VolumesCloneTest-259757594 None] Lock "cinder-7a96fa0b-69b1-4269-a771-1135fca9ecca-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:31:13 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-36eae04a-f5f5-4347-9471-ee97e2600c82 tempest-VolumesCloneTest-259757594 None] Acquiring lock "cinder-quobyte-7a96fa0b-69b1-4269-a771-1135fca9ecca" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:31:13 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-36eae04a-f5f5-4347-9471-ee97e2600c82 tempest-VolumesCloneTest-259757594 None] Lock "cinder-quobyte-7a96fa0b-69b1-4269-a771-1135fca9ecca" acquired by "delete_volume" :: waited 0.018s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:31:13 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[b45d7fcf-5aad-458f-a9d5-7de1c67abfcd]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:31:13 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-36eae04a-f5f5-4347-9471-ee97e2600c82 tempest-VolumesCloneTest-259757594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-7a96fa0b-69b1-4269-a771-1135fca9ecca {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:31:13 devstack sudo[106671]: pam_unix(sudo:session): session closed for user root Jul 31 12:31:13 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-93a68ef3-545c-4cec-b5b5-7b4671d30b23 tempest-SnapshotDataIntegrityTests-113348013 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-8ef75942-d7b9-4102-a4ca-651a1de7d88a" returned: 0 in 0.393s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:31:13 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-93a68ef3-545c-4cec-b5b5-7b4671d30b23 tempest-SnapshotDataIntegrityTests-113348013 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-8ef75942-d7b9-4102-a4ca-651a1de7d88a {{(pid=89182) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Jul 31 12:31:13 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-93a68ef3-545c-4cec-b5b5-7b4671d30b23 tempest-SnapshotDataIntegrityTests-113348013 None] Creating direct copy from snapshot {{(pid=89182) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Jul 31 12:31:13 devstack sudo[106673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-7a96fa0b-69b1-4269-a771-1135fca9ecca Jul 31 12:31:13 devstack sudo[106673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:31:13 devstack cinder-volume[89182]: DEBUG cinder.utils [None req-93a68ef3-545c-4cec-b5b5-7b4671d30b23 tempest-SnapshotDataIntegrityTests-113348013 None] Path /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-52b3dce3-91b8-4da0-99fe-4c0919ab8b11 not found in is_blk_device check {{(pid=89182) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 31 12:31:13 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-93a68ef3-545c-4cec-b5b5-7b4671d30b23 tempest-SnapshotDataIntegrityTests-113348013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-8ef75942-d7b9-4102-a4ca-651a1de7d88a /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-52b3dce3-91b8-4da0-99fe-4c0919ab8b11 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:31:13 devstack sudo[106678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-8ef75942-d7b9-4102-a4ca-651a1de7d88a /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-52b3dce3-91b8-4da0-99fe-4c0919ab8b11 Jul 31 12:31:13 devstack sudo[106678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:31:13 devstack sudo[106673]: pam_unix(sudo:session): session closed for user root Jul 31 12:31:13 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-36eae04a-f5f5-4347-9471-ee97e2600c82 tempest-VolumesCloneTest-259757594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-7a96fa0b-69b1-4269-a771-1135fca9ecca" returned: 0 in 0.376s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:31:13 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-36eae04a-f5f5-4347-9471-ee97e2600c82 tempest-VolumesCloneTest-259757594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-7a96fa0b-69b1-4269-a771-1135fca9ecca {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:31:13 devstack sudo[106686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-7a96fa0b-69b1-4269-a771-1135fca9ecca Jul 31 12:31:13 devstack sudo[106686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:31:13 devstack sudo[106686]: pam_unix(sudo:session): session closed for user root Jul 31 12:31:13 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-36eae04a-f5f5-4347-9471-ee97e2600c82 tempest-VolumesCloneTest-259757594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-7a96fa0b-69b1-4269-a771-1135fca9ecca" returned: 0 in 0.276s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:31:13 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-36eae04a-f5f5-4347-9471-ee97e2600c82 tempest-VolumesCloneTest-259757594 None] Lock "cinder-quobyte-7a96fa0b-69b1-4269-a771-1135fca9ecca" released by "delete_volume" :: held 0.690s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:31:14 devstack cinder-volume[89182]: DEBUG cinder.quota [None req-36eae04a-f5f5-4347-9471-ee97e2600c82 tempest-VolumesCloneTest-259757594 None] Created reservations ['cf06580e-72ba-4677-945c-8376214723c8', '7c947940-7abc-4a60-a0eb-b9e5b218bdf3', 'ad82436e-8dd8-49db-ad62-bdd676c24788', 'bb95915e-dc5c-459b-a0ea-f8f9b674d107'] {{(pid=89182) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 12:31:14 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-36eae04a-f5f5-4347-9471-ee97e2600c82 tempest-VolumesCloneTest-259757594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:31:14 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-36eae04a-f5f5-4347-9471-ee97e2600c82 tempest-VolumesCloneTest-259757594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:31:14 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-36eae04a-f5f5-4347-9471-ee97e2600c82 tempest-VolumesCloneTest-259757594 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:31:14 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-36eae04a-f5f5-4347-9471-ee97e2600c82 tempest-VolumesCloneTest-259757594 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:31:14 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-36eae04a-f5f5-4347-9471-ee97e2600c82 tempest-VolumesCloneTest-259757594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:31:14 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-36eae04a-f5f5-4347-9471-ee97e2600c82 tempest-VolumesCloneTest-259757594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:31:14 devstack sudo[106697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 Jul 31 12:31:14 devstack sudo[106697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:31:14 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-e8f82db2-a145-458b-b853-65b9cf03d970 tempest-VolumesCloneTest-259757594 None] Acquiring lock "cinder-1c17ca16-8703-42fc-9ddb-ad1109315a82-delete_volume" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:31:14 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-e8f82db2-a145-458b-b853-65b9cf03d970 tempest-VolumesCloneTest-259757594 None] Lock "cinder-1c17ca16-8703-42fc-9ddb-ad1109315a82-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:31:14 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-e8f82db2-a145-458b-b853-65b9cf03d970 tempest-VolumesCloneTest-259757594 None] Acquiring lock "cinder-quobyte-1c17ca16-8703-42fc-9ddb-ad1109315a82" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:31:14 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-e8f82db2-a145-458b-b853-65b9cf03d970 tempest-VolumesCloneTest-259757594 None] Lock "cinder-quobyte-1c17ca16-8703-42fc-9ddb-ad1109315a82" acquired by "delete_volume" :: waited 0.036s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:31:14 devstack sudo[106697]: pam_unix(sudo:session): session closed for user root Jul 31 12:31:14 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-36eae04a-f5f5-4347-9471-ee97e2600c82 tempest-VolumesCloneTest-259757594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2" returned: 0 in 0.544s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:31:14 devstack cinder-volume[89182]: DEBUG cinder.manager [None req-36eae04a-f5f5-4347-9471-ee97e2600c82 tempest-VolumesCloneTest-259757594 None] Notifying Schedulers of capabilities ... {{(pid=89182) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 12:31:14 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-36eae04a-f5f5-4347-9471-ee97e2600c82 tempest-VolumesCloneTest-259757594 None] Deleted volume successfully. Jul 31 12:31:14 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[28f7223a-1b0c-4fac-81e7-61087c4a399f]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:31:14 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-e8f82db2-a145-458b-b853-65b9cf03d970 tempest-VolumesCloneTest-259757594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-1c17ca16-8703-42fc-9ddb-ad1109315a82 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:31:14 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-36eae04a-f5f5-4347-9471-ee97e2600c82 tempest-VolumesCloneTest-259757594 None] Lock "cinder-7a96fa0b-69b1-4269-a771-1135fca9ecca-delete_volume" released by "delete_volume" :: held 1.772s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:31:15 devstack sudo[106700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-1c17ca16-8703-42fc-9ddb-ad1109315a82 Jul 31 12:31:15 devstack sudo[106700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:31:15 devstack sudo[106700]: pam_unix(sudo:session): session closed for user root Jul 31 12:31:15 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-e8f82db2-a145-458b-b853-65b9cf03d970 tempest-VolumesCloneTest-259757594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-1c17ca16-8703-42fc-9ddb-ad1109315a82" returned: 0 in 0.996s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:31:15 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-e8f82db2-a145-458b-b853-65b9cf03d970 tempest-VolumesCloneTest-259757594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-1c17ca16-8703-42fc-9ddb-ad1109315a82 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:31:15 devstack sudo[106705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-1c17ca16-8703-42fc-9ddb-ad1109315a82 Jul 31 12:31:15 devstack sudo[106705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:31:16 devstack sudo[106705]: pam_unix(sudo:session): session closed for user root Jul 31 12:31:16 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-e8f82db2-a145-458b-b853-65b9cf03d970 tempest-VolumesCloneTest-259757594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-1c17ca16-8703-42fc-9ddb-ad1109315a82" returned: 0 in 0.577s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:31:16 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-e8f82db2-a145-458b-b853-65b9cf03d970 tempest-VolumesCloneTest-259757594 None] Lock "cinder-quobyte-1c17ca16-8703-42fc-9ddb-ad1109315a82" released by "delete_volume" :: held 1.715s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:31:16 devstack cinder-volume[89182]: DEBUG cinder.quota [None req-e8f82db2-a145-458b-b853-65b9cf03d970 tempest-VolumesCloneTest-259757594 None] Created reservations ['6c787474-a4b1-4c6e-8534-41acd4e42129', '902fe1cc-fb59-417e-a10f-14505ebdf89f', 'b2f0e80f-3e3c-44f1-aef6-bd4cb29139e0', '4ae8e740-8d20-455a-82a5-823e98b51435'] {{(pid=89182) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 12:31:16 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-e8f82db2-a145-458b-b853-65b9cf03d970 tempest-VolumesCloneTest-259757594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:31:16 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-e8f82db2-a145-458b-b853-65b9cf03d970 tempest-VolumesCloneTest-259757594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:31:16 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-e8f82db2-a145-458b-b853-65b9cf03d970 tempest-VolumesCloneTest-259757594 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:31:16 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-e8f82db2-a145-458b-b853-65b9cf03d970 tempest-VolumesCloneTest-259757594 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:31:16 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-e8f82db2-a145-458b-b853-65b9cf03d970 tempest-VolumesCloneTest-259757594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:31:16 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-e8f82db2-a145-458b-b853-65b9cf03d970 tempest-VolumesCloneTest-259757594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:31:16 devstack sudo[106709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 Jul 31 12:31:16 devstack sudo[106709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:31:17 devstack sudo[106709]: pam_unix(sudo:session): session closed for user root Jul 31 12:31:17 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-e8f82db2-a145-458b-b853-65b9cf03d970 tempest-VolumesCloneTest-259757594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2" returned: 0 in 0.560s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:31:17 devstack cinder-volume[89182]: DEBUG cinder.manager [None req-e8f82db2-a145-458b-b853-65b9cf03d970 tempest-VolumesCloneTest-259757594 None] Notifying Schedulers of capabilities ... {{(pid=89182) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 12:31:17 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-e8f82db2-a145-458b-b853-65b9cf03d970 tempest-VolumesCloneTest-259757594 None] Deleted volume successfully. Jul 31 12:31:17 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-e8f82db2-a145-458b-b853-65b9cf03d970 tempest-VolumesCloneTest-259757594 None] Lock "cinder-1c17ca16-8703-42fc-9ddb-ad1109315a82-delete_volume" released by "delete_volume" :: held 2.825s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:31:18 devstack sudo[106678]: pam_unix(sudo:session): session closed for user root Jul 31 12:31:18 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-93a68ef3-545c-4cec-b5b5-7b4671d30b23 tempest-SnapshotDataIntegrityTests-113348013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-8ef75942-d7b9-4102-a4ca-651a1de7d88a /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-52b3dce3-91b8-4da0-99fe-4c0919ab8b11" returned: 0 in 4.958s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:31:18 devstack cinder-volume[89182]: DEBUG cinder.image.image_utils [None req-93a68ef3-545c-4cec-b5b5-7b4671d30b23 tempest-SnapshotDataIntegrityTests-113348013 None] Image conversion details: src /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-8ef75942-d7b9-4102-a4ca-651a1de7d88a, size 1024.00 MB, duration 4.96 sec, destination /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-52b3dce3-91b8-4da0-99fe-4c0919ab8b11 {{(pid=89182) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 31 12:31:18 devstack cinder-volume[89182]: INFO cinder.image.image_utils [None req-93a68ef3-545c-4cec-b5b5-7b4671d30b23 tempest-SnapshotDataIntegrityTests-113348013 None] Converted 1024.00 MB image at 206.48 MB/s Jul 31 12:31:18 devstack cinder-volume[89182]: WARNING cinder.volume.drivers.remotefs [None req-93a68ef3-545c-4cec-b5b5-7b4671d30b23 tempest-SnapshotDataIntegrityTests-113348013 None] /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-52b3dce3-91b8-4da0-99fe-4c0919ab8b11 is being set with open permissions: ugo+rw Jul 31 12:31:18 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-93a68ef3-545c-4cec-b5b5-7b4671d30b23 tempest-SnapshotDataIntegrityTests-113348013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-52b3dce3-91b8-4da0-99fe-4c0919ab8b11 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:31:18 devstack sudo[106712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-52b3dce3-91b8-4da0-99fe-4c0919ab8b11 Jul 31 12:31:18 devstack sudo[106712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:31:18 devstack sudo[106712]: pam_unix(sudo:session): session closed for user root Jul 31 12:31:18 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-93a68ef3-545c-4cec-b5b5-7b4671d30b23 tempest-SnapshotDataIntegrityTests-113348013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-52b3dce3-91b8-4da0-99fe-4c0919ab8b11" returned: 0 in 0.264s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:31:18 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-93a68ef3-545c-4cec-b5b5-7b4671d30b23 tempest-SnapshotDataIntegrityTests-113348013 None] Lock "cinder-quobyte-52b3dce3-91b8-4da0-99fe-4c0919ab8b11" released by "_copy_volume_from_snapshot" :: held 6.065s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:31:18 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-93a68ef3-545c-4cec-b5b5-7b4671d30b23 tempest-SnapshotDataIntegrityTests-113348013 None] Lock "cinder-quobyte-b8369f85-c94c-4c5c-9b7e-1f6060bee802-52b3dce3-91b8-4da0-99fe-4c0919ab8b11" released by "_create_volume_from_snapshot" :: held 6.153s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:31:18 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-93a68ef3-545c-4cec-b5b5-7b4671d30b23 tempest-SnapshotDataIntegrityTests-113348013 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.193s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:31:18 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-639009d6-450b-4324-a5cf-f4d95370015b tempest-VolumesExtendTest-1157568027 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 12.951s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:31:18 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb7a9829-83ab-4e7c-91f5-1730d8c0b1a4]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:31:18 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-639009d6-450b-4324-a5cf-f4d95370015b tempest-VolumesExtendTest-1157568027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-98c78d9a-133c-442a-a8f6-472946b0d0ee {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:31:18 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-93a68ef3-545c-4cec-b5b5-7b4671d30b23 tempest-SnapshotDataIntegrityTests-113348013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a92df8a-6475-4d45-81f1-c00634ad8817) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-52b3dce3-91b8-4da0-99fe-4c0919ab8b11', 'volume_size': 1, 'snapshot_id': 'b8369f85-c94c-4c5c-9b7e-1f6060bee802'}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:31:18 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-93a68ef3-545c-4cec-b5b5-7b4671d30b23 tempest-SnapshotDataIntegrityTests-113348013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9952fe39-43b7-4f05-a99a-bb047f52fe72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:31:18 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-93a68ef3-545c-4cec-b5b5-7b4671d30b23 tempest-SnapshotDataIntegrityTests-113348013 None] Volume volume-52b3dce3-91b8-4da0-99fe-4c0919ab8b11 (52b3dce3-91b8-4da0-99fe-4c0919ab8b11): created successfully Jul 31 12:31:18 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-93a68ef3-545c-4cec-b5b5-7b4671d30b23 tempest-SnapshotDataIntegrityTests-113348013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9952fe39-43b7-4f05-a99a-bb047f52fe72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:31:18 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-93a68ef3-545c-4cec-b5b5-7b4671d30b23 tempest-SnapshotDataIntegrityTests-113348013 None] Flow 'volume_create_manager' (3ca1b24c-b5c4-49e8-ad7d-521b31693d24) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:31:18 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-93a68ef3-545c-4cec-b5b5-7b4671d30b23 tempest-SnapshotDataIntegrityTests-113348013 None] Created volume successfully. Jul 31 12:31:18 devstack sudo[106715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-98c78d9a-133c-442a-a8f6-472946b0d0ee Jul 31 12:31:18 devstack sudo[106715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:31:19 devstack sudo[106715]: pam_unix(sudo:session): session closed for user root Jul 31 12:31:19 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-639009d6-450b-4324-a5cf-f4d95370015b tempest-VolumesExtendTest-1157568027 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-98c78d9a-133c-442a-a8f6-472946b0d0ee" returned: 0 in 0.402s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:31:19 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-639009d6-450b-4324-a5cf-f4d95370015b tempest-VolumesExtendTest-1157568027 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-98c78d9a-133c-442a-a8f6-472946b0d0ee 2G {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:31:19 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-639009d6-450b-4324-a5cf-f4d95370015b tempest-VolumesExtendTest-1157568027 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-98c78d9a-133c-442a-a8f6-472946b0d0ee 2G" returned: 0 in 0.121s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:31:19 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-639009d6-450b-4324-a5cf-f4d95370015b tempest-VolumesExtendTest-1157568027 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.548s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:31:19 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-639009d6-450b-4324-a5cf-f4d95370015b tempest-VolumesExtendTest-1157568027 None] Extend volume completed successfully. Jul 31 12:31:20 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-b5d6c9bc-70c5-4a0c-8b62-03c8e8f85378 tempest-VolumesExtendTest-1157568027 None] Acquiring lock "cinder-98c78d9a-133c-442a-a8f6-472946b0d0ee-delete_volume" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:31:20 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-b5d6c9bc-70c5-4a0c-8b62-03c8e8f85378 tempest-VolumesExtendTest-1157568027 None] Lock "cinder-98c78d9a-133c-442a-a8f6-472946b0d0ee-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:31:20 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-b5d6c9bc-70c5-4a0c-8b62-03c8e8f85378 tempest-VolumesExtendTest-1157568027 None] Acquiring lock "cinder-quobyte-98c78d9a-133c-442a-a8f6-472946b0d0ee" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:31:20 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-b5d6c9bc-70c5-4a0c-8b62-03c8e8f85378 tempest-VolumesExtendTest-1157568027 None] Lock "cinder-quobyte-98c78d9a-133c-442a-a8f6-472946b0d0ee" acquired by "delete_volume" :: waited 0.028s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:31:20 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3c11365-107b-48bc-b000-1d526ad9df05]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:31:20 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-b5d6c9bc-70c5-4a0c-8b62-03c8e8f85378 tempest-VolumesExtendTest-1157568027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-98c78d9a-133c-442a-a8f6-472946b0d0ee {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:31:20 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [req-cf868bbc-a06f-46ce-904d-1ee92a947efd req-897356ba-b977-4794-937d-a1fb3f2e5db4 tempest-SnapshotDataIntegrityTests-113348013 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:31:20 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [req-cf868bbc-a06f-46ce-904d-1ee92a947efd req-897356ba-b977-4794-937d-a1fb3f2e5db4 tempest-SnapshotDataIntegrityTests-113348013 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:31:20 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [req-cf868bbc-a06f-46ce-904d-1ee92a947efd req-897356ba-b977-4794-937d-a1fb3f2e5db4 tempest-SnapshotDataIntegrityTests-113348013 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:31:20 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [req-cf868bbc-a06f-46ce-904d-1ee92a947efd req-897356ba-b977-4794-937d-a1fb3f2e5db4 tempest-SnapshotDataIntegrityTests-113348013 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88', 'name': 'volume-52b3dce3-91b8-4da0-99fe-4c0919ab8b11', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7682c1e1-9cce-46fc-bb94-b9b38d830d09', 'enforce_multipath': True} {{(pid=89182) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 31 12:31:20 devstack sudo[106738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-98c78d9a-133c-442a-a8f6-472946b0d0ee Jul 31 12:31:20 devstack sudo[106738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:31:20 devstack cinder-volume[89182]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce81fecf-311c-4c93-9a2f-6479fa8b1c5e tempest-VolumesNegativeTest-242317537 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89182) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 12:31:20 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-ce81fecf-311c-4c93-9a2f-6479fa8b1c5e tempest-VolumesNegativeTest-242317537 None] Flow 'volume_create_manager' (49c51da0-7676-49e5-a5ef-0d5772633516) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:31:20 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-ce81fecf-311c-4c93-9a2f-6479fa8b1c5e tempest-VolumesNegativeTest-242317537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8e3f882-3f39-41c6-bdf7-3b398423d461) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:31:20 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-ce81fecf-311c-4c93-9a2f-6479fa8b1c5e tempest-VolumesNegativeTest-242317537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8e3f882-3f39-41c6-bdf7-3b398423d461) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:31:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-906334505',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39c0d368-a821-44f5-a52e-7f1ce47177b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32b03e3f86a64970b28dc0f90cce57fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:31:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:31:21Z,use_quota=True,user_id='55628ab3f9c8448fb40aa365e41296c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:31:20 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-ce81fecf-311c-4c93-9a2f-6479fa8b1c5e tempest-VolumesNegativeTest-242317537 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a8333db-ca76-4746-8c8f-843f0fff1e64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:31:20 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-ce81fecf-311c-4c93-9a2f-6479fa8b1c5e tempest-VolumesNegativeTest-242317537 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a8333db-ca76-4746-8c8f-843f0fff1e64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:31:20 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-ce81fecf-311c-4c93-9a2f-6479fa8b1c5e tempest-VolumesNegativeTest-242317537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd0da132-b6d4-428e-aa95-ef7675f905d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:31:20 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-ce81fecf-311c-4c93-9a2f-6479fa8b1c5e tempest-VolumesNegativeTest-242317537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd0da132-b6d4-428e-aa95-ef7675f905d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '39c0d368-a821-44f5-a52e-7f1ce47177b4', 'volume_name': 'volume-39c0d368-a821-44f5-a52e-7f1ce47177b4', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:31:20 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-ce81fecf-311c-4c93-9a2f-6479fa8b1c5e tempest-VolumesNegativeTest-242317537 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (602d047b-74f6-42c2-8f8c-b0b27c065058) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:31:20 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-ce81fecf-311c-4c93-9a2f-6479fa8b1c5e tempest-VolumesNegativeTest-242317537 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (602d047b-74f6-42c2-8f8c-b0b27c065058) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:31:20 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-ce81fecf-311c-4c93-9a2f-6479fa8b1c5e tempest-VolumesNegativeTest-242317537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62d72e44-b5f9-4b04-9228-aaca1fdc8673) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:31:20 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-ce81fecf-311c-4c93-9a2f-6479fa8b1c5e tempest-VolumesNegativeTest-242317537 None] Volume 39c0d368-a821-44f5-a52e-7f1ce47177b4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-39c0d368-a821-44f5-a52e-7f1ce47177b4', 'volume_size': 1} Jul 31 12:31:20 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-ce81fecf-311c-4c93-9a2f-6479fa8b1c5e tempest-VolumesNegativeTest-242317537 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:31:20 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-ce81fecf-311c-4c93-9a2f-6479fa8b1c5e tempest-VolumesNegativeTest-242317537 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:31:20 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-ce81fecf-311c-4c93-9a2f-6479fa8b1c5e tempest-VolumesNegativeTest-242317537 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:31:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-906334505',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39c0d368-a821-44f5-a52e-7f1ce47177b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32b03e3f86a64970b28dc0f90cce57fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:31:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:31:21Z,use_quota=True,user_id='55628ab3f9c8448fb40aa365e41296c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)}" {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 12:31:20 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-ce81fecf-311c-4c93-9a2f-6479fa8b1c5e tempest-VolumesNegativeTest-242317537 None] Creating volume 39c0d368-a821-44f5-a52e-7f1ce47177b4 {{(pid=89182) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 12:31:20 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-ce81fecf-311c-4c93-9a2f-6479fa8b1c5e tempest-VolumesNegativeTest-242317537 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:31:20 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-ce81fecf-311c-4c93-9a2f-6479fa8b1c5e tempest-VolumesNegativeTest-242317537 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:31:20 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-ce81fecf-311c-4c93-9a2f-6479fa8b1c5e tempest-VolumesNegativeTest-242317537 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:31:20 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-ce81fecf-311c-4c93-9a2f-6479fa8b1c5e tempest-VolumesNegativeTest-242317537 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:31:20 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-ce81fecf-311c-4c93-9a2f-6479fa8b1c5e tempest-VolumesNegativeTest-242317537 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:31:20 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-ce81fecf-311c-4c93-9a2f-6479fa8b1c5e tempest-VolumesNegativeTest-242317537 None] Selected osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 as target Quobyte volume. {{(pid=89182) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 12:31:20 devstack cinder-volume[89182]: INFO cinder.volume.drivers.remotefs [None req-ce81fecf-311c-4c93-9a2f-6479fa8b1c5e tempest-VolumesNegativeTest-242317537 None] casted to osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 Jul 31 12:31:20 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-ce81fecf-311c-4c93-9a2f-6479fa8b1c5e tempest-VolumesNegativeTest-242317537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-39c0d368-a821-44f5-a52e-7f1ce47177b4 1073741824 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:31:20 devstack cinder-volume[89182]: INFO cinder.volume.manager [req-cf868bbc-a06f-46ce-904d-1ee92a947efd req-897356ba-b977-4794-937d-a1fb3f2e5db4 tempest-SnapshotDataIntegrityTests-113348013 None] attachment_update completed successfully. Jul 31 12:31:20 devstack sudo[106740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-39c0d368-a821-44f5-a52e-7f1ce47177b4 1073741824 Jul 31 12:31:20 devstack sudo[106740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:31:21 devstack sudo[106738]: pam_unix(sudo:session): session closed for user root Jul 31 12:31:21 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-b5d6c9bc-70c5-4a0c-8b62-03c8e8f85378 tempest-VolumesExtendTest-1157568027 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-98c78d9a-133c-442a-a8f6-472946b0d0ee" returned: 0 in 0.407s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:31:21 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-b5d6c9bc-70c5-4a0c-8b62-03c8e8f85378 tempest-VolumesExtendTest-1157568027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-98c78d9a-133c-442a-a8f6-472946b0d0ee {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:31:21 devstack sudo[106772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-98c78d9a-133c-442a-a8f6-472946b0d0ee Jul 31 12:31:21 devstack sudo[106772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:31:21 devstack sudo[106740]: pam_unix(sudo:session): session closed for user root Jul 31 12:31:21 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-ce81fecf-311c-4c93-9a2f-6479fa8b1c5e tempest-VolumesNegativeTest-242317537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-39c0d368-a821-44f5-a52e-7f1ce47177b4 1073741824" returned: 0 in 0.475s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:31:21 devstack sudo[106772]: pam_unix(sudo:session): session closed for user root Jul 31 12:31:21 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-b5d6c9bc-70c5-4a0c-8b62-03c8e8f85378 tempest-VolumesExtendTest-1157568027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-98c78d9a-133c-442a-a8f6-472946b0d0ee" returned: 0 in 0.322s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:31:21 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-ce81fecf-311c-4c93-9a2f-6479fa8b1c5e tempest-VolumesNegativeTest-242317537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-39c0d368-a821-44f5-a52e-7f1ce47177b4 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:31:21 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-b5d6c9bc-70c5-4a0c-8b62-03c8e8f85378 tempest-VolumesExtendTest-1157568027 None] Lock "cinder-quobyte-98c78d9a-133c-442a-a8f6-472946b0d0ee" released by "delete_volume" :: held 0.781s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:31:21 devstack sudo[107136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-39c0d368-a821-44f5-a52e-7f1ce47177b4 Jul 31 12:31:21 devstack sudo[107136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:31:21 devstack cinder-volume[89182]: DEBUG cinder.quota [None req-b5d6c9bc-70c5-4a0c-8b62-03c8e8f85378 tempest-VolumesExtendTest-1157568027 None] Created reservations ['0d227537-0b22-448b-b08a-5fe468e5f273', '9e156587-05a7-4a65-8a12-6424e31b6d9f', '21284d24-0d0d-4fe4-a7a1-6c6c483cb997', 'c4b0cd83-8532-4c79-a925-e28817027f36'] {{(pid=89182) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 12:31:21 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-b5d6c9bc-70c5-4a0c-8b62-03c8e8f85378 tempest-VolumesExtendTest-1157568027 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:31:21 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-b5d6c9bc-70c5-4a0c-8b62-03c8e8f85378 tempest-VolumesExtendTest-1157568027 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:31:21 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-b5d6c9bc-70c5-4a0c-8b62-03c8e8f85378 tempest-VolumesExtendTest-1157568027 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:31:21 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-b5d6c9bc-70c5-4a0c-8b62-03c8e8f85378 tempest-VolumesExtendTest-1157568027 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:31:21 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-b5d6c9bc-70c5-4a0c-8b62-03c8e8f85378 tempest-VolumesExtendTest-1157568027 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:31:21 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-b5d6c9bc-70c5-4a0c-8b62-03c8e8f85378 tempest-VolumesExtendTest-1157568027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:31:21 devstack sudo[107139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 Jul 31 12:31:21 devstack sudo[107139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:31:21 devstack sudo[107136]: pam_unix(sudo:session): session closed for user root Jul 31 12:31:21 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-ce81fecf-311c-4c93-9a2f-6479fa8b1c5e tempest-VolumesNegativeTest-242317537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-39c0d368-a821-44f5-a52e-7f1ce47177b4" returned: 0 in 0.381s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:31:21 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-ce81fecf-311c-4c93-9a2f-6479fa8b1c5e tempest-VolumesNegativeTest-242317537 None] <== create_volume: return (909ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'} {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 12:31:21 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-ce81fecf-311c-4c93-9a2f-6479fa8b1c5e tempest-VolumesNegativeTest-242317537 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.915s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:31:21 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-ce81fecf-311c-4c93-9a2f-6479fa8b1c5e tempest-VolumesNegativeTest-242317537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62d72e44-b5f9-4b04-9228-aaca1fdc8673) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-39c0d368-a821-44f5-a52e-7f1ce47177b4', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:31:21 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-ce81fecf-311c-4c93-9a2f-6479fa8b1c5e tempest-VolumesNegativeTest-242317537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa54df84-0d9f-4c14-93e2-16c66de3cd82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:31:21 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-ce81fecf-311c-4c93-9a2f-6479fa8b1c5e tempest-VolumesNegativeTest-242317537 None] Volume volume-39c0d368-a821-44f5-a52e-7f1ce47177b4 (39c0d368-a821-44f5-a52e-7f1ce47177b4): created successfully Jul 31 12:31:21 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-ce81fecf-311c-4c93-9a2f-6479fa8b1c5e tempest-VolumesNegativeTest-242317537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa54df84-0d9f-4c14-93e2-16c66de3cd82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:31:21 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-ce81fecf-311c-4c93-9a2f-6479fa8b1c5e tempest-VolumesNegativeTest-242317537 None] Flow 'volume_create_manager' (49c51da0-7676-49e5-a5ef-0d5772633516) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:31:21 devstack sudo[107139]: pam_unix(sudo:session): session closed for user root Jul 31 12:31:21 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-b5d6c9bc-70c5-4a0c-8b62-03c8e8f85378 tempest-VolumesExtendTest-1157568027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2" returned: 0 in 0.327s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:31:21 devstack cinder-volume[89182]: DEBUG cinder.manager [None req-b5d6c9bc-70c5-4a0c-8b62-03c8e8f85378 tempest-VolumesExtendTest-1157568027 None] Notifying Schedulers of capabilities ... {{(pid=89182) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 12:31:21 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-b5d6c9bc-70c5-4a0c-8b62-03c8e8f85378 tempest-VolumesExtendTest-1157568027 None] Deleted volume successfully. Jul 31 12:31:21 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-ce81fecf-311c-4c93-9a2f-6479fa8b1c5e tempest-VolumesNegativeTest-242317537 None] Created volume successfully. Jul 31 12:31:21 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-b5d6c9bc-70c5-4a0c-8b62-03c8e8f85378 tempest-VolumesExtendTest-1157568027 None] Lock "cinder-98c78d9a-133c-442a-a8f6-472946b0d0ee-delete_volume" released by "delete_volume" :: held 1.374s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:31:21 devstack cinder-volume[89182]: DEBUG oslo_service.periodic_task [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89182) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 31 12:31:21 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:31:21 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:31:21 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:31:21 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:31:21 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:31:21 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:31:22 devstack sudo[107144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 Jul 31 12:31:22 devstack sudo[107144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:31:22 devstack sudo[107144]: pam_unix(sudo:session): session closed for user root Jul 31 12:31:22 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2" returned: 0 in 0.259s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:31:22 devstack cinder-volume[89182]: DEBUG cinder.manager [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] Notifying Schedulers of capabilities ... {{(pid=89182) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 12:31:22 devstack cinder-volume[89182]: DEBUG oslo_service.periodic_task [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] Running periodic task VolumeManager._thread_info {{(pid=89182) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 31 12:31:22 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] thread count: 28 {{(pid=89182) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 31 12:31:22 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] thread info: [<_MainThread(MainThread, started 136154603720832)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=89182) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 31 12:31:22 devstack cinder-volume[89182]: DEBUG cinder.volume.flows.manager.create_volume [None req-6efc61ed-5809-452d-b585-e88cd1296419 tempest-VolumesExtendTest-1157568027 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89182) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 12:31:22 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-6efc61ed-5809-452d-b585-e88cd1296419 tempest-VolumesExtendTest-1157568027 None] Flow 'volume_create_manager' (6f9d0842-6fe2-4b1d-87a3-9ec88c4f82ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:31:22 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-6efc61ed-5809-452d-b585-e88cd1296419 tempest-VolumesExtendTest-1157568027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f66fa27-3abc-4272-a878-b09f8e062bd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:31:22 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-6efc61ed-5809-452d-b585-e88cd1296419 tempest-VolumesExtendTest-1157568027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f66fa27-3abc-4272-a878-b09f8e062bd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:31:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1669851254',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=141b3c5d-d982-47bf-992c-f7c120db755c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0dd736d01df468bb04ac8c0ee27a4ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:31:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:31:22Z,use_quota=True,user_id='b6e5fb63ba30434eb41a770ba1c207ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:31:22 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-6efc61ed-5809-452d-b585-e88cd1296419 tempest-VolumesExtendTest-1157568027 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3d8cf7e-cbcc-4691-950f-ace614907b99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:31:22 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-6efc61ed-5809-452d-b585-e88cd1296419 tempest-VolumesExtendTest-1157568027 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3d8cf7e-cbcc-4691-950f-ace614907b99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:31:22 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-6efc61ed-5809-452d-b585-e88cd1296419 tempest-VolumesExtendTest-1157568027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41d1d388-b94a-4f77-8b37-f41e0a69dec0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:31:22 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-6efc61ed-5809-452d-b585-e88cd1296419 tempest-VolumesExtendTest-1157568027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41d1d388-b94a-4f77-8b37-f41e0a69dec0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '141b3c5d-d982-47bf-992c-f7c120db755c', 'volume_name': 'volume-141b3c5d-d982-47bf-992c-f7c120db755c', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:31:22 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-6efc61ed-5809-452d-b585-e88cd1296419 tempest-VolumesExtendTest-1157568027 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3bd68cbc-c203-4d28-8176-1742bbeca144) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:31:22 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-6efc61ed-5809-452d-b585-e88cd1296419 tempest-VolumesExtendTest-1157568027 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3bd68cbc-c203-4d28-8176-1742bbeca144) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:31:22 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-6efc61ed-5809-452d-b585-e88cd1296419 tempest-VolumesExtendTest-1157568027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f154399d-5614-4245-a1ab-83fa9eff4603) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:31:22 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-6efc61ed-5809-452d-b585-e88cd1296419 tempest-VolumesExtendTest-1157568027 None] Volume 141b3c5d-d982-47bf-992c-f7c120db755c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-141b3c5d-d982-47bf-992c-f7c120db755c', 'volume_size': 1} Jul 31 12:31:22 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-6efc61ed-5809-452d-b585-e88cd1296419 tempest-VolumesExtendTest-1157568027 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:31:22 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-6efc61ed-5809-452d-b585-e88cd1296419 tempest-VolumesExtendTest-1157568027 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:31:22 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-6efc61ed-5809-452d-b585-e88cd1296419 tempest-VolumesExtendTest-1157568027 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:31:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1669851254',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=141b3c5d-d982-47bf-992c-f7c120db755c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0dd736d01df468bb04ac8c0ee27a4ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:31:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:31:22Z,use_quota=True,user_id='b6e5fb63ba30434eb41a770ba1c207ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)}" {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 12:31:22 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-6efc61ed-5809-452d-b585-e88cd1296419 tempest-VolumesExtendTest-1157568027 None] Creating volume 141b3c5d-d982-47bf-992c-f7c120db755c {{(pid=89182) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 12:31:22 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-6efc61ed-5809-452d-b585-e88cd1296419 tempest-VolumesExtendTest-1157568027 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:31:22 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-6efc61ed-5809-452d-b585-e88cd1296419 tempest-VolumesExtendTest-1157568027 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:31:22 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-6efc61ed-5809-452d-b585-e88cd1296419 tempest-VolumesExtendTest-1157568027 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:31:22 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-6efc61ed-5809-452d-b585-e88cd1296419 tempest-VolumesExtendTest-1157568027 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:31:22 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-6efc61ed-5809-452d-b585-e88cd1296419 tempest-VolumesExtendTest-1157568027 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:31:22 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-6efc61ed-5809-452d-b585-e88cd1296419 tempest-VolumesExtendTest-1157568027 None] Selected osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 as target Quobyte volume. {{(pid=89182) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 12:31:22 devstack cinder-volume[89182]: INFO cinder.volume.drivers.remotefs [None req-6efc61ed-5809-452d-b585-e88cd1296419 tempest-VolumesExtendTest-1157568027 None] casted to osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 Jul 31 12:31:22 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-6efc61ed-5809-452d-b585-e88cd1296419 tempest-VolumesExtendTest-1157568027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-141b3c5d-d982-47bf-992c-f7c120db755c 1073741824 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:31:22 devstack sudo[107147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-141b3c5d-d982-47bf-992c-f7c120db755c 1073741824 Jul 31 12:31:22 devstack sudo[107147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:31:22 devstack sudo[107147]: pam_unix(sudo:session): session closed for user root Jul 31 12:31:22 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-6efc61ed-5809-452d-b585-e88cd1296419 tempest-VolumesExtendTest-1157568027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-141b3c5d-d982-47bf-992c-f7c120db755c 1073741824" returned: 0 in 0.462s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:31:22 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-6efc61ed-5809-452d-b585-e88cd1296419 tempest-VolumesExtendTest-1157568027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-141b3c5d-d982-47bf-992c-f7c120db755c {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:31:22 devstack sudo[107163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-141b3c5d-d982-47bf-992c-f7c120db755c Jul 31 12:31:22 devstack sudo[107163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:31:23 devstack sudo[107163]: pam_unix(sudo:session): session closed for user root Jul 31 12:31:23 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-6efc61ed-5809-452d-b585-e88cd1296419 tempest-VolumesExtendTest-1157568027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-141b3c5d-d982-47bf-992c-f7c120db755c" returned: 0 in 0.266s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:31:23 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-6efc61ed-5809-452d-b585-e88cd1296419 tempest-VolumesExtendTest-1157568027 None] <== create_volume: return (781ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'} {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 12:31:23 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-6efc61ed-5809-452d-b585-e88cd1296419 tempest-VolumesExtendTest-1157568027 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.784s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:31:23 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-6efc61ed-5809-452d-b585-e88cd1296419 tempest-VolumesExtendTest-1157568027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f154399d-5614-4245-a1ab-83fa9eff4603) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-141b3c5d-d982-47bf-992c-f7c120db755c', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:31:23 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-6efc61ed-5809-452d-b585-e88cd1296419 tempest-VolumesExtendTest-1157568027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3bc4f760-8cd9-4506-83e6-b9be2993b198) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:31:23 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-6efc61ed-5809-452d-b585-e88cd1296419 tempest-VolumesExtendTest-1157568027 None] Volume volume-141b3c5d-d982-47bf-992c-f7c120db755c (141b3c5d-d982-47bf-992c-f7c120db755c): created successfully Jul 31 12:31:23 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-6efc61ed-5809-452d-b585-e88cd1296419 tempest-VolumesExtendTest-1157568027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3bc4f760-8cd9-4506-83e6-b9be2993b198) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:31:23 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-6efc61ed-5809-452d-b585-e88cd1296419 tempest-VolumesExtendTest-1157568027 None] Flow 'volume_create_manager' (6f9d0842-6fe2-4b1d-87a3-9ec88c4f82ad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:31:23 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-6efc61ed-5809-452d-b585-e88cd1296419 tempest-VolumesExtendTest-1157568027 None] Created volume successfully. Jul 31 12:31:23 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-d3089366-00ce-4d27-8620-82734fa04b31 tempest-VolumesExtendTest-1157568027 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:31:23 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-d3089366-00ce-4d27-8620-82734fa04b31 tempest-VolumesExtendTest-1157568027 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:31:23 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-d3089366-00ce-4d27-8620-82734fa04b31 tempest-VolumesExtendTest-1157568027 None] Creating offline snapshot e5dabe88-5643-4151-b1ef-10fe16b0a2f6 of volume 141b3c5d-d982-47bf-992c-f7c120db755c {{(pid=89182) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 31 12:31:23 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[82bff7c9-568b-4e24-996d-535cb2e525c6]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:31:23 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-d3089366-00ce-4d27-8620-82734fa04b31 tempest-VolumesExtendTest-1157568027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-141b3c5d-d982-47bf-992c-f7c120db755c {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:31:23 devstack sudo[107181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-141b3c5d-d982-47bf-992c-f7c120db755c Jul 31 12:31:23 devstack sudo[107181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:31:24 devstack sudo[107181]: pam_unix(sudo:session): session closed for user root Jul 31 12:31:24 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-d3089366-00ce-4d27-8620-82734fa04b31 tempest-VolumesExtendTest-1157568027 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-141b3c5d-d982-47bf-992c-f7c120db755c" returned: 0 in 0.436s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:31:24 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-d3089366-00ce-4d27-8620-82734fa04b31 tempest-VolumesExtendTest-1157568027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-141b3c5d-d982-47bf-992c-f7c120db755c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-141b3c5d-d982-47bf-992c-f7c120db755c.e5dabe88-5643-4151-b1ef-10fe16b0a2f6 1G {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:31:24 devstack sudo[107186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-141b3c5d-d982-47bf-992c-f7c120db755c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-141b3c5d-d982-47bf-992c-f7c120db755c.e5dabe88-5643-4151-b1ef-10fe16b0a2f6 1G Jul 31 12:31:24 devstack sudo[107186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:31:24 devstack cinder-volume[89182]: INFO cinder.volume.manager [req-321f0258-2d4d-45fe-9296-8efb7e569fb8 req-51a23cc1-99ab-4ced-b825-95e908260fb9 tempest-SnapshotDataIntegrityTests-113348013 None] Terminate volume connection completed successfully. Jul 31 12:31:24 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [req-321f0258-2d4d-45fe-9296-8efb7e569fb8 req-51a23cc1-99ab-4ced-b825-95e908260fb9 tempest-SnapshotDataIntegrityTests-113348013 None] Deleting attachment 7682c1e1-9cce-46fc-bb94-b9b38d830d09. {{(pid=89182) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 31 12:31:24 devstack sudo[107186]: pam_unix(sudo:session): session closed for user root Jul 31 12:31:24 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-d3089366-00ce-4d27-8620-82734fa04b31 tempest-VolumesExtendTest-1157568027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-141b3c5d-d982-47bf-992c-f7c120db755c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-141b3c5d-d982-47bf-992c-f7c120db755c.e5dabe88-5643-4151-b1ef-10fe16b0a2f6 1G" returned: 0 in 0.520s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:31:24 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-d3089366-00ce-4d27-8620-82734fa04b31 tempest-VolumesExtendTest-1157568027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-141b3c5d-d982-47bf-992c-f7c120db755c -F qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-141b3c5d-d982-47bf-992c-f7c120db755c.e5dabe88-5643-4151-b1ef-10fe16b0a2f6 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:31:24 devstack sudo[107223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-141b3c5d-d982-47bf-992c-f7c120db755c -F qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-141b3c5d-d982-47bf-992c-f7c120db755c.e5dabe88-5643-4151-b1ef-10fe16b0a2f6 Jul 31 12:31:24 devstack sudo[107223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:31:24 devstack sudo[107223]: pam_unix(sudo:session): session closed for user root Jul 31 12:31:24 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-d3089366-00ce-4d27-8620-82734fa04b31 tempest-VolumesExtendTest-1157568027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-141b3c5d-d982-47bf-992c-f7c120db755c -F qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-141b3c5d-d982-47bf-992c-f7c120db755c.e5dabe88-5643-4151-b1ef-10fe16b0a2f6" returned: 0 in 0.368s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:31:24 devstack cinder-volume[89182]: WARNING cinder.volume.drivers.remotefs [None req-d3089366-00ce-4d27-8620-82734fa04b31 tempest-VolumesExtendTest-1157568027 None] /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-141b3c5d-d982-47bf-992c-f7c120db755c.e5dabe88-5643-4151-b1ef-10fe16b0a2f6 is being set with open permissions: ugo+rw Jul 31 12:31:24 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-d3089366-00ce-4d27-8620-82734fa04b31 tempest-VolumesExtendTest-1157568027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-141b3c5d-d982-47bf-992c-f7c120db755c.e5dabe88-5643-4151-b1ef-10fe16b0a2f6 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:31:25 devstack sudo[107228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-141b3c5d-d982-47bf-992c-f7c120db755c.e5dabe88-5643-4151-b1ef-10fe16b0a2f6 Jul 31 12:31:25 devstack sudo[107228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:31:25 devstack sudo[107228]: pam_unix(sudo:session): session closed for user root Jul 31 12:31:25 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-d3089366-00ce-4d27-8620-82734fa04b31 tempest-VolumesExtendTest-1157568027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-141b3c5d-d982-47bf-992c-f7c120db755c.e5dabe88-5643-4151-b1ef-10fe16b0a2f6" returned: 0 in 0.300s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:31:25 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-d3089366-00ce-4d27-8620-82734fa04b31 tempest-VolumesExtendTest-1157568027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-141b3c5d-d982-47bf-992c-f7c120db755c.info {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:31:25 devstack sudo[107231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-141b3c5d-d982-47bf-992c-f7c120db755c.info Jul 31 12:31:25 devstack sudo[107231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:31:25 devstack sudo[107231]: pam_unix(sudo:session): session closed for user root Jul 31 12:31:25 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-d3089366-00ce-4d27-8620-82734fa04b31 tempest-VolumesExtendTest-1157568027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-141b3c5d-d982-47bf-992c-f7c120db755c.info" returned: 0 in 0.361s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:31:25 devstack cinder-volume[89182]: WARNING cinder.volume.drivers.remotefs [None req-d3089366-00ce-4d27-8620-82734fa04b31 tempest-VolumesExtendTest-1157568027 None] /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-141b3c5d-d982-47bf-992c-f7c120db755c.info is being set with open permissions: ugo+rw Jul 31 12:31:25 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-d3089366-00ce-4d27-8620-82734fa04b31 tempest-VolumesExtendTest-1157568027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-141b3c5d-d982-47bf-992c-f7c120db755c.info {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:31:25 devstack sudo[107238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-141b3c5d-d982-47bf-992c-f7c120db755c.info Jul 31 12:31:25 devstack sudo[107238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:31:25 devstack cinder-volume[89182]: DEBUG cinder.volume.flows.manager.create_volume [None req-89e21e2c-54e4-42b6-aed2-a3778b2ed085 tempest-SnapshotDataIntegrityTests-113348013 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89182) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 12:31:26 devstack sudo[107238]: pam_unix(sudo:session): session closed for user root Jul 31 12:31:26 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-89e21e2c-54e4-42b6-aed2-a3778b2ed085 tempest-SnapshotDataIntegrityTests-113348013 None] Flow 'volume_create_manager' (c0d541d5-d705-41ab-ad02-ffddfd9b1e39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:31:26 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-89e21e2c-54e4-42b6-aed2-a3778b2ed085 tempest-SnapshotDataIntegrityTests-113348013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df8a2760-77e5-4a6d-8498-a4c93e9641b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:31:26 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-d3089366-00ce-4d27-8620-82734fa04b31 tempest-VolumesExtendTest-1157568027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-141b3c5d-d982-47bf-992c-f7c120db755c.info" returned: 0 in 0.343s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:31:26 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-d3089366-00ce-4d27-8620-82734fa04b31 tempest-VolumesExtendTest-1157568027 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.507s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:31:26 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-89e21e2c-54e4-42b6-aed2-a3778b2ed085 tempest-SnapshotDataIntegrityTests-113348013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df8a2760-77e5-4a6d-8498-a4c93e9641b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:31:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDataIntegrityTests-volume-1302889048',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=caf61784-9d2c-4244-9421-3e97d71e440e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b7de7a8b3bf64f6b8012ee3189eeaff8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:31:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=7f584107-b1e4-435e-bc1d-5f9b2004ba6e,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:31:26Z,use_quota=True,user_id='00b607dae7d54b56a52ba547d8a1ab16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:31:26 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-89e21e2c-54e4-42b6-aed2-a3778b2ed085 tempest-SnapshotDataIntegrityTests-113348013 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de26533b-c5c8-4941-b263-a67f5ccc9c5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:31:26 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-89e21e2c-54e4-42b6-aed2-a3778b2ed085 tempest-SnapshotDataIntegrityTests-113348013 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de26533b-c5c8-4941-b263-a67f5ccc9c5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:31:26 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-89e21e2c-54e4-42b6-aed2-a3778b2ed085 tempest-SnapshotDataIntegrityTests-113348013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70b12ac4-fe18-485e-956f-b0ff63d3e435) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:31:26 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-89e21e2c-54e4-42b6-aed2-a3778b2ed085 tempest-SnapshotDataIntegrityTests-113348013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70b12ac4-fe18-485e-956f-b0ff63d3e435) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'caf61784-9d2c-4244-9421-3e97d71e440e', 'volume_name': 'volume-caf61784-9d2c-4244-9421-3e97d71e440e', 'volume_size': 1, 'snapshot_id': '7f584107-b1e4-435e-bc1d-5f9b2004ba6e'}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:31:26 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-89e21e2c-54e4-42b6-aed2-a3778b2ed085 tempest-SnapshotDataIntegrityTests-113348013 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33e99647-afc7-4822-90e4-9ecc2912d28e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:31:26 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-89e21e2c-54e4-42b6-aed2-a3778b2ed085 tempest-SnapshotDataIntegrityTests-113348013 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33e99647-afc7-4822-90e4-9ecc2912d28e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:31:26 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-89e21e2c-54e4-42b6-aed2-a3778b2ed085 tempest-SnapshotDataIntegrityTests-113348013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97b37aba-11f0-471f-a17b-37263aeae0c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:31:26 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-89e21e2c-54e4-42b6-aed2-a3778b2ed085 tempest-SnapshotDataIntegrityTests-113348013 None] Volume caf61784-9d2c-4244-9421-3e97d71e440e: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-caf61784-9d2c-4244-9421-3e97d71e440e', 'volume_size': 1, 'snapshot_id': '7f584107-b1e4-435e-bc1d-5f9b2004ba6e'} Jul 31 12:31:26 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-89e21e2c-54e4-42b6-aed2-a3778b2ed085 tempest-SnapshotDataIntegrityTests-113348013 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:31:26 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-89e21e2c-54e4-42b6-aed2-a3778b2ed085 tempest-SnapshotDataIntegrityTests-113348013 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:31:26 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-89e21e2c-54e4-42b6-aed2-a3778b2ed085 tempest-SnapshotDataIntegrityTests-113348013 None] Acquiring lock "cinder-quobyte-7f584107-b1e4-435e-bc1d-5f9b2004ba6e-caf61784-9d2c-4244-9421-3e97d71e440e" by "_create_volume_from_snapshot" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:31:26 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-d3089366-00ce-4d27-8620-82734fa04b31 tempest-VolumesExtendTest-1157568027 None] Create snapshot completed successfully Jul 31 12:31:26 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-89e21e2c-54e4-42b6-aed2-a3778b2ed085 tempest-SnapshotDataIntegrityTests-113348013 None] Lock "cinder-quobyte-7f584107-b1e4-435e-bc1d-5f9b2004ba6e-caf61784-9d2c-4244-9421-3e97d71e440e" acquired by "_create_volume_from_snapshot" :: waited 0.028s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:31:26 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-89e21e2c-54e4-42b6-aed2-a3778b2ed085 tempest-SnapshotDataIntegrityTests-113348013 None] Creating volume caf61784-9d2c-4244-9421-3e97d71e440e from snapshot 7f584107-b1e4-435e-bc1d-5f9b2004ba6e {{(pid=89182) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 31 12:31:26 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-89e21e2c-54e4-42b6-aed2-a3778b2ed085 tempest-SnapshotDataIntegrityTests-113348013 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:31:26 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-89e21e2c-54e4-42b6-aed2-a3778b2ed085 tempest-SnapshotDataIntegrityTests-113348013 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:31:26 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-89e21e2c-54e4-42b6-aed2-a3778b2ed085 tempest-SnapshotDataIntegrityTests-113348013 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:31:26 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-89e21e2c-54e4-42b6-aed2-a3778b2ed085 tempest-SnapshotDataIntegrityTests-113348013 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:31:26 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-89e21e2c-54e4-42b6-aed2-a3778b2ed085 tempest-SnapshotDataIntegrityTests-113348013 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:31:26 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-89e21e2c-54e4-42b6-aed2-a3778b2ed085 tempest-SnapshotDataIntegrityTests-113348013 None] Selected osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 as target Quobyte volume. {{(pid=89182) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 12:31:26 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-89e21e2c-54e4-42b6-aed2-a3778b2ed085 tempest-SnapshotDataIntegrityTests-113348013 None] Acquiring lock "cinder-quobyte-caf61784-9d2c-4244-9421-3e97d71e440e" by "_copy_volume_from_snapshot" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:31:26 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-89e21e2c-54e4-42b6-aed2-a3778b2ed085 tempest-SnapshotDataIntegrityTests-113348013 None] Lock "cinder-quobyte-caf61784-9d2c-4244-9421-3e97d71e440e" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:31:26 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-89e21e2c-54e4-42b6-aed2-a3778b2ed085 tempest-SnapshotDataIntegrityTests-113348013 None] snapshot: 7f584107-b1e4-435e-bc1d-5f9b2004ba6e, volume: caf61784-9d2c-4244-9421-3e97d71e440e, {{(pid=89182) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Jul 31 12:31:26 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-89e21e2c-54e4-42b6-aed2-a3778b2ed085 tempest-SnapshotDataIntegrityTests-113348013 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:31:26 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-89e21e2c-54e4-42b6-aed2-a3778b2ed085 tempest-SnapshotDataIntegrityTests-113348013 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:31:26 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-89e21e2c-54e4-42b6-aed2-a3778b2ed085 tempest-SnapshotDataIntegrityTests-113348013 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:31:26 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-89e21e2c-54e4-42b6-aed2-a3778b2ed085 tempest-SnapshotDataIntegrityTests-113348013 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:31:26 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-89e21e2c-54e4-42b6-aed2-a3778b2ed085 tempest-SnapshotDataIntegrityTests-113348013 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:31:26 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae3c9d40-207f-4c64-8e6a-26f1969bd9ac]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:31:26 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-89e21e2c-54e4-42b6-aed2-a3778b2ed085 tempest-SnapshotDataIntegrityTests-113348013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-8ef75942-d7b9-4102-a4ca-651a1de7d88a.7f584107-b1e4-435e-bc1d-5f9b2004ba6e {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:31:26 devstack sudo[107253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-8ef75942-d7b9-4102-a4ca-651a1de7d88a.7f584107-b1e4-435e-bc1d-5f9b2004ba6e Jul 31 12:31:26 devstack sudo[107253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:31:26 devstack sudo[107253]: pam_unix(sudo:session): session closed for user root Jul 31 12:31:26 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-89e21e2c-54e4-42b6-aed2-a3778b2ed085 tempest-SnapshotDataIntegrityTests-113348013 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-8ef75942-d7b9-4102-a4ca-651a1de7d88a.7f584107-b1e4-435e-bc1d-5f9b2004ba6e" returned: 0 in 0.409s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:31:26 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-89e21e2c-54e4-42b6-aed2-a3778b2ed085 tempest-SnapshotDataIntegrityTests-113348013 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8ef75942-d7b9-4102-a4ca-651a1de7d88a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89182) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 12:31:26 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dce7b7a-1a54-43dd-a238-92d2dc115bb2]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:31:26 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-89e21e2c-54e4-42b6-aed2-a3778b2ed085 tempest-SnapshotDataIntegrityTests-113348013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-8ef75942-d7b9-4102-a4ca-651a1de7d88a.b8369f85-c94c-4c5c-9b7e-1f6060bee802 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:31:26 devstack sudo[107260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-8ef75942-d7b9-4102-a4ca-651a1de7d88a.b8369f85-c94c-4c5c-9b7e-1f6060bee802 Jul 31 12:31:26 devstack sudo[107260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:31:26 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-34606d11-b680-4777-a5ea-03b7b0551069 tempest-VolumesExtendTest-1157568027 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:31:27 devstack sudo[107260]: pam_unix(sudo:session): session closed for user root Jul 31 12:31:27 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-89e21e2c-54e4-42b6-aed2-a3778b2ed085 tempest-SnapshotDataIntegrityTests-113348013 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-8ef75942-d7b9-4102-a4ca-651a1de7d88a.b8369f85-c94c-4c5c-9b7e-1f6060bee802" returned: 0 in 0.422s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:31:27 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-89e21e2c-54e4-42b6-aed2-a3778b2ed085 tempest-SnapshotDataIntegrityTests-113348013 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8ef75942-d7b9-4102-a4ca-651a1de7d88a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89182) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 12:31:27 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-89e21e2c-54e4-42b6-aed2-a3778b2ed085 tempest-SnapshotDataIntegrityTests-113348013 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-8ef75942-d7b9-4102-a4ca-651a1de7d88a.b8369f85-c94c-4c5c-9b7e-1f6060bee802 {{(pid=89182) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Jul 31 12:31:27 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-89e21e2c-54e4-42b6-aed2-a3778b2ed085 tempest-SnapshotDataIntegrityTests-113348013 None] Creating direct copy from snapshot {{(pid=89182) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Jul 31 12:31:27 devstack cinder-volume[89182]: DEBUG cinder.utils [None req-89e21e2c-54e4-42b6-aed2-a3778b2ed085 tempest-SnapshotDataIntegrityTests-113348013 None] Path /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-caf61784-9d2c-4244-9421-3e97d71e440e not found in is_blk_device check {{(pid=89182) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 31 12:31:27 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-89e21e2c-54e4-42b6-aed2-a3778b2ed085 tempest-SnapshotDataIntegrityTests-113348013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-8ef75942-d7b9-4102-a4ca-651a1de7d88a.b8369f85-c94c-4c5c-9b7e-1f6060bee802 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-caf61784-9d2c-4244-9421-3e97d71e440e {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:31:27 devstack sudo[107266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-8ef75942-d7b9-4102-a4ca-651a1de7d88a.b8369f85-c94c-4c5c-9b7e-1f6060bee802 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-caf61784-9d2c-4244-9421-3e97d71e440e Jul 31 12:31:27 devstack sudo[107266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:31:33 devstack sudo[107266]: pam_unix(sudo:session): session closed for user root Jul 31 12:31:33 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-89e21e2c-54e4-42b6-aed2-a3778b2ed085 tempest-SnapshotDataIntegrityTests-113348013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-8ef75942-d7b9-4102-a4ca-651a1de7d88a.b8369f85-c94c-4c5c-9b7e-1f6060bee802 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-caf61784-9d2c-4244-9421-3e97d71e440e" returned: 0 in 6.036s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:31:33 devstack cinder-volume[89182]: DEBUG cinder.image.image_utils [None req-89e21e2c-54e4-42b6-aed2-a3778b2ed085 tempest-SnapshotDataIntegrityTests-113348013 None] Image conversion details: src /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-8ef75942-d7b9-4102-a4ca-651a1de7d88a.b8369f85-c94c-4c5c-9b7e-1f6060bee802, size 1024.00 MB, duration 6.04 sec, destination /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-caf61784-9d2c-4244-9421-3e97d71e440e {{(pid=89182) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 31 12:31:33 devstack cinder-volume[89182]: INFO cinder.image.image_utils [None req-89e21e2c-54e4-42b6-aed2-a3778b2ed085 tempest-SnapshotDataIntegrityTests-113348013 None] Converted 1024.00 MB image at 169.61 MB/s Jul 31 12:31:33 devstack cinder-volume[89182]: WARNING cinder.volume.drivers.remotefs [None req-89e21e2c-54e4-42b6-aed2-a3778b2ed085 tempest-SnapshotDataIntegrityTests-113348013 None] /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-caf61784-9d2c-4244-9421-3e97d71e440e is being set with open permissions: ugo+rw Jul 31 12:31:33 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-89e21e2c-54e4-42b6-aed2-a3778b2ed085 tempest-SnapshotDataIntegrityTests-113348013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-caf61784-9d2c-4244-9421-3e97d71e440e {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:31:33 devstack sudo[107361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-caf61784-9d2c-4244-9421-3e97d71e440e Jul 31 12:31:33 devstack sudo[107361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:31:33 devstack sudo[107361]: pam_unix(sudo:session): session closed for user root Jul 31 12:31:33 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-89e21e2c-54e4-42b6-aed2-a3778b2ed085 tempest-SnapshotDataIntegrityTests-113348013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-caf61784-9d2c-4244-9421-3e97d71e440e" returned: 0 in 0.259s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:31:33 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-89e21e2c-54e4-42b6-aed2-a3778b2ed085 tempest-SnapshotDataIntegrityTests-113348013 None] Lock "cinder-quobyte-caf61784-9d2c-4244-9421-3e97d71e440e" released by "_copy_volume_from_snapshot" :: held 7.220s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:31:33 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-89e21e2c-54e4-42b6-aed2-a3778b2ed085 tempest-SnapshotDataIntegrityTests-113348013 None] Lock "cinder-quobyte-7f584107-b1e4-435e-bc1d-5f9b2004ba6e-caf61784-9d2c-4244-9421-3e97d71e440e" released by "_create_volume_from_snapshot" :: held 7.295s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:31:33 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-89e21e2c-54e4-42b6-aed2-a3778b2ed085 tempest-SnapshotDataIntegrityTests-113348013 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.324s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:31:33 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-34606d11-b680-4777-a5ea-03b7b0551069 tempest-VolumesExtendTest-1157568027 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 6.572s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:31:33 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c9248fb-9fdd-446e-be2e-07717b0c4f7f]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:31:33 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-34606d11-b680-4777-a5ea-03b7b0551069 tempest-VolumesExtendTest-1157568027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-141b3c5d-d982-47bf-992c-f7c120db755c {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:31:33 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-89e21e2c-54e4-42b6-aed2-a3778b2ed085 tempest-SnapshotDataIntegrityTests-113348013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97b37aba-11f0-471f-a17b-37263aeae0c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-caf61784-9d2c-4244-9421-3e97d71e440e', 'volume_size': 1, 'snapshot_id': '7f584107-b1e4-435e-bc1d-5f9b2004ba6e'}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:31:33 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-89e21e2c-54e4-42b6-aed2-a3778b2ed085 tempest-SnapshotDataIntegrityTests-113348013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5b05d2e-3cf7-49bc-9aff-bdf8fae453d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:31:33 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-89e21e2c-54e4-42b6-aed2-a3778b2ed085 tempest-SnapshotDataIntegrityTests-113348013 None] Volume volume-caf61784-9d2c-4244-9421-3e97d71e440e (caf61784-9d2c-4244-9421-3e97d71e440e): created successfully Jul 31 12:31:33 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-89e21e2c-54e4-42b6-aed2-a3778b2ed085 tempest-SnapshotDataIntegrityTests-113348013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5b05d2e-3cf7-49bc-9aff-bdf8fae453d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:31:33 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-89e21e2c-54e4-42b6-aed2-a3778b2ed085 tempest-SnapshotDataIntegrityTests-113348013 None] Flow 'volume_create_manager' (c0d541d5-d705-41ab-ad02-ffddfd9b1e39) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:31:33 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-89e21e2c-54e4-42b6-aed2-a3778b2ed085 tempest-SnapshotDataIntegrityTests-113348013 None] Created volume successfully. Jul 31 12:31:33 devstack sudo[107364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-141b3c5d-d982-47bf-992c-f7c120db755c Jul 31 12:31:33 devstack sudo[107364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:31:33 devstack sudo[107364]: pam_unix(sudo:session): session closed for user root Jul 31 12:31:33 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-34606d11-b680-4777-a5ea-03b7b0551069 tempest-VolumesExtendTest-1157568027 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-141b3c5d-d982-47bf-992c-f7c120db755c" returned: 0 in 0.466s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:31:33 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-34606d11-b680-4777-a5ea-03b7b0551069 tempest-VolumesExtendTest-1157568027 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-141b3c5d-d982-47bf-992c-f7c120db755c.e5dabe88-5643-4151-b1ef-10fe16b0a2f6 2G {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:31:34 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-34606d11-b680-4777-a5ea-03b7b0551069 tempest-VolumesExtendTest-1157568027 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-141b3c5d-d982-47bf-992c-f7c120db755c.e5dabe88-5643-4151-b1ef-10fe16b0a2f6 2G" returned: 0 in 0.323s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:31:34 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-34606d11-b680-4777-a5ea-03b7b0551069 tempest-VolumesExtendTest-1157568027 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.847s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:31:34 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-34606d11-b680-4777-a5ea-03b7b0551069 tempest-VolumesExtendTest-1157568027 None] Extend volume completed successfully. Jul 31 12:31:34 devstack cinder-volume[89182]: DEBUG dbcounter [-] [89182] Writing DB stats cinder:UPDATE=84,cinder:DELETE=11,cinder:SELECT=90,cinder:INSERT=33 {{(pid=89182) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 12:31:34 devstack cinder-volume[89182]: DEBUG dbcounter [-] [89182] Writing DB stats cinder:SELECT=92,cinder:INSERT=31,cinder:UPDATE=95,cinder:DELETE=7 {{(pid=89182) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 12:31:35 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [req-3bdb063c-d905-4d5f-8a44-6ba1620bf7ea req-0cb59c82-1811-45d1-b552-0f09fcb7c52d tempest-SnapshotDataIntegrityTests-113348013 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:31:35 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [req-3bdb063c-d905-4d5f-8a44-6ba1620bf7ea req-0cb59c82-1811-45d1-b552-0f09fcb7c52d tempest-SnapshotDataIntegrityTests-113348013 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:31:35 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [req-3bdb063c-d905-4d5f-8a44-6ba1620bf7ea req-0cb59c82-1811-45d1-b552-0f09fcb7c52d tempest-SnapshotDataIntegrityTests-113348013 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:31:35 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-150bfe2f-4f4f-4d35-b0be-d52dba2e07fc tempest-VolumesExtendTest-1157568027 None] Acquiring lock "cinder-e5dabe88-5643-4151-b1ef-10fe16b0a2f6-delete_snapshot" by "delete_snapshot" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:31:35 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [req-3bdb063c-d905-4d5f-8a44-6ba1620bf7ea req-0cb59c82-1811-45d1-b552-0f09fcb7c52d tempest-SnapshotDataIntegrityTests-113348013 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88', 'name': 'volume-caf61784-9d2c-4244-9421-3e97d71e440e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c01549b6-ec28-493b-b1ad-827cc14b3f16', 'enforce_multipath': True} {{(pid=89182) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 31 12:31:35 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-150bfe2f-4f4f-4d35-b0be-d52dba2e07fc tempest-VolumesExtendTest-1157568027 None] Lock "cinder-e5dabe88-5643-4151-b1ef-10fe16b0a2f6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.042s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:31:35 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-150bfe2f-4f4f-4d35-b0be-d52dba2e07fc tempest-VolumesExtendTest-1157568027 None] Acquiring lock "cinder-quobyte-141b3c5d-d982-47bf-992c-f7c120db755c" by "delete_snapshot" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:31:35 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-150bfe2f-4f4f-4d35-b0be-d52dba2e07fc tempest-VolumesExtendTest-1157568027 None] Lock "cinder-quobyte-141b3c5d-d982-47bf-992c-f7c120db755c" acquired by "delete_snapshot" :: waited 0.026s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:31:35 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-150bfe2f-4f4f-4d35-b0be-d52dba2e07fc tempest-VolumesExtendTest-1157568027 None] Acquiring lock "cinder-quobyte-e5dabe88-5643-4151-b1ef-10fe16b0a2f6" by "_delete_snapshot" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:31:35 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-150bfe2f-4f4f-4d35-b0be-d52dba2e07fc tempest-VolumesExtendTest-1157568027 None] Lock "cinder-quobyte-e5dabe88-5643-4151-b1ef-10fe16b0a2f6" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:31:35 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-150bfe2f-4f4f-4d35-b0be-d52dba2e07fc tempest-VolumesExtendTest-1157568027 None] Deleting offline snapshot e5dabe88-5643-4151-b1ef-10fe16b0a2f6 of volume 141b3c5d-d982-47bf-992c-f7c120db755c {{(pid=89182) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 31 12:31:35 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-150bfe2f-4f4f-4d35-b0be-d52dba2e07fc tempest-VolumesExtendTest-1157568027 None] snapshot_file for this snap is: volume-141b3c5d-d982-47bf-992c-f7c120db755c.e5dabe88-5643-4151-b1ef-10fe16b0a2f6 {{(pid=89182) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 31 12:31:35 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[03c321f4-e820-4942-8c38-768618d9e542]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:31:35 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-150bfe2f-4f4f-4d35-b0be-d52dba2e07fc tempest-VolumesExtendTest-1157568027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-141b3c5d-d982-47bf-992c-f7c120db755c.e5dabe88-5643-4151-b1ef-10fe16b0a2f6 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:31:35 devstack cinder-volume[89182]: INFO cinder.volume.manager [req-3bdb063c-d905-4d5f-8a44-6ba1620bf7ea req-0cb59c82-1811-45d1-b552-0f09fcb7c52d tempest-SnapshotDataIntegrityTests-113348013 None] attachment_update completed successfully. Jul 31 12:31:35 devstack sudo[107391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-141b3c5d-d982-47bf-992c-f7c120db755c.e5dabe88-5643-4151-b1ef-10fe16b0a2f6 Jul 31 12:31:35 devstack sudo[107391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:31:35 devstack sudo[107391]: pam_unix(sudo:session): session closed for user root Jul 31 12:31:35 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-150bfe2f-4f4f-4d35-b0be-d52dba2e07fc tempest-VolumesExtendTest-1157568027 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-141b3c5d-d982-47bf-992c-f7c120db755c.e5dabe88-5643-4151-b1ef-10fe16b0a2f6" returned: 0 in 0.534s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:31:35 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-150bfe2f-4f4f-4d35-b0be-d52dba2e07fc tempest-VolumesExtendTest-1157568027 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-141b3c5d-d982-47bf-992c-f7c120db755c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89182) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 12:31:35 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f8cae41-a0a4-4d9c-b401-d6f46cf2b14b]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:31:35 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-150bfe2f-4f4f-4d35-b0be-d52dba2e07fc tempest-VolumesExtendTest-1157568027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-141b3c5d-d982-47bf-992c-f7c120db755c {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:31:35 devstack sudo[107780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-141b3c5d-d982-47bf-992c-f7c120db755c Jul 31 12:31:35 devstack sudo[107780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:31:36 devstack sudo[107780]: pam_unix(sudo:session): session closed for user root Jul 31 12:31:36 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-150bfe2f-4f4f-4d35-b0be-d52dba2e07fc tempest-VolumesExtendTest-1157568027 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-141b3c5d-d982-47bf-992c-f7c120db755c" returned: 0 in 0.501s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:31:36 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-150bfe2f-4f4f-4d35-b0be-d52dba2e07fc tempest-VolumesExtendTest-1157568027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-141b3c5d-d982-47bf-992c-f7c120db755c.e5dabe88-5643-4151-b1ef-10fe16b0a2f6 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:31:36 devstack sudo[107790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-141b3c5d-d982-47bf-992c-f7c120db755c.e5dabe88-5643-4151-b1ef-10fe16b0a2f6 Jul 31 12:31:36 devstack sudo[107790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:31:36 devstack sudo[107790]: pam_unix(sudo:session): session closed for user root Jul 31 12:31:36 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-150bfe2f-4f4f-4d35-b0be-d52dba2e07fc tempest-VolumesExtendTest-1157568027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-141b3c5d-d982-47bf-992c-f7c120db755c.e5dabe88-5643-4151-b1ef-10fe16b0a2f6" returned: 0 in 0.542s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:31:36 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-150bfe2f-4f4f-4d35-b0be-d52dba2e07fc tempest-VolumesExtendTest-1157568027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-141b3c5d-d982-47bf-992c-f7c120db755c.e5dabe88-5643-4151-b1ef-10fe16b0a2f6 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:31:36 devstack sudo[107816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-141b3c5d-d982-47bf-992c-f7c120db755c.e5dabe88-5643-4151-b1ef-10fe16b0a2f6 Jul 31 12:31:36 devstack sudo[107816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:31:37 devstack sudo[107816]: pam_unix(sudo:session): session closed for user root Jul 31 12:31:37 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-150bfe2f-4f4f-4d35-b0be-d52dba2e07fc tempest-VolumesExtendTest-1157568027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-141b3c5d-d982-47bf-992c-f7c120db755c.e5dabe88-5643-4151-b1ef-10fe16b0a2f6" returned: 0 in 0.288s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:31:37 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-150bfe2f-4f4f-4d35-b0be-d52dba2e07fc tempest-VolumesExtendTest-1157568027 None] Lock "cinder-quobyte-e5dabe88-5643-4151-b1ef-10fe16b0a2f6" released by "_delete_snapshot" :: held 2.020s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:31:37 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-150bfe2f-4f4f-4d35-b0be-d52dba2e07fc tempest-VolumesExtendTest-1157568027 None] Lock "cinder-quobyte-141b3c5d-d982-47bf-992c-f7c120db755c" released by "delete_snapshot" :: held 2.056s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:31:37 devstack cinder-volume[89182]: DEBUG cinder.quota [None req-150bfe2f-4f4f-4d35-b0be-d52dba2e07fc tempest-VolumesExtendTest-1157568027 None] Created reservations ['cd86344d-e6bc-4d4a-b39a-c608b066f48f', '352fe33c-7e1e-4d74-924a-8f3e92261cdf', '88c3b14b-7ff0-4ee8-b6c0-1a6818933dcc', '011877e4-cba1-449d-9946-6e2d7edb9ded'] {{(pid=89182) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 12:31:37 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-150bfe2f-4f4f-4d35-b0be-d52dba2e07fc tempest-VolumesExtendTest-1157568027 None] Delete snapshot completed successfully. Jul 31 12:31:37 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-150bfe2f-4f4f-4d35-b0be-d52dba2e07fc tempest-VolumesExtendTest-1157568027 None] Lock "cinder-e5dabe88-5643-4151-b1ef-10fe16b0a2f6-delete_snapshot" released by "delete_snapshot" :: held 2.326s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:31:38 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-543092e9-f51d-4678-9044-f06a83a2a31e tempest-VolumesExtendTest-1157568027 None] Acquiring lock "cinder-141b3c5d-d982-47bf-992c-f7c120db755c-delete_volume" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:31:38 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-543092e9-f51d-4678-9044-f06a83a2a31e tempest-VolumesExtendTest-1157568027 None] Lock "cinder-141b3c5d-d982-47bf-992c-f7c120db755c-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:31:38 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-543092e9-f51d-4678-9044-f06a83a2a31e tempest-VolumesExtendTest-1157568027 None] Acquiring lock "cinder-quobyte-141b3c5d-d982-47bf-992c-f7c120db755c" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:31:38 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-543092e9-f51d-4678-9044-f06a83a2a31e tempest-VolumesExtendTest-1157568027 None] Lock "cinder-quobyte-141b3c5d-d982-47bf-992c-f7c120db755c" acquired by "delete_volume" :: waited 0.016s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:31:38 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb9837ac-963d-4da7-8245-50a95b581be7]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:31:38 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-543092e9-f51d-4678-9044-f06a83a2a31e tempest-VolumesExtendTest-1157568027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-141b3c5d-d982-47bf-992c-f7c120db755c {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:31:38 devstack sudo[107851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-141b3c5d-d982-47bf-992c-f7c120db755c Jul 31 12:31:38 devstack sudo[107851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:31:38 devstack sudo[107851]: pam_unix(sudo:session): session closed for user root Jul 31 12:31:38 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-543092e9-f51d-4678-9044-f06a83a2a31e tempest-VolumesExtendTest-1157568027 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-141b3c5d-d982-47bf-992c-f7c120db755c" returned: 0 in 0.467s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:31:38 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-543092e9-f51d-4678-9044-f06a83a2a31e tempest-VolumesExtendTest-1157568027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-141b3c5d-d982-47bf-992c-f7c120db755c {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:31:39 devstack sudo[107859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-141b3c5d-d982-47bf-992c-f7c120db755c Jul 31 12:31:39 devstack sudo[107859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:31:39 devstack cinder-volume[89182]: INFO cinder.volume.manager [req-ef1d7ab6-ec3b-41fd-a80e-1d8d92b52579 req-9923734f-ed87-41d1-b5dc-cc8ed1de8436 tempest-SnapshotDataIntegrityTests-113348013 None] Terminate volume connection completed successfully. Jul 31 12:31:39 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [req-ef1d7ab6-ec3b-41fd-a80e-1d8d92b52579 req-9923734f-ed87-41d1-b5dc-cc8ed1de8436 tempest-SnapshotDataIntegrityTests-113348013 None] Deleting attachment c01549b6-ec28-493b-b1ad-827cc14b3f16. {{(pid=89182) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 31 12:31:39 devstack sudo[107859]: pam_unix(sudo:session): session closed for user root Jul 31 12:31:39 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-543092e9-f51d-4678-9044-f06a83a2a31e tempest-VolumesExtendTest-1157568027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-141b3c5d-d982-47bf-992c-f7c120db755c" returned: 0 in 0.312s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:31:39 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-543092e9-f51d-4678-9044-f06a83a2a31e tempest-VolumesExtendTest-1157568027 None] Lock "cinder-quobyte-141b3c5d-d982-47bf-992c-f7c120db755c" released by "delete_volume" :: held 0.850s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:31:39 devstack cinder-volume[89182]: DEBUG cinder.quota [None req-543092e9-f51d-4678-9044-f06a83a2a31e tempest-VolumesExtendTest-1157568027 None] Created reservations ['6fba690a-e6a9-47fa-b33e-7da6f84163c0', 'd3fa8418-4a09-4e31-ab13-88e71b7eed9b', '65bc82f9-49c4-4ece-bafb-af8bb00e8b31', '8177376b-2ee1-4079-b9a7-e96e4ffd5141'] {{(pid=89182) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 12:31:39 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-543092e9-f51d-4678-9044-f06a83a2a31e tempest-VolumesExtendTest-1157568027 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:31:39 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-543092e9-f51d-4678-9044-f06a83a2a31e tempest-VolumesExtendTest-1157568027 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:31:39 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-543092e9-f51d-4678-9044-f06a83a2a31e tempest-VolumesExtendTest-1157568027 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:31:39 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-543092e9-f51d-4678-9044-f06a83a2a31e tempest-VolumesExtendTest-1157568027 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:31:39 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-543092e9-f51d-4678-9044-f06a83a2a31e tempest-VolumesExtendTest-1157568027 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:31:39 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-543092e9-f51d-4678-9044-f06a83a2a31e tempest-VolumesExtendTest-1157568027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:31:39 devstack sudo[107888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 Jul 31 12:31:39 devstack sudo[107888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:31:39 devstack sudo[107888]: pam_unix(sudo:session): session closed for user root Jul 31 12:31:39 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-543092e9-f51d-4678-9044-f06a83a2a31e tempest-VolumesExtendTest-1157568027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2" returned: 0 in 0.264s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:31:39 devstack cinder-volume[89182]: DEBUG cinder.manager [None req-543092e9-f51d-4678-9044-f06a83a2a31e tempest-VolumesExtendTest-1157568027 None] Notifying Schedulers of capabilities ... {{(pid=89182) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 12:31:39 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-543092e9-f51d-4678-9044-f06a83a2a31e tempest-VolumesExtendTest-1157568027 None] Deleted volume successfully. Jul 31 12:31:39 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-543092e9-f51d-4678-9044-f06a83a2a31e tempest-VolumesExtendTest-1157568027 None] Lock "cinder-141b3c5d-d982-47bf-992c-f7c120db755c-delete_volume" released by "delete_volume" :: held 1.355s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:31:40 devstack cinder-volume[89182]: DEBUG cinder.volume.flows.manager.create_volume [None req-09e08ed1-cfd5-4b81-8c3b-35b7c34ab87a tempest-SnapshotDataIntegrityTests-113348013 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89182) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 12:31:40 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-09e08ed1-cfd5-4b81-8c3b-35b7c34ab87a tempest-SnapshotDataIntegrityTests-113348013 None] Flow 'volume_create_manager' (75591135-6a30-46b4-bb5e-636071f8c1fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:31:40 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-09e08ed1-cfd5-4b81-8c3b-35b7c34ab87a tempest-SnapshotDataIntegrityTests-113348013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ddbb63a-6ed6-48b6-95e0-31d63b6ee3d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:31:40 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-09e08ed1-cfd5-4b81-8c3b-35b7c34ab87a tempest-SnapshotDataIntegrityTests-113348013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ddbb63a-6ed6-48b6-95e0-31d63b6ee3d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:31:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDataIntegrityTests-volume-881480797',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68c0020d-1037-4411-bde1-bfa983e6bb15,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b7de7a8b3bf64f6b8012ee3189eeaff8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:31:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=449abdff-86c6-4340-aa7c-dc571b705c1b,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:31:41Z,use_quota=True,user_id='00b607dae7d54b56a52ba547d8a1ab16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:31:40 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-09e08ed1-cfd5-4b81-8c3b-35b7c34ab87a tempest-SnapshotDataIntegrityTests-113348013 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5bd4d48-e001-4694-bb6d-3a797593f2bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:31:40 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-09e08ed1-cfd5-4b81-8c3b-35b7c34ab87a tempest-SnapshotDataIntegrityTests-113348013 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5bd4d48-e001-4694-bb6d-3a797593f2bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:31:40 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-09e08ed1-cfd5-4b81-8c3b-35b7c34ab87a tempest-SnapshotDataIntegrityTests-113348013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0bae4b23-faf5-4995-8256-d7ddf1c17ad7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:31:40 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-09e08ed1-cfd5-4b81-8c3b-35b7c34ab87a tempest-SnapshotDataIntegrityTests-113348013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0bae4b23-faf5-4995-8256-d7ddf1c17ad7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '68c0020d-1037-4411-bde1-bfa983e6bb15', 'volume_name': 'volume-68c0020d-1037-4411-bde1-bfa983e6bb15', 'volume_size': 1, 'snapshot_id': '449abdff-86c6-4340-aa7c-dc571b705c1b'}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:31:40 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-09e08ed1-cfd5-4b81-8c3b-35b7c34ab87a tempest-SnapshotDataIntegrityTests-113348013 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b0db778-d305-49b1-950c-1769ad42e6c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:31:40 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-09e08ed1-cfd5-4b81-8c3b-35b7c34ab87a tempest-SnapshotDataIntegrityTests-113348013 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b0db778-d305-49b1-950c-1769ad42e6c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:31:40 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-09e08ed1-cfd5-4b81-8c3b-35b7c34ab87a tempest-SnapshotDataIntegrityTests-113348013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (338a72c9-adde-4a74-ab31-60ded3459e17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:31:40 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-09e08ed1-cfd5-4b81-8c3b-35b7c34ab87a tempest-SnapshotDataIntegrityTests-113348013 None] Volume 68c0020d-1037-4411-bde1-bfa983e6bb15: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-68c0020d-1037-4411-bde1-bfa983e6bb15', 'volume_size': 1, 'snapshot_id': '449abdff-86c6-4340-aa7c-dc571b705c1b'} Jul 31 12:31:40 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-09e08ed1-cfd5-4b81-8c3b-35b7c34ab87a tempest-SnapshotDataIntegrityTests-113348013 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:31:40 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-09e08ed1-cfd5-4b81-8c3b-35b7c34ab87a tempest-SnapshotDataIntegrityTests-113348013 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:31:40 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-09e08ed1-cfd5-4b81-8c3b-35b7c34ab87a tempest-SnapshotDataIntegrityTests-113348013 None] Acquiring lock "cinder-quobyte-449abdff-86c6-4340-aa7c-dc571b705c1b-68c0020d-1037-4411-bde1-bfa983e6bb15" by "_create_volume_from_snapshot" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:31:41 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-09e08ed1-cfd5-4b81-8c3b-35b7c34ab87a tempest-SnapshotDataIntegrityTests-113348013 None] Lock "cinder-quobyte-449abdff-86c6-4340-aa7c-dc571b705c1b-68c0020d-1037-4411-bde1-bfa983e6bb15" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:31:41 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-09e08ed1-cfd5-4b81-8c3b-35b7c34ab87a tempest-SnapshotDataIntegrityTests-113348013 None] Creating volume 68c0020d-1037-4411-bde1-bfa983e6bb15 from snapshot 449abdff-86c6-4340-aa7c-dc571b705c1b {{(pid=89182) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 31 12:31:41 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-09e08ed1-cfd5-4b81-8c3b-35b7c34ab87a tempest-SnapshotDataIntegrityTests-113348013 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:31:41 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-09e08ed1-cfd5-4b81-8c3b-35b7c34ab87a tempest-SnapshotDataIntegrityTests-113348013 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:31:41 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-09e08ed1-cfd5-4b81-8c3b-35b7c34ab87a tempest-SnapshotDataIntegrityTests-113348013 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:31:41 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-09e08ed1-cfd5-4b81-8c3b-35b7c34ab87a tempest-SnapshotDataIntegrityTests-113348013 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:31:41 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-09e08ed1-cfd5-4b81-8c3b-35b7c34ab87a tempest-SnapshotDataIntegrityTests-113348013 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:31:41 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-09e08ed1-cfd5-4b81-8c3b-35b7c34ab87a tempest-SnapshotDataIntegrityTests-113348013 None] Selected osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 as target Quobyte volume. {{(pid=89182) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 12:31:41 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-09e08ed1-cfd5-4b81-8c3b-35b7c34ab87a tempest-SnapshotDataIntegrityTests-113348013 None] Acquiring lock "cinder-quobyte-68c0020d-1037-4411-bde1-bfa983e6bb15" by "_copy_volume_from_snapshot" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:31:41 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-09e08ed1-cfd5-4b81-8c3b-35b7c34ab87a tempest-SnapshotDataIntegrityTests-113348013 None] Lock "cinder-quobyte-68c0020d-1037-4411-bde1-bfa983e6bb15" acquired by "_copy_volume_from_snapshot" :: waited 0.026s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:31:41 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-09e08ed1-cfd5-4b81-8c3b-35b7c34ab87a tempest-SnapshotDataIntegrityTests-113348013 None] snapshot: 449abdff-86c6-4340-aa7c-dc571b705c1b, volume: 68c0020d-1037-4411-bde1-bfa983e6bb15, {{(pid=89182) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Jul 31 12:31:41 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-09e08ed1-cfd5-4b81-8c3b-35b7c34ab87a tempest-SnapshotDataIntegrityTests-113348013 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:31:41 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-09e08ed1-cfd5-4b81-8c3b-35b7c34ab87a tempest-SnapshotDataIntegrityTests-113348013 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:31:41 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-09e08ed1-cfd5-4b81-8c3b-35b7c34ab87a tempest-SnapshotDataIntegrityTests-113348013 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:31:41 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-09e08ed1-cfd5-4b81-8c3b-35b7c34ab87a tempest-SnapshotDataIntegrityTests-113348013 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:31:41 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-09e08ed1-cfd5-4b81-8c3b-35b7c34ab87a tempest-SnapshotDataIntegrityTests-113348013 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:31:41 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd695c11-62da-4a0e-8acf-147c3746dd96]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:31:41 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-09e08ed1-cfd5-4b81-8c3b-35b7c34ab87a tempest-SnapshotDataIntegrityTests-113348013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-8ef75942-d7b9-4102-a4ca-651a1de7d88a.449abdff-86c6-4340-aa7c-dc571b705c1b {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:31:41 devstack sudo[107926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-8ef75942-d7b9-4102-a4ca-651a1de7d88a.449abdff-86c6-4340-aa7c-dc571b705c1b Jul 31 12:31:41 devstack sudo[107926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:31:41 devstack sudo[107926]: pam_unix(sudo:session): session closed for user root Jul 31 12:31:41 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-09e08ed1-cfd5-4b81-8c3b-35b7c34ab87a tempest-SnapshotDataIntegrityTests-113348013 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-8ef75942-d7b9-4102-a4ca-651a1de7d88a.449abdff-86c6-4340-aa7c-dc571b705c1b" returned: 0 in 0.561s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:31:41 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-09e08ed1-cfd5-4b81-8c3b-35b7c34ab87a tempest-SnapshotDataIntegrityTests-113348013 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8ef75942-d7b9-4102-a4ca-651a1de7d88a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89182) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 12:31:41 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7171d24-3a1c-4306-af29-de5158f06cd9]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:31:41 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-09e08ed1-cfd5-4b81-8c3b-35b7c34ab87a tempest-SnapshotDataIntegrityTests-113348013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-8ef75942-d7b9-4102-a4ca-651a1de7d88a.7f584107-b1e4-435e-bc1d-5f9b2004ba6e {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:31:41 devstack sudo[107933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-8ef75942-d7b9-4102-a4ca-651a1de7d88a.7f584107-b1e4-435e-bc1d-5f9b2004ba6e Jul 31 12:31:41 devstack sudo[107933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:31:42 devstack sudo[107933]: pam_unix(sudo:session): session closed for user root Jul 31 12:31:42 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-09e08ed1-cfd5-4b81-8c3b-35b7c34ab87a tempest-SnapshotDataIntegrityTests-113348013 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-8ef75942-d7b9-4102-a4ca-651a1de7d88a.7f584107-b1e4-435e-bc1d-5f9b2004ba6e" returned: 0 in 0.505s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:31:42 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-09e08ed1-cfd5-4b81-8c3b-35b7c34ab87a tempest-SnapshotDataIntegrityTests-113348013 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8ef75942-d7b9-4102-a4ca-651a1de7d88a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89182) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 12:31:42 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-09e08ed1-cfd5-4b81-8c3b-35b7c34ab87a tempest-SnapshotDataIntegrityTests-113348013 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-8ef75942-d7b9-4102-a4ca-651a1de7d88a.7f584107-b1e4-435e-bc1d-5f9b2004ba6e {{(pid=89182) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Jul 31 12:31:42 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-09e08ed1-cfd5-4b81-8c3b-35b7c34ab87a tempest-SnapshotDataIntegrityTests-113348013 None] Creating direct copy from snapshot {{(pid=89182) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Jul 31 12:31:42 devstack cinder-volume[89182]: DEBUG cinder.utils [None req-09e08ed1-cfd5-4b81-8c3b-35b7c34ab87a tempest-SnapshotDataIntegrityTests-113348013 None] Path /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-68c0020d-1037-4411-bde1-bfa983e6bb15 not found in is_blk_device check {{(pid=89182) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 31 12:31:42 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-09e08ed1-cfd5-4b81-8c3b-35b7c34ab87a tempest-SnapshotDataIntegrityTests-113348013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-8ef75942-d7b9-4102-a4ca-651a1de7d88a.7f584107-b1e4-435e-bc1d-5f9b2004ba6e /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-68c0020d-1037-4411-bde1-bfa983e6bb15 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:31:42 devstack sudo[107939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-8ef75942-d7b9-4102-a4ca-651a1de7d88a.7f584107-b1e4-435e-bc1d-5f9b2004ba6e /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-68c0020d-1037-4411-bde1-bfa983e6bb15 Jul 31 12:31:42 devstack sudo[107939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:31:48 devstack sudo[107939]: pam_unix(sudo:session): session closed for user root Jul 31 12:31:48 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-09e08ed1-cfd5-4b81-8c3b-35b7c34ab87a tempest-SnapshotDataIntegrityTests-113348013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-8ef75942-d7b9-4102-a4ca-651a1de7d88a.7f584107-b1e4-435e-bc1d-5f9b2004ba6e /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-68c0020d-1037-4411-bde1-bfa983e6bb15" returned: 0 in 5.831s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:31:48 devstack cinder-volume[89182]: DEBUG cinder.image.image_utils [None req-09e08ed1-cfd5-4b81-8c3b-35b7c34ab87a tempest-SnapshotDataIntegrityTests-113348013 None] Image conversion details: src /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-8ef75942-d7b9-4102-a4ca-651a1de7d88a.7f584107-b1e4-435e-bc1d-5f9b2004ba6e, size 1024.00 MB, duration 5.83 sec, destination /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-68c0020d-1037-4411-bde1-bfa983e6bb15 {{(pid=89182) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 31 12:31:48 devstack cinder-volume[89182]: INFO cinder.image.image_utils [None req-09e08ed1-cfd5-4b81-8c3b-35b7c34ab87a tempest-SnapshotDataIntegrityTests-113348013 None] Converted 1024.00 MB image at 175.58 MB/s Jul 31 12:31:48 devstack cinder-volume[89182]: WARNING cinder.volume.drivers.remotefs [None req-09e08ed1-cfd5-4b81-8c3b-35b7c34ab87a tempest-SnapshotDataIntegrityTests-113348013 None] /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-68c0020d-1037-4411-bde1-bfa983e6bb15 is being set with open permissions: ugo+rw Jul 31 12:31:48 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-09e08ed1-cfd5-4b81-8c3b-35b7c34ab87a tempest-SnapshotDataIntegrityTests-113348013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-68c0020d-1037-4411-bde1-bfa983e6bb15 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:31:48 devstack sudo[107955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-68c0020d-1037-4411-bde1-bfa983e6bb15 Jul 31 12:31:48 devstack sudo[107955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:31:48 devstack sudo[107955]: pam_unix(sudo:session): session closed for user root Jul 31 12:31:48 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-09e08ed1-cfd5-4b81-8c3b-35b7c34ab87a tempest-SnapshotDataIntegrityTests-113348013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-68c0020d-1037-4411-bde1-bfa983e6bb15" returned: 0 in 0.301s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:31:48 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-09e08ed1-cfd5-4b81-8c3b-35b7c34ab87a tempest-SnapshotDataIntegrityTests-113348013 None] Lock "cinder-quobyte-68c0020d-1037-4411-bde1-bfa983e6bb15" released by "_copy_volume_from_snapshot" :: held 7.312s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:31:48 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-09e08ed1-cfd5-4b81-8c3b-35b7c34ab87a tempest-SnapshotDataIntegrityTests-113348013 None] Lock "cinder-quobyte-449abdff-86c6-4340-aa7c-dc571b705c1b-68c0020d-1037-4411-bde1-bfa983e6bb15" released by "_create_volume_from_snapshot" :: held 7.400s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:31:48 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-09e08ed1-cfd5-4b81-8c3b-35b7c34ab87a tempest-SnapshotDataIntegrityTests-113348013 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.418s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:31:48 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-09e08ed1-cfd5-4b81-8c3b-35b7c34ab87a tempest-SnapshotDataIntegrityTests-113348013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (338a72c9-adde-4a74-ab31-60ded3459e17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-68c0020d-1037-4411-bde1-bfa983e6bb15', 'volume_size': 1, 'snapshot_id': '449abdff-86c6-4340-aa7c-dc571b705c1b'}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:31:48 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-09e08ed1-cfd5-4b81-8c3b-35b7c34ab87a tempest-SnapshotDataIntegrityTests-113348013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bcb3ffac-c97c-48be-aa51-3e2385b628af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:31:48 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-09e08ed1-cfd5-4b81-8c3b-35b7c34ab87a tempest-SnapshotDataIntegrityTests-113348013 None] Volume volume-68c0020d-1037-4411-bde1-bfa983e6bb15 (68c0020d-1037-4411-bde1-bfa983e6bb15): created successfully Jul 31 12:31:48 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-09e08ed1-cfd5-4b81-8c3b-35b7c34ab87a tempest-SnapshotDataIntegrityTests-113348013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bcb3ffac-c97c-48be-aa51-3e2385b628af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:31:48 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-09e08ed1-cfd5-4b81-8c3b-35b7c34ab87a tempest-SnapshotDataIntegrityTests-113348013 None] Flow 'volume_create_manager' (75591135-6a30-46b4-bb5e-636071f8c1fc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:31:48 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-09e08ed1-cfd5-4b81-8c3b-35b7c34ab87a tempest-SnapshotDataIntegrityTests-113348013 None] Created volume successfully. Jul 31 12:31:49 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-6eb52435-28c6-4f92-b2e2-c5772197b851 tempest-VolumesNegativeTest-242317537 None] Acquiring lock "cinder-39c0d368-a821-44f5-a52e-7f1ce47177b4-delete_volume" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:31:49 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-6eb52435-28c6-4f92-b2e2-c5772197b851 tempest-VolumesNegativeTest-242317537 None] Lock "cinder-39c0d368-a821-44f5-a52e-7f1ce47177b4-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:31:49 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-6eb52435-28c6-4f92-b2e2-c5772197b851 tempest-VolumesNegativeTest-242317537 None] Acquiring lock "cinder-quobyte-39c0d368-a821-44f5-a52e-7f1ce47177b4" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:31:49 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-6eb52435-28c6-4f92-b2e2-c5772197b851 tempest-VolumesNegativeTest-242317537 None] Lock "cinder-quobyte-39c0d368-a821-44f5-a52e-7f1ce47177b4" acquired by "delete_volume" :: waited 0.035s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:31:49 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[3949c37d-9e31-42b3-bcd0-419eaec596da]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:31:49 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-6eb52435-28c6-4f92-b2e2-c5772197b851 tempest-VolumesNegativeTest-242317537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-39c0d368-a821-44f5-a52e-7f1ce47177b4 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:31:49 devstack sudo[107966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-39c0d368-a821-44f5-a52e-7f1ce47177b4 Jul 31 12:31:49 devstack sudo[107966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:31:50 devstack sudo[107966]: pam_unix(sudo:session): session closed for user root Jul 31 12:31:50 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-6eb52435-28c6-4f92-b2e2-c5772197b851 tempest-VolumesNegativeTest-242317537 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-39c0d368-a821-44f5-a52e-7f1ce47177b4" returned: 0 in 0.437s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:31:50 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-6eb52435-28c6-4f92-b2e2-c5772197b851 tempest-VolumesNegativeTest-242317537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-39c0d368-a821-44f5-a52e-7f1ce47177b4 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:31:50 devstack sudo[107976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-39c0d368-a821-44f5-a52e-7f1ce47177b4 Jul 31 12:31:50 devstack sudo[107976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:31:50 devstack sudo[107976]: pam_unix(sudo:session): session closed for user root Jul 31 12:31:50 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-6eb52435-28c6-4f92-b2e2-c5772197b851 tempest-VolumesNegativeTest-242317537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-39c0d368-a821-44f5-a52e-7f1ce47177b4" returned: 0 in 0.312s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:31:50 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-6eb52435-28c6-4f92-b2e2-c5772197b851 tempest-VolumesNegativeTest-242317537 None] Lock "cinder-quobyte-39c0d368-a821-44f5-a52e-7f1ce47177b4" released by "delete_volume" :: held 0.802s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:31:50 devstack cinder-volume[89182]: DEBUG cinder.quota [None req-6eb52435-28c6-4f92-b2e2-c5772197b851 tempest-VolumesNegativeTest-242317537 None] Created reservations ['f83516cd-e30b-4b13-80a7-1e0c5fc35ac3', '6592811a-660f-4285-b4ea-e580a735b145', 'a760e7bf-5acf-4582-a505-7bac8cd9cbf7', '2a64b700-b1ba-43c5-bb7d-1e9ac55f470d'] {{(pid=89182) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 12:31:50 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [req-5fc5baf3-d1a3-4fc9-ad5b-ace4c747e018 req-9dea7192-ba5e-4501-9ed1-10d5ed3fb5f6 tempest-SnapshotDataIntegrityTests-113348013 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:31:50 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [req-5fc5baf3-d1a3-4fc9-ad5b-ace4c747e018 req-9dea7192-ba5e-4501-9ed1-10d5ed3fb5f6 tempest-SnapshotDataIntegrityTests-113348013 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:31:50 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [req-5fc5baf3-d1a3-4fc9-ad5b-ace4c747e018 req-9dea7192-ba5e-4501-9ed1-10d5ed3fb5f6 tempest-SnapshotDataIntegrityTests-113348013 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:31:50 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-6eb52435-28c6-4f92-b2e2-c5772197b851 tempest-VolumesNegativeTest-242317537 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:31:50 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-6eb52435-28c6-4f92-b2e2-c5772197b851 tempest-VolumesNegativeTest-242317537 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:31:50 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-6eb52435-28c6-4f92-b2e2-c5772197b851 tempest-VolumesNegativeTest-242317537 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:31:50 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-6eb52435-28c6-4f92-b2e2-c5772197b851 tempest-VolumesNegativeTest-242317537 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:31:50 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-6eb52435-28c6-4f92-b2e2-c5772197b851 tempest-VolumesNegativeTest-242317537 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:31:50 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-6eb52435-28c6-4f92-b2e2-c5772197b851 tempest-VolumesNegativeTest-242317537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:31:50 devstack sudo[107988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 Jul 31 12:31:50 devstack sudo[107988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:31:50 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [req-5fc5baf3-d1a3-4fc9-ad5b-ace4c747e018 req-9dea7192-ba5e-4501-9ed1-10d5ed3fb5f6 tempest-SnapshotDataIntegrityTests-113348013 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88', 'name': 'volume-68c0020d-1037-4411-bde1-bfa983e6bb15', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '07e6f8d3-6fd0-4619-960f-41269a0df4eb', 'enforce_multipath': True} {{(pid=89182) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 31 12:31:50 devstack cinder-volume[89182]: INFO cinder.volume.manager [req-5fc5baf3-d1a3-4fc9-ad5b-ace4c747e018 req-9dea7192-ba5e-4501-9ed1-10d5ed3fb5f6 tempest-SnapshotDataIntegrityTests-113348013 None] attachment_update completed successfully. Jul 31 12:31:51 devstack sudo[107988]: pam_unix(sudo:session): session closed for user root Jul 31 12:31:51 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-6eb52435-28c6-4f92-b2e2-c5772197b851 tempest-VolumesNegativeTest-242317537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2" returned: 0 in 0.293s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:31:51 devstack cinder-volume[89182]: DEBUG cinder.manager [None req-6eb52435-28c6-4f92-b2e2-c5772197b851 tempest-VolumesNegativeTest-242317537 None] Notifying Schedulers of capabilities ... {{(pid=89182) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 12:31:51 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-6eb52435-28c6-4f92-b2e2-c5772197b851 tempest-VolumesNegativeTest-242317537 None] Deleted volume successfully. Jul 31 12:31:51 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-6eb52435-28c6-4f92-b2e2-c5772197b851 tempest-VolumesNegativeTest-242317537 None] Lock "cinder-39c0d368-a821-44f5-a52e-7f1ce47177b4-delete_volume" released by "delete_volume" :: held 1.636s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:31:54 devstack cinder-volume[89182]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4ec2570-9220-420c-8cc5-278c75cfb7e3 tempest-VolumesSnapshotNegativeTestJSON-1913200100 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89182) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 12:31:54 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-f4ec2570-9220-420c-8cc5-278c75cfb7e3 tempest-VolumesSnapshotNegativeTestJSON-1913200100 None] Flow 'volume_create_manager' (7db05533-6175-4c52-aeab-aed76031a547) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:31:54 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-f4ec2570-9220-420c-8cc5-278c75cfb7e3 tempest-VolumesSnapshotNegativeTestJSON-1913200100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01a590d5-304e-4cab-9c40-f29159e1b5f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:31:54 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-f4ec2570-9220-420c-8cc5-278c75cfb7e3 tempest-VolumesSnapshotNegativeTestJSON-1913200100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01a590d5-304e-4cab-9c40-f29159e1b5f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:31:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-588099123',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78792609-d034-45bf-9b4c-179a99ab6e9e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2b43671b4ff4774909066ce5cd0d863',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:31:55Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:31:55Z,use_quota=True,user_id='980298624c7542048ad2a833af3e3d7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:31:54 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-f4ec2570-9220-420c-8cc5-278c75cfb7e3 tempest-VolumesSnapshotNegativeTestJSON-1913200100 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73a02675-3f3d-469f-aedf-320b610f3f28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:31:54 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-f4ec2570-9220-420c-8cc5-278c75cfb7e3 tempest-VolumesSnapshotNegativeTestJSON-1913200100 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73a02675-3f3d-469f-aedf-320b610f3f28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:31:54 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-f4ec2570-9220-420c-8cc5-278c75cfb7e3 tempest-VolumesSnapshotNegativeTestJSON-1913200100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (594b0a7c-bd2f-4c0c-9bba-36ba4aa14d62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:31:54 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-f4ec2570-9220-420c-8cc5-278c75cfb7e3 tempest-VolumesSnapshotNegativeTestJSON-1913200100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (594b0a7c-bd2f-4c0c-9bba-36ba4aa14d62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '78792609-d034-45bf-9b4c-179a99ab6e9e', 'volume_name': 'volume-78792609-d034-45bf-9b4c-179a99ab6e9e', 'volume_size': 2}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:31:54 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-f4ec2570-9220-420c-8cc5-278c75cfb7e3 tempest-VolumesSnapshotNegativeTestJSON-1913200100 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d6c12a4-4ef9-446f-ac59-95647e14c64a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:31:54 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-f4ec2570-9220-420c-8cc5-278c75cfb7e3 tempest-VolumesSnapshotNegativeTestJSON-1913200100 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d6c12a4-4ef9-446f-ac59-95647e14c64a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:31:54 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-f4ec2570-9220-420c-8cc5-278c75cfb7e3 tempest-VolumesSnapshotNegativeTestJSON-1913200100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f72b95a8-2e76-4145-aff4-f2a12a3971db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:31:54 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-f4ec2570-9220-420c-8cc5-278c75cfb7e3 tempest-VolumesSnapshotNegativeTestJSON-1913200100 None] Volume 78792609-d034-45bf-9b4c-179a99ab6e9e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-78792609-d034-45bf-9b4c-179a99ab6e9e', 'volume_size': 2} Jul 31 12:31:54 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-f4ec2570-9220-420c-8cc5-278c75cfb7e3 tempest-VolumesSnapshotNegativeTestJSON-1913200100 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:31:54 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-f4ec2570-9220-420c-8cc5-278c75cfb7e3 tempest-VolumesSnapshotNegativeTestJSON-1913200100 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:31:54 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-f4ec2570-9220-420c-8cc5-278c75cfb7e3 tempest-VolumesSnapshotNegativeTestJSON-1913200100 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:31:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-588099123',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78792609-d034-45bf-9b4c-179a99ab6e9e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2b43671b4ff4774909066ce5cd0d863',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:31:55Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:31:55Z,use_quota=True,user_id='980298624c7542048ad2a833af3e3d7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)}" {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 12:31:54 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-f4ec2570-9220-420c-8cc5-278c75cfb7e3 tempest-VolumesSnapshotNegativeTestJSON-1913200100 None] Creating volume 78792609-d034-45bf-9b4c-179a99ab6e9e {{(pid=89182) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 12:31:54 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-f4ec2570-9220-420c-8cc5-278c75cfb7e3 tempest-VolumesSnapshotNegativeTestJSON-1913200100 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:31:54 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-f4ec2570-9220-420c-8cc5-278c75cfb7e3 tempest-VolumesSnapshotNegativeTestJSON-1913200100 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:31:54 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-f4ec2570-9220-420c-8cc5-278c75cfb7e3 tempest-VolumesSnapshotNegativeTestJSON-1913200100 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:31:54 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-f4ec2570-9220-420c-8cc5-278c75cfb7e3 tempest-VolumesSnapshotNegativeTestJSON-1913200100 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:31:54 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-f4ec2570-9220-420c-8cc5-278c75cfb7e3 tempest-VolumesSnapshotNegativeTestJSON-1913200100 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:31:54 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-f4ec2570-9220-420c-8cc5-278c75cfb7e3 tempest-VolumesSnapshotNegativeTestJSON-1913200100 None] Selected osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 as target Quobyte volume. {{(pid=89182) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 12:31:54 devstack cinder-volume[89182]: INFO cinder.volume.drivers.remotefs [None req-f4ec2570-9220-420c-8cc5-278c75cfb7e3 tempest-VolumesSnapshotNegativeTestJSON-1913200100 None] casted to osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 Jul 31 12:31:54 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-f4ec2570-9220-420c-8cc5-278c75cfb7e3 tempest-VolumesSnapshotNegativeTestJSON-1913200100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-78792609-d034-45bf-9b4c-179a99ab6e9e 2147483648 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:31:55 devstack sudo[108428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-78792609-d034-45bf-9b4c-179a99ab6e9e 2147483648 Jul 31 12:31:55 devstack sudo[108428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:31:55 devstack cinder-volume[89182]: INFO cinder.volume.manager [req-55117117-7f91-4f13-b82e-a9137a478148 req-e3ba9a61-365f-4038-b042-61164426c0a5 tempest-SnapshotDataIntegrityTests-113348013 None] Terminate volume connection completed successfully. Jul 31 12:31:55 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [req-55117117-7f91-4f13-b82e-a9137a478148 req-e3ba9a61-365f-4038-b042-61164426c0a5 tempest-SnapshotDataIntegrityTests-113348013 None] Deleting attachment 07e6f8d3-6fd0-4619-960f-41269a0df4eb. {{(pid=89182) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 31 12:31:55 devstack sudo[108428]: pam_unix(sudo:session): session closed for user root Jul 31 12:31:55 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-f4ec2570-9220-420c-8cc5-278c75cfb7e3 tempest-VolumesSnapshotNegativeTestJSON-1913200100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-78792609-d034-45bf-9b4c-179a99ab6e9e 2147483648" returned: 0 in 0.597s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:31:55 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-f4ec2570-9220-420c-8cc5-278c75cfb7e3 tempest-VolumesSnapshotNegativeTestJSON-1913200100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-78792609-d034-45bf-9b4c-179a99ab6e9e {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:31:55 devstack sudo[108434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-78792609-d034-45bf-9b4c-179a99ab6e9e Jul 31 12:31:55 devstack sudo[108434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:31:55 devstack sudo[108434]: pam_unix(sudo:session): session closed for user root Jul 31 12:31:55 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-f4ec2570-9220-420c-8cc5-278c75cfb7e3 tempest-VolumesSnapshotNegativeTestJSON-1913200100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-78792609-d034-45bf-9b4c-179a99ab6e9e" returned: 0 in 0.245s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:31:55 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-f4ec2570-9220-420c-8cc5-278c75cfb7e3 tempest-VolumesSnapshotNegativeTestJSON-1913200100 None] <== create_volume: return (912ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'} {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 12:31:55 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-f4ec2570-9220-420c-8cc5-278c75cfb7e3 tempest-VolumesSnapshotNegativeTestJSON-1913200100 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.915s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:31:55 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-f4ec2570-9220-420c-8cc5-278c75cfb7e3 tempest-VolumesSnapshotNegativeTestJSON-1913200100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f72b95a8-2e76-4145-aff4-f2a12a3971db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-78792609-d034-45bf-9b4c-179a99ab6e9e', 'volume_size': 2}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:31:55 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-f4ec2570-9220-420c-8cc5-278c75cfb7e3 tempest-VolumesSnapshotNegativeTestJSON-1913200100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce8c0b27-85a3-481b-9522-7704479a7146) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:31:55 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-f4ec2570-9220-420c-8cc5-278c75cfb7e3 tempest-VolumesSnapshotNegativeTestJSON-1913200100 None] Volume volume-78792609-d034-45bf-9b4c-179a99ab6e9e (78792609-d034-45bf-9b4c-179a99ab6e9e): created successfully Jul 31 12:31:55 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-f4ec2570-9220-420c-8cc5-278c75cfb7e3 tempest-VolumesSnapshotNegativeTestJSON-1913200100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce8c0b27-85a3-481b-9522-7704479a7146) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:31:55 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-f4ec2570-9220-420c-8cc5-278c75cfb7e3 tempest-VolumesSnapshotNegativeTestJSON-1913200100 None] Flow 'volume_create_manager' (7db05533-6175-4c52-aeab-aed76031a547) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:31:55 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-f4ec2570-9220-420c-8cc5-278c75cfb7e3 tempest-VolumesSnapshotNegativeTestJSON-1913200100 None] Created volume successfully. Jul 31 12:31:56 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-32363e27-465c-4b58-b0e7-f967045437e5 tempest-SnapshotDataIntegrityTests-113348013 None] Acquiring lock "cinder-68c0020d-1037-4411-bde1-bfa983e6bb15-delete_volume" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:31:56 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-32363e27-465c-4b58-b0e7-f967045437e5 tempest-SnapshotDataIntegrityTests-113348013 None] Lock "cinder-68c0020d-1037-4411-bde1-bfa983e6bb15-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:31:56 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-32363e27-465c-4b58-b0e7-f967045437e5 tempest-SnapshotDataIntegrityTests-113348013 None] Acquiring lock "cinder-quobyte-68c0020d-1037-4411-bde1-bfa983e6bb15" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:31:56 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-32363e27-465c-4b58-b0e7-f967045437e5 tempest-SnapshotDataIntegrityTests-113348013 None] Lock "cinder-quobyte-68c0020d-1037-4411-bde1-bfa983e6bb15" acquired by "delete_volume" :: waited 0.018s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:31:56 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5638a6b-e649-4752-b880-616496cb73ca]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:31:56 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-32363e27-465c-4b58-b0e7-f967045437e5 tempest-SnapshotDataIntegrityTests-113348013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-68c0020d-1037-4411-bde1-bfa983e6bb15 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:31:56 devstack sudo[108437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-68c0020d-1037-4411-bde1-bfa983e6bb15 Jul 31 12:31:56 devstack sudo[108437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:31:56 devstack sudo[108437]: pam_unix(sudo:session): session closed for user root Jul 31 12:31:56 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-32363e27-465c-4b58-b0e7-f967045437e5 tempest-SnapshotDataIntegrityTests-113348013 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-68c0020d-1037-4411-bde1-bfa983e6bb15" returned: 0 in 0.391s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:31:56 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-32363e27-465c-4b58-b0e7-f967045437e5 tempest-SnapshotDataIntegrityTests-113348013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-68c0020d-1037-4411-bde1-bfa983e6bb15 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:31:56 devstack sudo[108443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-68c0020d-1037-4411-bde1-bfa983e6bb15 Jul 31 12:31:56 devstack sudo[108443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:31:57 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-729f3bb9-720f-40d7-b6f3-3016b41a91d0 tempest-VolumesSnapshotNegativeTestJSON-1913200100 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:31:57 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-729f3bb9-720f-40d7-b6f3-3016b41a91d0 tempest-VolumesSnapshotNegativeTestJSON-1913200100 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:31:57 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-729f3bb9-720f-40d7-b6f3-3016b41a91d0 tempest-VolumesSnapshotNegativeTestJSON-1913200100 None] Creating offline snapshot 34aead5f-1cb4-4737-bb16-f1f7056dfd0f of volume 78792609-d034-45bf-9b4c-179a99ab6e9e {{(pid=89182) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 31 12:31:57 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[4433b2e6-eb07-4a0e-bdcd-17f61554294b]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:31:57 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-729f3bb9-720f-40d7-b6f3-3016b41a91d0 tempest-VolumesSnapshotNegativeTestJSON-1913200100 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-78792609-d034-45bf-9b4c-179a99ab6e9e {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:31:57 devstack sudo[108443]: pam_unix(sudo:session): session closed for user root Jul 31 12:31:57 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-32363e27-465c-4b58-b0e7-f967045437e5 tempest-SnapshotDataIntegrityTests-113348013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-68c0020d-1037-4411-bde1-bfa983e6bb15" returned: 0 in 0.307s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:31:57 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-32363e27-465c-4b58-b0e7-f967045437e5 tempest-SnapshotDataIntegrityTests-113348013 None] Lock "cinder-quobyte-68c0020d-1037-4411-bde1-bfa983e6bb15" released by "delete_volume" :: held 0.744s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:31:57 devstack sudo[108446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-78792609-d034-45bf-9b4c-179a99ab6e9e Jul 31 12:31:57 devstack sudo[108446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:31:57 devstack cinder-volume[89182]: DEBUG cinder.quota [None req-32363e27-465c-4b58-b0e7-f967045437e5 tempest-SnapshotDataIntegrityTests-113348013 None] Created reservations ['2ee9ce2e-05ce-4a79-a49d-85e4b9f4f7c3', '89d278fd-9fdc-4881-bf9d-8e2fb39a5227', '6a2fb02f-2dea-4ad1-bc0b-022131e6cd58', '9120ac8b-c109-4a62-8d6c-9164f1d66ba8'] {{(pid=89182) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 12:31:57 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-32363e27-465c-4b58-b0e7-f967045437e5 tempest-SnapshotDataIntegrityTests-113348013 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:31:57 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-32363e27-465c-4b58-b0e7-f967045437e5 tempest-SnapshotDataIntegrityTests-113348013 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:31:57 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-32363e27-465c-4b58-b0e7-f967045437e5 tempest-SnapshotDataIntegrityTests-113348013 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:31:57 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-32363e27-465c-4b58-b0e7-f967045437e5 tempest-SnapshotDataIntegrityTests-113348013 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:31:57 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-32363e27-465c-4b58-b0e7-f967045437e5 tempest-SnapshotDataIntegrityTests-113348013 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:31:57 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-32363e27-465c-4b58-b0e7-f967045437e5 tempest-SnapshotDataIntegrityTests-113348013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:31:57 devstack sudo[108448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 Jul 31 12:31:57 devstack sudo[108448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:31:57 devstack sudo[108446]: pam_unix(sudo:session): session closed for user root Jul 31 12:31:57 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-729f3bb9-720f-40d7-b6f3-3016b41a91d0 tempest-VolumesSnapshotNegativeTestJSON-1913200100 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-78792609-d034-45bf-9b4c-179a99ab6e9e" returned: 0 in 0.454s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:31:57 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-729f3bb9-720f-40d7-b6f3-3016b41a91d0 tempest-VolumesSnapshotNegativeTestJSON-1913200100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-78792609-d034-45bf-9b4c-179a99ab6e9e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-78792609-d034-45bf-9b4c-179a99ab6e9e.34aead5f-1cb4-4737-bb16-f1f7056dfd0f 2G {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:31:57 devstack sudo[108454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-78792609-d034-45bf-9b4c-179a99ab6e9e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-78792609-d034-45bf-9b4c-179a99ab6e9e.34aead5f-1cb4-4737-bb16-f1f7056dfd0f 2G Jul 31 12:31:57 devstack sudo[108454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:31:57 devstack sudo[108448]: pam_unix(sudo:session): session closed for user root Jul 31 12:31:57 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-32363e27-465c-4b58-b0e7-f967045437e5 tempest-SnapshotDataIntegrityTests-113348013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2" returned: 0 in 0.316s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:31:57 devstack cinder-volume[89182]: DEBUG cinder.manager [None req-32363e27-465c-4b58-b0e7-f967045437e5 tempest-SnapshotDataIntegrityTests-113348013 None] Notifying Schedulers of capabilities ... {{(pid=89182) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 12:31:57 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-32363e27-465c-4b58-b0e7-f967045437e5 tempest-SnapshotDataIntegrityTests-113348013 None] Deleted volume successfully. Jul 31 12:31:57 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-32363e27-465c-4b58-b0e7-f967045437e5 tempest-SnapshotDataIntegrityTests-113348013 None] Lock "cinder-68c0020d-1037-4411-bde1-bfa983e6bb15-delete_volume" released by "delete_volume" :: held 1.378s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:31:57 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-f50b4dec-efa6-451c-89a6-210c4c89a2b2 tempest-SnapshotDataIntegrityTests-113348013 None] Acquiring lock "cinder-caf61784-9d2c-4244-9421-3e97d71e440e-delete_volume" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:31:57 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-f50b4dec-efa6-451c-89a6-210c4c89a2b2 tempest-SnapshotDataIntegrityTests-113348013 None] Lock "cinder-caf61784-9d2c-4244-9421-3e97d71e440e-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:31:58 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-f50b4dec-efa6-451c-89a6-210c4c89a2b2 tempest-SnapshotDataIntegrityTests-113348013 None] Acquiring lock "cinder-quobyte-caf61784-9d2c-4244-9421-3e97d71e440e" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:31:58 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-f50b4dec-efa6-451c-89a6-210c4c89a2b2 tempest-SnapshotDataIntegrityTests-113348013 None] Lock "cinder-quobyte-caf61784-9d2c-4244-9421-3e97d71e440e" acquired by "delete_volume" :: waited 0.020s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:31:58 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5ebc3e4-862f-4f11-86d7-d8af189257d4]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:31:58 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-f50b4dec-efa6-451c-89a6-210c4c89a2b2 tempest-SnapshotDataIntegrityTests-113348013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-caf61784-9d2c-4244-9421-3e97d71e440e {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:31:58 devstack sudo[108459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-caf61784-9d2c-4244-9421-3e97d71e440e Jul 31 12:31:58 devstack sudo[108459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:31:58 devstack sudo[108454]: pam_unix(sudo:session): session closed for user root Jul 31 12:31:58 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-729f3bb9-720f-40d7-b6f3-3016b41a91d0 tempest-VolumesSnapshotNegativeTestJSON-1913200100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-78792609-d034-45bf-9b4c-179a99ab6e9e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-78792609-d034-45bf-9b4c-179a99ab6e9e.34aead5f-1cb4-4737-bb16-f1f7056dfd0f 2G" returned: 0 in 0.731s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:31:58 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-729f3bb9-720f-40d7-b6f3-3016b41a91d0 tempest-VolumesSnapshotNegativeTestJSON-1913200100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-78792609-d034-45bf-9b4c-179a99ab6e9e -F qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-78792609-d034-45bf-9b4c-179a99ab6e9e.34aead5f-1cb4-4737-bb16-f1f7056dfd0f {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:31:58 devstack sudo[108463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-78792609-d034-45bf-9b4c-179a99ab6e9e -F qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-78792609-d034-45bf-9b4c-179a99ab6e9e.34aead5f-1cb4-4737-bb16-f1f7056dfd0f Jul 31 12:31:58 devstack sudo[108463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:31:58 devstack sudo[108459]: pam_unix(sudo:session): session closed for user root Jul 31 12:31:58 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-f50b4dec-efa6-451c-89a6-210c4c89a2b2 tempest-SnapshotDataIntegrityTests-113348013 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-caf61784-9d2c-4244-9421-3e97d71e440e" returned: 0 in 0.486s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:31:58 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-f50b4dec-efa6-451c-89a6-210c4c89a2b2 tempest-SnapshotDataIntegrityTests-113348013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-caf61784-9d2c-4244-9421-3e97d71e440e {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:31:58 devstack sudo[108469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-caf61784-9d2c-4244-9421-3e97d71e440e Jul 31 12:31:58 devstack sudo[108469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:31:58 devstack sudo[108463]: pam_unix(sudo:session): session closed for user root Jul 31 12:31:58 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-729f3bb9-720f-40d7-b6f3-3016b41a91d0 tempest-VolumesSnapshotNegativeTestJSON-1913200100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-78792609-d034-45bf-9b4c-179a99ab6e9e -F qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-78792609-d034-45bf-9b4c-179a99ab6e9e.34aead5f-1cb4-4737-bb16-f1f7056dfd0f" returned: 0 in 0.414s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:31:58 devstack cinder-volume[89182]: WARNING cinder.volume.drivers.remotefs [None req-729f3bb9-720f-40d7-b6f3-3016b41a91d0 tempest-VolumesSnapshotNegativeTestJSON-1913200100 None] /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-78792609-d034-45bf-9b4c-179a99ab6e9e.34aead5f-1cb4-4737-bb16-f1f7056dfd0f is being set with open permissions: ugo+rw Jul 31 12:31:58 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-729f3bb9-720f-40d7-b6f3-3016b41a91d0 tempest-VolumesSnapshotNegativeTestJSON-1913200100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-78792609-d034-45bf-9b4c-179a99ab6e9e.34aead5f-1cb4-4737-bb16-f1f7056dfd0f {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:31:58 devstack sudo[108474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-78792609-d034-45bf-9b4c-179a99ab6e9e.34aead5f-1cb4-4737-bb16-f1f7056dfd0f Jul 31 12:31:58 devstack sudo[108474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:31:58 devstack sudo[108469]: pam_unix(sudo:session): session closed for user root Jul 31 12:31:58 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-f50b4dec-efa6-451c-89a6-210c4c89a2b2 tempest-SnapshotDataIntegrityTests-113348013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-caf61784-9d2c-4244-9421-3e97d71e440e" returned: 0 in 0.320s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:31:58 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-f50b4dec-efa6-451c-89a6-210c4c89a2b2 tempest-SnapshotDataIntegrityTests-113348013 None] Lock "cinder-quobyte-caf61784-9d2c-4244-9421-3e97d71e440e" released by "delete_volume" :: held 0.864s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:31:58 devstack cinder-volume[89182]: DEBUG cinder.quota [None req-f50b4dec-efa6-451c-89a6-210c4c89a2b2 tempest-SnapshotDataIntegrityTests-113348013 None] Created reservations ['cb9f11fa-2e98-42a6-913c-5e18f9c06f7c', 'cd9251f8-1b74-41e3-aef2-2b3b0c4a9906', '1e5d9df0-7882-4c43-afb7-aff7ba64459b', 'ff2907c4-6693-4a56-8611-0d1c74dcfd42'] {{(pid=89182) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 12:31:59 devstack sudo[108474]: pam_unix(sudo:session): session closed for user root Jul 31 12:31:59 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-f50b4dec-efa6-451c-89a6-210c4c89a2b2 tempest-SnapshotDataIntegrityTests-113348013 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:31:59 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-f50b4dec-efa6-451c-89a6-210c4c89a2b2 tempest-SnapshotDataIntegrityTests-113348013 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:31:59 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-f50b4dec-efa6-451c-89a6-210c4c89a2b2 tempest-SnapshotDataIntegrityTests-113348013 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:31:59 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-f50b4dec-efa6-451c-89a6-210c4c89a2b2 tempest-SnapshotDataIntegrityTests-113348013 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:31:59 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-f50b4dec-efa6-451c-89a6-210c4c89a2b2 tempest-SnapshotDataIntegrityTests-113348013 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:31:59 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-f50b4dec-efa6-451c-89a6-210c4c89a2b2 tempest-SnapshotDataIntegrityTests-113348013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:31:59 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-729f3bb9-720f-40d7-b6f3-3016b41a91d0 tempest-VolumesSnapshotNegativeTestJSON-1913200100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-78792609-d034-45bf-9b4c-179a99ab6e9e.34aead5f-1cb4-4737-bb16-f1f7056dfd0f" returned: 0 in 0.302s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:31:59 devstack sudo[108478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 Jul 31 12:31:59 devstack sudo[108478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:31:59 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-729f3bb9-720f-40d7-b6f3-3016b41a91d0 tempest-VolumesSnapshotNegativeTestJSON-1913200100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-78792609-d034-45bf-9b4c-179a99ab6e9e.info {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:31:59 devstack sudo[108480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-78792609-d034-45bf-9b4c-179a99ab6e9e.info Jul 31 12:31:59 devstack sudo[108480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:31:59 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-1357edcd-f72a-4904-8ead-0305f4d9ca5b tempest-SnapshotDataIntegrityTests-113348013 None] Acquiring lock "cinder-52b3dce3-91b8-4da0-99fe-4c0919ab8b11-delete_volume" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:31:59 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-1357edcd-f72a-4904-8ead-0305f4d9ca5b tempest-SnapshotDataIntegrityTests-113348013 None] Lock "cinder-52b3dce3-91b8-4da0-99fe-4c0919ab8b11-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:31:59 devstack sudo[108478]: pam_unix(sudo:session): session closed for user root Jul 31 12:31:59 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-1357edcd-f72a-4904-8ead-0305f4d9ca5b tempest-SnapshotDataIntegrityTests-113348013 None] Acquiring lock "cinder-quobyte-52b3dce3-91b8-4da0-99fe-4c0919ab8b11" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:31:59 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-f50b4dec-efa6-451c-89a6-210c4c89a2b2 tempest-SnapshotDataIntegrityTests-113348013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2" returned: 0 in 0.330s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:31:59 devstack cinder-volume[89182]: DEBUG cinder.manager [None req-f50b4dec-efa6-451c-89a6-210c4c89a2b2 tempest-SnapshotDataIntegrityTests-113348013 None] Notifying Schedulers of capabilities ... {{(pid=89182) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 12:31:59 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-f50b4dec-efa6-451c-89a6-210c4c89a2b2 tempest-SnapshotDataIntegrityTests-113348013 None] Deleted volume successfully. Jul 31 12:31:59 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-1357edcd-f72a-4904-8ead-0305f4d9ca5b tempest-SnapshotDataIntegrityTests-113348013 None] Lock "cinder-quobyte-52b3dce3-91b8-4da0-99fe-4c0919ab8b11" acquired by "delete_volume" :: waited 0.026s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:31:59 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-f50b4dec-efa6-451c-89a6-210c4c89a2b2 tempest-SnapshotDataIntegrityTests-113348013 None] Lock "cinder-caf61784-9d2c-4244-9421-3e97d71e440e-delete_volume" released by "delete_volume" :: held 1.497s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:31:59 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dd6d7a0-d176-4853-83af-48e1489d5cd8]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:31:59 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-1357edcd-f72a-4904-8ead-0305f4d9ca5b tempest-SnapshotDataIntegrityTests-113348013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-52b3dce3-91b8-4da0-99fe-4c0919ab8b11 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:31:59 devstack sudo[108480]: pam_unix(sudo:session): session closed for user root Jul 31 12:31:59 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-729f3bb9-720f-40d7-b6f3-3016b41a91d0 tempest-VolumesSnapshotNegativeTestJSON-1913200100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-78792609-d034-45bf-9b4c-179a99ab6e9e.info" returned: 0 in 0.371s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:31:59 devstack cinder-volume[89182]: WARNING cinder.volume.drivers.remotefs [None req-729f3bb9-720f-40d7-b6f3-3016b41a91d0 tempest-VolumesSnapshotNegativeTestJSON-1913200100 None] /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-78792609-d034-45bf-9b4c-179a99ab6e9e.info is being set with open permissions: ugo+rw Jul 31 12:31:59 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-729f3bb9-720f-40d7-b6f3-3016b41a91d0 tempest-VolumesSnapshotNegativeTestJSON-1913200100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-78792609-d034-45bf-9b4c-179a99ab6e9e.info {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:31:59 devstack sudo[108485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-78792609-d034-45bf-9b4c-179a99ab6e9e.info Jul 31 12:31:59 devstack sudo[108485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:31:59 devstack sudo[108484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-52b3dce3-91b8-4da0-99fe-4c0919ab8b11 Jul 31 12:31:59 devstack sudo[108484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:31:59 devstack sudo[108485]: pam_unix(sudo:session): session closed for user root Jul 31 12:31:59 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-729f3bb9-720f-40d7-b6f3-3016b41a91d0 tempest-VolumesSnapshotNegativeTestJSON-1913200100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-78792609-d034-45bf-9b4c-179a99ab6e9e.info" returned: 0 in 0.316s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:31:59 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-729f3bb9-720f-40d7-b6f3-3016b41a91d0 tempest-VolumesSnapshotNegativeTestJSON-1913200100 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.693s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:31:59 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-729f3bb9-720f-40d7-b6f3-3016b41a91d0 tempest-VolumesSnapshotNegativeTestJSON-1913200100 None] Create snapshot completed successfully Jul 31 12:31:59 devstack sudo[108484]: pam_unix(sudo:session): session closed for user root Jul 31 12:31:59 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-1357edcd-f72a-4904-8ead-0305f4d9ca5b tempest-SnapshotDataIntegrityTests-113348013 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-52b3dce3-91b8-4da0-99fe-4c0919ab8b11" returned: 0 in 0.435s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:31:59 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-1357edcd-f72a-4904-8ead-0305f4d9ca5b tempest-SnapshotDataIntegrityTests-113348013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-52b3dce3-91b8-4da0-99fe-4c0919ab8b11 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:31:59 devstack sudo[108492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-52b3dce3-91b8-4da0-99fe-4c0919ab8b11 Jul 31 12:31:59 devstack sudo[108492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:32:00 devstack sudo[108492]: pam_unix(sudo:session): session closed for user root Jul 31 12:32:00 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-1357edcd-f72a-4904-8ead-0305f4d9ca5b tempest-SnapshotDataIntegrityTests-113348013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-52b3dce3-91b8-4da0-99fe-4c0919ab8b11" returned: 0 in 0.289s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:32:00 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-1357edcd-f72a-4904-8ead-0305f4d9ca5b tempest-SnapshotDataIntegrityTests-113348013 None] Lock "cinder-quobyte-52b3dce3-91b8-4da0-99fe-4c0919ab8b11" released by "delete_volume" :: held 0.780s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:32:00 devstack cinder-volume[89182]: DEBUG cinder.quota [None req-1357edcd-f72a-4904-8ead-0305f4d9ca5b tempest-SnapshotDataIntegrityTests-113348013 None] Created reservations ['f23ca063-99d7-4339-9c90-5892c35797c4', '36b53eb0-59fa-4177-9c0b-974034d1de81', '7eb5d918-c1e6-4efe-bfcc-847db76ff0db', 'f59923ea-0b21-4378-978a-bf9e9d940719'] {{(pid=89182) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 12:32:00 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-1357edcd-f72a-4904-8ead-0305f4d9ca5b tempest-SnapshotDataIntegrityTests-113348013 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:32:00 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-1357edcd-f72a-4904-8ead-0305f4d9ca5b tempest-SnapshotDataIntegrityTests-113348013 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:32:00 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-1357edcd-f72a-4904-8ead-0305f4d9ca5b tempest-SnapshotDataIntegrityTests-113348013 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:32:00 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-1357edcd-f72a-4904-8ead-0305f4d9ca5b tempest-SnapshotDataIntegrityTests-113348013 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:32:00 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-1357edcd-f72a-4904-8ead-0305f4d9ca5b tempest-SnapshotDataIntegrityTests-113348013 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:32:00 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-1357edcd-f72a-4904-8ead-0305f4d9ca5b tempest-SnapshotDataIntegrityTests-113348013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:32:00 devstack sudo[108495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 Jul 31 12:32:00 devstack sudo[108495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:32:00 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-0fd2f089-422d-4503-9beb-c1ca28f91759 tempest-VolumesSnapshotNegativeTestJSON-1913200100 None] Acquiring lock "cinder-34aead5f-1cb4-4737-bb16-f1f7056dfd0f-delete_snapshot" by "delete_snapshot" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:32:00 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-0fd2f089-422d-4503-9beb-c1ca28f91759 tempest-VolumesSnapshotNegativeTestJSON-1913200100 None] Lock "cinder-34aead5f-1cb4-4737-bb16-f1f7056dfd0f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.051s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:32:00 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-0fd2f089-422d-4503-9beb-c1ca28f91759 tempest-VolumesSnapshotNegativeTestJSON-1913200100 None] Acquiring lock "cinder-quobyte-78792609-d034-45bf-9b4c-179a99ab6e9e" by "delete_snapshot" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:32:00 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-0fd2f089-422d-4503-9beb-c1ca28f91759 tempest-VolumesSnapshotNegativeTestJSON-1913200100 None] Lock "cinder-quobyte-78792609-d034-45bf-9b4c-179a99ab6e9e" acquired by "delete_snapshot" :: waited 0.024s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:32:00 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-0fd2f089-422d-4503-9beb-c1ca28f91759 tempest-VolumesSnapshotNegativeTestJSON-1913200100 None] Acquiring lock "cinder-quobyte-34aead5f-1cb4-4737-bb16-f1f7056dfd0f" by "_delete_snapshot" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:32:00 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-0fd2f089-422d-4503-9beb-c1ca28f91759 tempest-VolumesSnapshotNegativeTestJSON-1913200100 None] Lock "cinder-quobyte-34aead5f-1cb4-4737-bb16-f1f7056dfd0f" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:32:00 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-0fd2f089-422d-4503-9beb-c1ca28f91759 tempest-VolumesSnapshotNegativeTestJSON-1913200100 None] Deleting offline snapshot 34aead5f-1cb4-4737-bb16-f1f7056dfd0f of volume 78792609-d034-45bf-9b4c-179a99ab6e9e {{(pid=89182) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 31 12:32:00 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-0fd2f089-422d-4503-9beb-c1ca28f91759 tempest-VolumesSnapshotNegativeTestJSON-1913200100 None] snapshot_file for this snap is: volume-78792609-d034-45bf-9b4c-179a99ab6e9e.34aead5f-1cb4-4737-bb16-f1f7056dfd0f {{(pid=89182) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 31 12:32:00 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-6ee3d6fb-a1c2-42a5-a1a5-7e2611d6037d tempest-SnapshotDataIntegrityTests-113348013 None] Acquiring lock "cinder-449abdff-86c6-4340-aa7c-dc571b705c1b-delete_snapshot" by "delete_snapshot" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:32:00 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4bb8923-e147-47c3-8c72-b51441f533c9]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:32:00 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-0fd2f089-422d-4503-9beb-c1ca28f91759 tempest-VolumesSnapshotNegativeTestJSON-1913200100 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-78792609-d034-45bf-9b4c-179a99ab6e9e.34aead5f-1cb4-4737-bb16-f1f7056dfd0f {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:32:00 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-6ee3d6fb-a1c2-42a5-a1a5-7e2611d6037d tempest-SnapshotDataIntegrityTests-113348013 None] Lock "cinder-449abdff-86c6-4340-aa7c-dc571b705c1b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.045s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:32:00 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-6ee3d6fb-a1c2-42a5-a1a5-7e2611d6037d tempest-SnapshotDataIntegrityTests-113348013 None] Acquiring lock "cinder-quobyte-8ef75942-d7b9-4102-a4ca-651a1de7d88a" by "delete_snapshot" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:32:00 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-6ee3d6fb-a1c2-42a5-a1a5-7e2611d6037d tempest-SnapshotDataIntegrityTests-113348013 None] Lock "cinder-quobyte-8ef75942-d7b9-4102-a4ca-651a1de7d88a" acquired by "delete_snapshot" :: waited 0.044s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:32:00 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-6ee3d6fb-a1c2-42a5-a1a5-7e2611d6037d tempest-SnapshotDataIntegrityTests-113348013 None] Acquiring lock "cinder-quobyte-449abdff-86c6-4340-aa7c-dc571b705c1b" by "_delete_snapshot" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:32:00 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-6ee3d6fb-a1c2-42a5-a1a5-7e2611d6037d tempest-SnapshotDataIntegrityTests-113348013 None] Lock "cinder-quobyte-449abdff-86c6-4340-aa7c-dc571b705c1b" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:32:00 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-6ee3d6fb-a1c2-42a5-a1a5-7e2611d6037d tempest-SnapshotDataIntegrityTests-113348013 None] Deleting offline snapshot 449abdff-86c6-4340-aa7c-dc571b705c1b of volume 8ef75942-d7b9-4102-a4ca-651a1de7d88a {{(pid=89182) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 31 12:32:00 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-6ee3d6fb-a1c2-42a5-a1a5-7e2611d6037d tempest-SnapshotDataIntegrityTests-113348013 None] snapshot_file for this snap is: volume-8ef75942-d7b9-4102-a4ca-651a1de7d88a.449abdff-86c6-4340-aa7c-dc571b705c1b {{(pid=89182) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 31 12:32:00 devstack sudo[108495]: pam_unix(sudo:session): session closed for user root Jul 31 12:32:00 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-1357edcd-f72a-4904-8ead-0305f4d9ca5b tempest-SnapshotDataIntegrityTests-113348013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2" returned: 0 in 0.416s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:32:00 devstack cinder-volume[89182]: DEBUG cinder.manager [None req-1357edcd-f72a-4904-8ead-0305f4d9ca5b tempest-SnapshotDataIntegrityTests-113348013 None] Notifying Schedulers of capabilities ... {{(pid=89182) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 12:32:00 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-1357edcd-f72a-4904-8ead-0305f4d9ca5b tempest-SnapshotDataIntegrityTests-113348013 None] Deleted volume successfully. Jul 31 12:32:00 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[78de75e2-2981-45f4-a33c-91bc5b5233c6]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:32:00 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-6ee3d6fb-a1c2-42a5-a1a5-7e2611d6037d tempest-SnapshotDataIntegrityTests-113348013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-8ef75942-d7b9-4102-a4ca-651a1de7d88a.449abdff-86c6-4340-aa7c-dc571b705c1b {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:32:00 devstack sudo[108497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-78792609-d034-45bf-9b4c-179a99ab6e9e.34aead5f-1cb4-4737-bb16-f1f7056dfd0f Jul 31 12:32:00 devstack sudo[108497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:32:00 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-1357edcd-f72a-4904-8ead-0305f4d9ca5b tempest-SnapshotDataIntegrityTests-113348013 None] Lock "cinder-52b3dce3-91b8-4da0-99fe-4c0919ab8b11-delete_volume" released by "delete_volume" :: held 1.504s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:32:00 devstack sudo[108499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-8ef75942-d7b9-4102-a4ca-651a1de7d88a.449abdff-86c6-4340-aa7c-dc571b705c1b Jul 31 12:32:00 devstack sudo[108499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:32:01 devstack sudo[108497]: pam_unix(sudo:session): session closed for user root Jul 31 12:32:01 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-0fd2f089-422d-4503-9beb-c1ca28f91759 tempest-VolumesSnapshotNegativeTestJSON-1913200100 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-78792609-d034-45bf-9b4c-179a99ab6e9e.34aead5f-1cb4-4737-bb16-f1f7056dfd0f" returned: 0 in 0.514s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:32:01 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-0fd2f089-422d-4503-9beb-c1ca28f91759 tempest-VolumesSnapshotNegativeTestJSON-1913200100 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-78792609-d034-45bf-9b4c-179a99ab6e9e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89182) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 12:32:01 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1e48dc6-0f35-41ce-8f6f-fdc512fe6d33]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:32:01 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-0fd2f089-422d-4503-9beb-c1ca28f91759 tempest-VolumesSnapshotNegativeTestJSON-1913200100 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-78792609-d034-45bf-9b4c-179a99ab6e9e {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:32:01 devstack sudo[108499]: pam_unix(sudo:session): session closed for user root Jul 31 12:32:01 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-6ee3d6fb-a1c2-42a5-a1a5-7e2611d6037d tempest-SnapshotDataIntegrityTests-113348013 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-8ef75942-d7b9-4102-a4ca-651a1de7d88a.449abdff-86c6-4340-aa7c-dc571b705c1b" returned: 0 in 0.418s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:32:01 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-6ee3d6fb-a1c2-42a5-a1a5-7e2611d6037d tempest-SnapshotDataIntegrityTests-113348013 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8ef75942-d7b9-4102-a4ca-651a1de7d88a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89182) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 12:32:01 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[e26860f9-a0b3-4927-8735-bf04e95f0ad9]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:32:01 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-6ee3d6fb-a1c2-42a5-a1a5-7e2611d6037d tempest-SnapshotDataIntegrityTests-113348013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-8ef75942-d7b9-4102-a4ca-651a1de7d88a.7f584107-b1e4-435e-bc1d-5f9b2004ba6e {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:32:01 devstack sudo[108509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-78792609-d034-45bf-9b4c-179a99ab6e9e Jul 31 12:32:01 devstack sudo[108509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:32:01 devstack sudo[108510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-8ef75942-d7b9-4102-a4ca-651a1de7d88a.7f584107-b1e4-435e-bc1d-5f9b2004ba6e Jul 31 12:32:01 devstack sudo[108510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:32:01 devstack sudo[108509]: pam_unix(sudo:session): session closed for user root Jul 31 12:32:01 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-0fd2f089-422d-4503-9beb-c1ca28f91759 tempest-VolumesSnapshotNegativeTestJSON-1913200100 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-78792609-d034-45bf-9b4c-179a99ab6e9e" returned: 0 in 0.406s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:32:01 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-0fd2f089-422d-4503-9beb-c1ca28f91759 tempest-VolumesSnapshotNegativeTestJSON-1913200100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-78792609-d034-45bf-9b4c-179a99ab6e9e.34aead5f-1cb4-4737-bb16-f1f7056dfd0f {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:32:01 devstack sudo[108516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-78792609-d034-45bf-9b4c-179a99ab6e9e.34aead5f-1cb4-4737-bb16-f1f7056dfd0f Jul 31 12:32:01 devstack sudo[108516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:32:01 devstack sudo[108510]: pam_unix(sudo:session): session closed for user root Jul 31 12:32:01 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-6ee3d6fb-a1c2-42a5-a1a5-7e2611d6037d tempest-SnapshotDataIntegrityTests-113348013 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-8ef75942-d7b9-4102-a4ca-651a1de7d88a.7f584107-b1e4-435e-bc1d-5f9b2004ba6e" returned: 0 in 0.466s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:32:01 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-6ee3d6fb-a1c2-42a5-a1a5-7e2611d6037d tempest-SnapshotDataIntegrityTests-113348013 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8ef75942-d7b9-4102-a4ca-651a1de7d88a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89182) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 12:32:01 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-6ee3d6fb-a1c2-42a5-a1a5-7e2611d6037d tempest-SnapshotDataIntegrityTests-113348013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-8ef75942-d7b9-4102-a4ca-651a1de7d88a.449abdff-86c6-4340-aa7c-dc571b705c1b {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:32:01 devstack sudo[108521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-8ef75942-d7b9-4102-a4ca-651a1de7d88a.449abdff-86c6-4340-aa7c-dc571b705c1b Jul 31 12:32:01 devstack sudo[108521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:32:01 devstack sudo[108516]: pam_unix(sudo:session): session closed for user root Jul 31 12:32:01 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-0fd2f089-422d-4503-9beb-c1ca28f91759 tempest-VolumesSnapshotNegativeTestJSON-1913200100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-78792609-d034-45bf-9b4c-179a99ab6e9e.34aead5f-1cb4-4737-bb16-f1f7056dfd0f" returned: 0 in 0.440s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:32:01 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-0fd2f089-422d-4503-9beb-c1ca28f91759 tempest-VolumesSnapshotNegativeTestJSON-1913200100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-78792609-d034-45bf-9b4c-179a99ab6e9e.34aead5f-1cb4-4737-bb16-f1f7056dfd0f {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:32:02 devstack sudo[108529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-78792609-d034-45bf-9b4c-179a99ab6e9e.34aead5f-1cb4-4737-bb16-f1f7056dfd0f Jul 31 12:32:02 devstack sudo[108529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:32:02 devstack sudo[108529]: pam_unix(sudo:session): session closed for user root Jul 31 12:32:02 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-0fd2f089-422d-4503-9beb-c1ca28f91759 tempest-VolumesSnapshotNegativeTestJSON-1913200100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-78792609-d034-45bf-9b4c-179a99ab6e9e.34aead5f-1cb4-4737-bb16-f1f7056dfd0f" returned: 0 in 0.276s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:32:02 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-0fd2f089-422d-4503-9beb-c1ca28f91759 tempest-VolumesSnapshotNegativeTestJSON-1913200100 None] Lock "cinder-quobyte-34aead5f-1cb4-4737-bb16-f1f7056dfd0f" released by "_delete_snapshot" :: held 1.796s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:32:02 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-0fd2f089-422d-4503-9beb-c1ca28f91759 tempest-VolumesSnapshotNegativeTestJSON-1913200100 None] Lock "cinder-quobyte-78792609-d034-45bf-9b4c-179a99ab6e9e" released by "delete_snapshot" :: held 1.828s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:32:02 devstack cinder-volume[89182]: DEBUG cinder.quota [None req-0fd2f089-422d-4503-9beb-c1ca28f91759 tempest-VolumesSnapshotNegativeTestJSON-1913200100 None] Created reservations ['94fe6e3d-f7e6-42b6-97d7-f83d06318c73', '375590eb-c5a6-4fec-9cb4-01611d2cf512', '9fca181b-f173-4a01-9a68-dc2da2f57b51', '090d68fe-fbe4-4d21-835c-585d8dc272ce'] {{(pid=89182) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 12:32:02 devstack sudo[108521]: pam_unix(sudo:session): session closed for user root Jul 31 12:32:02 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-6ee3d6fb-a1c2-42a5-a1a5-7e2611d6037d tempest-SnapshotDataIntegrityTests-113348013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-8ef75942-d7b9-4102-a4ca-651a1de7d88a.449abdff-86c6-4340-aa7c-dc571b705c1b" returned: 0 in 0.715s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:32:02 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-6ee3d6fb-a1c2-42a5-a1a5-7e2611d6037d tempest-SnapshotDataIntegrityTests-113348013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-8ef75942-d7b9-4102-a4ca-651a1de7d88a.449abdff-86c6-4340-aa7c-dc571b705c1b {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:32:02 devstack sudo[108534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-8ef75942-d7b9-4102-a4ca-651a1de7d88a.449abdff-86c6-4340-aa7c-dc571b705c1b Jul 31 12:32:02 devstack sudo[108534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:32:02 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-0fd2f089-422d-4503-9beb-c1ca28f91759 tempest-VolumesSnapshotNegativeTestJSON-1913200100 None] Delete snapshot completed successfully. Jul 31 12:32:02 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-0fd2f089-422d-4503-9beb-c1ca28f91759 tempest-VolumesSnapshotNegativeTestJSON-1913200100 None] Lock "cinder-34aead5f-1cb4-4737-bb16-f1f7056dfd0f-delete_snapshot" released by "delete_snapshot" :: held 2.002s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:32:02 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-0723e2e5-2e12-492d-b74b-d03a217f52fa tempest-VolumesSnapshotNegativeTestJSON-1913200100 None] Acquiring lock "cinder-78792609-d034-45bf-9b4c-179a99ab6e9e-delete_volume" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:32:02 devstack sudo[108534]: pam_unix(sudo:session): session closed for user root Jul 31 12:32:02 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-6ee3d6fb-a1c2-42a5-a1a5-7e2611d6037d tempest-SnapshotDataIntegrityTests-113348013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-8ef75942-d7b9-4102-a4ca-651a1de7d88a.449abdff-86c6-4340-aa7c-dc571b705c1b" returned: 0 in 0.305s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:32:02 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-0723e2e5-2e12-492d-b74b-d03a217f52fa tempest-VolumesSnapshotNegativeTestJSON-1913200100 None] Lock "cinder-78792609-d034-45bf-9b4c-179a99ab6e9e-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:32:02 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-6ee3d6fb-a1c2-42a5-a1a5-7e2611d6037d tempest-SnapshotDataIntegrityTests-113348013 None] Lock "cinder-quobyte-449abdff-86c6-4340-aa7c-dc571b705c1b" released by "_delete_snapshot" :: held 2.061s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:32:02 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-6ee3d6fb-a1c2-42a5-a1a5-7e2611d6037d tempest-SnapshotDataIntegrityTests-113348013 None] Lock "cinder-quobyte-8ef75942-d7b9-4102-a4ca-651a1de7d88a" released by "delete_snapshot" :: held 2.103s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:32:02 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-0723e2e5-2e12-492d-b74b-d03a217f52fa tempest-VolumesSnapshotNegativeTestJSON-1913200100 None] Acquiring lock "cinder-quobyte-78792609-d034-45bf-9b4c-179a99ab6e9e" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:32:02 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-0723e2e5-2e12-492d-b74b-d03a217f52fa tempest-VolumesSnapshotNegativeTestJSON-1913200100 None] Lock "cinder-quobyte-78792609-d034-45bf-9b4c-179a99ab6e9e" acquired by "delete_volume" :: waited 0.022s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:32:02 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bccd245-41b8-45f4-a47e-d24360154e20]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:32:02 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-0723e2e5-2e12-492d-b74b-d03a217f52fa tempest-VolumesSnapshotNegativeTestJSON-1913200100 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-78792609-d034-45bf-9b4c-179a99ab6e9e {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:32:02 devstack cinder-volume[89182]: DEBUG cinder.quota [None req-6ee3d6fb-a1c2-42a5-a1a5-7e2611d6037d tempest-SnapshotDataIntegrityTests-113348013 None] Created reservations ['72d4b848-6a1d-45a6-b8f4-957a0c5f870b', '225aacef-96b7-4c04-8798-107524b97e43', 'f979793c-7e1f-4a70-98a0-fc3b1a6767af', 'de5fee30-1352-47be-9e8c-3feb2b3ae399'] {{(pid=89182) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 12:32:03 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-6ee3d6fb-a1c2-42a5-a1a5-7e2611d6037d tempest-SnapshotDataIntegrityTests-113348013 None] Delete snapshot completed successfully. Jul 31 12:32:03 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-6ee3d6fb-a1c2-42a5-a1a5-7e2611d6037d tempest-SnapshotDataIntegrityTests-113348013 None] Lock "cinder-449abdff-86c6-4340-aa7c-dc571b705c1b-delete_snapshot" released by "delete_snapshot" :: held 2.451s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:32:03 devstack sudo[108537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-78792609-d034-45bf-9b4c-179a99ab6e9e Jul 31 12:32:03 devstack sudo[108537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:32:03 devstack sudo[108537]: pam_unix(sudo:session): session closed for user root Jul 31 12:32:03 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-0723e2e5-2e12-492d-b74b-d03a217f52fa tempest-VolumesSnapshotNegativeTestJSON-1913200100 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-78792609-d034-45bf-9b4c-179a99ab6e9e" returned: 0 in 0.480s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:32:03 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-0723e2e5-2e12-492d-b74b-d03a217f52fa tempest-VolumesSnapshotNegativeTestJSON-1913200100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-78792609-d034-45bf-9b4c-179a99ab6e9e {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:32:03 devstack sudo[108543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-78792609-d034-45bf-9b4c-179a99ab6e9e Jul 31 12:32:03 devstack sudo[108543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:32:03 devstack sudo[108543]: pam_unix(sudo:session): session closed for user root Jul 31 12:32:03 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-0723e2e5-2e12-492d-b74b-d03a217f52fa tempest-VolumesSnapshotNegativeTestJSON-1913200100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-78792609-d034-45bf-9b4c-179a99ab6e9e" returned: 0 in 0.265s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:32:03 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-0723e2e5-2e12-492d-b74b-d03a217f52fa tempest-VolumesSnapshotNegativeTestJSON-1913200100 None] Lock "cinder-quobyte-78792609-d034-45bf-9b4c-179a99ab6e9e" released by "delete_volume" :: held 0.807s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:32:03 devstack cinder-volume[89182]: DEBUG cinder.quota [None req-0723e2e5-2e12-492d-b74b-d03a217f52fa tempest-VolumesSnapshotNegativeTestJSON-1913200100 None] Created reservations ['4afe736d-f4a3-4656-bc32-79ee10ebb6a8', '501033bd-eb41-4bac-abe2-c74621f16c31', '120fd7c1-1c8d-4f19-89ba-4bab985c2322', '61eefc14-e7b4-4102-a6d7-b0aa14d53dd7'] {{(pid=89182) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 12:32:03 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-0723e2e5-2e12-492d-b74b-d03a217f52fa tempest-VolumesSnapshotNegativeTestJSON-1913200100 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:32:03 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-0723e2e5-2e12-492d-b74b-d03a217f52fa tempest-VolumesSnapshotNegativeTestJSON-1913200100 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:32:03 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-0723e2e5-2e12-492d-b74b-d03a217f52fa tempest-VolumesSnapshotNegativeTestJSON-1913200100 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:32:03 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-0723e2e5-2e12-492d-b74b-d03a217f52fa tempest-VolumesSnapshotNegativeTestJSON-1913200100 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:32:03 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-0723e2e5-2e12-492d-b74b-d03a217f52fa tempest-VolumesSnapshotNegativeTestJSON-1913200100 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:32:03 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-0723e2e5-2e12-492d-b74b-d03a217f52fa tempest-VolumesSnapshotNegativeTestJSON-1913200100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:32:03 devstack sudo[108546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 Jul 31 12:32:03 devstack sudo[108546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:32:03 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-26ca9476-851c-4d32-90a8-796fdfae580a tempest-SnapshotDataIntegrityTests-113348013 None] Acquiring lock "cinder-7f584107-b1e4-435e-bc1d-5f9b2004ba6e-delete_snapshot" by "delete_snapshot" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:32:03 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-26ca9476-851c-4d32-90a8-796fdfae580a tempest-SnapshotDataIntegrityTests-113348013 None] Lock "cinder-7f584107-b1e4-435e-bc1d-5f9b2004ba6e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:32:03 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-26ca9476-851c-4d32-90a8-796fdfae580a tempest-SnapshotDataIntegrityTests-113348013 None] Acquiring lock "cinder-quobyte-8ef75942-d7b9-4102-a4ca-651a1de7d88a" by "delete_snapshot" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:32:03 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-26ca9476-851c-4d32-90a8-796fdfae580a tempest-SnapshotDataIntegrityTests-113348013 None] Lock "cinder-quobyte-8ef75942-d7b9-4102-a4ca-651a1de7d88a" acquired by "delete_snapshot" :: waited 0.021s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:32:03 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-26ca9476-851c-4d32-90a8-796fdfae580a tempest-SnapshotDataIntegrityTests-113348013 None] Acquiring lock "cinder-quobyte-7f584107-b1e4-435e-bc1d-5f9b2004ba6e" by "_delete_snapshot" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:32:03 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-26ca9476-851c-4d32-90a8-796fdfae580a tempest-SnapshotDataIntegrityTests-113348013 None] Lock "cinder-quobyte-7f584107-b1e4-435e-bc1d-5f9b2004ba6e" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:32:03 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-26ca9476-851c-4d32-90a8-796fdfae580a tempest-SnapshotDataIntegrityTests-113348013 None] Deleting offline snapshot 7f584107-b1e4-435e-bc1d-5f9b2004ba6e of volume 8ef75942-d7b9-4102-a4ca-651a1de7d88a {{(pid=89182) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 31 12:32:03 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-26ca9476-851c-4d32-90a8-796fdfae580a tempest-SnapshotDataIntegrityTests-113348013 None] snapshot_file for this snap is: volume-8ef75942-d7b9-4102-a4ca-651a1de7d88a.7f584107-b1e4-435e-bc1d-5f9b2004ba6e {{(pid=89182) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 31 12:32:04 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7ffff2d-95b4-4503-897a-83d4331d83f8]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:32:04 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-26ca9476-851c-4d32-90a8-796fdfae580a tempest-SnapshotDataIntegrityTests-113348013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-8ef75942-d7b9-4102-a4ca-651a1de7d88a.7f584107-b1e4-435e-bc1d-5f9b2004ba6e {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:32:04 devstack sudo[108546]: pam_unix(sudo:session): session closed for user root Jul 31 12:32:04 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-0723e2e5-2e12-492d-b74b-d03a217f52fa tempest-VolumesSnapshotNegativeTestJSON-1913200100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2" returned: 0 in 0.311s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:32:04 devstack cinder-volume[89182]: DEBUG cinder.manager [None req-0723e2e5-2e12-492d-b74b-d03a217f52fa tempest-VolumesSnapshotNegativeTestJSON-1913200100 None] Notifying Schedulers of capabilities ... {{(pid=89182) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 12:32:04 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-0723e2e5-2e12-492d-b74b-d03a217f52fa tempest-VolumesSnapshotNegativeTestJSON-1913200100 None] Deleted volume successfully. Jul 31 12:32:04 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-0723e2e5-2e12-492d-b74b-d03a217f52fa tempest-VolumesSnapshotNegativeTestJSON-1913200100 None] Lock "cinder-78792609-d034-45bf-9b4c-179a99ab6e9e-delete_volume" released by "delete_volume" :: held 1.344s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:32:04 devstack sudo[108549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-8ef75942-d7b9-4102-a4ca-651a1de7d88a.7f584107-b1e4-435e-bc1d-5f9b2004ba6e Jul 31 12:32:04 devstack sudo[108549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:32:04 devstack sudo[108549]: pam_unix(sudo:session): session closed for user root Jul 31 12:32:04 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-26ca9476-851c-4d32-90a8-796fdfae580a tempest-SnapshotDataIntegrityTests-113348013 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-8ef75942-d7b9-4102-a4ca-651a1de7d88a.7f584107-b1e4-435e-bc1d-5f9b2004ba6e" returned: 0 in 0.491s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:32:04 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-26ca9476-851c-4d32-90a8-796fdfae580a tempest-SnapshotDataIntegrityTests-113348013 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8ef75942-d7b9-4102-a4ca-651a1de7d88a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89182) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 12:32:04 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[08ed6496-9c68-4801-ba45-493949a12bb1]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:32:04 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-26ca9476-851c-4d32-90a8-796fdfae580a tempest-SnapshotDataIntegrityTests-113348013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-8ef75942-d7b9-4102-a4ca-651a1de7d88a.b8369f85-c94c-4c5c-9b7e-1f6060bee802 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:32:04 devstack sudo[108554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-8ef75942-d7b9-4102-a4ca-651a1de7d88a.b8369f85-c94c-4c5c-9b7e-1f6060bee802 Jul 31 12:32:04 devstack sudo[108554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:32:05 devstack sudo[108554]: pam_unix(sudo:session): session closed for user root Jul 31 12:32:05 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-26ca9476-851c-4d32-90a8-796fdfae580a tempest-SnapshotDataIntegrityTests-113348013 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-8ef75942-d7b9-4102-a4ca-651a1de7d88a.b8369f85-c94c-4c5c-9b7e-1f6060bee802" returned: 0 in 0.481s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:32:05 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-26ca9476-851c-4d32-90a8-796fdfae580a tempest-SnapshotDataIntegrityTests-113348013 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8ef75942-d7b9-4102-a4ca-651a1de7d88a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89182) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 12:32:05 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-26ca9476-851c-4d32-90a8-796fdfae580a tempest-SnapshotDataIntegrityTests-113348013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-8ef75942-d7b9-4102-a4ca-651a1de7d88a.7f584107-b1e4-435e-bc1d-5f9b2004ba6e {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:32:05 devstack sudo[108559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-8ef75942-d7b9-4102-a4ca-651a1de7d88a.7f584107-b1e4-435e-bc1d-5f9b2004ba6e Jul 31 12:32:05 devstack sudo[108559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:32:05 devstack sudo[108559]: pam_unix(sudo:session): session closed for user root Jul 31 12:32:05 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-26ca9476-851c-4d32-90a8-796fdfae580a tempest-SnapshotDataIntegrityTests-113348013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-8ef75942-d7b9-4102-a4ca-651a1de7d88a.7f584107-b1e4-435e-bc1d-5f9b2004ba6e" returned: 0 in 0.566s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:32:05 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-26ca9476-851c-4d32-90a8-796fdfae580a tempest-SnapshotDataIntegrityTests-113348013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-8ef75942-d7b9-4102-a4ca-651a1de7d88a.7f584107-b1e4-435e-bc1d-5f9b2004ba6e {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:32:05 devstack sudo[108567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-8ef75942-d7b9-4102-a4ca-651a1de7d88a.7f584107-b1e4-435e-bc1d-5f9b2004ba6e Jul 31 12:32:05 devstack sudo[108567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:32:05 devstack sudo[108567]: pam_unix(sudo:session): session closed for user root Jul 31 12:32:05 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-26ca9476-851c-4d32-90a8-796fdfae580a tempest-SnapshotDataIntegrityTests-113348013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-8ef75942-d7b9-4102-a4ca-651a1de7d88a.7f584107-b1e4-435e-bc1d-5f9b2004ba6e" returned: 0 in 0.302s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:32:05 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-26ca9476-851c-4d32-90a8-796fdfae580a tempest-SnapshotDataIntegrityTests-113348013 None] Lock "cinder-quobyte-7f584107-b1e4-435e-bc1d-5f9b2004ba6e" released by "_delete_snapshot" :: held 1.988s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:32:05 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-26ca9476-851c-4d32-90a8-796fdfae580a tempest-SnapshotDataIntegrityTests-113348013 None] Lock "cinder-quobyte-8ef75942-d7b9-4102-a4ca-651a1de7d88a" released by "delete_snapshot" :: held 2.014s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:32:06 devstack cinder-volume[89182]: DEBUG cinder.quota [None req-26ca9476-851c-4d32-90a8-796fdfae580a tempest-SnapshotDataIntegrityTests-113348013 None] Created reservations ['cdb03982-f572-4452-ac4e-72d48d984d1c', '138dffd6-298d-467f-836d-87afc19f86e1', 'a3fbd9c1-fabc-4c11-9bd6-eeaa29f6187c', '654399f5-4972-4e28-9b36-a7e26a0da75d'] {{(pid=89182) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 12:32:06 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-26ca9476-851c-4d32-90a8-796fdfae580a tempest-SnapshotDataIntegrityTests-113348013 None] Delete snapshot completed successfully. Jul 31 12:32:06 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-26ca9476-851c-4d32-90a8-796fdfae580a tempest-SnapshotDataIntegrityTests-113348013 None] Lock "cinder-7f584107-b1e4-435e-bc1d-5f9b2004ba6e-delete_snapshot" released by "delete_snapshot" :: held 2.222s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:32:07 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-8e0c2114-8197-4ee8-9cfc-c670a455d4b1 tempest-SnapshotDataIntegrityTests-113348013 None] Acquiring lock "cinder-b8369f85-c94c-4c5c-9b7e-1f6060bee802-delete_snapshot" by "delete_snapshot" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:32:07 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-8e0c2114-8197-4ee8-9cfc-c670a455d4b1 tempest-SnapshotDataIntegrityTests-113348013 None] Lock "cinder-b8369f85-c94c-4c5c-9b7e-1f6060bee802-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:32:07 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-8e0c2114-8197-4ee8-9cfc-c670a455d4b1 tempest-SnapshotDataIntegrityTests-113348013 None] Acquiring lock "cinder-quobyte-8ef75942-d7b9-4102-a4ca-651a1de7d88a" by "delete_snapshot" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:32:07 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-8e0c2114-8197-4ee8-9cfc-c670a455d4b1 tempest-SnapshotDataIntegrityTests-113348013 None] Lock "cinder-quobyte-8ef75942-d7b9-4102-a4ca-651a1de7d88a" acquired by "delete_snapshot" :: waited 0.025s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:32:07 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-8e0c2114-8197-4ee8-9cfc-c670a455d4b1 tempest-SnapshotDataIntegrityTests-113348013 None] Acquiring lock "cinder-quobyte-b8369f85-c94c-4c5c-9b7e-1f6060bee802" by "_delete_snapshot" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:32:07 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-8e0c2114-8197-4ee8-9cfc-c670a455d4b1 tempest-SnapshotDataIntegrityTests-113348013 None] Lock "cinder-quobyte-b8369f85-c94c-4c5c-9b7e-1f6060bee802" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:32:07 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-8e0c2114-8197-4ee8-9cfc-c670a455d4b1 tempest-SnapshotDataIntegrityTests-113348013 None] Deleting offline snapshot b8369f85-c94c-4c5c-9b7e-1f6060bee802 of volume 8ef75942-d7b9-4102-a4ca-651a1de7d88a {{(pid=89182) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 31 12:32:07 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-8e0c2114-8197-4ee8-9cfc-c670a455d4b1 tempest-SnapshotDataIntegrityTests-113348013 None] snapshot_file for this snap is: volume-8ef75942-d7b9-4102-a4ca-651a1de7d88a.b8369f85-c94c-4c5c-9b7e-1f6060bee802 {{(pid=89182) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 31 12:32:07 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[68ac0c1e-99d1-4e28-b496-2839119a739f]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:32:07 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-8e0c2114-8197-4ee8-9cfc-c670a455d4b1 tempest-SnapshotDataIntegrityTests-113348013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-8ef75942-d7b9-4102-a4ca-651a1de7d88a.b8369f85-c94c-4c5c-9b7e-1f6060bee802 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:32:07 devstack sudo[108573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-8ef75942-d7b9-4102-a4ca-651a1de7d88a.b8369f85-c94c-4c5c-9b7e-1f6060bee802 Jul 31 12:32:07 devstack sudo[108573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:32:07 devstack sudo[108573]: pam_unix(sudo:session): session closed for user root Jul 31 12:32:07 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-8e0c2114-8197-4ee8-9cfc-c670a455d4b1 tempest-SnapshotDataIntegrityTests-113348013 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-8ef75942-d7b9-4102-a4ca-651a1de7d88a.b8369f85-c94c-4c5c-9b7e-1f6060bee802" returned: 0 in 0.433s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:32:07 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-8e0c2114-8197-4ee8-9cfc-c670a455d4b1 tempest-SnapshotDataIntegrityTests-113348013 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8ef75942-d7b9-4102-a4ca-651a1de7d88a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89182) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 12:32:07 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[018094cc-419d-4427-9713-06f9b6de8513]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:32:07 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-8e0c2114-8197-4ee8-9cfc-c670a455d4b1 tempest-SnapshotDataIntegrityTests-113348013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-8ef75942-d7b9-4102-a4ca-651a1de7d88a {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:32:07 devstack sudo[108579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-8ef75942-d7b9-4102-a4ca-651a1de7d88a Jul 31 12:32:07 devstack sudo[108579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:32:08 devstack sudo[108579]: pam_unix(sudo:session): session closed for user root Jul 31 12:32:08 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-8e0c2114-8197-4ee8-9cfc-c670a455d4b1 tempest-SnapshotDataIntegrityTests-113348013 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-8ef75942-d7b9-4102-a4ca-651a1de7d88a" returned: 0 in 0.446s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:32:08 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-8e0c2114-8197-4ee8-9cfc-c670a455d4b1 tempest-SnapshotDataIntegrityTests-113348013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-8ef75942-d7b9-4102-a4ca-651a1de7d88a.b8369f85-c94c-4c5c-9b7e-1f6060bee802 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:32:08 devstack sudo[108584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-8ef75942-d7b9-4102-a4ca-651a1de7d88a.b8369f85-c94c-4c5c-9b7e-1f6060bee802 Jul 31 12:32:08 devstack sudo[108584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:32:08 devstack sudo[108584]: pam_unix(sudo:session): session closed for user root Jul 31 12:32:08 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-8e0c2114-8197-4ee8-9cfc-c670a455d4b1 tempest-SnapshotDataIntegrityTests-113348013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-8ef75942-d7b9-4102-a4ca-651a1de7d88a.b8369f85-c94c-4c5c-9b7e-1f6060bee802" returned: 0 in 0.505s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:32:08 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-8e0c2114-8197-4ee8-9cfc-c670a455d4b1 tempest-SnapshotDataIntegrityTests-113348013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-8ef75942-d7b9-4102-a4ca-651a1de7d88a.b8369f85-c94c-4c5c-9b7e-1f6060bee802 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:32:08 devstack sudo[108594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-8ef75942-d7b9-4102-a4ca-651a1de7d88a.b8369f85-c94c-4c5c-9b7e-1f6060bee802 Jul 31 12:32:08 devstack sudo[108594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:32:09 devstack sudo[108594]: pam_unix(sudo:session): session closed for user root Jul 31 12:32:09 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-8e0c2114-8197-4ee8-9cfc-c670a455d4b1 tempest-SnapshotDataIntegrityTests-113348013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-8ef75942-d7b9-4102-a4ca-651a1de7d88a.b8369f85-c94c-4c5c-9b7e-1f6060bee802" returned: 0 in 0.332s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:32:09 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-8e0c2114-8197-4ee8-9cfc-c670a455d4b1 tempest-SnapshotDataIntegrityTests-113348013 None] Lock "cinder-quobyte-b8369f85-c94c-4c5c-9b7e-1f6060bee802" released by "_delete_snapshot" :: held 1.871s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:32:09 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-8e0c2114-8197-4ee8-9cfc-c670a455d4b1 tempest-SnapshotDataIntegrityTests-113348013 None] Lock "cinder-quobyte-8ef75942-d7b9-4102-a4ca-651a1de7d88a" released by "delete_snapshot" :: held 1.907s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:32:09 devstack cinder-volume[89182]: DEBUG cinder.quota [None req-8e0c2114-8197-4ee8-9cfc-c670a455d4b1 tempest-SnapshotDataIntegrityTests-113348013 None] Created reservations ['7fef92cd-efdb-4fd6-8cda-280d0f1b1b28', 'df934582-b254-4694-a3fc-534b668f33cc', '4b38b05a-9b84-4a74-81ef-d0032881e54e', '019d3762-4c8f-44c8-8161-20b7b98bc3bc'] {{(pid=89182) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 12:32:09 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-8e0c2114-8197-4ee8-9cfc-c670a455d4b1 tempest-SnapshotDataIntegrityTests-113348013 None] Delete snapshot completed successfully. Jul 31 12:32:09 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-8e0c2114-8197-4ee8-9cfc-c670a455d4b1 tempest-SnapshotDataIntegrityTests-113348013 None] Lock "cinder-b8369f85-c94c-4c5c-9b7e-1f6060bee802-delete_snapshot" released by "delete_snapshot" :: held 2.105s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:32:09 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-93f57d8e-de37-4766-bc20-e468b6f4d69f tempest-SnapshotDataIntegrityTests-113348013 None] Acquiring lock "cinder-8ef75942-d7b9-4102-a4ca-651a1de7d88a-delete_volume" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:32:09 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-93f57d8e-de37-4766-bc20-e468b6f4d69f tempest-SnapshotDataIntegrityTests-113348013 None] Lock "cinder-8ef75942-d7b9-4102-a4ca-651a1de7d88a-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:32:09 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-93f57d8e-de37-4766-bc20-e468b6f4d69f tempest-SnapshotDataIntegrityTests-113348013 None] Acquiring lock "cinder-quobyte-8ef75942-d7b9-4102-a4ca-651a1de7d88a" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:32:09 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-93f57d8e-de37-4766-bc20-e468b6f4d69f tempest-SnapshotDataIntegrityTests-113348013 None] Lock "cinder-quobyte-8ef75942-d7b9-4102-a4ca-651a1de7d88a" acquired by "delete_volume" :: waited 0.018s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:32:09 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[07043fac-1315-43e1-9178-08538277cff6]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:32:09 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-93f57d8e-de37-4766-bc20-e468b6f4d69f tempest-SnapshotDataIntegrityTests-113348013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-8ef75942-d7b9-4102-a4ca-651a1de7d88a {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:32:09 devstack sudo[108597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-8ef75942-d7b9-4102-a4ca-651a1de7d88a Jul 31 12:32:09 devstack sudo[108597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:32:10 devstack sudo[108597]: pam_unix(sudo:session): session closed for user root Jul 31 12:32:10 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-93f57d8e-de37-4766-bc20-e468b6f4d69f tempest-SnapshotDataIntegrityTests-113348013 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-8ef75942-d7b9-4102-a4ca-651a1de7d88a" returned: 0 in 0.488s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:32:10 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-93f57d8e-de37-4766-bc20-e468b6f4d69f tempest-SnapshotDataIntegrityTests-113348013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-8ef75942-d7b9-4102-a4ca-651a1de7d88a {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:32:10 devstack sudo[108602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-8ef75942-d7b9-4102-a4ca-651a1de7d88a Jul 31 12:32:10 devstack sudo[108602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:32:10 devstack sudo[108602]: pam_unix(sudo:session): session closed for user root Jul 31 12:32:10 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-93f57d8e-de37-4766-bc20-e468b6f4d69f tempest-SnapshotDataIntegrityTests-113348013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-8ef75942-d7b9-4102-a4ca-651a1de7d88a" returned: 0 in 0.330s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:32:10 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-93f57d8e-de37-4766-bc20-e468b6f4d69f tempest-SnapshotDataIntegrityTests-113348013 None] Lock "cinder-quobyte-8ef75942-d7b9-4102-a4ca-651a1de7d88a" released by "delete_volume" :: held 0.914s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:32:10 devstack cinder-volume[89182]: DEBUG cinder.quota [None req-93f57d8e-de37-4766-bc20-e468b6f4d69f tempest-SnapshotDataIntegrityTests-113348013 None] Created reservations ['7aa71d31-bd2b-4067-9e07-2c9488e108a3', '0defc5fd-deb1-4b3a-9ca0-27549703b4a8', '2f85bcea-458a-46c1-acca-81616fa2e19d', '239c1da9-0fa9-4de3-b011-48bb882f187b'] {{(pid=89182) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 12:32:10 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-93f57d8e-de37-4766-bc20-e468b6f4d69f tempest-SnapshotDataIntegrityTests-113348013 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:32:10 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-93f57d8e-de37-4766-bc20-e468b6f4d69f tempest-SnapshotDataIntegrityTests-113348013 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:32:10 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-93f57d8e-de37-4766-bc20-e468b6f4d69f tempest-SnapshotDataIntegrityTests-113348013 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:32:10 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-93f57d8e-de37-4766-bc20-e468b6f4d69f tempest-SnapshotDataIntegrityTests-113348013 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:32:10 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-93f57d8e-de37-4766-bc20-e468b6f4d69f tempest-SnapshotDataIntegrityTests-113348013 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:32:10 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-93f57d8e-de37-4766-bc20-e468b6f4d69f tempest-SnapshotDataIntegrityTests-113348013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:32:10 devstack sudo[108605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 Jul 31 12:32:10 devstack sudo[108605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:32:10 devstack sudo[108605]: pam_unix(sudo:session): session closed for user root Jul 31 12:32:10 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-93f57d8e-de37-4766-bc20-e468b6f4d69f tempest-SnapshotDataIntegrityTests-113348013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2" returned: 0 in 0.293s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:32:11 devstack cinder-volume[89182]: DEBUG cinder.manager [None req-93f57d8e-de37-4766-bc20-e468b6f4d69f tempest-SnapshotDataIntegrityTests-113348013 None] Notifying Schedulers of capabilities ... {{(pid=89182) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 12:32:11 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-93f57d8e-de37-4766-bc20-e468b6f4d69f tempest-SnapshotDataIntegrityTests-113348013 None] Deleted volume successfully. Jul 31 12:32:11 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-93f57d8e-de37-4766-bc20-e468b6f4d69f tempest-SnapshotDataIntegrityTests-113348013 None] Lock "cinder-8ef75942-d7b9-4102-a4ca-651a1de7d88a-delete_volume" released by "delete_volume" :: held 1.497s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:32:20 devstack cinder-volume[89182]: DEBUG dbcounter [-] [89182] Writing DB stats cinder:SELECT=76,cinder:UPDATE=93,cinder:INSERT=29,cinder:DELETE=2 {{(pid=89182) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 12:32:21 devstack cinder-volume[89182]: DEBUG dbcounter [-] [89182] Writing DB stats cinder:SELECT=91,cinder:UPDATE=95,cinder:INSERT=22,cinder:DELETE=8 {{(pid=89182) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 12:32:21 devstack cinder-volume[89182]: DEBUG oslo_service.periodic_task [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89182) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 31 12:32:21 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:32:21 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:32:21 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:32:21 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:32:21 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:32:21 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:32:22 devstack sudo[108676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 Jul 31 12:32:22 devstack sudo[108676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:32:22 devstack sudo[108676]: pam_unix(sudo:session): session closed for user root Jul 31 12:32:22 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2" returned: 0 in 0.309s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:32:22 devstack cinder-volume[89182]: DEBUG cinder.manager [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] Notifying Schedulers of capabilities ... {{(pid=89182) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 12:32:22 devstack cinder-volume[89182]: DEBUG oslo_service.periodic_task [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] Running periodic task VolumeManager._thread_info {{(pid=89182) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 31 12:32:22 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] thread count: 28 {{(pid=89182) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 31 12:32:22 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] thread info: [<_MainThread(MainThread, started 136154603720832)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=89182) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 31 12:32:34 devstack cinder-volume[89182]: DEBUG cinder.volume.flows.manager.create_volume [None req-7024ee57-a4e6-4361-b5f9-b830fe5fe534 tempest-TestServerVolumeAttachmentScenario-530745428 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89182) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 12:32:34 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-7024ee57-a4e6-4361-b5f9-b830fe5fe534 tempest-TestServerVolumeAttachmentScenario-530745428 None] Flow 'volume_create_manager' (0f0963b8-56c1-40bc-a907-684bbc073336) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:32:34 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-7024ee57-a4e6-4361-b5f9-b830fe5fe534 tempest-TestServerVolumeAttachmentScenario-530745428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37354809-cf06-4f8c-8cfe-8ea16f2b73d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:32:34 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-7024ee57-a4e6-4361-b5f9-b830fe5fe534 tempest-TestServerVolumeAttachmentScenario-530745428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37354809-cf06-4f8c-8cfe-8ea16f2b73d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:32:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1227954557',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d305f7a-ad99-409b-9dda-d48b769ce92c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2d66daa83c545e6bd6fd1cacf3075fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:32:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:32:34Z,use_quota=True,user_id='e6b8e81763474e5081f3e833e1d71340',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:32:34 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-7024ee57-a4e6-4361-b5f9-b830fe5fe534 tempest-TestServerVolumeAttachmentScenario-530745428 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4fac2a51-61b7-4e22-b14e-845bc820cf28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:32:34 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-7024ee57-a4e6-4361-b5f9-b830fe5fe534 tempest-TestServerVolumeAttachmentScenario-530745428 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4fac2a51-61b7-4e22-b14e-845bc820cf28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:32:34 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-7024ee57-a4e6-4361-b5f9-b830fe5fe534 tempest-TestServerVolumeAttachmentScenario-530745428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d01f0658-9498-42d6-8344-118a2762e900) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:32:34 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-7024ee57-a4e6-4361-b5f9-b830fe5fe534 tempest-TestServerVolumeAttachmentScenario-530745428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d01f0658-9498-42d6-8344-118a2762e900) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1d305f7a-ad99-409b-9dda-d48b769ce92c', 'volume_name': 'volume-1d305f7a-ad99-409b-9dda-d48b769ce92c', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:32:34 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-7024ee57-a4e6-4361-b5f9-b830fe5fe534 tempest-TestServerVolumeAttachmentScenario-530745428 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0434266-f9fc-49c7-b9e3-7e24d5402ded) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:32:34 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-7024ee57-a4e6-4361-b5f9-b830fe5fe534 tempest-TestServerVolumeAttachmentScenario-530745428 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0434266-f9fc-49c7-b9e3-7e24d5402ded) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:32:34 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-7024ee57-a4e6-4361-b5f9-b830fe5fe534 tempest-TestServerVolumeAttachmentScenario-530745428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0110287f-6ad9-4bc1-b118-08efb4e5138e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:32:34 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-7024ee57-a4e6-4361-b5f9-b830fe5fe534 tempest-TestServerVolumeAttachmentScenario-530745428 None] Volume 1d305f7a-ad99-409b-9dda-d48b769ce92c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1d305f7a-ad99-409b-9dda-d48b769ce92c', 'volume_size': 1} Jul 31 12:32:34 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-7024ee57-a4e6-4361-b5f9-b830fe5fe534 tempest-TestServerVolumeAttachmentScenario-530745428 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:32:34 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-7024ee57-a4e6-4361-b5f9-b830fe5fe534 tempest-TestServerVolumeAttachmentScenario-530745428 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:32:34 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-7024ee57-a4e6-4361-b5f9-b830fe5fe534 tempest-TestServerVolumeAttachmentScenario-530745428 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:32:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1227954557',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d305f7a-ad99-409b-9dda-d48b769ce92c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2d66daa83c545e6bd6fd1cacf3075fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:32:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:32:34Z,use_quota=True,user_id='e6b8e81763474e5081f3e833e1d71340',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)}" {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 12:32:34 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-7024ee57-a4e6-4361-b5f9-b830fe5fe534 tempest-TestServerVolumeAttachmentScenario-530745428 None] Creating volume 1d305f7a-ad99-409b-9dda-d48b769ce92c {{(pid=89182) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 12:32:34 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-7024ee57-a4e6-4361-b5f9-b830fe5fe534 tempest-TestServerVolumeAttachmentScenario-530745428 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:32:34 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-7024ee57-a4e6-4361-b5f9-b830fe5fe534 tempest-TestServerVolumeAttachmentScenario-530745428 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:32:34 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-7024ee57-a4e6-4361-b5f9-b830fe5fe534 tempest-TestServerVolumeAttachmentScenario-530745428 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:32:34 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-7024ee57-a4e6-4361-b5f9-b830fe5fe534 tempest-TestServerVolumeAttachmentScenario-530745428 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:32:34 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-7024ee57-a4e6-4361-b5f9-b830fe5fe534 tempest-TestServerVolumeAttachmentScenario-530745428 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:32:34 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-7024ee57-a4e6-4361-b5f9-b830fe5fe534 tempest-TestServerVolumeAttachmentScenario-530745428 None] Selected osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 as target Quobyte volume. {{(pid=89182) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 12:32:34 devstack cinder-volume[89182]: INFO cinder.volume.drivers.remotefs [None req-7024ee57-a4e6-4361-b5f9-b830fe5fe534 tempest-TestServerVolumeAttachmentScenario-530745428 None] casted to osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 Jul 31 12:32:34 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-7024ee57-a4e6-4361-b5f9-b830fe5fe534 tempest-TestServerVolumeAttachmentScenario-530745428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-1d305f7a-ad99-409b-9dda-d48b769ce92c 1073741824 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:32:34 devstack cinder-volume[89182]: DEBUG cinder.volume.flows.manager.create_volume [None req-0286386d-195d-4dcc-be9e-f63ac097de14 tempest-TestMinimumBasicScenario-1824458810 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89182) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 12:32:34 devstack sudo[108767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-1d305f7a-ad99-409b-9dda-d48b769ce92c 1073741824 Jul 31 12:32:34 devstack sudo[108767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:32:34 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-0286386d-195d-4dcc-be9e-f63ac097de14 tempest-TestMinimumBasicScenario-1824458810 None] Flow 'volume_create_manager' (27747368-7b62-430c-8dfb-01a4709e79ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:32:34 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-0286386d-195d-4dcc-be9e-f63ac097de14 tempest-TestMinimumBasicScenario-1824458810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (487f8308-e7b0-4583-b764-010db8bd23ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:32:34 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-0286386d-195d-4dcc-be9e-f63ac097de14 tempest-TestMinimumBasicScenario-1824458810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (487f8308-e7b0-4583-b764-010db8bd23ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:32:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1583160724',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23e7ecdc-ee25-488f-94eb-2e16a9944d94,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1db2a9609a2b4028a0804fb12ea58d62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:32:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:32:34Z,use_quota=True,user_id='adfe29a98283481aba7f19cde9c41cdc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:32:34 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-0286386d-195d-4dcc-be9e-f63ac097de14 tempest-TestMinimumBasicScenario-1824458810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d542d84-ea81-4a23-916d-635d14952c34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:32:34 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-0286386d-195d-4dcc-be9e-f63ac097de14 tempest-TestMinimumBasicScenario-1824458810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d542d84-ea81-4a23-916d-635d14952c34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:32:34 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-0286386d-195d-4dcc-be9e-f63ac097de14 tempest-TestMinimumBasicScenario-1824458810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (374045ee-aec3-4590-a34d-6f7820d1f1a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:32:34 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-0286386d-195d-4dcc-be9e-f63ac097de14 tempest-TestMinimumBasicScenario-1824458810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (374045ee-aec3-4590-a34d-6f7820d1f1a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '23e7ecdc-ee25-488f-94eb-2e16a9944d94', 'volume_name': 'volume-23e7ecdc-ee25-488f-94eb-2e16a9944d94', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:32:34 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-0286386d-195d-4dcc-be9e-f63ac097de14 tempest-TestMinimumBasicScenario-1824458810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff6dfa83-b344-4913-85db-461ab94ea1be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:32:34 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-0286386d-195d-4dcc-be9e-f63ac097de14 tempest-TestMinimumBasicScenario-1824458810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff6dfa83-b344-4913-85db-461ab94ea1be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:32:34 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-0286386d-195d-4dcc-be9e-f63ac097de14 tempest-TestMinimumBasicScenario-1824458810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36b946f0-a800-4525-89cf-24385bcac1da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:32:34 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-0286386d-195d-4dcc-be9e-f63ac097de14 tempest-TestMinimumBasicScenario-1824458810 None] Volume 23e7ecdc-ee25-488f-94eb-2e16a9944d94: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-23e7ecdc-ee25-488f-94eb-2e16a9944d94', 'volume_size': 1} Jul 31 12:32:34 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-0286386d-195d-4dcc-be9e-f63ac097de14 tempest-TestMinimumBasicScenario-1824458810 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:32:34 devstack cinder-volume[89182]: DEBUG cinder.volume.flows.manager.create_volume [None req-b02cbf82-aed1-4071-9800-47a49b867c03 tempest-TestServerVolumeAttachmentScenario-530745428 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89182) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 12:32:34 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-b02cbf82-aed1-4071-9800-47a49b867c03 tempest-TestServerVolumeAttachmentScenario-530745428 None] Flow 'volume_create_manager' (0a7a23f6-cad6-4565-9321-4e01c4b35c64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:32:34 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-b02cbf82-aed1-4071-9800-47a49b867c03 tempest-TestServerVolumeAttachmentScenario-530745428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15d42d25-ccdb-47b9-9a5b-cd4daaa1ed85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:32:34 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-b02cbf82-aed1-4071-9800-47a49b867c03 tempest-TestServerVolumeAttachmentScenario-530745428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15d42d25-ccdb-47b9-9a5b-cd4daaa1ed85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:32:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1455218389',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6ef178f-1640-456a-b5e2-36af7a1a8311,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2d66daa83c545e6bd6fd1cacf3075fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:32:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:32:35Z,use_quota=True,user_id='e6b8e81763474e5081f3e833e1d71340',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:32:34 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-b02cbf82-aed1-4071-9800-47a49b867c03 tempest-TestServerVolumeAttachmentScenario-530745428 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b48249d-38bb-4306-8242-8270fcebb3b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:32:34 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-b02cbf82-aed1-4071-9800-47a49b867c03 tempest-TestServerVolumeAttachmentScenario-530745428 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b48249d-38bb-4306-8242-8270fcebb3b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:32:34 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-b02cbf82-aed1-4071-9800-47a49b867c03 tempest-TestServerVolumeAttachmentScenario-530745428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6874cc99-f328-4d22-95c0-46c177b52e64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:32:34 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-b02cbf82-aed1-4071-9800-47a49b867c03 tempest-TestServerVolumeAttachmentScenario-530745428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6874cc99-f328-4d22-95c0-46c177b52e64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e6ef178f-1640-456a-b5e2-36af7a1a8311', 'volume_name': 'volume-e6ef178f-1640-456a-b5e2-36af7a1a8311', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:32:35 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-b02cbf82-aed1-4071-9800-47a49b867c03 tempest-TestServerVolumeAttachmentScenario-530745428 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5cf7af02-dd9e-41c6-95be-6c081de3e45e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:32:35 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-b02cbf82-aed1-4071-9800-47a49b867c03 tempest-TestServerVolumeAttachmentScenario-530745428 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5cf7af02-dd9e-41c6-95be-6c081de3e45e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:32:35 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-b02cbf82-aed1-4071-9800-47a49b867c03 tempest-TestServerVolumeAttachmentScenario-530745428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b036312-1bec-4cb2-8563-f8b210a0acf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:32:35 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-b02cbf82-aed1-4071-9800-47a49b867c03 tempest-TestServerVolumeAttachmentScenario-530745428 None] Volume e6ef178f-1640-456a-b5e2-36af7a1a8311: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e6ef178f-1640-456a-b5e2-36af7a1a8311', 'volume_size': 1} Jul 31 12:32:35 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-b02cbf82-aed1-4071-9800-47a49b867c03 tempest-TestServerVolumeAttachmentScenario-530745428 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:32:35 devstack sudo[108767]: pam_unix(sudo:session): session closed for user root Jul 31 12:32:35 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-7024ee57-a4e6-4361-b5f9-b830fe5fe534 tempest-TestServerVolumeAttachmentScenario-530745428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-1d305f7a-ad99-409b-9dda-d48b769ce92c 1073741824" returned: 0 in 0.792s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:32:35 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-7024ee57-a4e6-4361-b5f9-b830fe5fe534 tempest-TestServerVolumeAttachmentScenario-530745428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-1d305f7a-ad99-409b-9dda-d48b769ce92c {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:32:35 devstack sudo[108772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-1d305f7a-ad99-409b-9dda-d48b769ce92c Jul 31 12:32:35 devstack sudo[108772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:32:35 devstack sudo[108772]: pam_unix(sudo:session): session closed for user root Jul 31 12:32:35 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-7024ee57-a4e6-4361-b5f9-b830fe5fe534 tempest-TestServerVolumeAttachmentScenario-530745428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-1d305f7a-ad99-409b-9dda-d48b769ce92c" returned: 0 in 0.485s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:32:35 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-7024ee57-a4e6-4361-b5f9-b830fe5fe534 tempest-TestServerVolumeAttachmentScenario-530745428 None] <== create_volume: return (1367ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'} {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 12:32:35 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-7024ee57-a4e6-4361-b5f9-b830fe5fe534 tempest-TestServerVolumeAttachmentScenario-530745428 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.369s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:32:35 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-0286386d-195d-4dcc-be9e-f63ac097de14 tempest-TestMinimumBasicScenario-1824458810 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.992s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:32:35 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-0286386d-195d-4dcc-be9e-f63ac097de14 tempest-TestMinimumBasicScenario-1824458810 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:32:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1583160724',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23e7ecdc-ee25-488f-94eb-2e16a9944d94,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1db2a9609a2b4028a0804fb12ea58d62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:32:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:32:34Z,use_quota=True,user_id='adfe29a98283481aba7f19cde9c41cdc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)}" {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 12:32:35 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-0286386d-195d-4dcc-be9e-f63ac097de14 tempest-TestMinimumBasicScenario-1824458810 None] Creating volume 23e7ecdc-ee25-488f-94eb-2e16a9944d94 {{(pid=89182) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 12:32:35 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-0286386d-195d-4dcc-be9e-f63ac097de14 tempest-TestMinimumBasicScenario-1824458810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:32:35 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-0286386d-195d-4dcc-be9e-f63ac097de14 tempest-TestMinimumBasicScenario-1824458810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:32:35 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-0286386d-195d-4dcc-be9e-f63ac097de14 tempest-TestMinimumBasicScenario-1824458810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:32:35 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-0286386d-195d-4dcc-be9e-f63ac097de14 tempest-TestMinimumBasicScenario-1824458810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:32:35 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-0286386d-195d-4dcc-be9e-f63ac097de14 tempest-TestMinimumBasicScenario-1824458810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:32:35 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-0286386d-195d-4dcc-be9e-f63ac097de14 tempest-TestMinimumBasicScenario-1824458810 None] Selected osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 as target Quobyte volume. {{(pid=89182) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 12:32:35 devstack cinder-volume[89182]: INFO cinder.volume.drivers.remotefs [None req-0286386d-195d-4dcc-be9e-f63ac097de14 tempest-TestMinimumBasicScenario-1824458810 None] casted to osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 Jul 31 12:32:35 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-0286386d-195d-4dcc-be9e-f63ac097de14 tempest-TestMinimumBasicScenario-1824458810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-23e7ecdc-ee25-488f-94eb-2e16a9944d94 1073741824 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:32:35 devstack sudo[108775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-23e7ecdc-ee25-488f-94eb-2e16a9944d94 1073741824 Jul 31 12:32:35 devstack sudo[108775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:32:35 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-7024ee57-a4e6-4361-b5f9-b830fe5fe534 tempest-TestServerVolumeAttachmentScenario-530745428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0110287f-6ad9-4bc1-b118-08efb4e5138e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1d305f7a-ad99-409b-9dda-d48b769ce92c', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:32:35 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-7024ee57-a4e6-4361-b5f9-b830fe5fe534 tempest-TestServerVolumeAttachmentScenario-530745428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0e64c79-26f4-4551-a83f-10988aa43051) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:32:35 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-7024ee57-a4e6-4361-b5f9-b830fe5fe534 tempest-TestServerVolumeAttachmentScenario-530745428 None] Volume volume-1d305f7a-ad99-409b-9dda-d48b769ce92c (1d305f7a-ad99-409b-9dda-d48b769ce92c): created successfully Jul 31 12:32:35 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-7024ee57-a4e6-4361-b5f9-b830fe5fe534 tempest-TestServerVolumeAttachmentScenario-530745428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0e64c79-26f4-4551-a83f-10988aa43051) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:32:35 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-7024ee57-a4e6-4361-b5f9-b830fe5fe534 tempest-TestServerVolumeAttachmentScenario-530745428 None] Flow 'volume_create_manager' (0f0963b8-56c1-40bc-a907-684bbc073336) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:32:36 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-7024ee57-a4e6-4361-b5f9-b830fe5fe534 tempest-TestServerVolumeAttachmentScenario-530745428 None] Created volume successfully. Jul 31 12:32:36 devstack sudo[108775]: pam_unix(sudo:session): session closed for user root Jul 31 12:32:36 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-0286386d-195d-4dcc-be9e-f63ac097de14 tempest-TestMinimumBasicScenario-1824458810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-23e7ecdc-ee25-488f-94eb-2e16a9944d94 1073741824" returned: 0 in 0.615s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:32:36 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-0286386d-195d-4dcc-be9e-f63ac097de14 tempest-TestMinimumBasicScenario-1824458810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-23e7ecdc-ee25-488f-94eb-2e16a9944d94 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:32:36 devstack sudo[108781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-23e7ecdc-ee25-488f-94eb-2e16a9944d94 Jul 31 12:32:36 devstack sudo[108781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:32:36 devstack sudo[108781]: pam_unix(sudo:session): session closed for user root Jul 31 12:32:36 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-0286386d-195d-4dcc-be9e-f63ac097de14 tempest-TestMinimumBasicScenario-1824458810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-23e7ecdc-ee25-488f-94eb-2e16a9944d94" returned: 0 in 0.261s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:32:36 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-0286386d-195d-4dcc-be9e-f63ac097de14 tempest-TestMinimumBasicScenario-1824458810 None] <== create_volume: return (945ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'} {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 12:32:36 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-0286386d-195d-4dcc-be9e-f63ac097de14 tempest-TestMinimumBasicScenario-1824458810 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.952s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:32:36 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-b02cbf82-aed1-4071-9800-47a49b867c03 tempest-TestServerVolumeAttachmentScenario-530745428 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.641s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:32:36 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-b02cbf82-aed1-4071-9800-47a49b867c03 tempest-TestServerVolumeAttachmentScenario-530745428 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:32:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1455218389',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6ef178f-1640-456a-b5e2-36af7a1a8311,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2d66daa83c545e6bd6fd1cacf3075fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:32:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:32:35Z,use_quota=True,user_id='e6b8e81763474e5081f3e833e1d71340',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)}" {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 12:32:36 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-b02cbf82-aed1-4071-9800-47a49b867c03 tempest-TestServerVolumeAttachmentScenario-530745428 None] Creating volume e6ef178f-1640-456a-b5e2-36af7a1a8311 {{(pid=89182) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 12:32:36 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-b02cbf82-aed1-4071-9800-47a49b867c03 tempest-TestServerVolumeAttachmentScenario-530745428 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:32:36 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-b02cbf82-aed1-4071-9800-47a49b867c03 tempest-TestServerVolumeAttachmentScenario-530745428 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:32:36 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-b02cbf82-aed1-4071-9800-47a49b867c03 tempest-TestServerVolumeAttachmentScenario-530745428 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:32:36 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-b02cbf82-aed1-4071-9800-47a49b867c03 tempest-TestServerVolumeAttachmentScenario-530745428 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:32:36 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-b02cbf82-aed1-4071-9800-47a49b867c03 tempest-TestServerVolumeAttachmentScenario-530745428 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:32:36 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-b02cbf82-aed1-4071-9800-47a49b867c03 tempest-TestServerVolumeAttachmentScenario-530745428 None] Selected osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 as target Quobyte volume. {{(pid=89182) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 12:32:36 devstack cinder-volume[89182]: INFO cinder.volume.drivers.remotefs [None req-b02cbf82-aed1-4071-9800-47a49b867c03 tempest-TestServerVolumeAttachmentScenario-530745428 None] casted to osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 Jul 31 12:32:36 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-b02cbf82-aed1-4071-9800-47a49b867c03 tempest-TestServerVolumeAttachmentScenario-530745428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e6ef178f-1640-456a-b5e2-36af7a1a8311 1073741824 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:32:36 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-0286386d-195d-4dcc-be9e-f63ac097de14 tempest-TestMinimumBasicScenario-1824458810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36b946f0-a800-4525-89cf-24385bcac1da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-23e7ecdc-ee25-488f-94eb-2e16a9944d94', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:32:36 devstack sudo[108784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e6ef178f-1640-456a-b5e2-36af7a1a8311 1073741824 Jul 31 12:32:36 devstack sudo[108784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:32:36 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-0286386d-195d-4dcc-be9e-f63ac097de14 tempest-TestMinimumBasicScenario-1824458810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (216b65df-717f-4f36-afeb-1d087d45ae9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:32:36 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-0286386d-195d-4dcc-be9e-f63ac097de14 tempest-TestMinimumBasicScenario-1824458810 None] Volume volume-23e7ecdc-ee25-488f-94eb-2e16a9944d94 (23e7ecdc-ee25-488f-94eb-2e16a9944d94): created successfully Jul 31 12:32:36 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-0286386d-195d-4dcc-be9e-f63ac097de14 tempest-TestMinimumBasicScenario-1824458810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (216b65df-717f-4f36-afeb-1d087d45ae9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:32:36 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-0286386d-195d-4dcc-be9e-f63ac097de14 tempest-TestMinimumBasicScenario-1824458810 None] Flow 'volume_create_manager' (27747368-7b62-430c-8dfb-01a4709e79ca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:32:36 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-0286386d-195d-4dcc-be9e-f63ac097de14 tempest-TestMinimumBasicScenario-1824458810 None] Created volume successfully. Jul 31 12:32:37 devstack sudo[108784]: pam_unix(sudo:session): session closed for user root Jul 31 12:32:37 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-b02cbf82-aed1-4071-9800-47a49b867c03 tempest-TestServerVolumeAttachmentScenario-530745428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e6ef178f-1640-456a-b5e2-36af7a1a8311 1073741824" returned: 0 in 0.529s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:32:37 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-b02cbf82-aed1-4071-9800-47a49b867c03 tempest-TestServerVolumeAttachmentScenario-530745428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e6ef178f-1640-456a-b5e2-36af7a1a8311 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:32:37 devstack sudo[108791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e6ef178f-1640-456a-b5e2-36af7a1a8311 Jul 31 12:32:37 devstack sudo[108791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:32:37 devstack sudo[108791]: pam_unix(sudo:session): session closed for user root Jul 31 12:32:37 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-b02cbf82-aed1-4071-9800-47a49b867c03 tempest-TestServerVolumeAttachmentScenario-530745428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e6ef178f-1640-456a-b5e2-36af7a1a8311" returned: 0 in 0.340s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:32:37 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-b02cbf82-aed1-4071-9800-47a49b867c03 tempest-TestServerVolumeAttachmentScenario-530745428 None] <== create_volume: return (919ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'} {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 12:32:37 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-b02cbf82-aed1-4071-9800-47a49b867c03 tempest-TestServerVolumeAttachmentScenario-530745428 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.923s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:32:37 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-b02cbf82-aed1-4071-9800-47a49b867c03 tempest-TestServerVolumeAttachmentScenario-530745428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b036312-1bec-4cb2-8563-f8b210a0acf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e6ef178f-1640-456a-b5e2-36af7a1a8311', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:32:37 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-b02cbf82-aed1-4071-9800-47a49b867c03 tempest-TestServerVolumeAttachmentScenario-530745428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b55f08d-a675-48ea-bb36-9c3537cefc74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:32:37 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-b02cbf82-aed1-4071-9800-47a49b867c03 tempest-TestServerVolumeAttachmentScenario-530745428 None] Volume volume-e6ef178f-1640-456a-b5e2-36af7a1a8311 (e6ef178f-1640-456a-b5e2-36af7a1a8311): created successfully Jul 31 12:32:37 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-b02cbf82-aed1-4071-9800-47a49b867c03 tempest-TestServerVolumeAttachmentScenario-530745428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b55f08d-a675-48ea-bb36-9c3537cefc74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:32:37 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-b02cbf82-aed1-4071-9800-47a49b867c03 tempest-TestServerVolumeAttachmentScenario-530745428 None] Flow 'volume_create_manager' (0a7a23f6-cad6-4565-9321-4e01c4b35c64) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:32:37 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-b02cbf82-aed1-4071-9800-47a49b867c03 tempest-TestServerVolumeAttachmentScenario-530745428 None] Created volume successfully. Jul 31 12:32:38 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [req-988e1699-24a4-4da4-a3b4-59df92beb65d req-0978620a-74bc-440a-a9a3-83024c561ddb tempest-TestMinimumBasicScenario-1824458810 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:32:38 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [req-988e1699-24a4-4da4-a3b4-59df92beb65d req-0978620a-74bc-440a-a9a3-83024c561ddb tempest-TestMinimumBasicScenario-1824458810 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:32:38 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [req-988e1699-24a4-4da4-a3b4-59df92beb65d req-0978620a-74bc-440a-a9a3-83024c561ddb tempest-TestMinimumBasicScenario-1824458810 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:32:38 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [req-988e1699-24a4-4da4-a3b4-59df92beb65d req-0978620a-74bc-440a-a9a3-83024c561ddb tempest-TestMinimumBasicScenario-1824458810 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88', 'name': 'volume-23e7ecdc-ee25-488f-94eb-2e16a9944d94', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f2e56728-efbd-4113-bf7e-c2b66e756e35', 'enforce_multipath': True} {{(pid=89182) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 31 12:32:38 devstack cinder-volume[89182]: INFO cinder.volume.manager [req-988e1699-24a4-4da4-a3b4-59df92beb65d req-0978620a-74bc-440a-a9a3-83024c561ddb tempest-TestMinimumBasicScenario-1824458810 None] attachment_update completed successfully. Jul 31 12:32:48 devstack cinder-volume[89182]: DEBUG dbcounter [-] [89182] Writing DB stats cinder:SELECT=16,cinder:UPDATE=10,cinder:DELETE=1 {{(pid=89182) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 12:32:48 devstack cinder-volume[89182]: DEBUG dbcounter [-] [89182] Writing DB stats cinder:SELECT=9,cinder:UPDATE=11,cinder:INSERT=3,cinder:DELETE=2 {{(pid=89182) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 12:33:10 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [req-60a5f8b3-3851-423d-abb8-4e8fbabc6885 req-a4d3a81d-e830-43ff-bb2c-d69454f173cf tempest-TestServerVolumeAttachmentScenario-530745428 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:33:10 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [req-60a5f8b3-3851-423d-abb8-4e8fbabc6885 req-a4d3a81d-e830-43ff-bb2c-d69454f173cf tempest-TestServerVolumeAttachmentScenario-530745428 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:33:10 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [req-60a5f8b3-3851-423d-abb8-4e8fbabc6885 req-a4d3a81d-e830-43ff-bb2c-d69454f173cf tempest-TestServerVolumeAttachmentScenario-530745428 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:33:10 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [req-60a5f8b3-3851-423d-abb8-4e8fbabc6885 req-a4d3a81d-e830-43ff-bb2c-d69454f173cf tempest-TestServerVolumeAttachmentScenario-530745428 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88', 'name': 'volume-1d305f7a-ad99-409b-9dda-d48b769ce92c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '88ed9b64-6270-4548-a36c-40f702cc0eb7', 'enforce_multipath': True} {{(pid=89182) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 31 12:33:10 devstack cinder-volume[89182]: INFO cinder.volume.manager [req-60a5f8b3-3851-423d-abb8-4e8fbabc6885 req-a4d3a81d-e830-43ff-bb2c-d69454f173cf tempest-TestServerVolumeAttachmentScenario-530745428 None] attachment_update completed successfully. Jul 31 12:33:13 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [req-f74cc3b1-1e37-4682-8d7e-18db9e769124 req-b08ab92b-74c0-48bb-8c70-e93acb17158d tempest-TestServerVolumeAttachmentScenario-530745428 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:33:13 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [req-f74cc3b1-1e37-4682-8d7e-18db9e769124 req-b08ab92b-74c0-48bb-8c70-e93acb17158d tempest-TestServerVolumeAttachmentScenario-530745428 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:33:13 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [req-f74cc3b1-1e37-4682-8d7e-18db9e769124 req-b08ab92b-74c0-48bb-8c70-e93acb17158d tempest-TestServerVolumeAttachmentScenario-530745428 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:33:13 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [req-f74cc3b1-1e37-4682-8d7e-18db9e769124 req-b08ab92b-74c0-48bb-8c70-e93acb17158d tempest-TestServerVolumeAttachmentScenario-530745428 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88', 'name': 'volume-e6ef178f-1640-456a-b5e2-36af7a1a8311', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4f95966e-df7d-4575-8eb6-1ea2c66507e7', 'enforce_multipath': True} {{(pid=89182) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 31 12:33:13 devstack cinder-volume[89182]: INFO cinder.volume.manager [req-f74cc3b1-1e37-4682-8d7e-18db9e769124 req-b08ab92b-74c0-48bb-8c70-e93acb17158d tempest-TestServerVolumeAttachmentScenario-530745428 None] attachment_update completed successfully. Jul 31 12:33:15 devstack cinder-volume[89182]: INFO cinder.volume.manager [req-b91b0e16-939a-4602-bd63-840f01941d14 req-201b6f3c-8447-4d0b-aa72-348179a5aa85 tempest-TestServerVolumeAttachmentScenario-530745428 None] Terminate volume connection completed successfully. Jul 31 12:33:15 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [req-b91b0e16-939a-4602-bd63-840f01941d14 req-201b6f3c-8447-4d0b-aa72-348179a5aa85 tempest-TestServerVolumeAttachmentScenario-530745428 None] Deleting attachment 4f95966e-df7d-4575-8eb6-1ea2c66507e7. {{(pid=89182) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 31 12:33:17 devstack cinder-volume[89182]: INFO cinder.volume.manager [req-c246c380-21cb-484a-8361-7cc84b47e4a3 req-cc9f2f9b-0c75-4815-8950-74bb0b75ed7d tempest-TestServerVolumeAttachmentScenario-530745428 None] Terminate volume connection completed successfully. Jul 31 12:33:17 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [req-c246c380-21cb-484a-8361-7cc84b47e4a3 req-cc9f2f9b-0c75-4815-8950-74bb0b75ed7d tempest-TestServerVolumeAttachmentScenario-530745428 None] Deleting attachment 88ed9b64-6270-4548-a36c-40f702cc0eb7. {{(pid=89182) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 31 12:33:20 devstack cinder-volume[89182]: INFO cinder.volume.manager [req-798d741d-e9e6-4b07-b011-7b25376bde6b req-c52f8f17-d076-46e6-a5aa-b1f959e89558 tempest-TestMinimumBasicScenario-1824458810 None] Terminate volume connection completed successfully. Jul 31 12:33:20 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [req-798d741d-e9e6-4b07-b011-7b25376bde6b req-c52f8f17-d076-46e6-a5aa-b1f959e89558 tempest-TestMinimumBasicScenario-1824458810 None] Deleting attachment f2e56728-efbd-4113-bf7e-c2b66e756e35. {{(pid=89182) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 31 12:33:21 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-01b7fe51-3933-4b22-9a2c-eb3cb8ecf957 tempest-TestMinimumBasicScenario-1824458810 None] Acquiring lock "cinder-23e7ecdc-ee25-488f-94eb-2e16a9944d94-delete_volume" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:33:21 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-01b7fe51-3933-4b22-9a2c-eb3cb8ecf957 tempest-TestMinimumBasicScenario-1824458810 None] Lock "cinder-23e7ecdc-ee25-488f-94eb-2e16a9944d94-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:33:21 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-01b7fe51-3933-4b22-9a2c-eb3cb8ecf957 tempest-TestMinimumBasicScenario-1824458810 None] Acquiring lock "cinder-quobyte-23e7ecdc-ee25-488f-94eb-2e16a9944d94" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:33:21 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-01b7fe51-3933-4b22-9a2c-eb3cb8ecf957 tempest-TestMinimumBasicScenario-1824458810 None] Lock "cinder-quobyte-23e7ecdc-ee25-488f-94eb-2e16a9944d94" acquired by "delete_volume" :: waited 0.017s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:33:21 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[a729fa3d-58b0-4e29-841f-b4cd094a8766]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:33:21 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-01b7fe51-3933-4b22-9a2c-eb3cb8ecf957 tempest-TestMinimumBasicScenario-1824458810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-23e7ecdc-ee25-488f-94eb-2e16a9944d94 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:33:21 devstack sudo[109570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-23e7ecdc-ee25-488f-94eb-2e16a9944d94 Jul 31 12:33:21 devstack sudo[109570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:33:21 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-851f3e99-35cb-44b4-8cc1-3c7d18ac7c6f tempest-TestServerVolumeAttachmentScenario-530745428 None] Acquiring lock "cinder-e6ef178f-1640-456a-b5e2-36af7a1a8311-delete_volume" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:33:21 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-851f3e99-35cb-44b4-8cc1-3c7d18ac7c6f tempest-TestServerVolumeAttachmentScenario-530745428 None] Lock "cinder-e6ef178f-1640-456a-b5e2-36af7a1a8311-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:33:21 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-851f3e99-35cb-44b4-8cc1-3c7d18ac7c6f tempest-TestServerVolumeAttachmentScenario-530745428 None] Acquiring lock "cinder-quobyte-e6ef178f-1640-456a-b5e2-36af7a1a8311" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:33:21 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-851f3e99-35cb-44b4-8cc1-3c7d18ac7c6f tempest-TestServerVolumeAttachmentScenario-530745428 None] Lock "cinder-quobyte-e6ef178f-1640-456a-b5e2-36af7a1a8311" acquired by "delete_volume" :: waited 0.015s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:33:21 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6d9d63c-91d8-4335-97eb-5b187a9786bc]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:33:21 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-851f3e99-35cb-44b4-8cc1-3c7d18ac7c6f tempest-TestServerVolumeAttachmentScenario-530745428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e6ef178f-1640-456a-b5e2-36af7a1a8311 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:33:21 devstack cinder-volume[89182]: DEBUG oslo_service.periodic_task [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89182) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 31 12:33:21 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:33:21 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:33:21 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:33:21 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:33:21 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:33:21 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:33:22 devstack sudo[109573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 Jul 31 12:33:22 devstack sudo[109573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:33:22 devstack sudo[109572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e6ef178f-1640-456a-b5e2-36af7a1a8311 Jul 31 12:33:22 devstack sudo[109572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:33:22 devstack sudo[109570]: pam_unix(sudo:session): session closed for user root Jul 31 12:33:22 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-01b7fe51-3933-4b22-9a2c-eb3cb8ecf957 tempest-TestMinimumBasicScenario-1824458810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-23e7ecdc-ee25-488f-94eb-2e16a9944d94" returned: 0 in 0.423s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:33:22 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-01b7fe51-3933-4b22-9a2c-eb3cb8ecf957 tempest-TestMinimumBasicScenario-1824458810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-23e7ecdc-ee25-488f-94eb-2e16a9944d94 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:33:22 devstack sudo[109579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-23e7ecdc-ee25-488f-94eb-2e16a9944d94 Jul 31 12:33:22 devstack sudo[109579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:33:22 devstack sudo[109573]: pam_unix(sudo:session): session closed for user root Jul 31 12:33:22 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2" returned: 0 in 0.265s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:33:22 devstack cinder-volume[89182]: DEBUG cinder.manager [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] Notifying Schedulers of capabilities ... {{(pid=89182) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 12:33:22 devstack cinder-volume[89182]: DEBUG oslo_service.periodic_task [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] Running periodic task VolumeManager._thread_info {{(pid=89182) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 31 12:33:22 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] thread count: 28 {{(pid=89182) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 31 12:33:22 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] thread info: [<_MainThread(MainThread, started 136154603720832)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=89182) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 31 12:33:22 devstack sudo[109572]: pam_unix(sudo:session): session closed for user root Jul 31 12:33:22 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-851f3e99-35cb-44b4-8cc1-3c7d18ac7c6f tempest-TestServerVolumeAttachmentScenario-530745428 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e6ef178f-1640-456a-b5e2-36af7a1a8311" returned: 0 in 0.375s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:33:22 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-851f3e99-35cb-44b4-8cc1-3c7d18ac7c6f tempest-TestServerVolumeAttachmentScenario-530745428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e6ef178f-1640-456a-b5e2-36af7a1a8311 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:33:22 devstack sudo[109586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e6ef178f-1640-456a-b5e2-36af7a1a8311 Jul 31 12:33:22 devstack sudo[109586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:33:22 devstack sudo[109579]: pam_unix(sudo:session): session closed for user root Jul 31 12:33:22 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-01b7fe51-3933-4b22-9a2c-eb3cb8ecf957 tempest-TestMinimumBasicScenario-1824458810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-23e7ecdc-ee25-488f-94eb-2e16a9944d94" returned: 0 in 0.260s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:33:22 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-01b7fe51-3933-4b22-9a2c-eb3cb8ecf957 tempest-TestMinimumBasicScenario-1824458810 None] Lock "cinder-quobyte-23e7ecdc-ee25-488f-94eb-2e16a9944d94" released by "delete_volume" :: held 0.740s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:33:22 devstack cinder-volume[89182]: DEBUG cinder.quota [None req-01b7fe51-3933-4b22-9a2c-eb3cb8ecf957 tempest-TestMinimumBasicScenario-1824458810 None] Created reservations ['6fae418b-9af7-4357-80fd-51775e03f97f', '864c441a-acef-4399-af10-9cabb1001d04', 'bd6bd169-69ba-47e0-8e9d-c721bd7dbbad', '4df06548-6144-45a9-9c26-8e5ed6f1ab52'] {{(pid=89182) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 12:33:22 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-01b7fe51-3933-4b22-9a2c-eb3cb8ecf957 tempest-TestMinimumBasicScenario-1824458810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:33:22 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-01b7fe51-3933-4b22-9a2c-eb3cb8ecf957 tempest-TestMinimumBasicScenario-1824458810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:33:22 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-01b7fe51-3933-4b22-9a2c-eb3cb8ecf957 tempest-TestMinimumBasicScenario-1824458810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:33:22 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-01b7fe51-3933-4b22-9a2c-eb3cb8ecf957 tempest-TestMinimumBasicScenario-1824458810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:33:22 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-01b7fe51-3933-4b22-9a2c-eb3cb8ecf957 tempest-TestMinimumBasicScenario-1824458810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:33:22 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-01b7fe51-3933-4b22-9a2c-eb3cb8ecf957 tempest-TestMinimumBasicScenario-1824458810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:33:22 devstack sudo[109588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 Jul 31 12:33:22 devstack sudo[109588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:33:22 devstack sudo[109586]: pam_unix(sudo:session): session closed for user root Jul 31 12:33:22 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-851f3e99-35cb-44b4-8cc1-3c7d18ac7c6f tempest-TestServerVolumeAttachmentScenario-530745428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e6ef178f-1640-456a-b5e2-36af7a1a8311" returned: 0 in 0.273s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:33:22 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-851f3e99-35cb-44b4-8cc1-3c7d18ac7c6f tempest-TestServerVolumeAttachmentScenario-530745428 None] Lock "cinder-quobyte-e6ef178f-1640-456a-b5e2-36af7a1a8311" released by "delete_volume" :: held 0.691s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:33:22 devstack cinder-volume[89182]: DEBUG cinder.quota [None req-851f3e99-35cb-44b4-8cc1-3c7d18ac7c6f tempest-TestServerVolumeAttachmentScenario-530745428 None] Created reservations ['c584963b-ab67-4294-b8b5-617c30e863c4', 'a68ad211-db15-4574-ada0-eddf32205b4d', '2d2eb65c-25ec-4cf7-92c3-06e839bfc649', '6cee3022-b152-4a11-a70f-ce90c9406a7c'] {{(pid=89182) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 12:33:22 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-851f3e99-35cb-44b4-8cc1-3c7d18ac7c6f tempest-TestServerVolumeAttachmentScenario-530745428 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:33:22 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-851f3e99-35cb-44b4-8cc1-3c7d18ac7c6f tempest-TestServerVolumeAttachmentScenario-530745428 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:33:22 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-851f3e99-35cb-44b4-8cc1-3c7d18ac7c6f tempest-TestServerVolumeAttachmentScenario-530745428 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:33:22 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-851f3e99-35cb-44b4-8cc1-3c7d18ac7c6f tempest-TestServerVolumeAttachmentScenario-530745428 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:33:22 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-851f3e99-35cb-44b4-8cc1-3c7d18ac7c6f tempest-TestServerVolumeAttachmentScenario-530745428 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:33:22 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-851f3e99-35cb-44b4-8cc1-3c7d18ac7c6f tempest-TestServerVolumeAttachmentScenario-530745428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:33:22 devstack sudo[109588]: pam_unix(sudo:session): session closed for user root Jul 31 12:33:22 devstack sudo[109592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 Jul 31 12:33:22 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-01b7fe51-3933-4b22-9a2c-eb3cb8ecf957 tempest-TestMinimumBasicScenario-1824458810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2" returned: 0 in 0.267s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:33:22 devstack sudo[109592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:33:22 devstack cinder-volume[89182]: DEBUG cinder.manager [None req-01b7fe51-3933-4b22-9a2c-eb3cb8ecf957 tempest-TestMinimumBasicScenario-1824458810 None] Notifying Schedulers of capabilities ... {{(pid=89182) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 12:33:22 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-01b7fe51-3933-4b22-9a2c-eb3cb8ecf957 tempest-TestMinimumBasicScenario-1824458810 None] Deleted volume successfully. Jul 31 12:33:22 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-01b7fe51-3933-4b22-9a2c-eb3cb8ecf957 tempest-TestMinimumBasicScenario-1824458810 None] Lock "cinder-23e7ecdc-ee25-488f-94eb-2e16a9944d94-delete_volume" released by "delete_volume" :: held 1.206s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:33:23 devstack sudo[109592]: pam_unix(sudo:session): session closed for user root Jul 31 12:33:23 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-851f3e99-35cb-44b4-8cc1-3c7d18ac7c6f tempest-TestServerVolumeAttachmentScenario-530745428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2" returned: 0 in 0.314s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:33:23 devstack cinder-volume[89182]: DEBUG cinder.manager [None req-851f3e99-35cb-44b4-8cc1-3c7d18ac7c6f tempest-TestServerVolumeAttachmentScenario-530745428 None] Notifying Schedulers of capabilities ... {{(pid=89182) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 12:33:23 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-851f3e99-35cb-44b4-8cc1-3c7d18ac7c6f tempest-TestServerVolumeAttachmentScenario-530745428 None] Deleted volume successfully. Jul 31 12:33:23 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-daa9e728-c6d1-467e-9975-877339b87b07 tempest-TestServerVolumeAttachmentScenario-530745428 None] Acquiring lock "cinder-1d305f7a-ad99-409b-9dda-d48b769ce92c-delete_volume" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:33:23 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-851f3e99-35cb-44b4-8cc1-3c7d18ac7c6f tempest-TestServerVolumeAttachmentScenario-530745428 None] Lock "cinder-e6ef178f-1640-456a-b5e2-36af7a1a8311-delete_volume" released by "delete_volume" :: held 1.226s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:33:23 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-daa9e728-c6d1-467e-9975-877339b87b07 tempest-TestServerVolumeAttachmentScenario-530745428 None] Lock "cinder-1d305f7a-ad99-409b-9dda-d48b769ce92c-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:33:23 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-daa9e728-c6d1-467e-9975-877339b87b07 tempest-TestServerVolumeAttachmentScenario-530745428 None] Acquiring lock "cinder-quobyte-1d305f7a-ad99-409b-9dda-d48b769ce92c" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:33:23 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-daa9e728-c6d1-467e-9975-877339b87b07 tempest-TestServerVolumeAttachmentScenario-530745428 None] Lock "cinder-quobyte-1d305f7a-ad99-409b-9dda-d48b769ce92c" acquired by "delete_volume" :: waited 0.029s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:33:23 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[10ff8f59-0899-41dc-82fb-ae2940e3d20b]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:33:23 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-daa9e728-c6d1-467e-9975-877339b87b07 tempest-TestServerVolumeAttachmentScenario-530745428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-1d305f7a-ad99-409b-9dda-d48b769ce92c {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:33:23 devstack sudo[109599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-1d305f7a-ad99-409b-9dda-d48b769ce92c Jul 31 12:33:23 devstack sudo[109599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:33:23 devstack sudo[109599]: pam_unix(sudo:session): session closed for user root Jul 31 12:33:23 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-daa9e728-c6d1-467e-9975-877339b87b07 tempest-TestServerVolumeAttachmentScenario-530745428 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-1d305f7a-ad99-409b-9dda-d48b769ce92c" returned: 0 in 0.429s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:33:23 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-daa9e728-c6d1-467e-9975-877339b87b07 tempest-TestServerVolumeAttachmentScenario-530745428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-1d305f7a-ad99-409b-9dda-d48b769ce92c {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:33:23 devstack sudo[109622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-1d305f7a-ad99-409b-9dda-d48b769ce92c Jul 31 12:33:23 devstack sudo[109622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:33:23 devstack sudo[109622]: pam_unix(sudo:session): session closed for user root Jul 31 12:33:23 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-daa9e728-c6d1-467e-9975-877339b87b07 tempest-TestServerVolumeAttachmentScenario-530745428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-1d305f7a-ad99-409b-9dda-d48b769ce92c" returned: 0 in 0.293s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:33:23 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-daa9e728-c6d1-467e-9975-877339b87b07 tempest-TestServerVolumeAttachmentScenario-530745428 None] Lock "cinder-quobyte-1d305f7a-ad99-409b-9dda-d48b769ce92c" released by "delete_volume" :: held 0.774s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:33:23 devstack cinder-volume[89182]: DEBUG cinder.quota [None req-daa9e728-c6d1-467e-9975-877339b87b07 tempest-TestServerVolumeAttachmentScenario-530745428 None] Created reservations ['c566fd5f-ae96-4cff-92cb-f50c0b3afc57', 'a96b2098-3724-444d-96b2-0ced698b5389', '5b1ad291-e74c-4a92-9c66-653ae5aea2a9', '1e930b01-9038-4d72-9430-dc1d81c9659e'] {{(pid=89182) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 12:33:24 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-daa9e728-c6d1-467e-9975-877339b87b07 tempest-TestServerVolumeAttachmentScenario-530745428 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:33:24 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-daa9e728-c6d1-467e-9975-877339b87b07 tempest-TestServerVolumeAttachmentScenario-530745428 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:33:24 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-daa9e728-c6d1-467e-9975-877339b87b07 tempest-TestServerVolumeAttachmentScenario-530745428 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:33:24 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-daa9e728-c6d1-467e-9975-877339b87b07 tempest-TestServerVolumeAttachmentScenario-530745428 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:33:24 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-daa9e728-c6d1-467e-9975-877339b87b07 tempest-TestServerVolumeAttachmentScenario-530745428 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:33:24 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-daa9e728-c6d1-467e-9975-877339b87b07 tempest-TestServerVolumeAttachmentScenario-530745428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:33:24 devstack sudo[109627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 Jul 31 12:33:24 devstack sudo[109627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:33:24 devstack sudo[109627]: pam_unix(sudo:session): session closed for user root Jul 31 12:33:24 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-daa9e728-c6d1-467e-9975-877339b87b07 tempest-TestServerVolumeAttachmentScenario-530745428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2" returned: 0 in 0.360s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:33:24 devstack cinder-volume[89182]: DEBUG cinder.manager [None req-daa9e728-c6d1-467e-9975-877339b87b07 tempest-TestServerVolumeAttachmentScenario-530745428 None] Notifying Schedulers of capabilities ... {{(pid=89182) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 12:33:24 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-daa9e728-c6d1-467e-9975-877339b87b07 tempest-TestServerVolumeAttachmentScenario-530745428 None] Deleted volume successfully. Jul 31 12:33:24 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-daa9e728-c6d1-467e-9975-877339b87b07 tempest-TestServerVolumeAttachmentScenario-530745428 None] Lock "cinder-1d305f7a-ad99-409b-9dda-d48b769ce92c-delete_volume" released by "delete_volume" :: held 1.376s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:33:34 devstack cinder-volume[89182]: DEBUG dbcounter [-] [89182] Writing DB stats cinder:SELECT=32,cinder:UPDATE=31,cinder:INSERT=7,cinder:DELETE=2 {{(pid=89182) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 12:33:34 devstack cinder-volume[89182]: DEBUG dbcounter [-] [89182] Writing DB stats cinder:SELECT=31,cinder:UPDATE=24,cinder:INSERT=5,cinder:DELETE=1 {{(pid=89182) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 12:33:35 devstack cinder-volume[89182]: DEBUG cinder.volume.flows.manager.create_volume [None req-41efc452-75d6-4e21-bafd-42276e4fe4a2 tempest-CreateVolumesFromSourceVolumeTest-321845991 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89182) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 12:33:35 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-41efc452-75d6-4e21-bafd-42276e4fe4a2 tempest-CreateVolumesFromSourceVolumeTest-321845991 None] Flow 'volume_create_manager' (ea5d1b3b-38c0-4c34-aaf8-9d7486bf46e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:33:35 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-41efc452-75d6-4e21-bafd-42276e4fe4a2 tempest-CreateVolumesFromSourceVolumeTest-321845991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43543a77-a209-40ce-b3f9-a07151464db6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:33:35 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-41efc452-75d6-4e21-bafd-42276e4fe4a2 tempest-CreateVolumesFromSourceVolumeTest-321845991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43543a77-a209-40ce-b3f9-a07151464db6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:33:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1149806787',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59e05514-1ce0-4d60-ac05-0dd2ea228945,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='760681b6151e4fb2b0b7294ffab0d30b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:33:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:33:36Z,use_quota=True,user_id='1148227eb6ba4921b3453a6043885bea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:33:35 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-41efc452-75d6-4e21-bafd-42276e4fe4a2 tempest-CreateVolumesFromSourceVolumeTest-321845991 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1513796b-2316-4430-913d-ddb28f6375de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:33:35 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-41efc452-75d6-4e21-bafd-42276e4fe4a2 tempest-CreateVolumesFromSourceVolumeTest-321845991 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1513796b-2316-4430-913d-ddb28f6375de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:33:35 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-41efc452-75d6-4e21-bafd-42276e4fe4a2 tempest-CreateVolumesFromSourceVolumeTest-321845991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48d1b1f8-c9be-4fc9-b6c0-d2c64f108d74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:33:35 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-41efc452-75d6-4e21-bafd-42276e4fe4a2 tempest-CreateVolumesFromSourceVolumeTest-321845991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48d1b1f8-c9be-4fc9-b6c0-d2c64f108d74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '59e05514-1ce0-4d60-ac05-0dd2ea228945', 'volume_name': 'volume-59e05514-1ce0-4d60-ac05-0dd2ea228945', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:33:35 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-41efc452-75d6-4e21-bafd-42276e4fe4a2 tempest-CreateVolumesFromSourceVolumeTest-321845991 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (986e115a-65be-43b9-8716-10f31d686bb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:33:35 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-41efc452-75d6-4e21-bafd-42276e4fe4a2 tempest-CreateVolumesFromSourceVolumeTest-321845991 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (986e115a-65be-43b9-8716-10f31d686bb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:33:35 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-41efc452-75d6-4e21-bafd-42276e4fe4a2 tempest-CreateVolumesFromSourceVolumeTest-321845991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (579eb828-8eac-4f40-9adf-903d7cf25802) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:33:35 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-41efc452-75d6-4e21-bafd-42276e4fe4a2 tempest-CreateVolumesFromSourceVolumeTest-321845991 None] Volume 59e05514-1ce0-4d60-ac05-0dd2ea228945: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-59e05514-1ce0-4d60-ac05-0dd2ea228945', 'volume_size': 1} Jul 31 12:33:35 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-41efc452-75d6-4e21-bafd-42276e4fe4a2 tempest-CreateVolumesFromSourceVolumeTest-321845991 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:33:35 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-41efc452-75d6-4e21-bafd-42276e4fe4a2 tempest-CreateVolumesFromSourceVolumeTest-321845991 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:33:35 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-41efc452-75d6-4e21-bafd-42276e4fe4a2 tempest-CreateVolumesFromSourceVolumeTest-321845991 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:33:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1149806787',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59e05514-1ce0-4d60-ac05-0dd2ea228945,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='760681b6151e4fb2b0b7294ffab0d30b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:33:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:33:36Z,use_quota=True,user_id='1148227eb6ba4921b3453a6043885bea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)}" {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 12:33:35 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-41efc452-75d6-4e21-bafd-42276e4fe4a2 tempest-CreateVolumesFromSourceVolumeTest-321845991 None] Creating volume 59e05514-1ce0-4d60-ac05-0dd2ea228945 {{(pid=89182) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 12:33:35 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-41efc452-75d6-4e21-bafd-42276e4fe4a2 tempest-CreateVolumesFromSourceVolumeTest-321845991 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:33:35 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-41efc452-75d6-4e21-bafd-42276e4fe4a2 tempest-CreateVolumesFromSourceVolumeTest-321845991 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:33:35 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-41efc452-75d6-4e21-bafd-42276e4fe4a2 tempest-CreateVolumesFromSourceVolumeTest-321845991 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:33:35 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-41efc452-75d6-4e21-bafd-42276e4fe4a2 tempest-CreateVolumesFromSourceVolumeTest-321845991 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:33:35 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-41efc452-75d6-4e21-bafd-42276e4fe4a2 tempest-CreateVolumesFromSourceVolumeTest-321845991 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:33:35 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-41efc452-75d6-4e21-bafd-42276e4fe4a2 tempest-CreateVolumesFromSourceVolumeTest-321845991 None] Selected osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 as target Quobyte volume. {{(pid=89182) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 12:33:35 devstack cinder-volume[89182]: INFO cinder.volume.drivers.remotefs [None req-41efc452-75d6-4e21-bafd-42276e4fe4a2 tempest-CreateVolumesFromSourceVolumeTest-321845991 None] casted to osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 Jul 31 12:33:35 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-41efc452-75d6-4e21-bafd-42276e4fe4a2 tempest-CreateVolumesFromSourceVolumeTest-321845991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-59e05514-1ce0-4d60-ac05-0dd2ea228945 1073741824 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:33:35 devstack sudo[109640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-59e05514-1ce0-4d60-ac05-0dd2ea228945 1073741824 Jul 31 12:33:35 devstack sudo[109640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:33:36 devstack sudo[109640]: pam_unix(sudo:session): session closed for user root Jul 31 12:33:36 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-41efc452-75d6-4e21-bafd-42276e4fe4a2 tempest-CreateVolumesFromSourceVolumeTest-321845991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-59e05514-1ce0-4d60-ac05-0dd2ea228945 1073741824" returned: 0 in 0.498s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:33:36 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-41efc452-75d6-4e21-bafd-42276e4fe4a2 tempest-CreateVolumesFromSourceVolumeTest-321845991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-59e05514-1ce0-4d60-ac05-0dd2ea228945 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:33:36 devstack sudo[109645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-59e05514-1ce0-4d60-ac05-0dd2ea228945 Jul 31 12:33:36 devstack sudo[109645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:33:36 devstack sudo[109645]: pam_unix(sudo:session): session closed for user root Jul 31 12:33:36 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-41efc452-75d6-4e21-bafd-42276e4fe4a2 tempest-CreateVolumesFromSourceVolumeTest-321845991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-59e05514-1ce0-4d60-ac05-0dd2ea228945" returned: 0 in 0.262s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:33:36 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-41efc452-75d6-4e21-bafd-42276e4fe4a2 tempest-CreateVolumesFromSourceVolumeTest-321845991 None] <== create_volume: return (811ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'} {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 12:33:36 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-41efc452-75d6-4e21-bafd-42276e4fe4a2 tempest-CreateVolumesFromSourceVolumeTest-321845991 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.814s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:33:36 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-41efc452-75d6-4e21-bafd-42276e4fe4a2 tempest-CreateVolumesFromSourceVolumeTest-321845991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (579eb828-8eac-4f40-9adf-903d7cf25802) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-59e05514-1ce0-4d60-ac05-0dd2ea228945', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:33:36 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-41efc452-75d6-4e21-bafd-42276e4fe4a2 tempest-CreateVolumesFromSourceVolumeTest-321845991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c35fb36d-9596-4e01-a928-ca434d6b785f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:33:36 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-41efc452-75d6-4e21-bafd-42276e4fe4a2 tempest-CreateVolumesFromSourceVolumeTest-321845991 None] Volume volume-59e05514-1ce0-4d60-ac05-0dd2ea228945 (59e05514-1ce0-4d60-ac05-0dd2ea228945): created successfully Jul 31 12:33:36 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-41efc452-75d6-4e21-bafd-42276e4fe4a2 tempest-CreateVolumesFromSourceVolumeTest-321845991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c35fb36d-9596-4e01-a928-ca434d6b785f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:33:36 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-41efc452-75d6-4e21-bafd-42276e4fe4a2 tempest-CreateVolumesFromSourceVolumeTest-321845991 None] Flow 'volume_create_manager' (ea5d1b3b-38c0-4c34-aaf8-9d7486bf46e9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:33:36 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-41efc452-75d6-4e21-bafd-42276e4fe4a2 tempest-CreateVolumesFromSourceVolumeTest-321845991 None] Created volume successfully. Jul 31 12:33:38 devstack cinder-volume[89182]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7859877-1c94-49a0-b9bd-e93357b7734d tempest-CreateVolumesFromSourceVolumeTest-321845991 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89182) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 12:33:38 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-e7859877-1c94-49a0-b9bd-e93357b7734d tempest-CreateVolumesFromSourceVolumeTest-321845991 None] Flow 'volume_create_manager' (a1b292b9-2ba4-4f9d-8f4a-08735f14af0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:33:38 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-e7859877-1c94-49a0-b9bd-e93357b7734d tempest-CreateVolumesFromSourceVolumeTest-321845991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20e1b060-4781-4166-8e9b-ee1d559cf2e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:33:38 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-e7859877-1c94-49a0-b9bd-e93357b7734d tempest-CreateVolumesFromSourceVolumeTest-321845991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20e1b060-4781-4166-8e9b-ee1d559cf2e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:33:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-288199782',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4d7cb94-1d52-4499-b7da-4ed256db8585,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='760681b6151e4fb2b0b7294ffab0d30b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:33:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:33:38Z,use_quota=True,user_id='1148227eb6ba4921b3453a6043885bea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:33:38 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-e7859877-1c94-49a0-b9bd-e93357b7734d tempest-CreateVolumesFromSourceVolumeTest-321845991 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e775442-efb6-4bbf-9402-dcfbee4bd1f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:33:38 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-e7859877-1c94-49a0-b9bd-e93357b7734d tempest-CreateVolumesFromSourceVolumeTest-321845991 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e775442-efb6-4bbf-9402-dcfbee4bd1f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:33:38 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-e7859877-1c94-49a0-b9bd-e93357b7734d tempest-CreateVolumesFromSourceVolumeTest-321845991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0caa92ab-3d07-4d61-a6ef-915d26e9484f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:33:38 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-e7859877-1c94-49a0-b9bd-e93357b7734d tempest-CreateVolumesFromSourceVolumeTest-321845991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0caa92ab-3d07-4d61-a6ef-915d26e9484f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b4d7cb94-1d52-4499-b7da-4ed256db8585', 'volume_name': 'volume-b4d7cb94-1d52-4499-b7da-4ed256db8585', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:33:38 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-e7859877-1c94-49a0-b9bd-e93357b7734d tempest-CreateVolumesFromSourceVolumeTest-321845991 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77084862-428c-49fe-8d7b-4705b0fb5a2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:33:38 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-e7859877-1c94-49a0-b9bd-e93357b7734d tempest-CreateVolumesFromSourceVolumeTest-321845991 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77084862-428c-49fe-8d7b-4705b0fb5a2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:33:38 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-e7859877-1c94-49a0-b9bd-e93357b7734d tempest-CreateVolumesFromSourceVolumeTest-321845991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f849f8c-6698-41ae-bec3-b96581e97021) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:33:38 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-e7859877-1c94-49a0-b9bd-e93357b7734d tempest-CreateVolumesFromSourceVolumeTest-321845991 None] Volume b4d7cb94-1d52-4499-b7da-4ed256db8585: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b4d7cb94-1d52-4499-b7da-4ed256db8585', 'volume_size': 1} Jul 31 12:33:38 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-e7859877-1c94-49a0-b9bd-e93357b7734d tempest-CreateVolumesFromSourceVolumeTest-321845991 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:33:38 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-e7859877-1c94-49a0-b9bd-e93357b7734d tempest-CreateVolumesFromSourceVolumeTest-321845991 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:33:38 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-e7859877-1c94-49a0-b9bd-e93357b7734d tempest-CreateVolumesFromSourceVolumeTest-321845991 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:33:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-288199782',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4d7cb94-1d52-4499-b7da-4ed256db8585,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='760681b6151e4fb2b0b7294ffab0d30b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:33:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:33:38Z,use_quota=True,user_id='1148227eb6ba4921b3453a6043885bea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)}" {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 12:33:38 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-e7859877-1c94-49a0-b9bd-e93357b7734d tempest-CreateVolumesFromSourceVolumeTest-321845991 None] Creating volume b4d7cb94-1d52-4499-b7da-4ed256db8585 {{(pid=89182) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 12:33:38 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-e7859877-1c94-49a0-b9bd-e93357b7734d tempest-CreateVolumesFromSourceVolumeTest-321845991 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:33:38 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-e7859877-1c94-49a0-b9bd-e93357b7734d tempest-CreateVolumesFromSourceVolumeTest-321845991 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:33:38 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-e7859877-1c94-49a0-b9bd-e93357b7734d tempest-CreateVolumesFromSourceVolumeTest-321845991 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:33:38 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-e7859877-1c94-49a0-b9bd-e93357b7734d tempest-CreateVolumesFromSourceVolumeTest-321845991 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:33:38 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-e7859877-1c94-49a0-b9bd-e93357b7734d tempest-CreateVolumesFromSourceVolumeTest-321845991 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:33:38 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-e7859877-1c94-49a0-b9bd-e93357b7734d tempest-CreateVolumesFromSourceVolumeTest-321845991 None] Selected osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 as target Quobyte volume. {{(pid=89182) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 12:33:38 devstack cinder-volume[89182]: INFO cinder.volume.drivers.remotefs [None req-e7859877-1c94-49a0-b9bd-e93357b7734d tempest-CreateVolumesFromSourceVolumeTest-321845991 None] casted to osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 Jul 31 12:33:38 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-e7859877-1c94-49a0-b9bd-e93357b7734d tempest-CreateVolumesFromSourceVolumeTest-321845991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-b4d7cb94-1d52-4499-b7da-4ed256db8585 1073741824 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:33:38 devstack sudo[109649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-b4d7cb94-1d52-4499-b7da-4ed256db8585 1073741824 Jul 31 12:33:38 devstack sudo[109649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:33:38 devstack cinder-volume[89182]: DEBUG cinder.volume.flows.manager.create_volume [None req-0fd8bb25-dd52-4762-92d7-19dca26d002b tempest-CreateVolumesFromSourceVolumeTest-321845991 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89182) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 12:33:38 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-0fd8bb25-dd52-4762-92d7-19dca26d002b tempest-CreateVolumesFromSourceVolumeTest-321845991 None] Flow 'volume_create_manager' (fd8ac742-2644-4dd7-8d19-b4874ca950d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:33:38 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-0fd8bb25-dd52-4762-92d7-19dca26d002b tempest-CreateVolumesFromSourceVolumeTest-321845991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (157a0705-901e-431c-a03a-4b25dba6b6fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:33:38 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-0fd8bb25-dd52-4762-92d7-19dca26d002b tempest-CreateVolumesFromSourceVolumeTest-321845991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (157a0705-901e-431c-a03a-4b25dba6b6fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:33:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-37859897',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e9eee29-306c-4aa3-8343-e15f3b820fd5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='760681b6151e4fb2b0b7294ffab0d30b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:33:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:33:39Z,use_quota=True,user_id='1148227eb6ba4921b3453a6043885bea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:33:38 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-0fd8bb25-dd52-4762-92d7-19dca26d002b tempest-CreateVolumesFromSourceVolumeTest-321845991 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2e4ff25-c036-4a5e-9cbb-285543019819) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:33:38 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-0fd8bb25-dd52-4762-92d7-19dca26d002b tempest-CreateVolumesFromSourceVolumeTest-321845991 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2e4ff25-c036-4a5e-9cbb-285543019819) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:33:38 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-0fd8bb25-dd52-4762-92d7-19dca26d002b tempest-CreateVolumesFromSourceVolumeTest-321845991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d00953c6-8ed5-43c2-b769-e68f969cc00d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:33:38 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-0fd8bb25-dd52-4762-92d7-19dca26d002b tempest-CreateVolumesFromSourceVolumeTest-321845991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d00953c6-8ed5-43c2-b769-e68f969cc00d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6e9eee29-306c-4aa3-8343-e15f3b820fd5', 'volume_name': 'volume-6e9eee29-306c-4aa3-8343-e15f3b820fd5', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:33:38 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-0fd8bb25-dd52-4762-92d7-19dca26d002b tempest-CreateVolumesFromSourceVolumeTest-321845991 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0cd1c303-e3c6-4916-bab2-62af37501cf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:33:38 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-0fd8bb25-dd52-4762-92d7-19dca26d002b tempest-CreateVolumesFromSourceVolumeTest-321845991 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0cd1c303-e3c6-4916-bab2-62af37501cf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:33:38 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-0fd8bb25-dd52-4762-92d7-19dca26d002b tempest-CreateVolumesFromSourceVolumeTest-321845991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96a9b85c-d53c-4181-9514-85e7ac1baa2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:33:38 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-0fd8bb25-dd52-4762-92d7-19dca26d002b tempest-CreateVolumesFromSourceVolumeTest-321845991 None] Volume 6e9eee29-306c-4aa3-8343-e15f3b820fd5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6e9eee29-306c-4aa3-8343-e15f3b820fd5', 'volume_size': 1} Jul 31 12:33:38 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-0fd8bb25-dd52-4762-92d7-19dca26d002b tempest-CreateVolumesFromSourceVolumeTest-321845991 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:33:38 devstack sudo[109649]: pam_unix(sudo:session): session closed for user root Jul 31 12:33:38 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-e7859877-1c94-49a0-b9bd-e93357b7734d tempest-CreateVolumesFromSourceVolumeTest-321845991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-b4d7cb94-1d52-4499-b7da-4ed256db8585 1073741824" returned: 0 in 0.556s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:33:38 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-e7859877-1c94-49a0-b9bd-e93357b7734d tempest-CreateVolumesFromSourceVolumeTest-321845991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-b4d7cb94-1d52-4499-b7da-4ed256db8585 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:33:38 devstack sudo[109655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-b4d7cb94-1d52-4499-b7da-4ed256db8585 Jul 31 12:33:38 devstack sudo[109655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:33:39 devstack cinder-volume[89182]: DEBUG cinder.volume.flows.manager.create_volume [None req-c65204ae-74dd-41ab-9798-1094ab9acced tempest-CreateVolumesFromSourceVolumeTest-321845991 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89182) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 12:33:39 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-c65204ae-74dd-41ab-9798-1094ab9acced tempest-CreateVolumesFromSourceVolumeTest-321845991 None] Flow 'volume_create_manager' (5ca01ce4-4ff7-4dea-a5be-760b0329f952) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:33:39 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-c65204ae-74dd-41ab-9798-1094ab9acced tempest-CreateVolumesFromSourceVolumeTest-321845991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6d4ebb3-9f3c-41a7-86c9-24ed60d41e51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:33:39 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-c65204ae-74dd-41ab-9798-1094ab9acced tempest-CreateVolumesFromSourceVolumeTest-321845991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6d4ebb3-9f3c-41a7-86c9-24ed60d41e51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:33:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-861501528',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9bb0c3fc-37ed-43d1-966d-95f41f2aff26,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='760681b6151e4fb2b0b7294ffab0d30b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:33:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:33:39Z,use_quota=True,user_id='1148227eb6ba4921b3453a6043885bea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:33:39 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-c65204ae-74dd-41ab-9798-1094ab9acced tempest-CreateVolumesFromSourceVolumeTest-321845991 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa237394-e69e-4ad7-a2aa-55dd736eff95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:33:39 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-c65204ae-74dd-41ab-9798-1094ab9acced tempest-CreateVolumesFromSourceVolumeTest-321845991 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa237394-e69e-4ad7-a2aa-55dd736eff95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:33:39 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-c65204ae-74dd-41ab-9798-1094ab9acced tempest-CreateVolumesFromSourceVolumeTest-321845991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (caae1900-f609-48ad-8b0b-f2f2d849a90c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:33:39 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-c65204ae-74dd-41ab-9798-1094ab9acced tempest-CreateVolumesFromSourceVolumeTest-321845991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (caae1900-f609-48ad-8b0b-f2f2d849a90c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9bb0c3fc-37ed-43d1-966d-95f41f2aff26', 'volume_name': 'volume-9bb0c3fc-37ed-43d1-966d-95f41f2aff26', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:33:39 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-c65204ae-74dd-41ab-9798-1094ab9acced tempest-CreateVolumesFromSourceVolumeTest-321845991 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97cbc0ad-1a10-467a-8da3-35269b763034) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:33:39 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-c65204ae-74dd-41ab-9798-1094ab9acced tempest-CreateVolumesFromSourceVolumeTest-321845991 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97cbc0ad-1a10-467a-8da3-35269b763034) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:33:39 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-c65204ae-74dd-41ab-9798-1094ab9acced tempest-CreateVolumesFromSourceVolumeTest-321845991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9e71c0c-f2c4-49a6-b888-e04529bdbf31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:33:39 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-c65204ae-74dd-41ab-9798-1094ab9acced tempest-CreateVolumesFromSourceVolumeTest-321845991 None] Volume 9bb0c3fc-37ed-43d1-966d-95f41f2aff26: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9bb0c3fc-37ed-43d1-966d-95f41f2aff26', 'volume_size': 1} Jul 31 12:33:39 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-c65204ae-74dd-41ab-9798-1094ab9acced tempest-CreateVolumesFromSourceVolumeTest-321845991 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:33:39 devstack sudo[109655]: pam_unix(sudo:session): session closed for user root Jul 31 12:33:39 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-e7859877-1c94-49a0-b9bd-e93357b7734d tempest-CreateVolumesFromSourceVolumeTest-321845991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-b4d7cb94-1d52-4499-b7da-4ed256db8585" returned: 0 in 0.304s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:33:39 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-e7859877-1c94-49a0-b9bd-e93357b7734d tempest-CreateVolumesFromSourceVolumeTest-321845991 None] <== create_volume: return (923ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'} {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 12:33:39 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-e7859877-1c94-49a0-b9bd-e93357b7734d tempest-CreateVolumesFromSourceVolumeTest-321845991 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.926s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:33:39 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-0fd8bb25-dd52-4762-92d7-19dca26d002b tempest-CreateVolumesFromSourceVolumeTest-321845991 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.465s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:33:39 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-0fd8bb25-dd52-4762-92d7-19dca26d002b tempest-CreateVolumesFromSourceVolumeTest-321845991 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:33:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-37859897',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e9eee29-306c-4aa3-8343-e15f3b820fd5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='760681b6151e4fb2b0b7294ffab0d30b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:33:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:33:39Z,use_quota=True,user_id='1148227eb6ba4921b3453a6043885bea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)}" {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 12:33:39 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-0fd8bb25-dd52-4762-92d7-19dca26d002b tempest-CreateVolumesFromSourceVolumeTest-321845991 None] Creating volume 6e9eee29-306c-4aa3-8343-e15f3b820fd5 {{(pid=89182) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 12:33:39 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-0fd8bb25-dd52-4762-92d7-19dca26d002b tempest-CreateVolumesFromSourceVolumeTest-321845991 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:33:39 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-0fd8bb25-dd52-4762-92d7-19dca26d002b tempest-CreateVolumesFromSourceVolumeTest-321845991 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:33:39 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-0fd8bb25-dd52-4762-92d7-19dca26d002b tempest-CreateVolumesFromSourceVolumeTest-321845991 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:33:39 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-0fd8bb25-dd52-4762-92d7-19dca26d002b tempest-CreateVolumesFromSourceVolumeTest-321845991 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:33:39 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-0fd8bb25-dd52-4762-92d7-19dca26d002b tempest-CreateVolumesFromSourceVolumeTest-321845991 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:33:39 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-0fd8bb25-dd52-4762-92d7-19dca26d002b tempest-CreateVolumesFromSourceVolumeTest-321845991 None] Selected osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 as target Quobyte volume. {{(pid=89182) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 12:33:39 devstack cinder-volume[89182]: INFO cinder.volume.drivers.remotefs [None req-0fd8bb25-dd52-4762-92d7-19dca26d002b tempest-CreateVolumesFromSourceVolumeTest-321845991 None] casted to osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 Jul 31 12:33:39 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-0fd8bb25-dd52-4762-92d7-19dca26d002b tempest-CreateVolumesFromSourceVolumeTest-321845991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-6e9eee29-306c-4aa3-8343-e15f3b820fd5 1073741824 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:33:39 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-e7859877-1c94-49a0-b9bd-e93357b7734d tempest-CreateVolumesFromSourceVolumeTest-321845991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f849f8c-6698-41ae-bec3-b96581e97021) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b4d7cb94-1d52-4499-b7da-4ed256db8585', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:33:39 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-e7859877-1c94-49a0-b9bd-e93357b7734d tempest-CreateVolumesFromSourceVolumeTest-321845991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40f561e6-eb2e-4256-bf56-b76d28b0e1b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:33:39 devstack sudo[109658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-6e9eee29-306c-4aa3-8343-e15f3b820fd5 1073741824 Jul 31 12:33:39 devstack sudo[109658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:33:39 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-e7859877-1c94-49a0-b9bd-e93357b7734d tempest-CreateVolumesFromSourceVolumeTest-321845991 None] Volume volume-b4d7cb94-1d52-4499-b7da-4ed256db8585 (b4d7cb94-1d52-4499-b7da-4ed256db8585): created successfully Jul 31 12:33:39 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-e7859877-1c94-49a0-b9bd-e93357b7734d tempest-CreateVolumesFromSourceVolumeTest-321845991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40f561e6-eb2e-4256-bf56-b76d28b0e1b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:33:39 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-e7859877-1c94-49a0-b9bd-e93357b7734d tempest-CreateVolumesFromSourceVolumeTest-321845991 None] Flow 'volume_create_manager' (a1b292b9-2ba4-4f9d-8f4a-08735f14af0e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:33:39 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-e7859877-1c94-49a0-b9bd-e93357b7734d tempest-CreateVolumesFromSourceVolumeTest-321845991 None] Created volume successfully. Jul 31 12:33:39 devstack cinder-volume[89182]: DEBUG cinder.volume.flows.manager.create_volume [None req-c2c191b7-5d26-4747-800d-e6dd51a54026 tempest-CreateVolumesFromSourceVolumeTest-321845991 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89182) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 12:33:39 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-c2c191b7-5d26-4747-800d-e6dd51a54026 tempest-CreateVolumesFromSourceVolumeTest-321845991 None] Flow 'volume_create_manager' (d9fb3d7a-f7cd-48a8-a40b-e17a8311b326) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:33:39 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-c2c191b7-5d26-4747-800d-e6dd51a54026 tempest-CreateVolumesFromSourceVolumeTest-321845991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c480ac95-e9e5-478c-b2ce-0bfd594006b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:33:39 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-c2c191b7-5d26-4747-800d-e6dd51a54026 tempest-CreateVolumesFromSourceVolumeTest-321845991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c480ac95-e9e5-478c-b2ce-0bfd594006b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:33:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1111349277',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87c386a1-852b-4898-adba-3ece06db05c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='760681b6151e4fb2b0b7294ffab0d30b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:33:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:33:40Z,use_quota=True,user_id='1148227eb6ba4921b3453a6043885bea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:33:39 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-c2c191b7-5d26-4747-800d-e6dd51a54026 tempest-CreateVolumesFromSourceVolumeTest-321845991 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7800b7e8-e781-4d50-9f8d-d5750b369f26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:33:39 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-c2c191b7-5d26-4747-800d-e6dd51a54026 tempest-CreateVolumesFromSourceVolumeTest-321845991 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7800b7e8-e781-4d50-9f8d-d5750b369f26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:33:39 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-c2c191b7-5d26-4747-800d-e6dd51a54026 tempest-CreateVolumesFromSourceVolumeTest-321845991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57aaf90f-e0ed-44e0-8236-410de424612a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:33:39 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-c2c191b7-5d26-4747-800d-e6dd51a54026 tempest-CreateVolumesFromSourceVolumeTest-321845991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57aaf90f-e0ed-44e0-8236-410de424612a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '87c386a1-852b-4898-adba-3ece06db05c2', 'volume_name': 'volume-87c386a1-852b-4898-adba-3ece06db05c2', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:33:39 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-c2c191b7-5d26-4747-800d-e6dd51a54026 tempest-CreateVolumesFromSourceVolumeTest-321845991 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e02fd7f2-7034-4b62-b133-a681767d4b08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:33:39 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-c2c191b7-5d26-4747-800d-e6dd51a54026 tempest-CreateVolumesFromSourceVolumeTest-321845991 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e02fd7f2-7034-4b62-b133-a681767d4b08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:33:39 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-c2c191b7-5d26-4747-800d-e6dd51a54026 tempest-CreateVolumesFromSourceVolumeTest-321845991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6c5b044-9ca4-4b37-8f46-d860dbb24659) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:33:39 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-c2c191b7-5d26-4747-800d-e6dd51a54026 tempest-CreateVolumesFromSourceVolumeTest-321845991 None] Volume 87c386a1-852b-4898-adba-3ece06db05c2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-87c386a1-852b-4898-adba-3ece06db05c2', 'volume_size': 1} Jul 31 12:33:39 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-c2c191b7-5d26-4747-800d-e6dd51a54026 tempest-CreateVolumesFromSourceVolumeTest-321845991 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:33:39 devstack sudo[109658]: pam_unix(sudo:session): session closed for user root Jul 31 12:33:39 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-0fd8bb25-dd52-4762-92d7-19dca26d002b tempest-CreateVolumesFromSourceVolumeTest-321845991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-6e9eee29-306c-4aa3-8343-e15f3b820fd5 1073741824" returned: 0 in 0.709s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:33:40 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-0fd8bb25-dd52-4762-92d7-19dca26d002b tempest-CreateVolumesFromSourceVolumeTest-321845991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-6e9eee29-306c-4aa3-8343-e15f3b820fd5 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:33:40 devstack sudo[109666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-6e9eee29-306c-4aa3-8343-e15f3b820fd5 Jul 31 12:33:40 devstack sudo[109666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:33:40 devstack cinder-volume[89182]: DEBUG cinder.volume.flows.manager.create_volume [None req-48a50d65-fbdb-4150-9714-c940d3d4d00e tempest-CreateVolumesFromSourceVolumeTest-321845991 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89182) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 12:33:40 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-48a50d65-fbdb-4150-9714-c940d3d4d00e tempest-CreateVolumesFromSourceVolumeTest-321845991 None] Flow 'volume_create_manager' (c4b27702-79f7-44ad-bea7-59e608ec976a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:33:40 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-48a50d65-fbdb-4150-9714-c940d3d4d00e tempest-CreateVolumesFromSourceVolumeTest-321845991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20f3af50-6362-4941-a1fe-da3c8875c1ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:33:40 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-48a50d65-fbdb-4150-9714-c940d3d4d00e tempest-CreateVolumesFromSourceVolumeTest-321845991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20f3af50-6362-4941-a1fe-da3c8875c1ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:33:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-381626476',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88ce3279-dc86-48b8-b6c6-8269794debc7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='760681b6151e4fb2b0b7294ffab0d30b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:33:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:33:40Z,use_quota=True,user_id='1148227eb6ba4921b3453a6043885bea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:33:40 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-48a50d65-fbdb-4150-9714-c940d3d4d00e tempest-CreateVolumesFromSourceVolumeTest-321845991 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c343c74f-7431-4eff-8f7f-4ad854a46ab1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:33:40 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-48a50d65-fbdb-4150-9714-c940d3d4d00e tempest-CreateVolumesFromSourceVolumeTest-321845991 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c343c74f-7431-4eff-8f7f-4ad854a46ab1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:33:40 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-48a50d65-fbdb-4150-9714-c940d3d4d00e tempest-CreateVolumesFromSourceVolumeTest-321845991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f314c9a1-a2b0-4a08-8f24-9f52a48beda2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:33:40 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-48a50d65-fbdb-4150-9714-c940d3d4d00e tempest-CreateVolumesFromSourceVolumeTest-321845991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f314c9a1-a2b0-4a08-8f24-9f52a48beda2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '88ce3279-dc86-48b8-b6c6-8269794debc7', 'volume_name': 'volume-88ce3279-dc86-48b8-b6c6-8269794debc7', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:33:40 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-48a50d65-fbdb-4150-9714-c940d3d4d00e tempest-CreateVolumesFromSourceVolumeTest-321845991 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4206a36-dba8-4ab4-890d-1d6c97d4998c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:33:40 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-48a50d65-fbdb-4150-9714-c940d3d4d00e tempest-CreateVolumesFromSourceVolumeTest-321845991 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4206a36-dba8-4ab4-890d-1d6c97d4998c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:33:40 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-48a50d65-fbdb-4150-9714-c940d3d4d00e tempest-CreateVolumesFromSourceVolumeTest-321845991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b24ecb4-1c04-4655-b156-f7ccb4f16f71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:33:40 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-48a50d65-fbdb-4150-9714-c940d3d4d00e tempest-CreateVolumesFromSourceVolumeTest-321845991 None] Volume 88ce3279-dc86-48b8-b6c6-8269794debc7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-88ce3279-dc86-48b8-b6c6-8269794debc7', 'volume_size': 1} Jul 31 12:33:40 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-48a50d65-fbdb-4150-9714-c940d3d4d00e tempest-CreateVolumesFromSourceVolumeTest-321845991 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:33:40 devstack sudo[109666]: pam_unix(sudo:session): session closed for user root Jul 31 12:33:40 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-0fd8bb25-dd52-4762-92d7-19dca26d002b tempest-CreateVolumesFromSourceVolumeTest-321845991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-6e9eee29-306c-4aa3-8343-e15f3b820fd5" returned: 0 in 0.298s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:33:40 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-0fd8bb25-dd52-4762-92d7-19dca26d002b tempest-CreateVolumesFromSourceVolumeTest-321845991 None] <== create_volume: return (1093ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'} {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 12:33:40 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-0fd8bb25-dd52-4762-92d7-19dca26d002b tempest-CreateVolumesFromSourceVolumeTest-321845991 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.097s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:33:40 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-c65204ae-74dd-41ab-9798-1094ab9acced tempest-CreateVolumesFromSourceVolumeTest-321845991 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.122s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:33:40 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-c65204ae-74dd-41ab-9798-1094ab9acced tempest-CreateVolumesFromSourceVolumeTest-321845991 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:33:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-861501528',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9bb0c3fc-37ed-43d1-966d-95f41f2aff26,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='760681b6151e4fb2b0b7294ffab0d30b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:33:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:33:39Z,use_quota=True,user_id='1148227eb6ba4921b3453a6043885bea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)}" {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 12:33:40 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-c65204ae-74dd-41ab-9798-1094ab9acced tempest-CreateVolumesFromSourceVolumeTest-321845991 None] Creating volume 9bb0c3fc-37ed-43d1-966d-95f41f2aff26 {{(pid=89182) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 12:33:40 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-c65204ae-74dd-41ab-9798-1094ab9acced tempest-CreateVolumesFromSourceVolumeTest-321845991 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:33:40 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-c65204ae-74dd-41ab-9798-1094ab9acced tempest-CreateVolumesFromSourceVolumeTest-321845991 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:33:40 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-c65204ae-74dd-41ab-9798-1094ab9acced tempest-CreateVolumesFromSourceVolumeTest-321845991 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:33:40 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-c65204ae-74dd-41ab-9798-1094ab9acced tempest-CreateVolumesFromSourceVolumeTest-321845991 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:33:40 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-c65204ae-74dd-41ab-9798-1094ab9acced tempest-CreateVolumesFromSourceVolumeTest-321845991 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:33:40 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-c65204ae-74dd-41ab-9798-1094ab9acced tempest-CreateVolumesFromSourceVolumeTest-321845991 None] Selected osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 as target Quobyte volume. {{(pid=89182) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 12:33:40 devstack cinder-volume[89182]: INFO cinder.volume.drivers.remotefs [None req-c65204ae-74dd-41ab-9798-1094ab9acced tempest-CreateVolumesFromSourceVolumeTest-321845991 None] casted to osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 Jul 31 12:33:40 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-c65204ae-74dd-41ab-9798-1094ab9acced tempest-CreateVolumesFromSourceVolumeTest-321845991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-9bb0c3fc-37ed-43d1-966d-95f41f2aff26 1073741824 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:33:40 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-0fd8bb25-dd52-4762-92d7-19dca26d002b tempest-CreateVolumesFromSourceVolumeTest-321845991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96a9b85c-d53c-4181-9514-85e7ac1baa2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6e9eee29-306c-4aa3-8343-e15f3b820fd5', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:33:40 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-0fd8bb25-dd52-4762-92d7-19dca26d002b tempest-CreateVolumesFromSourceVolumeTest-321845991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (479f9b1d-cede-47d1-9ec6-1b9ab822d763) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:33:40 devstack sudo[109669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-9bb0c3fc-37ed-43d1-966d-95f41f2aff26 1073741824 Jul 31 12:33:40 devstack sudo[109669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:33:40 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-0fd8bb25-dd52-4762-92d7-19dca26d002b tempest-CreateVolumesFromSourceVolumeTest-321845991 None] Volume volume-6e9eee29-306c-4aa3-8343-e15f3b820fd5 (6e9eee29-306c-4aa3-8343-e15f3b820fd5): created successfully Jul 31 12:33:40 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-0fd8bb25-dd52-4762-92d7-19dca26d002b tempest-CreateVolumesFromSourceVolumeTest-321845991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (479f9b1d-cede-47d1-9ec6-1b9ab822d763) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:33:40 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-0fd8bb25-dd52-4762-92d7-19dca26d002b tempest-CreateVolumesFromSourceVolumeTest-321845991 None] Flow 'volume_create_manager' (fd8ac742-2644-4dd7-8d19-b4874ca950d7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:33:40 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-0fd8bb25-dd52-4762-92d7-19dca26d002b tempest-CreateVolumesFromSourceVolumeTest-321845991 None] Created volume successfully. Jul 31 12:33:40 devstack sudo[109669]: pam_unix(sudo:session): session closed for user root Jul 31 12:33:40 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-c65204ae-74dd-41ab-9798-1094ab9acced tempest-CreateVolumesFromSourceVolumeTest-321845991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-9bb0c3fc-37ed-43d1-966d-95f41f2aff26 1073741824" returned: 0 in 0.569s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:33:40 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-c65204ae-74dd-41ab-9798-1094ab9acced tempest-CreateVolumesFromSourceVolumeTest-321845991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-9bb0c3fc-37ed-43d1-966d-95f41f2aff26 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:33:41 devstack sudo[109675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-9bb0c3fc-37ed-43d1-966d-95f41f2aff26 Jul 31 12:33:41 devstack sudo[109675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:33:41 devstack sudo[109675]: pam_unix(sudo:session): session closed for user root Jul 31 12:33:41 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-c65204ae-74dd-41ab-9798-1094ab9acced tempest-CreateVolumesFromSourceVolumeTest-321845991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-9bb0c3fc-37ed-43d1-966d-95f41f2aff26" returned: 0 in 0.300s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:33:41 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-c65204ae-74dd-41ab-9798-1094ab9acced tempest-CreateVolumesFromSourceVolumeTest-321845991 None] <== create_volume: return (921ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'} {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 12:33:41 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-c65204ae-74dd-41ab-9798-1094ab9acced tempest-CreateVolumesFromSourceVolumeTest-321845991 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.924s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:33:41 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-c2c191b7-5d26-4747-800d-e6dd51a54026 tempest-CreateVolumesFromSourceVolumeTest-321845991 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.512s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:33:41 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-c2c191b7-5d26-4747-800d-e6dd51a54026 tempest-CreateVolumesFromSourceVolumeTest-321845991 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:33:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1111349277',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87c386a1-852b-4898-adba-3ece06db05c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='760681b6151e4fb2b0b7294ffab0d30b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:33:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:33:40Z,use_quota=True,user_id='1148227eb6ba4921b3453a6043885bea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)}" {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 12:33:41 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-c2c191b7-5d26-4747-800d-e6dd51a54026 tempest-CreateVolumesFromSourceVolumeTest-321845991 None] Creating volume 87c386a1-852b-4898-adba-3ece06db05c2 {{(pid=89182) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 12:33:41 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-c2c191b7-5d26-4747-800d-e6dd51a54026 tempest-CreateVolumesFromSourceVolumeTest-321845991 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:33:41 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-c2c191b7-5d26-4747-800d-e6dd51a54026 tempest-CreateVolumesFromSourceVolumeTest-321845991 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:33:41 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-c2c191b7-5d26-4747-800d-e6dd51a54026 tempest-CreateVolumesFromSourceVolumeTest-321845991 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:33:41 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-c2c191b7-5d26-4747-800d-e6dd51a54026 tempest-CreateVolumesFromSourceVolumeTest-321845991 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:33:41 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-c2c191b7-5d26-4747-800d-e6dd51a54026 tempest-CreateVolumesFromSourceVolumeTest-321845991 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:33:41 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-c2c191b7-5d26-4747-800d-e6dd51a54026 tempest-CreateVolumesFromSourceVolumeTest-321845991 None] Selected osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 as target Quobyte volume. {{(pid=89182) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 12:33:41 devstack cinder-volume[89182]: INFO cinder.volume.drivers.remotefs [None req-c2c191b7-5d26-4747-800d-e6dd51a54026 tempest-CreateVolumesFromSourceVolumeTest-321845991 None] casted to osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 Jul 31 12:33:41 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-c2c191b7-5d26-4747-800d-e6dd51a54026 tempest-CreateVolumesFromSourceVolumeTest-321845991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-87c386a1-852b-4898-adba-3ece06db05c2 1073741824 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:33:41 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-c65204ae-74dd-41ab-9798-1094ab9acced tempest-CreateVolumesFromSourceVolumeTest-321845991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9e71c0c-f2c4-49a6-b888-e04529bdbf31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9bb0c3fc-37ed-43d1-966d-95f41f2aff26', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:33:41 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-c65204ae-74dd-41ab-9798-1094ab9acced tempest-CreateVolumesFromSourceVolumeTest-321845991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14dfe39b-b3b8-467a-bb2b-fe720a9bd465) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:33:41 devstack sudo[109678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-87c386a1-852b-4898-adba-3ece06db05c2 1073741824 Jul 31 12:33:41 devstack sudo[109678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:33:41 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-c65204ae-74dd-41ab-9798-1094ab9acced tempest-CreateVolumesFromSourceVolumeTest-321845991 None] Volume volume-9bb0c3fc-37ed-43d1-966d-95f41f2aff26 (9bb0c3fc-37ed-43d1-966d-95f41f2aff26): created successfully Jul 31 12:33:41 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-c65204ae-74dd-41ab-9798-1094ab9acced tempest-CreateVolumesFromSourceVolumeTest-321845991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14dfe39b-b3b8-467a-bb2b-fe720a9bd465) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:33:41 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-c65204ae-74dd-41ab-9798-1094ab9acced tempest-CreateVolumesFromSourceVolumeTest-321845991 None] Flow 'volume_create_manager' (5ca01ce4-4ff7-4dea-a5be-760b0329f952) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:33:41 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-c65204ae-74dd-41ab-9798-1094ab9acced tempest-CreateVolumesFromSourceVolumeTest-321845991 None] Created volume successfully. Jul 31 12:33:41 devstack sudo[109678]: pam_unix(sudo:session): session closed for user root Jul 31 12:33:41 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-c2c191b7-5d26-4747-800d-e6dd51a54026 tempest-CreateVolumesFromSourceVolumeTest-321845991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-87c386a1-852b-4898-adba-3ece06db05c2 1073741824" returned: 0 in 0.491s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:33:41 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-c2c191b7-5d26-4747-800d-e6dd51a54026 tempest-CreateVolumesFromSourceVolumeTest-321845991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-87c386a1-852b-4898-adba-3ece06db05c2 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:33:41 devstack sudo[109684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-87c386a1-852b-4898-adba-3ece06db05c2 Jul 31 12:33:41 devstack sudo[109684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:33:42 devstack sudo[109684]: pam_unix(sudo:session): session closed for user root Jul 31 12:33:42 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-c2c191b7-5d26-4747-800d-e6dd51a54026 tempest-CreateVolumesFromSourceVolumeTest-321845991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-87c386a1-852b-4898-adba-3ece06db05c2" returned: 0 in 0.251s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:33:42 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-c2c191b7-5d26-4747-800d-e6dd51a54026 tempest-CreateVolumesFromSourceVolumeTest-321845991 None] <== create_volume: return (801ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'} {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 12:33:42 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-c2c191b7-5d26-4747-800d-e6dd51a54026 tempest-CreateVolumesFromSourceVolumeTest-321845991 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.804s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:33:42 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-48a50d65-fbdb-4150-9714-c940d3d4d00e tempest-CreateVolumesFromSourceVolumeTest-321845991 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.897s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:33:42 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-48a50d65-fbdb-4150-9714-c940d3d4d00e tempest-CreateVolumesFromSourceVolumeTest-321845991 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:33:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-381626476',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88ce3279-dc86-48b8-b6c6-8269794debc7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='760681b6151e4fb2b0b7294ffab0d30b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:33:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:33:40Z,use_quota=True,user_id='1148227eb6ba4921b3453a6043885bea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)}" {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 12:33:42 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-48a50d65-fbdb-4150-9714-c940d3d4d00e tempest-CreateVolumesFromSourceVolumeTest-321845991 None] Creating volume 88ce3279-dc86-48b8-b6c6-8269794debc7 {{(pid=89182) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 12:33:42 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-48a50d65-fbdb-4150-9714-c940d3d4d00e tempest-CreateVolumesFromSourceVolumeTest-321845991 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:33:42 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-48a50d65-fbdb-4150-9714-c940d3d4d00e tempest-CreateVolumesFromSourceVolumeTest-321845991 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:33:42 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-48a50d65-fbdb-4150-9714-c940d3d4d00e tempest-CreateVolumesFromSourceVolumeTest-321845991 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:33:42 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-48a50d65-fbdb-4150-9714-c940d3d4d00e tempest-CreateVolumesFromSourceVolumeTest-321845991 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:33:42 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-48a50d65-fbdb-4150-9714-c940d3d4d00e tempest-CreateVolumesFromSourceVolumeTest-321845991 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:33:42 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-48a50d65-fbdb-4150-9714-c940d3d4d00e tempest-CreateVolumesFromSourceVolumeTest-321845991 None] Selected osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 as target Quobyte volume. {{(pid=89182) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 12:33:42 devstack cinder-volume[89182]: INFO cinder.volume.drivers.remotefs [None req-48a50d65-fbdb-4150-9714-c940d3d4d00e tempest-CreateVolumesFromSourceVolumeTest-321845991 None] casted to osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 Jul 31 12:33:42 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-48a50d65-fbdb-4150-9714-c940d3d4d00e tempest-CreateVolumesFromSourceVolumeTest-321845991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-88ce3279-dc86-48b8-b6c6-8269794debc7 1073741824 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:33:42 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-c2c191b7-5d26-4747-800d-e6dd51a54026 tempest-CreateVolumesFromSourceVolumeTest-321845991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6c5b044-9ca4-4b37-8f46-d860dbb24659) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-87c386a1-852b-4898-adba-3ece06db05c2', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:33:42 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-c2c191b7-5d26-4747-800d-e6dd51a54026 tempest-CreateVolumesFromSourceVolumeTest-321845991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e735d8c5-c89e-4c8a-9f5d-83c1e9537447) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:33:42 devstack sudo[109687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-88ce3279-dc86-48b8-b6c6-8269794debc7 1073741824 Jul 31 12:33:42 devstack sudo[109687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:33:42 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-c2c191b7-5d26-4747-800d-e6dd51a54026 tempest-CreateVolumesFromSourceVolumeTest-321845991 None] Volume volume-87c386a1-852b-4898-adba-3ece06db05c2 (87c386a1-852b-4898-adba-3ece06db05c2): created successfully Jul 31 12:33:42 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-c2c191b7-5d26-4747-800d-e6dd51a54026 tempest-CreateVolumesFromSourceVolumeTest-321845991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e735d8c5-c89e-4c8a-9f5d-83c1e9537447) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:33:42 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-c2c191b7-5d26-4747-800d-e6dd51a54026 tempest-CreateVolumesFromSourceVolumeTest-321845991 None] Flow 'volume_create_manager' (d9fb3d7a-f7cd-48a8-a40b-e17a8311b326) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:33:42 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-c2c191b7-5d26-4747-800d-e6dd51a54026 tempest-CreateVolumesFromSourceVolumeTest-321845991 None] Created volume successfully. Jul 31 12:33:42 devstack sudo[109687]: pam_unix(sudo:session): session closed for user root Jul 31 12:33:42 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-48a50d65-fbdb-4150-9714-c940d3d4d00e tempest-CreateVolumesFromSourceVolumeTest-321845991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-88ce3279-dc86-48b8-b6c6-8269794debc7 1073741824" returned: 0 in 0.555s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:33:42 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-48a50d65-fbdb-4150-9714-c940d3d4d00e tempest-CreateVolumesFromSourceVolumeTest-321845991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-88ce3279-dc86-48b8-b6c6-8269794debc7 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:33:42 devstack sudo[109728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-88ce3279-dc86-48b8-b6c6-8269794debc7 Jul 31 12:33:42 devstack sudo[109728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:33:42 devstack sudo[109728]: pam_unix(sudo:session): session closed for user root Jul 31 12:33:42 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-48a50d65-fbdb-4150-9714-c940d3d4d00e tempest-CreateVolumesFromSourceVolumeTest-321845991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-88ce3279-dc86-48b8-b6c6-8269794debc7" returned: 0 in 0.263s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:33:42 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-48a50d65-fbdb-4150-9714-c940d3d4d00e tempest-CreateVolumesFromSourceVolumeTest-321845991 None] <== create_volume: return (868ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'} {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 12:33:42 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-48a50d65-fbdb-4150-9714-c940d3d4d00e tempest-CreateVolumesFromSourceVolumeTest-321845991 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.870s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:33:43 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-48a50d65-fbdb-4150-9714-c940d3d4d00e tempest-CreateVolumesFromSourceVolumeTest-321845991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b24ecb4-1c04-4655-b156-f7ccb4f16f71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-88ce3279-dc86-48b8-b6c6-8269794debc7', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:33:43 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-48a50d65-fbdb-4150-9714-c940d3d4d00e tempest-CreateVolumesFromSourceVolumeTest-321845991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8c03315-336a-4df7-a756-2596c8fdbcc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:33:43 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-48a50d65-fbdb-4150-9714-c940d3d4d00e tempest-CreateVolumesFromSourceVolumeTest-321845991 None] Volume volume-88ce3279-dc86-48b8-b6c6-8269794debc7 (88ce3279-dc86-48b8-b6c6-8269794debc7): created successfully Jul 31 12:33:43 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-48a50d65-fbdb-4150-9714-c940d3d4d00e tempest-CreateVolumesFromSourceVolumeTest-321845991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8c03315-336a-4df7-a756-2596c8fdbcc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:33:43 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-48a50d65-fbdb-4150-9714-c940d3d4d00e tempest-CreateVolumesFromSourceVolumeTest-321845991 None] Flow 'volume_create_manager' (c4b27702-79f7-44ad-bea7-59e608ec976a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:33:43 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-48a50d65-fbdb-4150-9714-c940d3d4d00e tempest-CreateVolumesFromSourceVolumeTest-321845991 None] Created volume successfully. Jul 31 12:33:43 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-0cc521e9-876a-4cf5-85b4-764eac653d5f tempest-CreateVolumesFromSourceVolumeTest-321845991 None] Acquiring lock "cinder-88ce3279-dc86-48b8-b6c6-8269794debc7-delete_volume" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:33:43 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-0cc521e9-876a-4cf5-85b4-764eac653d5f tempest-CreateVolumesFromSourceVolumeTest-321845991 None] Lock "cinder-88ce3279-dc86-48b8-b6c6-8269794debc7-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:33:43 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-0cc521e9-876a-4cf5-85b4-764eac653d5f tempest-CreateVolumesFromSourceVolumeTest-321845991 None] Acquiring lock "cinder-quobyte-88ce3279-dc86-48b8-b6c6-8269794debc7" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:33:43 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-0cc521e9-876a-4cf5-85b4-764eac653d5f tempest-CreateVolumesFromSourceVolumeTest-321845991 None] Lock "cinder-quobyte-88ce3279-dc86-48b8-b6c6-8269794debc7" acquired by "delete_volume" :: waited 0.021s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:33:43 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed49f08f-a231-43c8-8963-af7389d9f90e]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:33:43 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-0cc521e9-876a-4cf5-85b4-764eac653d5f tempest-CreateVolumesFromSourceVolumeTest-321845991 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-88ce3279-dc86-48b8-b6c6-8269794debc7 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:33:43 devstack sudo[109733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-88ce3279-dc86-48b8-b6c6-8269794debc7 Jul 31 12:33:43 devstack sudo[109733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:33:44 devstack sudo[109733]: pam_unix(sudo:session): session closed for user root Jul 31 12:33:44 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-0cc521e9-876a-4cf5-85b4-764eac653d5f tempest-CreateVolumesFromSourceVolumeTest-321845991 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-88ce3279-dc86-48b8-b6c6-8269794debc7" returned: 0 in 0.404s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:33:44 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-0cc521e9-876a-4cf5-85b4-764eac653d5f tempest-CreateVolumesFromSourceVolumeTest-321845991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-88ce3279-dc86-48b8-b6c6-8269794debc7 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:33:44 devstack sudo[109738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-88ce3279-dc86-48b8-b6c6-8269794debc7 Jul 31 12:33:44 devstack sudo[109738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:33:44 devstack sudo[109738]: pam_unix(sudo:session): session closed for user root Jul 31 12:33:44 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-0cc521e9-876a-4cf5-85b4-764eac653d5f tempest-CreateVolumesFromSourceVolumeTest-321845991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-88ce3279-dc86-48b8-b6c6-8269794debc7" returned: 0 in 0.256s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:33:44 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-0cc521e9-876a-4cf5-85b4-764eac653d5f tempest-CreateVolumesFromSourceVolumeTest-321845991 None] Lock "cinder-quobyte-88ce3279-dc86-48b8-b6c6-8269794debc7" released by "delete_volume" :: held 0.724s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:33:44 devstack cinder-volume[89182]: DEBUG cinder.quota [None req-0cc521e9-876a-4cf5-85b4-764eac653d5f tempest-CreateVolumesFromSourceVolumeTest-321845991 None] Created reservations ['4c18607a-5edb-4bbf-807c-5dd51ccc9401', '6c2b0e1a-1b9d-4eff-a66b-4a7073a10dd9', 'ecbe5de1-af3f-43e2-98d0-6f87941b9c50', 'f2b092c8-781d-4fad-9a43-a396b3313ec9'] {{(pid=89182) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 12:33:44 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-0cc521e9-876a-4cf5-85b4-764eac653d5f tempest-CreateVolumesFromSourceVolumeTest-321845991 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:33:44 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-0cc521e9-876a-4cf5-85b4-764eac653d5f tempest-CreateVolumesFromSourceVolumeTest-321845991 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:33:44 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-0cc521e9-876a-4cf5-85b4-764eac653d5f tempest-CreateVolumesFromSourceVolumeTest-321845991 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:33:44 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-0cc521e9-876a-4cf5-85b4-764eac653d5f tempest-CreateVolumesFromSourceVolumeTest-321845991 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:33:44 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-0cc521e9-876a-4cf5-85b4-764eac653d5f tempest-CreateVolumesFromSourceVolumeTest-321845991 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:33:44 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-0cc521e9-876a-4cf5-85b4-764eac653d5f tempest-CreateVolumesFromSourceVolumeTest-321845991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:33:44 devstack sudo[109742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 Jul 31 12:33:44 devstack sudo[109742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:33:44 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-a609579a-34ea-454c-9e78-0e45bd7d64e0 tempest-CreateVolumesFromSourceVolumeTest-321845991 None] Acquiring lock "cinder-87c386a1-852b-4898-adba-3ece06db05c2-delete_volume" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:33:44 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-a609579a-34ea-454c-9e78-0e45bd7d64e0 tempest-CreateVolumesFromSourceVolumeTest-321845991 None] Lock "cinder-87c386a1-852b-4898-adba-3ece06db05c2-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:33:44 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-a609579a-34ea-454c-9e78-0e45bd7d64e0 tempest-CreateVolumesFromSourceVolumeTest-321845991 None] Acquiring lock "cinder-quobyte-87c386a1-852b-4898-adba-3ece06db05c2" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:33:44 devstack sudo[109742]: pam_unix(sudo:session): session closed for user root Jul 31 12:33:44 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-0cc521e9-876a-4cf5-85b4-764eac653d5f tempest-CreateVolumesFromSourceVolumeTest-321845991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2" returned: 0 in 0.336s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:33:44 devstack cinder-volume[89182]: DEBUG cinder.manager [None req-0cc521e9-876a-4cf5-85b4-764eac653d5f tempest-CreateVolumesFromSourceVolumeTest-321845991 None] Notifying Schedulers of capabilities ... {{(pid=89182) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 12:33:44 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-0cc521e9-876a-4cf5-85b4-764eac653d5f tempest-CreateVolumesFromSourceVolumeTest-321845991 None] Deleted volume successfully. Jul 31 12:33:44 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-a609579a-34ea-454c-9e78-0e45bd7d64e0 tempest-CreateVolumesFromSourceVolumeTest-321845991 None] Lock "cinder-quobyte-87c386a1-852b-4898-adba-3ece06db05c2" acquired by "delete_volume" :: waited 0.022s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:33:44 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-0cc521e9-876a-4cf5-85b4-764eac653d5f tempest-CreateVolumesFromSourceVolumeTest-321845991 None] Lock "cinder-88ce3279-dc86-48b8-b6c6-8269794debc7-delete_volume" released by "delete_volume" :: held 1.311s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:33:44 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6575c51-76dc-453f-a6d9-3131149ff1ed]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:33:44 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-a609579a-34ea-454c-9e78-0e45bd7d64e0 tempest-CreateVolumesFromSourceVolumeTest-321845991 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-87c386a1-852b-4898-adba-3ece06db05c2 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:33:45 devstack sudo[109745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-87c386a1-852b-4898-adba-3ece06db05c2 Jul 31 12:33:45 devstack sudo[109745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:33:45 devstack sudo[109745]: pam_unix(sudo:session): session closed for user root Jul 31 12:33:45 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-a609579a-34ea-454c-9e78-0e45bd7d64e0 tempest-CreateVolumesFromSourceVolumeTest-321845991 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-87c386a1-852b-4898-adba-3ece06db05c2" returned: 0 in 0.383s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:33:45 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-a609579a-34ea-454c-9e78-0e45bd7d64e0 tempest-CreateVolumesFromSourceVolumeTest-321845991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-87c386a1-852b-4898-adba-3ece06db05c2 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:33:45 devstack sudo[109751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-87c386a1-852b-4898-adba-3ece06db05c2 Jul 31 12:33:45 devstack sudo[109751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:33:45 devstack sudo[109751]: pam_unix(sudo:session): session closed for user root Jul 31 12:33:45 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-a609579a-34ea-454c-9e78-0e45bd7d64e0 tempest-CreateVolumesFromSourceVolumeTest-321845991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-87c386a1-852b-4898-adba-3ece06db05c2" returned: 0 in 0.251s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:33:45 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-a609579a-34ea-454c-9e78-0e45bd7d64e0 tempest-CreateVolumesFromSourceVolumeTest-321845991 None] Lock "cinder-quobyte-87c386a1-852b-4898-adba-3ece06db05c2" released by "delete_volume" :: held 0.690s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:33:45 devstack cinder-volume[89182]: DEBUG cinder.quota [None req-a609579a-34ea-454c-9e78-0e45bd7d64e0 tempest-CreateVolumesFromSourceVolumeTest-321845991 None] Created reservations ['fae379cd-e3b6-4d90-b218-495b7b7877de', '8b4d1b0b-a92c-4bfc-b9e8-89c10c6b2fd1', '9d9e8a5c-ec3a-4795-96bb-6f94b971164f', '8f259cba-1fa1-4948-92ea-284adcfa17e9'] {{(pid=89182) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 12:33:45 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-a609579a-34ea-454c-9e78-0e45bd7d64e0 tempest-CreateVolumesFromSourceVolumeTest-321845991 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:33:45 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-a609579a-34ea-454c-9e78-0e45bd7d64e0 tempest-CreateVolumesFromSourceVolumeTest-321845991 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:33:45 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-a609579a-34ea-454c-9e78-0e45bd7d64e0 tempest-CreateVolumesFromSourceVolumeTest-321845991 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:33:45 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-a609579a-34ea-454c-9e78-0e45bd7d64e0 tempest-CreateVolumesFromSourceVolumeTest-321845991 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:33:45 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-a609579a-34ea-454c-9e78-0e45bd7d64e0 tempest-CreateVolumesFromSourceVolumeTest-321845991 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:33:45 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-a609579a-34ea-454c-9e78-0e45bd7d64e0 tempest-CreateVolumesFromSourceVolumeTest-321845991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:33:45 devstack sudo[109754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 Jul 31 12:33:45 devstack sudo[109754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:33:45 devstack sudo[109754]: pam_unix(sudo:session): session closed for user root Jul 31 12:33:45 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-a609579a-34ea-454c-9e78-0e45bd7d64e0 tempest-CreateVolumesFromSourceVolumeTest-321845991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2" returned: 0 in 0.269s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:33:45 devstack cinder-volume[89182]: DEBUG cinder.manager [None req-a609579a-34ea-454c-9e78-0e45bd7d64e0 tempest-CreateVolumesFromSourceVolumeTest-321845991 None] Notifying Schedulers of capabilities ... {{(pid=89182) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 12:33:45 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-a609579a-34ea-454c-9e78-0e45bd7d64e0 tempest-CreateVolumesFromSourceVolumeTest-321845991 None] Deleted volume successfully. Jul 31 12:33:45 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-63ca77dc-5af0-4133-95c9-18ef108c73ed tempest-CreateVolumesFromSourceVolumeTest-321845991 None] Acquiring lock "cinder-9bb0c3fc-37ed-43d1-966d-95f41f2aff26-delete_volume" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:33:46 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-63ca77dc-5af0-4133-95c9-18ef108c73ed tempest-CreateVolumesFromSourceVolumeTest-321845991 None] Lock "cinder-9bb0c3fc-37ed-43d1-966d-95f41f2aff26-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:33:46 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-a609579a-34ea-454c-9e78-0e45bd7d64e0 tempest-CreateVolumesFromSourceVolumeTest-321845991 None] Lock "cinder-87c386a1-852b-4898-adba-3ece06db05c2-delete_volume" released by "delete_volume" :: held 1.197s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:33:46 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-63ca77dc-5af0-4133-95c9-18ef108c73ed tempest-CreateVolumesFromSourceVolumeTest-321845991 None] Acquiring lock "cinder-quobyte-9bb0c3fc-37ed-43d1-966d-95f41f2aff26" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:33:46 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-63ca77dc-5af0-4133-95c9-18ef108c73ed tempest-CreateVolumesFromSourceVolumeTest-321845991 None] Lock "cinder-quobyte-9bb0c3fc-37ed-43d1-966d-95f41f2aff26" acquired by "delete_volume" :: waited 0.023s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:33:46 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[35338aac-51a6-460b-bd78-da31a6ab6024]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:33:46 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-63ca77dc-5af0-4133-95c9-18ef108c73ed tempest-CreateVolumesFromSourceVolumeTest-321845991 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-9bb0c3fc-37ed-43d1-966d-95f41f2aff26 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:33:46 devstack sudo[109757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-9bb0c3fc-37ed-43d1-966d-95f41f2aff26 Jul 31 12:33:46 devstack sudo[109757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:33:46 devstack sudo[109757]: pam_unix(sudo:session): session closed for user root Jul 31 12:33:46 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-63ca77dc-5af0-4133-95c9-18ef108c73ed tempest-CreateVolumesFromSourceVolumeTest-321845991 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-9bb0c3fc-37ed-43d1-966d-95f41f2aff26" returned: 0 in 0.421s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:33:46 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-63ca77dc-5af0-4133-95c9-18ef108c73ed tempest-CreateVolumesFromSourceVolumeTest-321845991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-9bb0c3fc-37ed-43d1-966d-95f41f2aff26 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:33:46 devstack sudo[109762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-9bb0c3fc-37ed-43d1-966d-95f41f2aff26 Jul 31 12:33:46 devstack sudo[109762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:33:46 devstack sudo[109762]: pam_unix(sudo:session): session closed for user root Jul 31 12:33:46 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-63ca77dc-5af0-4133-95c9-18ef108c73ed tempest-CreateVolumesFromSourceVolumeTest-321845991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-9bb0c3fc-37ed-43d1-966d-95f41f2aff26" returned: 0 in 0.261s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:33:46 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-63ca77dc-5af0-4133-95c9-18ef108c73ed tempest-CreateVolumesFromSourceVolumeTest-321845991 None] Lock "cinder-quobyte-9bb0c3fc-37ed-43d1-966d-95f41f2aff26" released by "delete_volume" :: held 0.729s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:33:46 devstack cinder-volume[89182]: DEBUG cinder.quota [None req-63ca77dc-5af0-4133-95c9-18ef108c73ed tempest-CreateVolumesFromSourceVolumeTest-321845991 None] Created reservations ['f05e62eb-ccf0-4785-8045-35b2125e307a', '4264b53a-4206-4eb7-97c0-7e588cfc62f3', 'c5241641-a28b-4a02-adf3-db0724b372ae', '945daf8d-2114-4ca1-a32f-08734410d278'] {{(pid=89182) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 12:33:46 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-63ca77dc-5af0-4133-95c9-18ef108c73ed tempest-CreateVolumesFromSourceVolumeTest-321845991 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:33:46 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-63ca77dc-5af0-4133-95c9-18ef108c73ed tempest-CreateVolumesFromSourceVolumeTest-321845991 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:33:46 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-63ca77dc-5af0-4133-95c9-18ef108c73ed tempest-CreateVolumesFromSourceVolumeTest-321845991 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:33:46 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-63ca77dc-5af0-4133-95c9-18ef108c73ed tempest-CreateVolumesFromSourceVolumeTest-321845991 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:33:46 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-63ca77dc-5af0-4133-95c9-18ef108c73ed tempest-CreateVolumesFromSourceVolumeTest-321845991 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:33:46 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-63ca77dc-5af0-4133-95c9-18ef108c73ed tempest-CreateVolumesFromSourceVolumeTest-321845991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:33:46 devstack sudo[109766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 Jul 31 12:33:46 devstack sudo[109766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:33:47 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-48eeb065-5072-4caa-89c7-e57dd443f6ce tempest-CreateVolumesFromSourceVolumeTest-321845991 None] Acquiring lock "cinder-6e9eee29-306c-4aa3-8343-e15f3b820fd5-delete_volume" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:33:47 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-48eeb065-5072-4caa-89c7-e57dd443f6ce tempest-CreateVolumesFromSourceVolumeTest-321845991 None] Lock "cinder-6e9eee29-306c-4aa3-8343-e15f3b820fd5-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:33:47 devstack sudo[109766]: pam_unix(sudo:session): session closed for user root Jul 31 12:33:47 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-63ca77dc-5af0-4133-95c9-18ef108c73ed tempest-CreateVolumesFromSourceVolumeTest-321845991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2" returned: 0 in 0.262s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:33:47 devstack cinder-volume[89182]: DEBUG cinder.manager [None req-63ca77dc-5af0-4133-95c9-18ef108c73ed tempest-CreateVolumesFromSourceVolumeTest-321845991 None] Notifying Schedulers of capabilities ... {{(pid=89182) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 12:33:47 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-63ca77dc-5af0-4133-95c9-18ef108c73ed tempest-CreateVolumesFromSourceVolumeTest-321845991 None] Deleted volume successfully. Jul 31 12:33:47 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-63ca77dc-5af0-4133-95c9-18ef108c73ed tempest-CreateVolumesFromSourceVolumeTest-321845991 None] Lock "cinder-9bb0c3fc-37ed-43d1-966d-95f41f2aff26-delete_volume" released by "delete_volume" :: held 1.251s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:33:47 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-48eeb065-5072-4caa-89c7-e57dd443f6ce tempest-CreateVolumesFromSourceVolumeTest-321845991 None] Acquiring lock "cinder-quobyte-6e9eee29-306c-4aa3-8343-e15f3b820fd5" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:33:47 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-48eeb065-5072-4caa-89c7-e57dd443f6ce tempest-CreateVolumesFromSourceVolumeTest-321845991 None] Lock "cinder-quobyte-6e9eee29-306c-4aa3-8343-e15f3b820fd5" acquired by "delete_volume" :: waited 0.015s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:33:47 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[d450dab3-9ce4-41c1-b580-59ba2568178c]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:33:47 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-48eeb065-5072-4caa-89c7-e57dd443f6ce tempest-CreateVolumesFromSourceVolumeTest-321845991 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-6e9eee29-306c-4aa3-8343-e15f3b820fd5 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:33:47 devstack sudo[109769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-6e9eee29-306c-4aa3-8343-e15f3b820fd5 Jul 31 12:33:47 devstack sudo[109769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:33:47 devstack sudo[109769]: pam_unix(sudo:session): session closed for user root Jul 31 12:33:47 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-48eeb065-5072-4caa-89c7-e57dd443f6ce tempest-CreateVolumesFromSourceVolumeTest-321845991 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-6e9eee29-306c-4aa3-8343-e15f3b820fd5" returned: 0 in 0.389s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:33:47 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-48eeb065-5072-4caa-89c7-e57dd443f6ce tempest-CreateVolumesFromSourceVolumeTest-321845991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-6e9eee29-306c-4aa3-8343-e15f3b820fd5 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:33:47 devstack sudo[109774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-6e9eee29-306c-4aa3-8343-e15f3b820fd5 Jul 31 12:33:47 devstack sudo[109774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:33:47 devstack sudo[109774]: pam_unix(sudo:session): session closed for user root Jul 31 12:33:47 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-48eeb065-5072-4caa-89c7-e57dd443f6ce tempest-CreateVolumesFromSourceVolumeTest-321845991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-6e9eee29-306c-4aa3-8343-e15f3b820fd5" returned: 0 in 0.245s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:33:47 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-48eeb065-5072-4caa-89c7-e57dd443f6ce tempest-CreateVolumesFromSourceVolumeTest-321845991 None] Lock "cinder-quobyte-6e9eee29-306c-4aa3-8343-e15f3b820fd5" released by "delete_volume" :: held 0.675s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:33:48 devstack cinder-volume[89182]: DEBUG cinder.quota [None req-48eeb065-5072-4caa-89c7-e57dd443f6ce tempest-CreateVolumesFromSourceVolumeTest-321845991 None] Created reservations ['f701a33e-c51c-45e1-91f3-2b113c5dac66', 'a5bc2fcb-91b4-4e4d-8f30-0a9dc3361ad4', '3815fba0-4fa0-4701-b034-2ca65b779071', '1c4cdc97-0727-4cf4-b9e0-d235bd28519c'] {{(pid=89182) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 12:33:48 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-48eeb065-5072-4caa-89c7-e57dd443f6ce tempest-CreateVolumesFromSourceVolumeTest-321845991 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:33:48 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-48eeb065-5072-4caa-89c7-e57dd443f6ce tempest-CreateVolumesFromSourceVolumeTest-321845991 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:33:48 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-48eeb065-5072-4caa-89c7-e57dd443f6ce tempest-CreateVolumesFromSourceVolumeTest-321845991 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:33:48 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-48eeb065-5072-4caa-89c7-e57dd443f6ce tempest-CreateVolumesFromSourceVolumeTest-321845991 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:33:48 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-48eeb065-5072-4caa-89c7-e57dd443f6ce tempest-CreateVolumesFromSourceVolumeTest-321845991 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:33:48 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-48eeb065-5072-4caa-89c7-e57dd443f6ce tempest-CreateVolumesFromSourceVolumeTest-321845991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:33:48 devstack sudo[109777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 Jul 31 12:33:48 devstack sudo[109777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:33:48 devstack sudo[109777]: pam_unix(sudo:session): session closed for user root Jul 31 12:33:48 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-48eeb065-5072-4caa-89c7-e57dd443f6ce tempest-CreateVolumesFromSourceVolumeTest-321845991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2" returned: 0 in 0.245s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:33:48 devstack cinder-volume[89182]: DEBUG cinder.manager [None req-48eeb065-5072-4caa-89c7-e57dd443f6ce tempest-CreateVolumesFromSourceVolumeTest-321845991 None] Notifying Schedulers of capabilities ... {{(pid=89182) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 12:33:48 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-48eeb065-5072-4caa-89c7-e57dd443f6ce tempest-CreateVolumesFromSourceVolumeTest-321845991 None] Deleted volume successfully. Jul 31 12:33:48 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-5fb7c0d2-f256-49a5-8b7d-b40b9b216478 tempest-CreateVolumesFromSourceVolumeTest-321845991 None] Acquiring lock "cinder-b4d7cb94-1d52-4499-b7da-4ed256db8585-delete_volume" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:33:48 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-48eeb065-5072-4caa-89c7-e57dd443f6ce tempest-CreateVolumesFromSourceVolumeTest-321845991 None] Lock "cinder-6e9eee29-306c-4aa3-8343-e15f3b820fd5-delete_volume" released by "delete_volume" :: held 1.202s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:33:48 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-5fb7c0d2-f256-49a5-8b7d-b40b9b216478 tempest-CreateVolumesFromSourceVolumeTest-321845991 None] Lock "cinder-b4d7cb94-1d52-4499-b7da-4ed256db8585-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:33:48 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-5fb7c0d2-f256-49a5-8b7d-b40b9b216478 tempest-CreateVolumesFromSourceVolumeTest-321845991 None] Acquiring lock "cinder-quobyte-b4d7cb94-1d52-4499-b7da-4ed256db8585" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:33:48 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-5fb7c0d2-f256-49a5-8b7d-b40b9b216478 tempest-CreateVolumesFromSourceVolumeTest-321845991 None] Lock "cinder-quobyte-b4d7cb94-1d52-4499-b7da-4ed256db8585" acquired by "delete_volume" :: waited 0.018s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:33:48 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbdfc7d0-09e2-46d0-ad79-eba803d545fd]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:33:48 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-5fb7c0d2-f256-49a5-8b7d-b40b9b216478 tempest-CreateVolumesFromSourceVolumeTest-321845991 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-b4d7cb94-1d52-4499-b7da-4ed256db8585 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:33:48 devstack sudo[109780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-b4d7cb94-1d52-4499-b7da-4ed256db8585 Jul 31 12:33:48 devstack sudo[109780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:33:48 devstack sudo[109780]: pam_unix(sudo:session): session closed for user root Jul 31 12:33:48 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-5fb7c0d2-f256-49a5-8b7d-b40b9b216478 tempest-CreateVolumesFromSourceVolumeTest-321845991 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-b4d7cb94-1d52-4499-b7da-4ed256db8585" returned: 0 in 0.379s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:33:48 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-5fb7c0d2-f256-49a5-8b7d-b40b9b216478 tempest-CreateVolumesFromSourceVolumeTest-321845991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-b4d7cb94-1d52-4499-b7da-4ed256db8585 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:33:48 devstack sudo[109785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-b4d7cb94-1d52-4499-b7da-4ed256db8585 Jul 31 12:33:48 devstack sudo[109785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:33:49 devstack sudo[109785]: pam_unix(sudo:session): session closed for user root Jul 31 12:33:49 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-5fb7c0d2-f256-49a5-8b7d-b40b9b216478 tempest-CreateVolumesFromSourceVolumeTest-321845991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-b4d7cb94-1d52-4499-b7da-4ed256db8585" returned: 0 in 0.250s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:33:49 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-5fb7c0d2-f256-49a5-8b7d-b40b9b216478 tempest-CreateVolumesFromSourceVolumeTest-321845991 None] Lock "cinder-quobyte-b4d7cb94-1d52-4499-b7da-4ed256db8585" released by "delete_volume" :: held 0.696s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:33:49 devstack cinder-volume[89182]: DEBUG cinder.quota [None req-5fb7c0d2-f256-49a5-8b7d-b40b9b216478 tempest-CreateVolumesFromSourceVolumeTest-321845991 None] Created reservations ['dcdfe5c9-3746-4d2f-9bf6-ea49f15a7602', '4b4ce38c-cd46-4945-87fd-a035052d25f9', '815a1ee3-5780-49bb-a7a4-b25715186982', 'b16875a6-ddbf-4df8-8e20-1ad478828361'] {{(pid=89182) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 12:33:49 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-5fb7c0d2-f256-49a5-8b7d-b40b9b216478 tempest-CreateVolumesFromSourceVolumeTest-321845991 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:33:49 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-5fb7c0d2-f256-49a5-8b7d-b40b9b216478 tempest-CreateVolumesFromSourceVolumeTest-321845991 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:33:49 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-5fb7c0d2-f256-49a5-8b7d-b40b9b216478 tempest-CreateVolumesFromSourceVolumeTest-321845991 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:33:49 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-5fb7c0d2-f256-49a5-8b7d-b40b9b216478 tempest-CreateVolumesFromSourceVolumeTest-321845991 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:33:49 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-5fb7c0d2-f256-49a5-8b7d-b40b9b216478 tempest-CreateVolumesFromSourceVolumeTest-321845991 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:33:49 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-5fb7c0d2-f256-49a5-8b7d-b40b9b216478 tempest-CreateVolumesFromSourceVolumeTest-321845991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:33:49 devstack sudo[109788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 Jul 31 12:33:49 devstack sudo[109788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:33:49 devstack sudo[109788]: pam_unix(sudo:session): session closed for user root Jul 31 12:33:49 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-5fb7c0d2-f256-49a5-8b7d-b40b9b216478 tempest-CreateVolumesFromSourceVolumeTest-321845991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2" returned: 0 in 0.263s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:33:49 devstack cinder-volume[89182]: DEBUG cinder.manager [None req-5fb7c0d2-f256-49a5-8b7d-b40b9b216478 tempest-CreateVolumesFromSourceVolumeTest-321845991 None] Notifying Schedulers of capabilities ... {{(pid=89182) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 12:33:49 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-5fb7c0d2-f256-49a5-8b7d-b40b9b216478 tempest-CreateVolumesFromSourceVolumeTest-321845991 None] Deleted volume successfully. Jul 31 12:33:49 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-5fb7c0d2-f256-49a5-8b7d-b40b9b216478 tempest-CreateVolumesFromSourceVolumeTest-321845991 None] Lock "cinder-b4d7cb94-1d52-4499-b7da-4ed256db8585-delete_volume" released by "delete_volume" :: held 1.186s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:33:49 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-1c9a3d43-62e3-4437-8035-916e323de687 tempest-CreateVolumesFromSourceVolumeTest-321845991 None] Acquiring lock "cinder-59e05514-1ce0-4d60-ac05-0dd2ea228945-delete_volume" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:33:49 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-1c9a3d43-62e3-4437-8035-916e323de687 tempest-CreateVolumesFromSourceVolumeTest-321845991 None] Lock "cinder-59e05514-1ce0-4d60-ac05-0dd2ea228945-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:33:49 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-1c9a3d43-62e3-4437-8035-916e323de687 tempest-CreateVolumesFromSourceVolumeTest-321845991 None] Acquiring lock "cinder-quobyte-59e05514-1ce0-4d60-ac05-0dd2ea228945" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:33:49 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-1c9a3d43-62e3-4437-8035-916e323de687 tempest-CreateVolumesFromSourceVolumeTest-321845991 None] Lock "cinder-quobyte-59e05514-1ce0-4d60-ac05-0dd2ea228945" acquired by "delete_volume" :: waited 0.028s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:33:49 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[269ccdd1-1769-4d61-802a-fd702f1d831a]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:33:49 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-1c9a3d43-62e3-4437-8035-916e323de687 tempest-CreateVolumesFromSourceVolumeTest-321845991 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-59e05514-1ce0-4d60-ac05-0dd2ea228945 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:33:49 devstack sudo[109797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-59e05514-1ce0-4d60-ac05-0dd2ea228945 Jul 31 12:33:49 devstack sudo[109797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:33:50 devstack sudo[109797]: pam_unix(sudo:session): session closed for user root Jul 31 12:33:50 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-1c9a3d43-62e3-4437-8035-916e323de687 tempest-CreateVolumesFromSourceVolumeTest-321845991 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-59e05514-1ce0-4d60-ac05-0dd2ea228945" returned: 0 in 0.385s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:33:50 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-1c9a3d43-62e3-4437-8035-916e323de687 tempest-CreateVolumesFromSourceVolumeTest-321845991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-59e05514-1ce0-4d60-ac05-0dd2ea228945 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:33:50 devstack sudo[109802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-59e05514-1ce0-4d60-ac05-0dd2ea228945 Jul 31 12:33:50 devstack sudo[109802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:33:50 devstack sudo[109802]: pam_unix(sudo:session): session closed for user root Jul 31 12:33:50 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-1c9a3d43-62e3-4437-8035-916e323de687 tempest-CreateVolumesFromSourceVolumeTest-321845991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-59e05514-1ce0-4d60-ac05-0dd2ea228945" returned: 0 in 0.275s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:33:50 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-1c9a3d43-62e3-4437-8035-916e323de687 tempest-CreateVolumesFromSourceVolumeTest-321845991 None] Lock "cinder-quobyte-59e05514-1ce0-4d60-ac05-0dd2ea228945" released by "delete_volume" :: held 0.703s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:33:50 devstack cinder-volume[89182]: DEBUG cinder.quota [None req-1c9a3d43-62e3-4437-8035-916e323de687 tempest-CreateVolumesFromSourceVolumeTest-321845991 None] Created reservations ['ee5d4239-a8c4-42aa-9688-97358c261961', '1be580f7-d009-4076-8bf7-8f0a7c6a36d4', '2d23c8bf-804e-4dd0-98fd-186a5e2dad84', '983c5d1b-10fa-4a5e-b34f-e7b0046b5a10'] {{(pid=89182) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 12:33:50 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-1c9a3d43-62e3-4437-8035-916e323de687 tempest-CreateVolumesFromSourceVolumeTest-321845991 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:33:50 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-1c9a3d43-62e3-4437-8035-916e323de687 tempest-CreateVolumesFromSourceVolumeTest-321845991 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:33:50 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-1c9a3d43-62e3-4437-8035-916e323de687 tempest-CreateVolumesFromSourceVolumeTest-321845991 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:33:50 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-1c9a3d43-62e3-4437-8035-916e323de687 tempest-CreateVolumesFromSourceVolumeTest-321845991 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:33:50 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-1c9a3d43-62e3-4437-8035-916e323de687 tempest-CreateVolumesFromSourceVolumeTest-321845991 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:33:50 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-1c9a3d43-62e3-4437-8035-916e323de687 tempest-CreateVolumesFromSourceVolumeTest-321845991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:33:50 devstack sudo[109805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 Jul 31 12:33:50 devstack sudo[109805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:33:50 devstack sudo[109805]: pam_unix(sudo:session): session closed for user root Jul 31 12:33:50 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-1c9a3d43-62e3-4437-8035-916e323de687 tempest-CreateVolumesFromSourceVolumeTest-321845991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2" returned: 0 in 0.281s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:33:50 devstack cinder-volume[89182]: DEBUG cinder.manager [None req-1c9a3d43-62e3-4437-8035-916e323de687 tempest-CreateVolumesFromSourceVolumeTest-321845991 None] Notifying Schedulers of capabilities ... {{(pid=89182) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 12:33:50 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-1c9a3d43-62e3-4437-8035-916e323de687 tempest-CreateVolumesFromSourceVolumeTest-321845991 None] Deleted volume successfully. Jul 31 12:33:50 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-1c9a3d43-62e3-4437-8035-916e323de687 tempest-CreateVolumesFromSourceVolumeTest-321845991 None] Lock "cinder-59e05514-1ce0-4d60-ac05-0dd2ea228945-delete_volume" released by "delete_volume" :: held 1.257s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:33:54 devstack cinder-volume[89182]: DEBUG cinder.volume.flows.manager.create_volume [None req-7dc2dc40-3a4a-4a0f-934c-28135eddb5ea tempest-VolumeDependencyTests-1064398708 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89182) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 12:33:54 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-7dc2dc40-3a4a-4a0f-934c-28135eddb5ea tempest-VolumeDependencyTests-1064398708 None] Flow 'volume_create_manager' (c1b24e61-096b-4f52-97ac-c926deaea8b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:33:54 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-7dc2dc40-3a4a-4a0f-934c-28135eddb5ea tempest-VolumeDependencyTests-1064398708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8b5851c-a8b8-4ca2-a31b-1b0f20653edb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:33:54 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-7dc2dc40-3a4a-4a0f-934c-28135eddb5ea tempest-VolumeDependencyTests-1064398708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8b5851c-a8b8-4ca2-a31b-1b0f20653edb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:33:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-21790963',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92bf62ad-33f6-4238-9a2d-50b69b436262,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af5708b20f594719a09679b9f56f242f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:33:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:33:54Z,use_quota=True,user_id='3fad3d5c7d5b44e6b70fa58e652f1cd2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:33:54 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-7dc2dc40-3a4a-4a0f-934c-28135eddb5ea tempest-VolumeDependencyTests-1064398708 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17924576-5237-4715-bb2f-b37b3a2524ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:33:54 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-7dc2dc40-3a4a-4a0f-934c-28135eddb5ea tempest-VolumeDependencyTests-1064398708 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17924576-5237-4715-bb2f-b37b3a2524ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:33:54 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-7dc2dc40-3a4a-4a0f-934c-28135eddb5ea tempest-VolumeDependencyTests-1064398708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14292bad-ce6e-41b0-8aa5-a524ab1835b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:33:54 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-7dc2dc40-3a4a-4a0f-934c-28135eddb5ea tempest-VolumeDependencyTests-1064398708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14292bad-ce6e-41b0-8aa5-a524ab1835b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '92bf62ad-33f6-4238-9a2d-50b69b436262', 'volume_name': 'volume-92bf62ad-33f6-4238-9a2d-50b69b436262', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:33:54 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-7dc2dc40-3a4a-4a0f-934c-28135eddb5ea tempest-VolumeDependencyTests-1064398708 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5160e8c5-e16b-48ad-aecd-9184e8508fb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:33:54 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-7dc2dc40-3a4a-4a0f-934c-28135eddb5ea tempest-VolumeDependencyTests-1064398708 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5160e8c5-e16b-48ad-aecd-9184e8508fb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:33:54 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-7dc2dc40-3a4a-4a0f-934c-28135eddb5ea tempest-VolumeDependencyTests-1064398708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ee795e6-7d11-458c-b374-75d01cc97bfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:33:54 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-7dc2dc40-3a4a-4a0f-934c-28135eddb5ea tempest-VolumeDependencyTests-1064398708 None] Volume 92bf62ad-33f6-4238-9a2d-50b69b436262: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-92bf62ad-33f6-4238-9a2d-50b69b436262', 'volume_size': 1} Jul 31 12:33:54 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-7dc2dc40-3a4a-4a0f-934c-28135eddb5ea tempest-VolumeDependencyTests-1064398708 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:33:54 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-7dc2dc40-3a4a-4a0f-934c-28135eddb5ea tempest-VolumeDependencyTests-1064398708 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:33:54 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-7dc2dc40-3a4a-4a0f-934c-28135eddb5ea tempest-VolumeDependencyTests-1064398708 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:33:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-21790963',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92bf62ad-33f6-4238-9a2d-50b69b436262,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af5708b20f594719a09679b9f56f242f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:33:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:33:54Z,use_quota=True,user_id='3fad3d5c7d5b44e6b70fa58e652f1cd2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)}" {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 12:33:54 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-7dc2dc40-3a4a-4a0f-934c-28135eddb5ea tempest-VolumeDependencyTests-1064398708 None] Creating volume 92bf62ad-33f6-4238-9a2d-50b69b436262 {{(pid=89182) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 12:33:54 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-7dc2dc40-3a4a-4a0f-934c-28135eddb5ea tempest-VolumeDependencyTests-1064398708 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:33:54 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-7dc2dc40-3a4a-4a0f-934c-28135eddb5ea tempest-VolumeDependencyTests-1064398708 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:33:54 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-7dc2dc40-3a4a-4a0f-934c-28135eddb5ea tempest-VolumeDependencyTests-1064398708 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:33:54 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-7dc2dc40-3a4a-4a0f-934c-28135eddb5ea tempest-VolumeDependencyTests-1064398708 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:33:54 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-7dc2dc40-3a4a-4a0f-934c-28135eddb5ea tempest-VolumeDependencyTests-1064398708 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:33:54 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-7dc2dc40-3a4a-4a0f-934c-28135eddb5ea tempest-VolumeDependencyTests-1064398708 None] Selected osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 as target Quobyte volume. {{(pid=89182) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 12:33:54 devstack cinder-volume[89182]: INFO cinder.volume.drivers.remotefs [None req-7dc2dc40-3a4a-4a0f-934c-28135eddb5ea tempest-VolumeDependencyTests-1064398708 None] casted to osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 Jul 31 12:33:54 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-7dc2dc40-3a4a-4a0f-934c-28135eddb5ea tempest-VolumeDependencyTests-1064398708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-92bf62ad-33f6-4238-9a2d-50b69b436262 1073741824 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:33:54 devstack sudo[109808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-92bf62ad-33f6-4238-9a2d-50b69b436262 1073741824 Jul 31 12:33:54 devstack sudo[109808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:33:54 devstack sudo[109808]: pam_unix(sudo:session): session closed for user root Jul 31 12:33:54 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-7dc2dc40-3a4a-4a0f-934c-28135eddb5ea tempest-VolumeDependencyTests-1064398708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-92bf62ad-33f6-4238-9a2d-50b69b436262 1073741824" returned: 0 in 0.446s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:33:54 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-7dc2dc40-3a4a-4a0f-934c-28135eddb5ea tempest-VolumeDependencyTests-1064398708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-92bf62ad-33f6-4238-9a2d-50b69b436262 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:33:54 devstack sudo[109813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-92bf62ad-33f6-4238-9a2d-50b69b436262 Jul 31 12:33:54 devstack sudo[109813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:33:54 devstack sudo[109813]: pam_unix(sudo:session): session closed for user root Jul 31 12:33:54 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-7dc2dc40-3a4a-4a0f-934c-28135eddb5ea tempest-VolumeDependencyTests-1064398708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-92bf62ad-33f6-4238-9a2d-50b69b436262" returned: 0 in 0.273s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:33:54 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-7dc2dc40-3a4a-4a0f-934c-28135eddb5ea tempest-VolumeDependencyTests-1064398708 None] <== create_volume: return (765ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'} {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 12:33:54 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-7dc2dc40-3a4a-4a0f-934c-28135eddb5ea tempest-VolumeDependencyTests-1064398708 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.768s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:33:54 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-7dc2dc40-3a4a-4a0f-934c-28135eddb5ea tempest-VolumeDependencyTests-1064398708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ee795e6-7d11-458c-b374-75d01cc97bfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-92bf62ad-33f6-4238-9a2d-50b69b436262', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:33:54 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-7dc2dc40-3a4a-4a0f-934c-28135eddb5ea tempest-VolumeDependencyTests-1064398708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8fa1fab-e304-45eb-9432-aff8ce8bd3f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:33:54 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-7dc2dc40-3a4a-4a0f-934c-28135eddb5ea tempest-VolumeDependencyTests-1064398708 None] Volume volume-92bf62ad-33f6-4238-9a2d-50b69b436262 (92bf62ad-33f6-4238-9a2d-50b69b436262): created successfully Jul 31 12:33:54 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-7dc2dc40-3a4a-4a0f-934c-28135eddb5ea tempest-VolumeDependencyTests-1064398708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8fa1fab-e304-45eb-9432-aff8ce8bd3f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:33:54 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-7dc2dc40-3a4a-4a0f-934c-28135eddb5ea tempest-VolumeDependencyTests-1064398708 None] Flow 'volume_create_manager' (c1b24e61-096b-4f52-97ac-c926deaea8b6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:33:54 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-7dc2dc40-3a4a-4a0f-934c-28135eddb5ea tempest-VolumeDependencyTests-1064398708 None] Created volume successfully. Jul 31 12:33:55 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-9f47484c-8d3d-4a68-8ce2-e69e27b60a85 tempest-VolumeDependencyTests-1064398708 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:33:55 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-9f47484c-8d3d-4a68-8ce2-e69e27b60a85 tempest-VolumeDependencyTests-1064398708 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:33:55 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-9f47484c-8d3d-4a68-8ce2-e69e27b60a85 tempest-VolumeDependencyTests-1064398708 None] Creating offline snapshot 1e0e0ec8-5d8d-4b9f-9dc5-2f82f98049b4 of volume 92bf62ad-33f6-4238-9a2d-50b69b436262 {{(pid=89182) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 31 12:33:55 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[9611541f-84f4-46a8-bf99-2b32ac37c92e]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:33:55 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-9f47484c-8d3d-4a68-8ce2-e69e27b60a85 tempest-VolumeDependencyTests-1064398708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-92bf62ad-33f6-4238-9a2d-50b69b436262 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:33:55 devstack sudo[109816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-92bf62ad-33f6-4238-9a2d-50b69b436262 Jul 31 12:33:55 devstack sudo[109816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:33:55 devstack sudo[109816]: pam_unix(sudo:session): session closed for user root Jul 31 12:33:55 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-9f47484c-8d3d-4a68-8ce2-e69e27b60a85 tempest-VolumeDependencyTests-1064398708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-92bf62ad-33f6-4238-9a2d-50b69b436262" returned: 0 in 0.369s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:33:55 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-9f47484c-8d3d-4a68-8ce2-e69e27b60a85 tempest-VolumeDependencyTests-1064398708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-92bf62ad-33f6-4238-9a2d-50b69b436262,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-92bf62ad-33f6-4238-9a2d-50b69b436262.1e0e0ec8-5d8d-4b9f-9dc5-2f82f98049b4 1G {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:33:55 devstack sudo[109821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-92bf62ad-33f6-4238-9a2d-50b69b436262,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-92bf62ad-33f6-4238-9a2d-50b69b436262.1e0e0ec8-5d8d-4b9f-9dc5-2f82f98049b4 1G Jul 31 12:33:55 devstack sudo[109821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:33:56 devstack sudo[109821]: pam_unix(sudo:session): session closed for user root Jul 31 12:33:56 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-9f47484c-8d3d-4a68-8ce2-e69e27b60a85 tempest-VolumeDependencyTests-1064398708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-92bf62ad-33f6-4238-9a2d-50b69b436262,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-92bf62ad-33f6-4238-9a2d-50b69b436262.1e0e0ec8-5d8d-4b9f-9dc5-2f82f98049b4 1G" returned: 0 in 0.474s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:33:56 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-9f47484c-8d3d-4a68-8ce2-e69e27b60a85 tempest-VolumeDependencyTests-1064398708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-92bf62ad-33f6-4238-9a2d-50b69b436262 -F qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-92bf62ad-33f6-4238-9a2d-50b69b436262.1e0e0ec8-5d8d-4b9f-9dc5-2f82f98049b4 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:33:56 devstack sudo[109827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-92bf62ad-33f6-4238-9a2d-50b69b436262 -F qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-92bf62ad-33f6-4238-9a2d-50b69b436262.1e0e0ec8-5d8d-4b9f-9dc5-2f82f98049b4 Jul 31 12:33:56 devstack sudo[109827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:33:56 devstack sudo[109827]: pam_unix(sudo:session): session closed for user root Jul 31 12:33:56 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-9f47484c-8d3d-4a68-8ce2-e69e27b60a85 tempest-VolumeDependencyTests-1064398708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-92bf62ad-33f6-4238-9a2d-50b69b436262 -F qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-92bf62ad-33f6-4238-9a2d-50b69b436262.1e0e0ec8-5d8d-4b9f-9dc5-2f82f98049b4" returned: 0 in 0.313s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:33:56 devstack cinder-volume[89182]: WARNING cinder.volume.drivers.remotefs [None req-9f47484c-8d3d-4a68-8ce2-e69e27b60a85 tempest-VolumeDependencyTests-1064398708 None] /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-92bf62ad-33f6-4238-9a2d-50b69b436262.1e0e0ec8-5d8d-4b9f-9dc5-2f82f98049b4 is being set with open permissions: ugo+rw Jul 31 12:33:56 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-9f47484c-8d3d-4a68-8ce2-e69e27b60a85 tempest-VolumeDependencyTests-1064398708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-92bf62ad-33f6-4238-9a2d-50b69b436262.1e0e0ec8-5d8d-4b9f-9dc5-2f82f98049b4 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:33:56 devstack sudo[109832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-92bf62ad-33f6-4238-9a2d-50b69b436262.1e0e0ec8-5d8d-4b9f-9dc5-2f82f98049b4 Jul 31 12:33:56 devstack sudo[109832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:33:56 devstack sudo[109832]: pam_unix(sudo:session): session closed for user root Jul 31 12:33:56 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-9f47484c-8d3d-4a68-8ce2-e69e27b60a85 tempest-VolumeDependencyTests-1064398708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-92bf62ad-33f6-4238-9a2d-50b69b436262.1e0e0ec8-5d8d-4b9f-9dc5-2f82f98049b4" returned: 0 in 0.285s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:33:56 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-9f47484c-8d3d-4a68-8ce2-e69e27b60a85 tempest-VolumeDependencyTests-1064398708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-92bf62ad-33f6-4238-9a2d-50b69b436262.info {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:33:56 devstack sudo[109835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-92bf62ad-33f6-4238-9a2d-50b69b436262.info Jul 31 12:33:56 devstack sudo[109835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:33:57 devstack sudo[109835]: pam_unix(sudo:session): session closed for user root Jul 31 12:33:57 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-9f47484c-8d3d-4a68-8ce2-e69e27b60a85 tempest-VolumeDependencyTests-1064398708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-92bf62ad-33f6-4238-9a2d-50b69b436262.info" returned: 0 in 0.258s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:33:57 devstack cinder-volume[89182]: WARNING cinder.volume.drivers.remotefs [None req-9f47484c-8d3d-4a68-8ce2-e69e27b60a85 tempest-VolumeDependencyTests-1064398708 None] /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-92bf62ad-33f6-4238-9a2d-50b69b436262.info is being set with open permissions: ugo+rw Jul 31 12:33:57 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-9f47484c-8d3d-4a68-8ce2-e69e27b60a85 tempest-VolumeDependencyTests-1064398708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-92bf62ad-33f6-4238-9a2d-50b69b436262.info {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:33:57 devstack sudo[109839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-92bf62ad-33f6-4238-9a2d-50b69b436262.info Jul 31 12:33:57 devstack sudo[109839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:33:57 devstack sudo[109839]: pam_unix(sudo:session): session closed for user root Jul 31 12:33:57 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-9f47484c-8d3d-4a68-8ce2-e69e27b60a85 tempest-VolumeDependencyTests-1064398708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-92bf62ad-33f6-4238-9a2d-50b69b436262.info" returned: 0 in 0.270s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:33:57 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-9f47484c-8d3d-4a68-8ce2-e69e27b60a85 tempest-VolumeDependencyTests-1064398708 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.071s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:33:57 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-9f47484c-8d3d-4a68-8ce2-e69e27b60a85 tempest-VolumeDependencyTests-1064398708 None] Create snapshot completed successfully Jul 31 12:33:58 devstack cinder-volume[89182]: DEBUG cinder.volume.flows.manager.create_volume [None req-47dbc325-abbb-4216-a45b-f94b998251ab tempest-VolumeDependencyTests-1064398708 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89182) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 12:33:58 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-47dbc325-abbb-4216-a45b-f94b998251ab tempest-VolumeDependencyTests-1064398708 None] Flow 'volume_create_manager' (fc4c0b1c-457f-4189-a357-e060e8da2c90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:33:59 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-47dbc325-abbb-4216-a45b-f94b998251ab tempest-VolumeDependencyTests-1064398708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ddea3e44-adf1-4688-85b7-8567122b1148) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:33:59 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-47dbc325-abbb-4216-a45b-f94b998251ab tempest-VolumeDependencyTests-1064398708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ddea3e44-adf1-4688-85b7-8567122b1148) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:33:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1585934202',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d1ed4d9-fe79-4e22-93ab-b2416a92a575,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af5708b20f594719a09679b9f56f242f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:33:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=1e0e0ec8-5d8d-4b9f-9dc5-2f82f98049b4,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:33:59Z,use_quota=True,user_id='3fad3d5c7d5b44e6b70fa58e652f1cd2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:33:59 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-47dbc325-abbb-4216-a45b-f94b998251ab tempest-VolumeDependencyTests-1064398708 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66366fe5-3ff0-4e23-93a4-9f1d3b8c8098) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:33:59 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-47dbc325-abbb-4216-a45b-f94b998251ab tempest-VolumeDependencyTests-1064398708 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66366fe5-3ff0-4e23-93a4-9f1d3b8c8098) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:33:59 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-47dbc325-abbb-4216-a45b-f94b998251ab tempest-VolumeDependencyTests-1064398708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea75fb21-67e8-4935-97cf-ee59d2178bf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:33:59 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-47dbc325-abbb-4216-a45b-f94b998251ab tempest-VolumeDependencyTests-1064398708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea75fb21-67e8-4935-97cf-ee59d2178bf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '3d1ed4d9-fe79-4e22-93ab-b2416a92a575', 'volume_name': 'volume-3d1ed4d9-fe79-4e22-93ab-b2416a92a575', 'volume_size': 1, 'snapshot_id': '1e0e0ec8-5d8d-4b9f-9dc5-2f82f98049b4'}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:33:59 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-47dbc325-abbb-4216-a45b-f94b998251ab tempest-VolumeDependencyTests-1064398708 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fbe702e6-a127-4bcc-a163-abbcb3626752) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:33:59 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-47dbc325-abbb-4216-a45b-f94b998251ab tempest-VolumeDependencyTests-1064398708 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fbe702e6-a127-4bcc-a163-abbcb3626752) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:33:59 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-47dbc325-abbb-4216-a45b-f94b998251ab tempest-VolumeDependencyTests-1064398708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (313674d0-cd84-44b3-93fe-efd533a5c14f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:33:59 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-47dbc325-abbb-4216-a45b-f94b998251ab tempest-VolumeDependencyTests-1064398708 None] Volume 3d1ed4d9-fe79-4e22-93ab-b2416a92a575: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-3d1ed4d9-fe79-4e22-93ab-b2416a92a575', 'volume_size': 1, 'snapshot_id': '1e0e0ec8-5d8d-4b9f-9dc5-2f82f98049b4'} Jul 31 12:33:59 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-47dbc325-abbb-4216-a45b-f94b998251ab tempest-VolumeDependencyTests-1064398708 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:33:59 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-47dbc325-abbb-4216-a45b-f94b998251ab tempest-VolumeDependencyTests-1064398708 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:33:59 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-47dbc325-abbb-4216-a45b-f94b998251ab tempest-VolumeDependencyTests-1064398708 None] Acquiring lock "cinder-quobyte-1e0e0ec8-5d8d-4b9f-9dc5-2f82f98049b4-3d1ed4d9-fe79-4e22-93ab-b2416a92a575" by "_create_volume_from_snapshot" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:33:59 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-47dbc325-abbb-4216-a45b-f94b998251ab tempest-VolumeDependencyTests-1064398708 None] Lock "cinder-quobyte-1e0e0ec8-5d8d-4b9f-9dc5-2f82f98049b4-3d1ed4d9-fe79-4e22-93ab-b2416a92a575" acquired by "_create_volume_from_snapshot" :: waited 0.017s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:33:59 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-47dbc325-abbb-4216-a45b-f94b998251ab tempest-VolumeDependencyTests-1064398708 None] Creating volume 3d1ed4d9-fe79-4e22-93ab-b2416a92a575 from snapshot 1e0e0ec8-5d8d-4b9f-9dc5-2f82f98049b4 {{(pid=89182) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 31 12:33:59 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-47dbc325-abbb-4216-a45b-f94b998251ab tempest-VolumeDependencyTests-1064398708 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:33:59 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-47dbc325-abbb-4216-a45b-f94b998251ab tempest-VolumeDependencyTests-1064398708 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:33:59 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-47dbc325-abbb-4216-a45b-f94b998251ab tempest-VolumeDependencyTests-1064398708 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:33:59 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-47dbc325-abbb-4216-a45b-f94b998251ab tempest-VolumeDependencyTests-1064398708 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:33:59 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-47dbc325-abbb-4216-a45b-f94b998251ab tempest-VolumeDependencyTests-1064398708 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:33:59 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-47dbc325-abbb-4216-a45b-f94b998251ab tempest-VolumeDependencyTests-1064398708 None] Selected osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 as target Quobyte volume. {{(pid=89182) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 12:33:59 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-47dbc325-abbb-4216-a45b-f94b998251ab tempest-VolumeDependencyTests-1064398708 None] Acquiring lock "cinder-quobyte-3d1ed4d9-fe79-4e22-93ab-b2416a92a575" by "_copy_volume_from_snapshot" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:33:59 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-47dbc325-abbb-4216-a45b-f94b998251ab tempest-VolumeDependencyTests-1064398708 None] Lock "cinder-quobyte-3d1ed4d9-fe79-4e22-93ab-b2416a92a575" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:33:59 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-47dbc325-abbb-4216-a45b-f94b998251ab tempest-VolumeDependencyTests-1064398708 None] snapshot: 1e0e0ec8-5d8d-4b9f-9dc5-2f82f98049b4, volume: 3d1ed4d9-fe79-4e22-93ab-b2416a92a575, {{(pid=89182) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Jul 31 12:33:59 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-47dbc325-abbb-4216-a45b-f94b998251ab tempest-VolumeDependencyTests-1064398708 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:33:59 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-47dbc325-abbb-4216-a45b-f94b998251ab tempest-VolumeDependencyTests-1064398708 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:33:59 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-47dbc325-abbb-4216-a45b-f94b998251ab tempest-VolumeDependencyTests-1064398708 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:33:59 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-47dbc325-abbb-4216-a45b-f94b998251ab tempest-VolumeDependencyTests-1064398708 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:33:59 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-47dbc325-abbb-4216-a45b-f94b998251ab tempest-VolumeDependencyTests-1064398708 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:33:59 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1f78d0b-1c6c-4402-8c7f-6c05f8b4c26f]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:33:59 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-47dbc325-abbb-4216-a45b-f94b998251ab tempest-VolumeDependencyTests-1064398708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-92bf62ad-33f6-4238-9a2d-50b69b436262.1e0e0ec8-5d8d-4b9f-9dc5-2f82f98049b4 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:33:59 devstack sudo[109842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-92bf62ad-33f6-4238-9a2d-50b69b436262.1e0e0ec8-5d8d-4b9f-9dc5-2f82f98049b4 Jul 31 12:33:59 devstack sudo[109842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:33:59 devstack sudo[109842]: pam_unix(sudo:session): session closed for user root Jul 31 12:33:59 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-47dbc325-abbb-4216-a45b-f94b998251ab tempest-VolumeDependencyTests-1064398708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-92bf62ad-33f6-4238-9a2d-50b69b436262.1e0e0ec8-5d8d-4b9f-9dc5-2f82f98049b4" returned: 0 in 0.384s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:33:59 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-47dbc325-abbb-4216-a45b-f94b998251ab tempest-VolumeDependencyTests-1064398708 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-92bf62ad-33f6-4238-9a2d-50b69b436262(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89182) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 12:33:59 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d1c7ddc-7f5c-4768-a7e3-9a0ae4c95cde]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:33:59 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-47dbc325-abbb-4216-a45b-f94b998251ab tempest-VolumeDependencyTests-1064398708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-92bf62ad-33f6-4238-9a2d-50b69b436262 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:33:59 devstack sudo[109850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-92bf62ad-33f6-4238-9a2d-50b69b436262 Jul 31 12:33:59 devstack sudo[109850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:33:59 devstack sudo[109850]: pam_unix(sudo:session): session closed for user root Jul 31 12:33:59 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-47dbc325-abbb-4216-a45b-f94b998251ab tempest-VolumeDependencyTests-1064398708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-92bf62ad-33f6-4238-9a2d-50b69b436262" returned: 0 in 0.411s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:33:59 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-47dbc325-abbb-4216-a45b-f94b998251ab tempest-VolumeDependencyTests-1064398708 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-92bf62ad-33f6-4238-9a2d-50b69b436262 {{(pid=89182) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Jul 31 12:33:59 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-47dbc325-abbb-4216-a45b-f94b998251ab tempest-VolumeDependencyTests-1064398708 None] Creating direct copy from snapshot {{(pid=89182) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Jul 31 12:33:59 devstack cinder-volume[89182]: DEBUG cinder.utils [None req-47dbc325-abbb-4216-a45b-f94b998251ab tempest-VolumeDependencyTests-1064398708 None] Path /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-3d1ed4d9-fe79-4e22-93ab-b2416a92a575 not found in is_blk_device check {{(pid=89182) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 31 12:33:59 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-47dbc325-abbb-4216-a45b-f94b998251ab tempest-VolumeDependencyTests-1064398708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-92bf62ad-33f6-4238-9a2d-50b69b436262 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-3d1ed4d9-fe79-4e22-93ab-b2416a92a575 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:34:00 devstack sudo[109855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-92bf62ad-33f6-4238-9a2d-50b69b436262 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-3d1ed4d9-fe79-4e22-93ab-b2416a92a575 Jul 31 12:34:00 devstack sudo[109855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:34:05 devstack sudo[109855]: pam_unix(sudo:session): session closed for user root Jul 31 12:34:05 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-47dbc325-abbb-4216-a45b-f94b998251ab tempest-VolumeDependencyTests-1064398708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-92bf62ad-33f6-4238-9a2d-50b69b436262 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-3d1ed4d9-fe79-4e22-93ab-b2416a92a575" returned: 0 in 5.411s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:34:05 devstack cinder-volume[89182]: DEBUG cinder.image.image_utils [None req-47dbc325-abbb-4216-a45b-f94b998251ab tempest-VolumeDependencyTests-1064398708 None] Image conversion details: src /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-92bf62ad-33f6-4238-9a2d-50b69b436262, size 1024.00 MB, duration 5.41 sec, destination /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-3d1ed4d9-fe79-4e22-93ab-b2416a92a575 {{(pid=89182) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 31 12:34:05 devstack cinder-volume[89182]: INFO cinder.image.image_utils [None req-47dbc325-abbb-4216-a45b-f94b998251ab tempest-VolumeDependencyTests-1064398708 None] Converted 1024.00 MB image at 189.21 MB/s Jul 31 12:34:05 devstack cinder-volume[89182]: WARNING cinder.volume.drivers.remotefs [None req-47dbc325-abbb-4216-a45b-f94b998251ab tempest-VolumeDependencyTests-1064398708 None] /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-3d1ed4d9-fe79-4e22-93ab-b2416a92a575 is being set with open permissions: ugo+rw Jul 31 12:34:05 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-47dbc325-abbb-4216-a45b-f94b998251ab tempest-VolumeDependencyTests-1064398708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-3d1ed4d9-fe79-4e22-93ab-b2416a92a575 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:34:05 devstack sudo[109887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-3d1ed4d9-fe79-4e22-93ab-b2416a92a575 Jul 31 12:34:05 devstack sudo[109887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:34:05 devstack sudo[109887]: pam_unix(sudo:session): session closed for user root Jul 31 12:34:05 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-47dbc325-abbb-4216-a45b-f94b998251ab tempest-VolumeDependencyTests-1064398708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-3d1ed4d9-fe79-4e22-93ab-b2416a92a575" returned: 0 in 0.307s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:34:05 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-47dbc325-abbb-4216-a45b-f94b998251ab tempest-VolumeDependencyTests-1064398708 None] Lock "cinder-quobyte-3d1ed4d9-fe79-4e22-93ab-b2416a92a575" released by "_copy_volume_from_snapshot" :: held 6.604s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:34:05 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-47dbc325-abbb-4216-a45b-f94b998251ab tempest-VolumeDependencyTests-1064398708 None] Lock "cinder-quobyte-1e0e0ec8-5d8d-4b9f-9dc5-2f82f98049b4-3d1ed4d9-fe79-4e22-93ab-b2416a92a575" released by "_create_volume_from_snapshot" :: held 6.686s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:34:05 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-47dbc325-abbb-4216-a45b-f94b998251ab tempest-VolumeDependencyTests-1064398708 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.704s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:34:05 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-47dbc325-abbb-4216-a45b-f94b998251ab tempest-VolumeDependencyTests-1064398708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (313674d0-cd84-44b3-93fe-efd533a5c14f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3d1ed4d9-fe79-4e22-93ab-b2416a92a575', 'volume_size': 1, 'snapshot_id': '1e0e0ec8-5d8d-4b9f-9dc5-2f82f98049b4'}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:34:05 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-47dbc325-abbb-4216-a45b-f94b998251ab tempest-VolumeDependencyTests-1064398708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e14dbec-91ab-4480-a8a0-f12318e9711f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:34:05 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-47dbc325-abbb-4216-a45b-f94b998251ab tempest-VolumeDependencyTests-1064398708 None] Volume volume-3d1ed4d9-fe79-4e22-93ab-b2416a92a575 (3d1ed4d9-fe79-4e22-93ab-b2416a92a575): created successfully Jul 31 12:34:05 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-47dbc325-abbb-4216-a45b-f94b998251ab tempest-VolumeDependencyTests-1064398708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e14dbec-91ab-4480-a8a0-f12318e9711f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:34:05 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-47dbc325-abbb-4216-a45b-f94b998251ab tempest-VolumeDependencyTests-1064398708 None] Flow 'volume_create_manager' (fc4c0b1c-457f-4189-a357-e060e8da2c90) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:34:05 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-47dbc325-abbb-4216-a45b-f94b998251ab tempest-VolumeDependencyTests-1064398708 None] Created volume successfully. Jul 31 12:34:07 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-e6539471-2395-42b0-9654-eb0c9d48d84f tempest-VolumeDependencyTests-1064398708 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:34:07 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-e6539471-2395-42b0-9654-eb0c9d48d84f tempest-VolumeDependencyTests-1064398708 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:34:07 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-e6539471-2395-42b0-9654-eb0c9d48d84f tempest-VolumeDependencyTests-1064398708 None] Creating offline snapshot 43174e5a-9536-404e-a203-c90bec5020bd of volume 3d1ed4d9-fe79-4e22-93ab-b2416a92a575 {{(pid=89182) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 31 12:34:07 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e456b8b-1a4a-42d5-add3-8787a89afb2b]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:34:07 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-e6539471-2395-42b0-9654-eb0c9d48d84f tempest-VolumeDependencyTests-1064398708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-3d1ed4d9-fe79-4e22-93ab-b2416a92a575 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:34:07 devstack sudo[109973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-3d1ed4d9-fe79-4e22-93ab-b2416a92a575 Jul 31 12:34:07 devstack sudo[109973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:34:07 devstack sudo[109973]: pam_unix(sudo:session): session closed for user root Jul 31 12:34:07 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-e6539471-2395-42b0-9654-eb0c9d48d84f tempest-VolumeDependencyTests-1064398708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-3d1ed4d9-fe79-4e22-93ab-b2416a92a575" returned: 0 in 0.369s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:34:07 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-e6539471-2395-42b0-9654-eb0c9d48d84f tempest-VolumeDependencyTests-1064398708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-3d1ed4d9-fe79-4e22-93ab-b2416a92a575,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-3d1ed4d9-fe79-4e22-93ab-b2416a92a575.43174e5a-9536-404e-a203-c90bec5020bd 1G {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:34:07 devstack sudo[109979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-3d1ed4d9-fe79-4e22-93ab-b2416a92a575,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-3d1ed4d9-fe79-4e22-93ab-b2416a92a575.43174e5a-9536-404e-a203-c90bec5020bd 1G Jul 31 12:34:07 devstack sudo[109979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:34:08 devstack sudo[109979]: pam_unix(sudo:session): session closed for user root Jul 31 12:34:08 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-e6539471-2395-42b0-9654-eb0c9d48d84f tempest-VolumeDependencyTests-1064398708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-3d1ed4d9-fe79-4e22-93ab-b2416a92a575,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-3d1ed4d9-fe79-4e22-93ab-b2416a92a575.43174e5a-9536-404e-a203-c90bec5020bd 1G" returned: 0 in 0.597s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:34:08 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-e6539471-2395-42b0-9654-eb0c9d48d84f tempest-VolumeDependencyTests-1064398708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3d1ed4d9-fe79-4e22-93ab-b2416a92a575 -F qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-3d1ed4d9-fe79-4e22-93ab-b2416a92a575.43174e5a-9536-404e-a203-c90bec5020bd {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:34:08 devstack sudo[109986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3d1ed4d9-fe79-4e22-93ab-b2416a92a575 -F qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-3d1ed4d9-fe79-4e22-93ab-b2416a92a575.43174e5a-9536-404e-a203-c90bec5020bd Jul 31 12:34:08 devstack sudo[109986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:34:08 devstack sudo[109986]: pam_unix(sudo:session): session closed for user root Jul 31 12:34:08 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-e6539471-2395-42b0-9654-eb0c9d48d84f tempest-VolumeDependencyTests-1064398708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3d1ed4d9-fe79-4e22-93ab-b2416a92a575 -F qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-3d1ed4d9-fe79-4e22-93ab-b2416a92a575.43174e5a-9536-404e-a203-c90bec5020bd" returned: 0 in 0.343s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:34:08 devstack cinder-volume[89182]: WARNING cinder.volume.drivers.remotefs [None req-e6539471-2395-42b0-9654-eb0c9d48d84f tempest-VolumeDependencyTests-1064398708 None] /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-3d1ed4d9-fe79-4e22-93ab-b2416a92a575.43174e5a-9536-404e-a203-c90bec5020bd is being set with open permissions: ugo+rw Jul 31 12:34:08 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-e6539471-2395-42b0-9654-eb0c9d48d84f tempest-VolumeDependencyTests-1064398708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-3d1ed4d9-fe79-4e22-93ab-b2416a92a575.43174e5a-9536-404e-a203-c90bec5020bd {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:34:08 devstack sudo[109991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-3d1ed4d9-fe79-4e22-93ab-b2416a92a575.43174e5a-9536-404e-a203-c90bec5020bd Jul 31 12:34:08 devstack sudo[109991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:34:08 devstack sudo[109991]: pam_unix(sudo:session): session closed for user root Jul 31 12:34:09 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-e6539471-2395-42b0-9654-eb0c9d48d84f tempest-VolumeDependencyTests-1064398708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-3d1ed4d9-fe79-4e22-93ab-b2416a92a575.43174e5a-9536-404e-a203-c90bec5020bd" returned: 0 in 0.255s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:34:09 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-e6539471-2395-42b0-9654-eb0c9d48d84f tempest-VolumeDependencyTests-1064398708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-3d1ed4d9-fe79-4e22-93ab-b2416a92a575.info {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:34:09 devstack sudo[109994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-3d1ed4d9-fe79-4e22-93ab-b2416a92a575.info Jul 31 12:34:09 devstack sudo[109994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:34:09 devstack sudo[109994]: pam_unix(sudo:session): session closed for user root Jul 31 12:34:09 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-e6539471-2395-42b0-9654-eb0c9d48d84f tempest-VolumeDependencyTests-1064398708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-3d1ed4d9-fe79-4e22-93ab-b2416a92a575.info" returned: 0 in 0.277s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:34:09 devstack cinder-volume[89182]: WARNING cinder.volume.drivers.remotefs [None req-e6539471-2395-42b0-9654-eb0c9d48d84f tempest-VolumeDependencyTests-1064398708 None] /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-3d1ed4d9-fe79-4e22-93ab-b2416a92a575.info is being set with open permissions: ugo+rw Jul 31 12:34:09 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-e6539471-2395-42b0-9654-eb0c9d48d84f tempest-VolumeDependencyTests-1064398708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-3d1ed4d9-fe79-4e22-93ab-b2416a92a575.info {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:34:09 devstack sudo[109997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-3d1ed4d9-fe79-4e22-93ab-b2416a92a575.info Jul 31 12:34:09 devstack sudo[109997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:34:09 devstack sudo[109997]: pam_unix(sudo:session): session closed for user root Jul 31 12:34:09 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-e6539471-2395-42b0-9654-eb0c9d48d84f tempest-VolumeDependencyTests-1064398708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-3d1ed4d9-fe79-4e22-93ab-b2416a92a575.info" returned: 0 in 0.300s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:34:09 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-e6539471-2395-42b0-9654-eb0c9d48d84f tempest-VolumeDependencyTests-1064398708 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.249s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:34:09 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-e6539471-2395-42b0-9654-eb0c9d48d84f tempest-VolumeDependencyTests-1064398708 None] Create snapshot completed successfully Jul 31 12:34:11 devstack cinder-volume[89182]: DEBUG cinder.volume.flows.manager.create_volume [None req-42805ca8-78fa-49a9-9bab-4f8a79346601 tempest-VolumeDependencyTests-1064398708 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89182) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 12:34:11 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-42805ca8-78fa-49a9-9bab-4f8a79346601 tempest-VolumeDependencyTests-1064398708 None] Flow 'volume_create_manager' (3bb5bfe5-690c-4c17-b6b5-8477cc215c91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:34:11 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-42805ca8-78fa-49a9-9bab-4f8a79346601 tempest-VolumeDependencyTests-1064398708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db3ca0d4-47da-4aa9-b045-9430aadbfaa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:34:11 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-42805ca8-78fa-49a9-9bab-4f8a79346601 tempest-VolumeDependencyTests-1064398708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db3ca0d4-47da-4aa9-b045-9430aadbfaa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:34:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-6188140',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=331e8145-f72e-450b-9863-e2bf202b7f22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af5708b20f594719a09679b9f56f242f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:34:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=43174e5a-9536-404e-a203-c90bec5020bd,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:34:11Z,use_quota=True,user_id='3fad3d5c7d5b44e6b70fa58e652f1cd2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:34:11 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-42805ca8-78fa-49a9-9bab-4f8a79346601 tempest-VolumeDependencyTests-1064398708 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93cb5e56-61c9-49df-94d1-7ed8df636a2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:34:11 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-42805ca8-78fa-49a9-9bab-4f8a79346601 tempest-VolumeDependencyTests-1064398708 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93cb5e56-61c9-49df-94d1-7ed8df636a2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:34:11 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-42805ca8-78fa-49a9-9bab-4f8a79346601 tempest-VolumeDependencyTests-1064398708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eab29b75-3143-44d7-b4e3-08ed39cb4bb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:34:11 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-42805ca8-78fa-49a9-9bab-4f8a79346601 tempest-VolumeDependencyTests-1064398708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eab29b75-3143-44d7-b4e3-08ed39cb4bb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '331e8145-f72e-450b-9863-e2bf202b7f22', 'volume_name': 'volume-331e8145-f72e-450b-9863-e2bf202b7f22', 'volume_size': 1, 'snapshot_id': '43174e5a-9536-404e-a203-c90bec5020bd'}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:34:11 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-42805ca8-78fa-49a9-9bab-4f8a79346601 tempest-VolumeDependencyTests-1064398708 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12d47fcc-afb2-4752-bbf4-5eea22f936b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:34:11 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-42805ca8-78fa-49a9-9bab-4f8a79346601 tempest-VolumeDependencyTests-1064398708 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12d47fcc-afb2-4752-bbf4-5eea22f936b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:34:11 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-42805ca8-78fa-49a9-9bab-4f8a79346601 tempest-VolumeDependencyTests-1064398708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (812d416a-d6c1-4fe5-a411-8cd52abed0f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:34:11 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-42805ca8-78fa-49a9-9bab-4f8a79346601 tempest-VolumeDependencyTests-1064398708 None] Volume 331e8145-f72e-450b-9863-e2bf202b7f22: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-331e8145-f72e-450b-9863-e2bf202b7f22', 'volume_size': 1, 'snapshot_id': '43174e5a-9536-404e-a203-c90bec5020bd'} Jul 31 12:34:11 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-42805ca8-78fa-49a9-9bab-4f8a79346601 tempest-VolumeDependencyTests-1064398708 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:34:11 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-42805ca8-78fa-49a9-9bab-4f8a79346601 tempest-VolumeDependencyTests-1064398708 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.000s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:34:11 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-42805ca8-78fa-49a9-9bab-4f8a79346601 tempest-VolumeDependencyTests-1064398708 None] Acquiring lock "cinder-quobyte-43174e5a-9536-404e-a203-c90bec5020bd-331e8145-f72e-450b-9863-e2bf202b7f22" by "_create_volume_from_snapshot" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:34:11 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-42805ca8-78fa-49a9-9bab-4f8a79346601 tempest-VolumeDependencyTests-1064398708 None] Lock "cinder-quobyte-43174e5a-9536-404e-a203-c90bec5020bd-331e8145-f72e-450b-9863-e2bf202b7f22" acquired by "_create_volume_from_snapshot" :: waited 0.015s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:34:11 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-42805ca8-78fa-49a9-9bab-4f8a79346601 tempest-VolumeDependencyTests-1064398708 None] Creating volume 331e8145-f72e-450b-9863-e2bf202b7f22 from snapshot 43174e5a-9536-404e-a203-c90bec5020bd {{(pid=89182) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 31 12:34:11 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-42805ca8-78fa-49a9-9bab-4f8a79346601 tempest-VolumeDependencyTests-1064398708 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:34:11 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-42805ca8-78fa-49a9-9bab-4f8a79346601 tempest-VolumeDependencyTests-1064398708 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:34:11 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-42805ca8-78fa-49a9-9bab-4f8a79346601 tempest-VolumeDependencyTests-1064398708 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:34:11 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-42805ca8-78fa-49a9-9bab-4f8a79346601 tempest-VolumeDependencyTests-1064398708 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:34:11 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-42805ca8-78fa-49a9-9bab-4f8a79346601 tempest-VolumeDependencyTests-1064398708 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:34:11 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-42805ca8-78fa-49a9-9bab-4f8a79346601 tempest-VolumeDependencyTests-1064398708 None] Selected osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 as target Quobyte volume. {{(pid=89182) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 12:34:11 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-42805ca8-78fa-49a9-9bab-4f8a79346601 tempest-VolumeDependencyTests-1064398708 None] Acquiring lock "cinder-quobyte-331e8145-f72e-450b-9863-e2bf202b7f22" by "_copy_volume_from_snapshot" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:34:11 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-42805ca8-78fa-49a9-9bab-4f8a79346601 tempest-VolumeDependencyTests-1064398708 None] Lock "cinder-quobyte-331e8145-f72e-450b-9863-e2bf202b7f22" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:34:11 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-42805ca8-78fa-49a9-9bab-4f8a79346601 tempest-VolumeDependencyTests-1064398708 None] snapshot: 43174e5a-9536-404e-a203-c90bec5020bd, volume: 331e8145-f72e-450b-9863-e2bf202b7f22, {{(pid=89182) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Jul 31 12:34:11 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-42805ca8-78fa-49a9-9bab-4f8a79346601 tempest-VolumeDependencyTests-1064398708 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:34:11 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-42805ca8-78fa-49a9-9bab-4f8a79346601 tempest-VolumeDependencyTests-1064398708 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:34:11 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-42805ca8-78fa-49a9-9bab-4f8a79346601 tempest-VolumeDependencyTests-1064398708 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:34:11 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-42805ca8-78fa-49a9-9bab-4f8a79346601 tempest-VolumeDependencyTests-1064398708 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:34:11 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-42805ca8-78fa-49a9-9bab-4f8a79346601 tempest-VolumeDependencyTests-1064398708 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:34:11 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8b2f090-d03c-49ce-8105-631303fcb485]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:34:11 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-42805ca8-78fa-49a9-9bab-4f8a79346601 tempest-VolumeDependencyTests-1064398708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-3d1ed4d9-fe79-4e22-93ab-b2416a92a575.43174e5a-9536-404e-a203-c90bec5020bd {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:34:11 devstack sudo[110002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-3d1ed4d9-fe79-4e22-93ab-b2416a92a575.43174e5a-9536-404e-a203-c90bec5020bd Jul 31 12:34:11 devstack sudo[110002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:34:11 devstack sudo[110002]: pam_unix(sudo:session): session closed for user root Jul 31 12:34:11 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-42805ca8-78fa-49a9-9bab-4f8a79346601 tempest-VolumeDependencyTests-1064398708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-3d1ed4d9-fe79-4e22-93ab-b2416a92a575.43174e5a-9536-404e-a203-c90bec5020bd" returned: 0 in 0.383s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:34:11 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-42805ca8-78fa-49a9-9bab-4f8a79346601 tempest-VolumeDependencyTests-1064398708 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3d1ed4d9-fe79-4e22-93ab-b2416a92a575(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89182) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 12:34:11 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdecd686-0953-4ac1-9b98-a1e94bd8a9cc]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:34:11 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-42805ca8-78fa-49a9-9bab-4f8a79346601 tempest-VolumeDependencyTests-1064398708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-3d1ed4d9-fe79-4e22-93ab-b2416a92a575 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:34:11 devstack sudo[110007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-3d1ed4d9-fe79-4e22-93ab-b2416a92a575 Jul 31 12:34:11 devstack sudo[110007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:34:12 devstack sudo[110007]: pam_unix(sudo:session): session closed for user root Jul 31 12:34:12 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-42805ca8-78fa-49a9-9bab-4f8a79346601 tempest-VolumeDependencyTests-1064398708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-3d1ed4d9-fe79-4e22-93ab-b2416a92a575" returned: 0 in 0.350s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:34:12 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-42805ca8-78fa-49a9-9bab-4f8a79346601 tempest-VolumeDependencyTests-1064398708 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-3d1ed4d9-fe79-4e22-93ab-b2416a92a575 {{(pid=89182) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Jul 31 12:34:12 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-42805ca8-78fa-49a9-9bab-4f8a79346601 tempest-VolumeDependencyTests-1064398708 None] Creating direct copy from snapshot {{(pid=89182) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Jul 31 12:34:12 devstack cinder-volume[89182]: DEBUG cinder.utils [None req-42805ca8-78fa-49a9-9bab-4f8a79346601 tempest-VolumeDependencyTests-1064398708 None] Path /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-331e8145-f72e-450b-9863-e2bf202b7f22 not found in is_blk_device check {{(pid=89182) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 31 12:34:12 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-42805ca8-78fa-49a9-9bab-4f8a79346601 tempest-VolumeDependencyTests-1064398708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-3d1ed4d9-fe79-4e22-93ab-b2416a92a575 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-331e8145-f72e-450b-9863-e2bf202b7f22 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:34:12 devstack sudo[110012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-3d1ed4d9-fe79-4e22-93ab-b2416a92a575 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-331e8145-f72e-450b-9863-e2bf202b7f22 Jul 31 12:34:12 devstack sudo[110012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:34:12 devstack sudo[110012]: pam_unix(sudo:session): session closed for user root Jul 31 12:34:12 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-42805ca8-78fa-49a9-9bab-4f8a79346601 tempest-VolumeDependencyTests-1064398708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-3d1ed4d9-fe79-4e22-93ab-b2416a92a575 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-331e8145-f72e-450b-9863-e2bf202b7f22" returned: 0 in 0.458s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:34:12 devstack cinder-volume[89182]: DEBUG cinder.image.image_utils [None req-42805ca8-78fa-49a9-9bab-4f8a79346601 tempest-VolumeDependencyTests-1064398708 None] Image conversion details: src /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-3d1ed4d9-fe79-4e22-93ab-b2416a92a575, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-331e8145-f72e-450b-9863-e2bf202b7f22 {{(pid=89182) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 31 12:34:12 devstack cinder-volume[89182]: INFO cinder.image.image_utils [None req-42805ca8-78fa-49a9-9bab-4f8a79346601 tempest-VolumeDependencyTests-1064398708 None] Converted 1024.00 MB image at 1024.00 MB/s Jul 31 12:34:12 devstack cinder-volume[89182]: WARNING cinder.volume.drivers.remotefs [None req-42805ca8-78fa-49a9-9bab-4f8a79346601 tempest-VolumeDependencyTests-1064398708 None] /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-331e8145-f72e-450b-9863-e2bf202b7f22 is being set with open permissions: ugo+rw Jul 31 12:34:12 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-42805ca8-78fa-49a9-9bab-4f8a79346601 tempest-VolumeDependencyTests-1064398708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-331e8145-f72e-450b-9863-e2bf202b7f22 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:34:12 devstack sudo[110018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-331e8145-f72e-450b-9863-e2bf202b7f22 Jul 31 12:34:12 devstack sudo[110018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:34:12 devstack sudo[110018]: pam_unix(sudo:session): session closed for user root Jul 31 12:34:12 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-42805ca8-78fa-49a9-9bab-4f8a79346601 tempest-VolumeDependencyTests-1064398708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-331e8145-f72e-450b-9863-e2bf202b7f22" returned: 0 in 0.242s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:34:12 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-42805ca8-78fa-49a9-9bab-4f8a79346601 tempest-VolumeDependencyTests-1064398708 None] Lock "cinder-quobyte-331e8145-f72e-450b-9863-e2bf202b7f22" released by "_copy_volume_from_snapshot" :: held 1.519s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:34:12 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-42805ca8-78fa-49a9-9bab-4f8a79346601 tempest-VolumeDependencyTests-1064398708 None] Lock "cinder-quobyte-43174e5a-9536-404e-a203-c90bec5020bd-331e8145-f72e-450b-9863-e2bf202b7f22" released by "_create_volume_from_snapshot" :: held 1.583s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:34:12 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-42805ca8-78fa-49a9-9bab-4f8a79346601 tempest-VolumeDependencyTests-1064398708 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 1.600s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:34:12 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-42805ca8-78fa-49a9-9bab-4f8a79346601 tempest-VolumeDependencyTests-1064398708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (812d416a-d6c1-4fe5-a411-8cd52abed0f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-331e8145-f72e-450b-9863-e2bf202b7f22', 'volume_size': 1, 'snapshot_id': '43174e5a-9536-404e-a203-c90bec5020bd'}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:34:12 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-42805ca8-78fa-49a9-9bab-4f8a79346601 tempest-VolumeDependencyTests-1064398708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d30709a-f336-4c07-8a26-ff5017db51a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:34:12 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-42805ca8-78fa-49a9-9bab-4f8a79346601 tempest-VolumeDependencyTests-1064398708 None] Volume volume-331e8145-f72e-450b-9863-e2bf202b7f22 (331e8145-f72e-450b-9863-e2bf202b7f22): created successfully Jul 31 12:34:12 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-42805ca8-78fa-49a9-9bab-4f8a79346601 tempest-VolumeDependencyTests-1064398708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d30709a-f336-4c07-8a26-ff5017db51a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:34:12 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-42805ca8-78fa-49a9-9bab-4f8a79346601 tempest-VolumeDependencyTests-1064398708 None] Flow 'volume_create_manager' (3bb5bfe5-690c-4c17-b6b5-8477cc215c91) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:34:12 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-42805ca8-78fa-49a9-9bab-4f8a79346601 tempest-VolumeDependencyTests-1064398708 None] Created volume successfully. Jul 31 12:34:13 devstack cinder-volume[89182]: DEBUG cinder.volume.flows.manager.create_volume [None req-e907fcd9-86fa-4bb2-86de-79f278f43171 tempest-VolumeDependencyTests-1064398708 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89182) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 12:34:13 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-e907fcd9-86fa-4bb2-86de-79f278f43171 tempest-VolumeDependencyTests-1064398708 None] Flow 'volume_create_manager' (119849bf-11b7-4bc7-9f5c-306b228877df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:34:13 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-e907fcd9-86fa-4bb2-86de-79f278f43171 tempest-VolumeDependencyTests-1064398708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c470b0ea-ea84-4aff-8151-1c8711ea5ab7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:34:13 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-e907fcd9-86fa-4bb2-86de-79f278f43171 tempest-VolumeDependencyTests-1064398708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c470b0ea-ea84-4aff-8151-1c8711ea5ab7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:34:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1808663529',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25b3512e-2596-4d71-a0f6-3efa1896eace,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af5708b20f594719a09679b9f56f242f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:34:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=331e8145-f72e-450b-9863-e2bf202b7f22,status='creating',terminated_at=None,updated_at=2026-07-31T10:34:14Z,use_quota=True,user_id='3fad3d5c7d5b44e6b70fa58e652f1cd2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:34:13 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-e907fcd9-86fa-4bb2-86de-79f278f43171 tempest-VolumeDependencyTests-1064398708 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d408605c-c8f2-4990-9517-632097b022a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:34:13 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-e907fcd9-86fa-4bb2-86de-79f278f43171 tempest-VolumeDependencyTests-1064398708 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d408605c-c8f2-4990-9517-632097b022a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:34:13 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-e907fcd9-86fa-4bb2-86de-79f278f43171 tempest-VolumeDependencyTests-1064398708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1211f1c-7bac-4981-b826-927f741ed395) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:34:13 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-e907fcd9-86fa-4bb2-86de-79f278f43171 tempest-VolumeDependencyTests-1064398708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1211f1c-7bac-4981-b826-927f741ed395) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '25b3512e-2596-4d71-a0f6-3efa1896eace', 'volume_name': 'volume-25b3512e-2596-4d71-a0f6-3efa1896eace', 'volume_size': 1, 'source_volid': '331e8145-f72e-450b-9863-e2bf202b7f22', 'source_volstatus': 'available'}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:34:13 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-e907fcd9-86fa-4bb2-86de-79f278f43171 tempest-VolumeDependencyTests-1064398708 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30674774-6643-4e92-84c7-521da9113a79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:34:13 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-e907fcd9-86fa-4bb2-86de-79f278f43171 tempest-VolumeDependencyTests-1064398708 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30674774-6643-4e92-84c7-521da9113a79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:34:13 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-e907fcd9-86fa-4bb2-86de-79f278f43171 tempest-VolumeDependencyTests-1064398708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa510023-34ce-426f-92cc-465f8040d7d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:34:13 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-e907fcd9-86fa-4bb2-86de-79f278f43171 tempest-VolumeDependencyTests-1064398708 None] Volume 25b3512e-2596-4d71-a0f6-3efa1896eace: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-25b3512e-2596-4d71-a0f6-3efa1896eace', 'volume_size': 1, 'source_volid': '331e8145-f72e-450b-9863-e2bf202b7f22', 'source_volstatus': 'available'} Jul 31 12:34:13 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-e907fcd9-86fa-4bb2-86de-79f278f43171 tempest-VolumeDependencyTests-1064398708 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:34:13 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-e907fcd9-86fa-4bb2-86de-79f278f43171 tempest-VolumeDependencyTests-1064398708 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:34:13 devstack cinder-volume[89182]: INFO cinder.volume.drivers.remotefs [None req-e907fcd9-86fa-4bb2-86de-79f278f43171 tempest-VolumeDependencyTests-1064398708 None] Cloning volume 331e8145-f72e-450b-9863-e2bf202b7f22 to volume 25b3512e-2596-4d71-a0f6-3efa1896eace Jul 31 12:34:13 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-e907fcd9-86fa-4bb2-86de-79f278f43171 tempest-VolumeDependencyTests-1064398708 None] Creating offline snapshot a99180df-d351-473d-9424-89433fb2a442 of volume 331e8145-f72e-450b-9863-e2bf202b7f22 {{(pid=89182) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 31 12:34:13 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fca51f4-9222-4504-a94c-f20a96ec415b]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:34:13 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-e907fcd9-86fa-4bb2-86de-79f278f43171 tempest-VolumeDependencyTests-1064398708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-331e8145-f72e-450b-9863-e2bf202b7f22 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:34:13 devstack sudo[110021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-331e8145-f72e-450b-9863-e2bf202b7f22 Jul 31 12:34:13 devstack sudo[110021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:34:14 devstack sudo[110021]: pam_unix(sudo:session): session closed for user root Jul 31 12:34:14 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-e907fcd9-86fa-4bb2-86de-79f278f43171 tempest-VolumeDependencyTests-1064398708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-331e8145-f72e-450b-9863-e2bf202b7f22" returned: 0 in 0.381s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:34:14 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-e907fcd9-86fa-4bb2-86de-79f278f43171 tempest-VolumeDependencyTests-1064398708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-331e8145-f72e-450b-9863-e2bf202b7f22,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-331e8145-f72e-450b-9863-e2bf202b7f22.a99180df-d351-473d-9424-89433fb2a442 1G {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:34:14 devstack sudo[110026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-331e8145-f72e-450b-9863-e2bf202b7f22,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-331e8145-f72e-450b-9863-e2bf202b7f22.a99180df-d351-473d-9424-89433fb2a442 1G Jul 31 12:34:14 devstack sudo[110026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:34:14 devstack sudo[110026]: pam_unix(sudo:session): session closed for user root Jul 31 12:34:14 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-e907fcd9-86fa-4bb2-86de-79f278f43171 tempest-VolumeDependencyTests-1064398708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-331e8145-f72e-450b-9863-e2bf202b7f22,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-331e8145-f72e-450b-9863-e2bf202b7f22.a99180df-d351-473d-9424-89433fb2a442 1G" returned: 0 in 0.422s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:34:14 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-e907fcd9-86fa-4bb2-86de-79f278f43171 tempest-VolumeDependencyTests-1064398708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-331e8145-f72e-450b-9863-e2bf202b7f22 -F qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-331e8145-f72e-450b-9863-e2bf202b7f22.a99180df-d351-473d-9424-89433fb2a442 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:34:14 devstack sudo[110031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-331e8145-f72e-450b-9863-e2bf202b7f22 -F qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-331e8145-f72e-450b-9863-e2bf202b7f22.a99180df-d351-473d-9424-89433fb2a442 Jul 31 12:34:14 devstack sudo[110031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:34:14 devstack sudo[110031]: pam_unix(sudo:session): session closed for user root Jul 31 12:34:14 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-e907fcd9-86fa-4bb2-86de-79f278f43171 tempest-VolumeDependencyTests-1064398708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-331e8145-f72e-450b-9863-e2bf202b7f22 -F qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-331e8145-f72e-450b-9863-e2bf202b7f22.a99180df-d351-473d-9424-89433fb2a442" returned: 0 in 0.299s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:34:14 devstack cinder-volume[89182]: WARNING cinder.volume.drivers.remotefs [None req-e907fcd9-86fa-4bb2-86de-79f278f43171 tempest-VolumeDependencyTests-1064398708 None] /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-331e8145-f72e-450b-9863-e2bf202b7f22.a99180df-d351-473d-9424-89433fb2a442 is being set with open permissions: ugo+rw Jul 31 12:34:14 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-e907fcd9-86fa-4bb2-86de-79f278f43171 tempest-VolumeDependencyTests-1064398708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-331e8145-f72e-450b-9863-e2bf202b7f22.a99180df-d351-473d-9424-89433fb2a442 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:34:14 devstack sudo[110036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-331e8145-f72e-450b-9863-e2bf202b7f22.a99180df-d351-473d-9424-89433fb2a442 Jul 31 12:34:14 devstack sudo[110036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:34:15 devstack sudo[110036]: pam_unix(sudo:session): session closed for user root Jul 31 12:34:15 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-e907fcd9-86fa-4bb2-86de-79f278f43171 tempest-VolumeDependencyTests-1064398708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-331e8145-f72e-450b-9863-e2bf202b7f22.a99180df-d351-473d-9424-89433fb2a442" returned: 0 in 0.257s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:34:15 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-e907fcd9-86fa-4bb2-86de-79f278f43171 tempest-VolumeDependencyTests-1064398708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-331e8145-f72e-450b-9863-e2bf202b7f22.info {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:34:15 devstack sudo[110039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-331e8145-f72e-450b-9863-e2bf202b7f22.info Jul 31 12:34:15 devstack sudo[110039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:34:15 devstack sudo[110039]: pam_unix(sudo:session): session closed for user root Jul 31 12:34:15 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-e907fcd9-86fa-4bb2-86de-79f278f43171 tempest-VolumeDependencyTests-1064398708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-331e8145-f72e-450b-9863-e2bf202b7f22.info" returned: 0 in 0.260s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:34:15 devstack cinder-volume[89182]: WARNING cinder.volume.drivers.remotefs [None req-e907fcd9-86fa-4bb2-86de-79f278f43171 tempest-VolumeDependencyTests-1064398708 None] /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-331e8145-f72e-450b-9863-e2bf202b7f22.info is being set with open permissions: ugo+rw Jul 31 12:34:15 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-e907fcd9-86fa-4bb2-86de-79f278f43171 tempest-VolumeDependencyTests-1064398708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-331e8145-f72e-450b-9863-e2bf202b7f22.info {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:34:15 devstack sudo[110042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-331e8145-f72e-450b-9863-e2bf202b7f22.info Jul 31 12:34:15 devstack sudo[110042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:34:15 devstack sudo[110042]: pam_unix(sudo:session): session closed for user root Jul 31 12:34:15 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-e907fcd9-86fa-4bb2-86de-79f278f43171 tempest-VolumeDependencyTests-1064398708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-331e8145-f72e-450b-9863-e2bf202b7f22.info" returned: 0 in 0.286s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:34:15 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-e907fcd9-86fa-4bb2-86de-79f278f43171 tempest-VolumeDependencyTests-1064398708 None] Acquiring lock "cinder-quobyte-25b3512e-2596-4d71-a0f6-3efa1896eace" by "_copy_volume_from_snapshot" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:34:15 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-e907fcd9-86fa-4bb2-86de-79f278f43171 tempest-VolumeDependencyTests-1064398708 None] Lock "cinder-quobyte-25b3512e-2596-4d71-a0f6-3efa1896eace" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:34:15 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-e907fcd9-86fa-4bb2-86de-79f278f43171 tempest-VolumeDependencyTests-1064398708 None] snapshot: a99180df-d351-473d-9424-89433fb2a442, volume: 25b3512e-2596-4d71-a0f6-3efa1896eace, {{(pid=89182) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Jul 31 12:34:15 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-e907fcd9-86fa-4bb2-86de-79f278f43171 tempest-VolumeDependencyTests-1064398708 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:34:15 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-e907fcd9-86fa-4bb2-86de-79f278f43171 tempest-VolumeDependencyTests-1064398708 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:34:15 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-e907fcd9-86fa-4bb2-86de-79f278f43171 tempest-VolumeDependencyTests-1064398708 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:34:15 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-e907fcd9-86fa-4bb2-86de-79f278f43171 tempest-VolumeDependencyTests-1064398708 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:34:15 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-e907fcd9-86fa-4bb2-86de-79f278f43171 tempest-VolumeDependencyTests-1064398708 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:34:15 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc6fe629-bccb-44b4-998e-05ba15c8fc3c]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:34:15 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-e907fcd9-86fa-4bb2-86de-79f278f43171 tempest-VolumeDependencyTests-1064398708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-331e8145-f72e-450b-9863-e2bf202b7f22.a99180df-d351-473d-9424-89433fb2a442 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:34:15 devstack sudo[110045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-331e8145-f72e-450b-9863-e2bf202b7f22.a99180df-d351-473d-9424-89433fb2a442 Jul 31 12:34:15 devstack sudo[110045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:34:16 devstack sudo[110045]: pam_unix(sudo:session): session closed for user root Jul 31 12:34:16 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-e907fcd9-86fa-4bb2-86de-79f278f43171 tempest-VolumeDependencyTests-1064398708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-331e8145-f72e-450b-9863-e2bf202b7f22.a99180df-d351-473d-9424-89433fb2a442" returned: 0 in 0.384s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:34:16 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-e907fcd9-86fa-4bb2-86de-79f278f43171 tempest-VolumeDependencyTests-1064398708 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-331e8145-f72e-450b-9863-e2bf202b7f22(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89182) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 12:34:16 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d298b21-4145-4a4b-9cc2-440335c0acc9]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:34:16 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-e907fcd9-86fa-4bb2-86de-79f278f43171 tempest-VolumeDependencyTests-1064398708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-331e8145-f72e-450b-9863-e2bf202b7f22 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:34:16 devstack sudo[110050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-331e8145-f72e-450b-9863-e2bf202b7f22 Jul 31 12:34:16 devstack sudo[110050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:34:16 devstack sudo[110050]: pam_unix(sudo:session): session closed for user root Jul 31 12:34:16 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-e907fcd9-86fa-4bb2-86de-79f278f43171 tempest-VolumeDependencyTests-1064398708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-331e8145-f72e-450b-9863-e2bf202b7f22" returned: 0 in 0.374s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:34:16 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-e907fcd9-86fa-4bb2-86de-79f278f43171 tempest-VolumeDependencyTests-1064398708 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-331e8145-f72e-450b-9863-e2bf202b7f22 {{(pid=89182) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Jul 31 12:34:16 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-e907fcd9-86fa-4bb2-86de-79f278f43171 tempest-VolumeDependencyTests-1064398708 None] Creating direct copy from snapshot {{(pid=89182) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Jul 31 12:34:16 devstack cinder-volume[89182]: DEBUG cinder.utils [None req-e907fcd9-86fa-4bb2-86de-79f278f43171 tempest-VolumeDependencyTests-1064398708 None] Path /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-25b3512e-2596-4d71-a0f6-3efa1896eace not found in is_blk_device check {{(pid=89182) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 31 12:34:16 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-e907fcd9-86fa-4bb2-86de-79f278f43171 tempest-VolumeDependencyTests-1064398708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-331e8145-f72e-450b-9863-e2bf202b7f22 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-25b3512e-2596-4d71-a0f6-3efa1896eace {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:34:16 devstack sudo[110055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-331e8145-f72e-450b-9863-e2bf202b7f22 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-25b3512e-2596-4d71-a0f6-3efa1896eace Jul 31 12:34:16 devstack sudo[110055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:34:17 devstack sudo[110055]: pam_unix(sudo:session): session closed for user root Jul 31 12:34:17 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-e907fcd9-86fa-4bb2-86de-79f278f43171 tempest-VolumeDependencyTests-1064398708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-331e8145-f72e-450b-9863-e2bf202b7f22 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-25b3512e-2596-4d71-a0f6-3efa1896eace" returned: 0 in 0.443s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:34:17 devstack cinder-volume[89182]: DEBUG cinder.image.image_utils [None req-e907fcd9-86fa-4bb2-86de-79f278f43171 tempest-VolumeDependencyTests-1064398708 None] Image conversion details: src /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-331e8145-f72e-450b-9863-e2bf202b7f22, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-25b3512e-2596-4d71-a0f6-3efa1896eace {{(pid=89182) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 31 12:34:17 devstack cinder-volume[89182]: INFO cinder.image.image_utils [None req-e907fcd9-86fa-4bb2-86de-79f278f43171 tempest-VolumeDependencyTests-1064398708 None] Converted 1024.00 MB image at 1024.00 MB/s Jul 31 12:34:17 devstack cinder-volume[89182]: WARNING cinder.volume.drivers.remotefs [None req-e907fcd9-86fa-4bb2-86de-79f278f43171 tempest-VolumeDependencyTests-1064398708 None] /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-25b3512e-2596-4d71-a0f6-3efa1896eace is being set with open permissions: ugo+rw Jul 31 12:34:17 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-e907fcd9-86fa-4bb2-86de-79f278f43171 tempest-VolumeDependencyTests-1064398708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-25b3512e-2596-4d71-a0f6-3efa1896eace {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:34:17 devstack sudo[110061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-25b3512e-2596-4d71-a0f6-3efa1896eace Jul 31 12:34:17 devstack sudo[110061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:34:17 devstack sudo[110061]: pam_unix(sudo:session): session closed for user root Jul 31 12:34:17 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-e907fcd9-86fa-4bb2-86de-79f278f43171 tempest-VolumeDependencyTests-1064398708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-25b3512e-2596-4d71-a0f6-3efa1896eace" returned: 0 in 0.256s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:34:17 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-e907fcd9-86fa-4bb2-86de-79f278f43171 tempest-VolumeDependencyTests-1064398708 None] Lock "cinder-quobyte-25b3512e-2596-4d71-a0f6-3efa1896eace" released by "_copy_volume_from_snapshot" :: held 1.529s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:34:17 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-e907fcd9-86fa-4bb2-86de-79f278f43171 tempest-VolumeDependencyTests-1064398708 None] Acquiring lock "cinder-quobyte-a99180df-d351-473d-9424-89433fb2a442" by "_delete_snapshot" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:34:17 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-e907fcd9-86fa-4bb2-86de-79f278f43171 tempest-VolumeDependencyTests-1064398708 None] Lock "cinder-quobyte-a99180df-d351-473d-9424-89433fb2a442" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:34:17 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-e907fcd9-86fa-4bb2-86de-79f278f43171 tempest-VolumeDependencyTests-1064398708 None] Deleting offline snapshot a99180df-d351-473d-9424-89433fb2a442 of volume 331e8145-f72e-450b-9863-e2bf202b7f22 {{(pid=89182) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 31 12:34:17 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-e907fcd9-86fa-4bb2-86de-79f278f43171 tempest-VolumeDependencyTests-1064398708 None] snapshot_file for this snap is: volume-331e8145-f72e-450b-9863-e2bf202b7f22.a99180df-d351-473d-9424-89433fb2a442 {{(pid=89182) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 31 12:34:17 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6fc0d7a-de34-43ee-b29d-b3c7a6b3cb8d]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:34:17 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-e907fcd9-86fa-4bb2-86de-79f278f43171 tempest-VolumeDependencyTests-1064398708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-331e8145-f72e-450b-9863-e2bf202b7f22.a99180df-d351-473d-9424-89433fb2a442 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:34:17 devstack sudo[110064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-331e8145-f72e-450b-9863-e2bf202b7f22.a99180df-d351-473d-9424-89433fb2a442 Jul 31 12:34:17 devstack sudo[110064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:34:17 devstack sudo[110064]: pam_unix(sudo:session): session closed for user root Jul 31 12:34:17 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-e907fcd9-86fa-4bb2-86de-79f278f43171 tempest-VolumeDependencyTests-1064398708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-331e8145-f72e-450b-9863-e2bf202b7f22.a99180df-d351-473d-9424-89433fb2a442" returned: 0 in 0.408s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:34:17 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-e907fcd9-86fa-4bb2-86de-79f278f43171 tempest-VolumeDependencyTests-1064398708 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-331e8145-f72e-450b-9863-e2bf202b7f22(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89182) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 12:34:17 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4bc9e7f-1b67-4845-89c4-1d9dc6d9abb7]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:34:17 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-e907fcd9-86fa-4bb2-86de-79f278f43171 tempest-VolumeDependencyTests-1064398708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-331e8145-f72e-450b-9863-e2bf202b7f22 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:34:17 devstack sudo[110069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-331e8145-f72e-450b-9863-e2bf202b7f22 Jul 31 12:34:17 devstack sudo[110069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:34:18 devstack sudo[110069]: pam_unix(sudo:session): session closed for user root Jul 31 12:34:18 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-e907fcd9-86fa-4bb2-86de-79f278f43171 tempest-VolumeDependencyTests-1064398708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-331e8145-f72e-450b-9863-e2bf202b7f22" returned: 0 in 0.389s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:34:18 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-e907fcd9-86fa-4bb2-86de-79f278f43171 tempest-VolumeDependencyTests-1064398708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-331e8145-f72e-450b-9863-e2bf202b7f22.a99180df-d351-473d-9424-89433fb2a442 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:34:18 devstack sudo[110074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-331e8145-f72e-450b-9863-e2bf202b7f22.a99180df-d351-473d-9424-89433fb2a442 Jul 31 12:34:18 devstack sudo[110074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:34:18 devstack sudo[110074]: pam_unix(sudo:session): session closed for user root Jul 31 12:34:18 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-e907fcd9-86fa-4bb2-86de-79f278f43171 tempest-VolumeDependencyTests-1064398708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-331e8145-f72e-450b-9863-e2bf202b7f22.a99180df-d351-473d-9424-89433fb2a442" returned: 0 in 0.356s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:34:18 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-e907fcd9-86fa-4bb2-86de-79f278f43171 tempest-VolumeDependencyTests-1064398708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-331e8145-f72e-450b-9863-e2bf202b7f22.a99180df-d351-473d-9424-89433fb2a442 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:34:18 devstack sudo[110079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-331e8145-f72e-450b-9863-e2bf202b7f22.a99180df-d351-473d-9424-89433fb2a442 Jul 31 12:34:18 devstack sudo[110079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:34:18 devstack sudo[110079]: pam_unix(sudo:session): session closed for user root Jul 31 12:34:18 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-e907fcd9-86fa-4bb2-86de-79f278f43171 tempest-VolumeDependencyTests-1064398708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-331e8145-f72e-450b-9863-e2bf202b7f22.a99180df-d351-473d-9424-89433fb2a442" returned: 0 in 0.269s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:34:18 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-e907fcd9-86fa-4bb2-86de-79f278f43171 tempest-VolumeDependencyTests-1064398708 None] Lock "cinder-quobyte-a99180df-d351-473d-9424-89433fb2a442" released by "_delete_snapshot" :: held 1.517s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:34:18 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-e907fcd9-86fa-4bb2-86de-79f278f43171 tempest-VolumeDependencyTests-1064398708 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 5.145s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:34:18 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-e907fcd9-86fa-4bb2-86de-79f278f43171 tempest-VolumeDependencyTests-1064398708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa510023-34ce-426f-92cc-465f8040d7d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-25b3512e-2596-4d71-a0f6-3efa1896eace', 'volume_size': 1, 'source_volid': '331e8145-f72e-450b-9863-e2bf202b7f22', 'source_volstatus': 'available'}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:34:18 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-e907fcd9-86fa-4bb2-86de-79f278f43171 tempest-VolumeDependencyTests-1064398708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd9a67a9-0df2-4c93-888e-65cab768be05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:34:19 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-e907fcd9-86fa-4bb2-86de-79f278f43171 tempest-VolumeDependencyTests-1064398708 None] Volume volume-25b3512e-2596-4d71-a0f6-3efa1896eace (25b3512e-2596-4d71-a0f6-3efa1896eace): created successfully Jul 31 12:34:19 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-e907fcd9-86fa-4bb2-86de-79f278f43171 tempest-VolumeDependencyTests-1064398708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd9a67a9-0df2-4c93-888e-65cab768be05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:34:19 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-e907fcd9-86fa-4bb2-86de-79f278f43171 tempest-VolumeDependencyTests-1064398708 None] Flow 'volume_create_manager' (119849bf-11b7-4bc7-9f5c-306b228877df) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:34:19 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-e907fcd9-86fa-4bb2-86de-79f278f43171 tempest-VolumeDependencyTests-1064398708 None] Created volume successfully. Jul 31 12:34:20 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-1a89b5e3-6350-4013-894b-5b4586b28888 tempest-VolumeDependencyTests-1064398708 None] Acquiring lock "cinder-1e0e0ec8-5d8d-4b9f-9dc5-2f82f98049b4-delete_snapshot" by "delete_snapshot" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:34:20 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-1a89b5e3-6350-4013-894b-5b4586b28888 tempest-VolumeDependencyTests-1064398708 None] Lock "cinder-1e0e0ec8-5d8d-4b9f-9dc5-2f82f98049b4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:34:20 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-1a89b5e3-6350-4013-894b-5b4586b28888 tempest-VolumeDependencyTests-1064398708 None] Acquiring lock "cinder-quobyte-92bf62ad-33f6-4238-9a2d-50b69b436262" by "delete_snapshot" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:34:20 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-1a89b5e3-6350-4013-894b-5b4586b28888 tempest-VolumeDependencyTests-1064398708 None] Lock "cinder-quobyte-92bf62ad-33f6-4238-9a2d-50b69b436262" acquired by "delete_snapshot" :: waited 0.016s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:34:20 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-1a89b5e3-6350-4013-894b-5b4586b28888 tempest-VolumeDependencyTests-1064398708 None] Acquiring lock "cinder-quobyte-1e0e0ec8-5d8d-4b9f-9dc5-2f82f98049b4" by "_delete_snapshot" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:34:20 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-1a89b5e3-6350-4013-894b-5b4586b28888 tempest-VolumeDependencyTests-1064398708 None] Lock "cinder-quobyte-1e0e0ec8-5d8d-4b9f-9dc5-2f82f98049b4" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:34:20 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-1a89b5e3-6350-4013-894b-5b4586b28888 tempest-VolumeDependencyTests-1064398708 None] Deleting offline snapshot 1e0e0ec8-5d8d-4b9f-9dc5-2f82f98049b4 of volume 92bf62ad-33f6-4238-9a2d-50b69b436262 {{(pid=89182) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 31 12:34:20 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-1a89b5e3-6350-4013-894b-5b4586b28888 tempest-VolumeDependencyTests-1064398708 None] snapshot_file for this snap is: volume-92bf62ad-33f6-4238-9a2d-50b69b436262.1e0e0ec8-5d8d-4b9f-9dc5-2f82f98049b4 {{(pid=89182) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 31 12:34:20 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[03896c16-17ed-4255-a2b8-6ab8c0dee5c9]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:34:20 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-1a89b5e3-6350-4013-894b-5b4586b28888 tempest-VolumeDependencyTests-1064398708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-92bf62ad-33f6-4238-9a2d-50b69b436262.1e0e0ec8-5d8d-4b9f-9dc5-2f82f98049b4 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:34:20 devstack sudo[110094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-92bf62ad-33f6-4238-9a2d-50b69b436262.1e0e0ec8-5d8d-4b9f-9dc5-2f82f98049b4 Jul 31 12:34:20 devstack sudo[110094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:34:20 devstack sudo[110094]: pam_unix(sudo:session): session closed for user root Jul 31 12:34:20 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-1a89b5e3-6350-4013-894b-5b4586b28888 tempest-VolumeDependencyTests-1064398708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-92bf62ad-33f6-4238-9a2d-50b69b436262.1e0e0ec8-5d8d-4b9f-9dc5-2f82f98049b4" returned: 0 in 0.384s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:34:20 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-1a89b5e3-6350-4013-894b-5b4586b28888 tempest-VolumeDependencyTests-1064398708 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-92bf62ad-33f6-4238-9a2d-50b69b436262(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89182) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 12:34:20 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e026227-cca4-4b86-a414-1c2e47dbfc5f]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:34:20 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-1a89b5e3-6350-4013-894b-5b4586b28888 tempest-VolumeDependencyTests-1064398708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-92bf62ad-33f6-4238-9a2d-50b69b436262 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:34:20 devstack sudo[110099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-92bf62ad-33f6-4238-9a2d-50b69b436262 Jul 31 12:34:20 devstack sudo[110099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:34:21 devstack sudo[110099]: pam_unix(sudo:session): session closed for user root Jul 31 12:34:21 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-1a89b5e3-6350-4013-894b-5b4586b28888 tempest-VolumeDependencyTests-1064398708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-92bf62ad-33f6-4238-9a2d-50b69b436262" returned: 0 in 0.551s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:34:21 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-1a89b5e3-6350-4013-894b-5b4586b28888 tempest-VolumeDependencyTests-1064398708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-92bf62ad-33f6-4238-9a2d-50b69b436262.1e0e0ec8-5d8d-4b9f-9dc5-2f82f98049b4 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:34:21 devstack sudo[110104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-92bf62ad-33f6-4238-9a2d-50b69b436262.1e0e0ec8-5d8d-4b9f-9dc5-2f82f98049b4 Jul 31 12:34:21 devstack sudo[110104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:34:21 devstack sudo[110104]: pam_unix(sudo:session): session closed for user root Jul 31 12:34:21 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-1a89b5e3-6350-4013-894b-5b4586b28888 tempest-VolumeDependencyTests-1064398708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-92bf62ad-33f6-4238-9a2d-50b69b436262.1e0e0ec8-5d8d-4b9f-9dc5-2f82f98049b4" returned: 0 in 0.339s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:34:21 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-1a89b5e3-6350-4013-894b-5b4586b28888 tempest-VolumeDependencyTests-1064398708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-92bf62ad-33f6-4238-9a2d-50b69b436262.1e0e0ec8-5d8d-4b9f-9dc5-2f82f98049b4 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:34:21 devstack sudo[110110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-92bf62ad-33f6-4238-9a2d-50b69b436262.1e0e0ec8-5d8d-4b9f-9dc5-2f82f98049b4 Jul 31 12:34:21 devstack sudo[110110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:34:21 devstack sudo[110110]: pam_unix(sudo:session): session closed for user root Jul 31 12:34:21 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-1a89b5e3-6350-4013-894b-5b4586b28888 tempest-VolumeDependencyTests-1064398708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-92bf62ad-33f6-4238-9a2d-50b69b436262.1e0e0ec8-5d8d-4b9f-9dc5-2f82f98049b4" returned: 0 in 0.248s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:34:21 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-1a89b5e3-6350-4013-894b-5b4586b28888 tempest-VolumeDependencyTests-1064398708 None] Lock "cinder-quobyte-1e0e0ec8-5d8d-4b9f-9dc5-2f82f98049b4" released by "_delete_snapshot" :: held 1.631s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:34:21 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-1a89b5e3-6350-4013-894b-5b4586b28888 tempest-VolumeDependencyTests-1064398708 None] Lock "cinder-quobyte-92bf62ad-33f6-4238-9a2d-50b69b436262" released by "delete_snapshot" :: held 1.660s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:34:21 devstack cinder-volume[89182]: DEBUG cinder.quota [None req-1a89b5e3-6350-4013-894b-5b4586b28888 tempest-VolumeDependencyTests-1064398708 None] Created reservations ['4f4ee301-be02-4e57-b840-69e25b44c1b4', 'e5e127b4-8a90-4d18-9a96-ab3dbcf6b63f', '77a41bfa-e81e-4030-a4ac-7d29b5c482b3', '0292fea5-7fbc-4d3d-96fc-369ad22b93bf'] {{(pid=89182) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 12:34:21 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-1a89b5e3-6350-4013-894b-5b4586b28888 tempest-VolumeDependencyTests-1064398708 None] Delete snapshot completed successfully. Jul 31 12:34:21 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-1a89b5e3-6350-4013-894b-5b4586b28888 tempest-VolumeDependencyTests-1064398708 None] Lock "cinder-1e0e0ec8-5d8d-4b9f-9dc5-2f82f98049b4-delete_snapshot" released by "delete_snapshot" :: held 1.789s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:34:21 devstack cinder-volume[89182]: DEBUG oslo_service.periodic_task [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89182) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 31 12:34:21 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:34:21 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:34:21 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:34:21 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:34:21 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:34:21 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:34:22 devstack sudo[110113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 Jul 31 12:34:22 devstack sudo[110113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:34:22 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-3314c5e0-2c5e-46db-88a9-4702ad69206d tempest-VolumeDependencyTests-1064398708 None] Acquiring lock "cinder-43174e5a-9536-404e-a203-c90bec5020bd-delete_snapshot" by "delete_snapshot" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:34:22 devstack sudo[110113]: pam_unix(sudo:session): session closed for user root Jul 31 12:34:22 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2" returned: 0 in 0.255s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:34:22 devstack cinder-volume[89182]: DEBUG cinder.manager [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] Notifying Schedulers of capabilities ... {{(pid=89182) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 12:34:22 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-3314c5e0-2c5e-46db-88a9-4702ad69206d tempest-VolumeDependencyTests-1064398708 None] Lock "cinder-43174e5a-9536-404e-a203-c90bec5020bd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:34:22 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-3314c5e0-2c5e-46db-88a9-4702ad69206d tempest-VolumeDependencyTests-1064398708 None] Acquiring lock "cinder-quobyte-3d1ed4d9-fe79-4e22-93ab-b2416a92a575" by "delete_snapshot" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:34:22 devstack cinder-volume[89182]: DEBUG oslo_service.periodic_task [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] Running periodic task VolumeManager._thread_info {{(pid=89182) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 31 12:34:22 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] thread count: 28 {{(pid=89182) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 31 12:34:22 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] thread info: [<_MainThread(MainThread, started 136154603720832)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=89182) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 31 12:34:22 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-3314c5e0-2c5e-46db-88a9-4702ad69206d tempest-VolumeDependencyTests-1064398708 None] Lock "cinder-quobyte-3d1ed4d9-fe79-4e22-93ab-b2416a92a575" acquired by "delete_snapshot" :: waited 0.021s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:34:22 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-3314c5e0-2c5e-46db-88a9-4702ad69206d tempest-VolumeDependencyTests-1064398708 None] Acquiring lock "cinder-quobyte-43174e5a-9536-404e-a203-c90bec5020bd" by "_delete_snapshot" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:34:22 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-3314c5e0-2c5e-46db-88a9-4702ad69206d tempest-VolumeDependencyTests-1064398708 None] Lock "cinder-quobyte-43174e5a-9536-404e-a203-c90bec5020bd" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:34:22 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-3314c5e0-2c5e-46db-88a9-4702ad69206d tempest-VolumeDependencyTests-1064398708 None] Deleting offline snapshot 43174e5a-9536-404e-a203-c90bec5020bd of volume 3d1ed4d9-fe79-4e22-93ab-b2416a92a575 {{(pid=89182) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 31 12:34:22 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-3314c5e0-2c5e-46db-88a9-4702ad69206d tempest-VolumeDependencyTests-1064398708 None] snapshot_file for this snap is: volume-3d1ed4d9-fe79-4e22-93ab-b2416a92a575.43174e5a-9536-404e-a203-c90bec5020bd {{(pid=89182) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 31 12:34:22 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[776f6fa6-b929-4e09-9857-85be9561266c]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:34:22 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-3314c5e0-2c5e-46db-88a9-4702ad69206d tempest-VolumeDependencyTests-1064398708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-3d1ed4d9-fe79-4e22-93ab-b2416a92a575.43174e5a-9536-404e-a203-c90bec5020bd {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:34:22 devstack sudo[110116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-3d1ed4d9-fe79-4e22-93ab-b2416a92a575.43174e5a-9536-404e-a203-c90bec5020bd Jul 31 12:34:22 devstack sudo[110116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:34:22 devstack sudo[110116]: pam_unix(sudo:session): session closed for user root Jul 31 12:34:22 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-3314c5e0-2c5e-46db-88a9-4702ad69206d tempest-VolumeDependencyTests-1064398708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-3d1ed4d9-fe79-4e22-93ab-b2416a92a575.43174e5a-9536-404e-a203-c90bec5020bd" returned: 0 in 0.373s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:34:22 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-3314c5e0-2c5e-46db-88a9-4702ad69206d tempest-VolumeDependencyTests-1064398708 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3d1ed4d9-fe79-4e22-93ab-b2416a92a575(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89182) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 12:34:22 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0345cee-64e9-4020-b001-eb7aad4a06f0]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:34:22 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-3314c5e0-2c5e-46db-88a9-4702ad69206d tempest-VolumeDependencyTests-1064398708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-3d1ed4d9-fe79-4e22-93ab-b2416a92a575 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:34:22 devstack sudo[110121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-3d1ed4d9-fe79-4e22-93ab-b2416a92a575 Jul 31 12:34:22 devstack sudo[110121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:34:23 devstack sudo[110121]: pam_unix(sudo:session): session closed for user root Jul 31 12:34:23 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-3314c5e0-2c5e-46db-88a9-4702ad69206d tempest-VolumeDependencyTests-1064398708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-3d1ed4d9-fe79-4e22-93ab-b2416a92a575" returned: 0 in 0.363s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:34:23 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-3314c5e0-2c5e-46db-88a9-4702ad69206d tempest-VolumeDependencyTests-1064398708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-3d1ed4d9-fe79-4e22-93ab-b2416a92a575.43174e5a-9536-404e-a203-c90bec5020bd {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:34:23 devstack sudo[110126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-3d1ed4d9-fe79-4e22-93ab-b2416a92a575.43174e5a-9536-404e-a203-c90bec5020bd Jul 31 12:34:23 devstack sudo[110126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:34:23 devstack sudo[110126]: pam_unix(sudo:session): session closed for user root Jul 31 12:34:23 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-3314c5e0-2c5e-46db-88a9-4702ad69206d tempest-VolumeDependencyTests-1064398708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-3d1ed4d9-fe79-4e22-93ab-b2416a92a575.43174e5a-9536-404e-a203-c90bec5020bd" returned: 0 in 0.326s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:34:23 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-3314c5e0-2c5e-46db-88a9-4702ad69206d tempest-VolumeDependencyTests-1064398708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-3d1ed4d9-fe79-4e22-93ab-b2416a92a575.43174e5a-9536-404e-a203-c90bec5020bd {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:34:23 devstack sudo[110131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-3d1ed4d9-fe79-4e22-93ab-b2416a92a575.43174e5a-9536-404e-a203-c90bec5020bd Jul 31 12:34:23 devstack sudo[110131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:34:23 devstack sudo[110131]: pam_unix(sudo:session): session closed for user root Jul 31 12:34:23 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-3314c5e0-2c5e-46db-88a9-4702ad69206d tempest-VolumeDependencyTests-1064398708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-3d1ed4d9-fe79-4e22-93ab-b2416a92a575.43174e5a-9536-404e-a203-c90bec5020bd" returned: 0 in 0.246s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:34:23 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-3314c5e0-2c5e-46db-88a9-4702ad69206d tempest-VolumeDependencyTests-1064398708 None] Lock "cinder-quobyte-43174e5a-9536-404e-a203-c90bec5020bd" released by "_delete_snapshot" :: held 1.404s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:34:23 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-3314c5e0-2c5e-46db-88a9-4702ad69206d tempest-VolumeDependencyTests-1064398708 None] Lock "cinder-quobyte-3d1ed4d9-fe79-4e22-93ab-b2416a92a575" released by "delete_snapshot" :: held 1.428s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:34:23 devstack cinder-volume[89182]: DEBUG cinder.quota [None req-3314c5e0-2c5e-46db-88a9-4702ad69206d tempest-VolumeDependencyTests-1064398708 None] Created reservations ['d58dfd8d-2bed-4a4f-814d-68b13ecf9d86', '6c9f539a-8936-4f9e-af20-d20d521e9d70', '8408ccd7-8e54-45ac-abaa-ab6bd97f4571', 'c9e27969-d311-4bf9-855f-435774d70118'] {{(pid=89182) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 12:34:23 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-3314c5e0-2c5e-46db-88a9-4702ad69206d tempest-VolumeDependencyTests-1064398708 None] Delete snapshot completed successfully. Jul 31 12:34:23 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-3314c5e0-2c5e-46db-88a9-4702ad69206d tempest-VolumeDependencyTests-1064398708 None] Lock "cinder-43174e5a-9536-404e-a203-c90bec5020bd-delete_snapshot" released by "delete_snapshot" :: held 1.557s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:34:24 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-51351134-cd58-4152-99a9-e701ca542543 tempest-VolumeDependencyTests-1064398708 None] Acquiring lock "cinder-331e8145-f72e-450b-9863-e2bf202b7f22-delete_volume" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:34:24 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-51351134-cd58-4152-99a9-e701ca542543 tempest-VolumeDependencyTests-1064398708 None] Lock "cinder-331e8145-f72e-450b-9863-e2bf202b7f22-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:34:24 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-51351134-cd58-4152-99a9-e701ca542543 tempest-VolumeDependencyTests-1064398708 None] Acquiring lock "cinder-quobyte-331e8145-f72e-450b-9863-e2bf202b7f22" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:34:24 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-51351134-cd58-4152-99a9-e701ca542543 tempest-VolumeDependencyTests-1064398708 None] Lock "cinder-quobyte-331e8145-f72e-450b-9863-e2bf202b7f22" acquired by "delete_volume" :: waited 0.014s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:34:24 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[c961026b-fc3b-4fa7-a6f4-f3a4d94353b1]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:34:24 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-51351134-cd58-4152-99a9-e701ca542543 tempest-VolumeDependencyTests-1064398708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-331e8145-f72e-450b-9863-e2bf202b7f22 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:34:24 devstack sudo[110134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-331e8145-f72e-450b-9863-e2bf202b7f22 Jul 31 12:34:24 devstack sudo[110134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:34:24 devstack sudo[110134]: pam_unix(sudo:session): session closed for user root Jul 31 12:34:24 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-51351134-cd58-4152-99a9-e701ca542543 tempest-VolumeDependencyTests-1064398708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-331e8145-f72e-450b-9863-e2bf202b7f22" returned: 0 in 0.364s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:34:24 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-51351134-cd58-4152-99a9-e701ca542543 tempest-VolumeDependencyTests-1064398708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-331e8145-f72e-450b-9863-e2bf202b7f22 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:34:24 devstack sudo[110139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-331e8145-f72e-450b-9863-e2bf202b7f22 Jul 31 12:34:24 devstack sudo[110139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:34:25 devstack sudo[110139]: pam_unix(sudo:session): session closed for user root Jul 31 12:34:25 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-51351134-cd58-4152-99a9-e701ca542543 tempest-VolumeDependencyTests-1064398708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-331e8145-f72e-450b-9863-e2bf202b7f22" returned: 0 in 0.247s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:34:25 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-51351134-cd58-4152-99a9-e701ca542543 tempest-VolumeDependencyTests-1064398708 None] Lock "cinder-quobyte-331e8145-f72e-450b-9863-e2bf202b7f22" released by "delete_volume" :: held 0.668s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:34:25 devstack cinder-volume[89182]: DEBUG cinder.quota [None req-51351134-cd58-4152-99a9-e701ca542543 tempest-VolumeDependencyTests-1064398708 None] Created reservations ['bd04eb91-ae4e-48b3-b69d-398887300c52', 'e4f69783-7ea3-4abc-a43f-6fd708dff744', 'b00fd002-cf70-4e91-803a-b0dd54c2797e', '415e6ad3-e577-4bb5-b6de-db75fe9782fd'] {{(pid=89182) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 12:34:25 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-51351134-cd58-4152-99a9-e701ca542543 tempest-VolumeDependencyTests-1064398708 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:34:25 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-51351134-cd58-4152-99a9-e701ca542543 tempest-VolumeDependencyTests-1064398708 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:34:25 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-51351134-cd58-4152-99a9-e701ca542543 tempest-VolumeDependencyTests-1064398708 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:34:25 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-51351134-cd58-4152-99a9-e701ca542543 tempest-VolumeDependencyTests-1064398708 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:34:25 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-51351134-cd58-4152-99a9-e701ca542543 tempest-VolumeDependencyTests-1064398708 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:34:25 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-51351134-cd58-4152-99a9-e701ca542543 tempest-VolumeDependencyTests-1064398708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:34:25 devstack sudo[110142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 Jul 31 12:34:25 devstack sudo[110142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:34:25 devstack sudo[110142]: pam_unix(sudo:session): session closed for user root Jul 31 12:34:25 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-51351134-cd58-4152-99a9-e701ca542543 tempest-VolumeDependencyTests-1064398708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2" returned: 0 in 0.247s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:34:25 devstack cinder-volume[89182]: DEBUG cinder.manager [None req-51351134-cd58-4152-99a9-e701ca542543 tempest-VolumeDependencyTests-1064398708 None] Notifying Schedulers of capabilities ... {{(pid=89182) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 12:34:25 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-51351134-cd58-4152-99a9-e701ca542543 tempest-VolumeDependencyTests-1064398708 None] Deleted volume successfully. Jul 31 12:34:25 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-51351134-cd58-4152-99a9-e701ca542543 tempest-VolumeDependencyTests-1064398708 None] Lock "cinder-331e8145-f72e-450b-9863-e2bf202b7f22-delete_volume" released by "delete_volume" :: held 1.109s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:34:25 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-e4d31f24-3d60-42a7-a0e7-12f76ee9915b tempest-VolumeDependencyTests-1064398708 None] Acquiring lock "cinder-92bf62ad-33f6-4238-9a2d-50b69b436262-delete_volume" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:34:25 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-e4d31f24-3d60-42a7-a0e7-12f76ee9915b tempest-VolumeDependencyTests-1064398708 None] Lock "cinder-92bf62ad-33f6-4238-9a2d-50b69b436262-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:34:25 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-e4d31f24-3d60-42a7-a0e7-12f76ee9915b tempest-VolumeDependencyTests-1064398708 None] Acquiring lock "cinder-quobyte-92bf62ad-33f6-4238-9a2d-50b69b436262" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:34:25 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-e4d31f24-3d60-42a7-a0e7-12f76ee9915b tempest-VolumeDependencyTests-1064398708 None] Lock "cinder-quobyte-92bf62ad-33f6-4238-9a2d-50b69b436262" acquired by "delete_volume" :: waited 0.021s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:34:25 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[20e06721-6445-45ce-b68a-d7354dd35e43]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:34:25 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-e4d31f24-3d60-42a7-a0e7-12f76ee9915b tempest-VolumeDependencyTests-1064398708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-92bf62ad-33f6-4238-9a2d-50b69b436262 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:34:25 devstack sudo[110145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-92bf62ad-33f6-4238-9a2d-50b69b436262 Jul 31 12:34:25 devstack sudo[110145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:34:26 devstack sudo[110145]: pam_unix(sudo:session): session closed for user root Jul 31 12:34:26 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-e4d31f24-3d60-42a7-a0e7-12f76ee9915b tempest-VolumeDependencyTests-1064398708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-92bf62ad-33f6-4238-9a2d-50b69b436262" returned: 0 in 0.373s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:34:26 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-e4d31f24-3d60-42a7-a0e7-12f76ee9915b tempest-VolumeDependencyTests-1064398708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-92bf62ad-33f6-4238-9a2d-50b69b436262 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:34:26 devstack sudo[110150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-92bf62ad-33f6-4238-9a2d-50b69b436262 Jul 31 12:34:26 devstack sudo[110150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:34:26 devstack sudo[110150]: pam_unix(sudo:session): session closed for user root Jul 31 12:34:26 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-e4d31f24-3d60-42a7-a0e7-12f76ee9915b tempest-VolumeDependencyTests-1064398708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-92bf62ad-33f6-4238-9a2d-50b69b436262" returned: 0 in 0.250s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:34:26 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-e4d31f24-3d60-42a7-a0e7-12f76ee9915b tempest-VolumeDependencyTests-1064398708 None] Lock "cinder-quobyte-92bf62ad-33f6-4238-9a2d-50b69b436262" released by "delete_volume" :: held 0.679s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:34:26 devstack cinder-volume[89182]: DEBUG cinder.quota [None req-e4d31f24-3d60-42a7-a0e7-12f76ee9915b tempest-VolumeDependencyTests-1064398708 None] Created reservations ['473186e4-ed8c-45fe-bf03-9ed2f19a6c93', '4d3b64f7-a7af-41a8-bf82-a234fca3f731', '1bec207d-9aa0-4b61-9d0c-6491155bd523', '07aff917-eed0-483d-883b-085ee46fc99d'] {{(pid=89182) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 12:34:26 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-e4d31f24-3d60-42a7-a0e7-12f76ee9915b tempest-VolumeDependencyTests-1064398708 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:34:26 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-e4d31f24-3d60-42a7-a0e7-12f76ee9915b tempest-VolumeDependencyTests-1064398708 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:34:26 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-e4d31f24-3d60-42a7-a0e7-12f76ee9915b tempest-VolumeDependencyTests-1064398708 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:34:26 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-e4d31f24-3d60-42a7-a0e7-12f76ee9915b tempest-VolumeDependencyTests-1064398708 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:34:26 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-e4d31f24-3d60-42a7-a0e7-12f76ee9915b tempest-VolumeDependencyTests-1064398708 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:34:26 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-e4d31f24-3d60-42a7-a0e7-12f76ee9915b tempest-VolumeDependencyTests-1064398708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:34:26 devstack sudo[110153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 Jul 31 12:34:26 devstack sudo[110153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:34:26 devstack sudo[110153]: pam_unix(sudo:session): session closed for user root Jul 31 12:34:26 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-e4d31f24-3d60-42a7-a0e7-12f76ee9915b tempest-VolumeDependencyTests-1064398708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2" returned: 0 in 0.277s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:34:26 devstack cinder-volume[89182]: DEBUG cinder.manager [None req-e4d31f24-3d60-42a7-a0e7-12f76ee9915b tempest-VolumeDependencyTests-1064398708 None] Notifying Schedulers of capabilities ... {{(pid=89182) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 12:34:26 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-e4d31f24-3d60-42a7-a0e7-12f76ee9915b tempest-VolumeDependencyTests-1064398708 None] Deleted volume successfully. Jul 31 12:34:26 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-0de5ff9e-9d7d-4000-8eb9-0b89902a07bb tempest-VolumeDependencyTests-1064398708 None] Acquiring lock "cinder-3d1ed4d9-fe79-4e22-93ab-b2416a92a575-delete_volume" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:34:26 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-0de5ff9e-9d7d-4000-8eb9-0b89902a07bb tempest-VolumeDependencyTests-1064398708 None] Lock "cinder-3d1ed4d9-fe79-4e22-93ab-b2416a92a575-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:34:26 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-e4d31f24-3d60-42a7-a0e7-12f76ee9915b tempest-VolumeDependencyTests-1064398708 None] Lock "cinder-92bf62ad-33f6-4238-9a2d-50b69b436262-delete_volume" released by "delete_volume" :: held 1.222s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:34:26 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-0de5ff9e-9d7d-4000-8eb9-0b89902a07bb tempest-VolumeDependencyTests-1064398708 None] Acquiring lock "cinder-quobyte-3d1ed4d9-fe79-4e22-93ab-b2416a92a575" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:34:26 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-0de5ff9e-9d7d-4000-8eb9-0b89902a07bb tempest-VolumeDependencyTests-1064398708 None] Lock "cinder-quobyte-3d1ed4d9-fe79-4e22-93ab-b2416a92a575" acquired by "delete_volume" :: waited 0.017s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:34:26 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4fc0079-733f-4be7-95ce-eefcbbe64ca4]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:34:26 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-0de5ff9e-9d7d-4000-8eb9-0b89902a07bb tempest-VolumeDependencyTests-1064398708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-3d1ed4d9-fe79-4e22-93ab-b2416a92a575 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:34:26 devstack sudo[110156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-3d1ed4d9-fe79-4e22-93ab-b2416a92a575 Jul 31 12:34:26 devstack sudo[110156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:34:27 devstack sudo[110156]: pam_unix(sudo:session): session closed for user root Jul 31 12:34:27 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-0de5ff9e-9d7d-4000-8eb9-0b89902a07bb tempest-VolumeDependencyTests-1064398708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-3d1ed4d9-fe79-4e22-93ab-b2416a92a575" returned: 0 in 0.360s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:34:27 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-0de5ff9e-9d7d-4000-8eb9-0b89902a07bb tempest-VolumeDependencyTests-1064398708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-3d1ed4d9-fe79-4e22-93ab-b2416a92a575 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:34:27 devstack sudo[110162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-3d1ed4d9-fe79-4e22-93ab-b2416a92a575 Jul 31 12:34:27 devstack sudo[110162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:34:27 devstack sudo[110162]: pam_unix(sudo:session): session closed for user root Jul 31 12:34:27 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-0de5ff9e-9d7d-4000-8eb9-0b89902a07bb tempest-VolumeDependencyTests-1064398708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-3d1ed4d9-fe79-4e22-93ab-b2416a92a575" returned: 0 in 0.260s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:34:27 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-0de5ff9e-9d7d-4000-8eb9-0b89902a07bb tempest-VolumeDependencyTests-1064398708 None] Lock "cinder-quobyte-3d1ed4d9-fe79-4e22-93ab-b2416a92a575" released by "delete_volume" :: held 0.684s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:34:27 devstack cinder-volume[89182]: DEBUG cinder.quota [None req-0de5ff9e-9d7d-4000-8eb9-0b89902a07bb tempest-VolumeDependencyTests-1064398708 None] Created reservations ['a5e017b1-2471-45fd-ab0a-6f008d3dab8f', '2352cd42-c37c-4e56-9fc4-c910099201f6', '45fe602f-dc7e-44bd-893a-dafb52c3a6b8', '2c8b2c5a-6cda-4805-b69a-3e16d22e8863'] {{(pid=89182) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 12:34:27 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-0de5ff9e-9d7d-4000-8eb9-0b89902a07bb tempest-VolumeDependencyTests-1064398708 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:34:27 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-0de5ff9e-9d7d-4000-8eb9-0b89902a07bb tempest-VolumeDependencyTests-1064398708 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:34:27 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-0de5ff9e-9d7d-4000-8eb9-0b89902a07bb tempest-VolumeDependencyTests-1064398708 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:34:27 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-0de5ff9e-9d7d-4000-8eb9-0b89902a07bb tempest-VolumeDependencyTests-1064398708 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:34:27 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-0de5ff9e-9d7d-4000-8eb9-0b89902a07bb tempest-VolumeDependencyTests-1064398708 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:34:27 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-0de5ff9e-9d7d-4000-8eb9-0b89902a07bb tempest-VolumeDependencyTests-1064398708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:34:27 devstack sudo[110165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 Jul 31 12:34:27 devstack sudo[110165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:34:27 devstack sudo[110165]: pam_unix(sudo:session): session closed for user root Jul 31 12:34:27 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-0de5ff9e-9d7d-4000-8eb9-0b89902a07bb tempest-VolumeDependencyTests-1064398708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2" returned: 0 in 0.269s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:34:27 devstack cinder-volume[89182]: DEBUG cinder.manager [None req-0de5ff9e-9d7d-4000-8eb9-0b89902a07bb tempest-VolumeDependencyTests-1064398708 None] Notifying Schedulers of capabilities ... {{(pid=89182) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 12:34:27 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-0de5ff9e-9d7d-4000-8eb9-0b89902a07bb tempest-VolumeDependencyTests-1064398708 None] Deleted volume successfully. Jul 31 12:34:27 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-2977ad16-6a30-4f1c-9825-04bbd86fc3ab tempest-VolumeDependencyTests-1064398708 None] Acquiring lock "cinder-25b3512e-2596-4d71-a0f6-3efa1896eace-delete_volume" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:34:27 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-0de5ff9e-9d7d-4000-8eb9-0b89902a07bb tempest-VolumeDependencyTests-1064398708 None] Lock "cinder-3d1ed4d9-fe79-4e22-93ab-b2416a92a575-delete_volume" released by "delete_volume" :: held 1.170s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:34:27 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-2977ad16-6a30-4f1c-9825-04bbd86fc3ab tempest-VolumeDependencyTests-1064398708 None] Lock "cinder-25b3512e-2596-4d71-a0f6-3efa1896eace-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:34:27 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-2977ad16-6a30-4f1c-9825-04bbd86fc3ab tempest-VolumeDependencyTests-1064398708 None] Acquiring lock "cinder-quobyte-25b3512e-2596-4d71-a0f6-3efa1896eace" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:34:28 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-2977ad16-6a30-4f1c-9825-04bbd86fc3ab tempest-VolumeDependencyTests-1064398708 None] Lock "cinder-quobyte-25b3512e-2596-4d71-a0f6-3efa1896eace" acquired by "delete_volume" :: waited 0.022s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:34:28 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[74e03f64-4c1b-4cec-b917-36efa656b698]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:34:28 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-2977ad16-6a30-4f1c-9825-04bbd86fc3ab tempest-VolumeDependencyTests-1064398708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-25b3512e-2596-4d71-a0f6-3efa1896eace {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:34:28 devstack sudo[110168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-25b3512e-2596-4d71-a0f6-3efa1896eace Jul 31 12:34:28 devstack sudo[110168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:34:28 devstack sudo[110168]: pam_unix(sudo:session): session closed for user root Jul 31 12:34:28 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-2977ad16-6a30-4f1c-9825-04bbd86fc3ab tempest-VolumeDependencyTests-1064398708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-25b3512e-2596-4d71-a0f6-3efa1896eace" returned: 0 in 0.374s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:34:28 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-2977ad16-6a30-4f1c-9825-04bbd86fc3ab tempest-VolumeDependencyTests-1064398708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-25b3512e-2596-4d71-a0f6-3efa1896eace {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:34:28 devstack sudo[110173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-25b3512e-2596-4d71-a0f6-3efa1896eace Jul 31 12:34:28 devstack sudo[110173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:34:28 devstack sudo[110173]: pam_unix(sudo:session): session closed for user root Jul 31 12:34:28 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-2977ad16-6a30-4f1c-9825-04bbd86fc3ab tempest-VolumeDependencyTests-1064398708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-25b3512e-2596-4d71-a0f6-3efa1896eace" returned: 0 in 0.261s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:34:28 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-2977ad16-6a30-4f1c-9825-04bbd86fc3ab tempest-VolumeDependencyTests-1064398708 None] Lock "cinder-quobyte-25b3512e-2596-4d71-a0f6-3efa1896eace" released by "delete_volume" :: held 0.682s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:34:28 devstack cinder-volume[89182]: DEBUG cinder.quota [None req-2977ad16-6a30-4f1c-9825-04bbd86fc3ab tempest-VolumeDependencyTests-1064398708 None] Created reservations ['444d0d13-7a63-4a04-86d7-a89dcc1a92c3', '2b03f4e0-7314-4dc7-9b90-152809520abd', 'd7951c6a-30f6-4dfa-bbca-130679f88345', '11955973-de5d-42ae-b0ca-160225d6491f'] {{(pid=89182) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 12:34:28 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-2977ad16-6a30-4f1c-9825-04bbd86fc3ab tempest-VolumeDependencyTests-1064398708 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:34:28 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-2977ad16-6a30-4f1c-9825-04bbd86fc3ab tempest-VolumeDependencyTests-1064398708 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:34:28 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-2977ad16-6a30-4f1c-9825-04bbd86fc3ab tempest-VolumeDependencyTests-1064398708 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:34:28 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-2977ad16-6a30-4f1c-9825-04bbd86fc3ab tempest-VolumeDependencyTests-1064398708 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:34:28 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-2977ad16-6a30-4f1c-9825-04bbd86fc3ab tempest-VolumeDependencyTests-1064398708 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:34:28 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-2977ad16-6a30-4f1c-9825-04bbd86fc3ab tempest-VolumeDependencyTests-1064398708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:34:28 devstack sudo[110176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 Jul 31 12:34:28 devstack sudo[110176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:34:29 devstack sudo[110176]: pam_unix(sudo:session): session closed for user root Jul 31 12:34:29 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-2977ad16-6a30-4f1c-9825-04bbd86fc3ab tempest-VolumeDependencyTests-1064398708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2" returned: 0 in 0.256s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:34:29 devstack cinder-volume[89182]: DEBUG cinder.manager [None req-2977ad16-6a30-4f1c-9825-04bbd86fc3ab tempest-VolumeDependencyTests-1064398708 None] Notifying Schedulers of capabilities ... {{(pid=89182) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 12:34:29 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-2977ad16-6a30-4f1c-9825-04bbd86fc3ab tempest-VolumeDependencyTests-1064398708 None] Deleted volume successfully. Jul 31 12:34:29 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-2977ad16-6a30-4f1c-9825-04bbd86fc3ab tempest-VolumeDependencyTests-1064398708 None] Lock "cinder-25b3512e-2596-4d71-a0f6-3efa1896eace-delete_volume" released by "delete_volume" :: held 1.163s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:34:29 devstack cinder-volume[89182]: DEBUG cinder.volume.flows.manager.create_volume [None req-451f45ce-e859-49c1-88ae-8d22facebd42 tempest-VolumeDependencyTests-1064398708 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89182) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 12:34:29 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-451f45ce-e859-49c1-88ae-8d22facebd42 tempest-VolumeDependencyTests-1064398708 None] Flow 'volume_create_manager' (a236b467-063b-4918-96bb-05140cd212bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:34:29 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-451f45ce-e859-49c1-88ae-8d22facebd42 tempest-VolumeDependencyTests-1064398708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (048859e5-d29a-42eb-8155-6307e7150bc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:34:29 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-451f45ce-e859-49c1-88ae-8d22facebd42 tempest-VolumeDependencyTests-1064398708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (048859e5-d29a-42eb-8155-6307e7150bc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:34:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-810196629',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87eacf0b-c8b8-46e9-9a62-91756ec23f1f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af5708b20f594719a09679b9f56f242f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:34:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:34:29Z,use_quota=True,user_id='3fad3d5c7d5b44e6b70fa58e652f1cd2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:34:29 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-451f45ce-e859-49c1-88ae-8d22facebd42 tempest-VolumeDependencyTests-1064398708 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f24a1227-b57b-403f-8713-e8ac591e3997) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:34:29 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-451f45ce-e859-49c1-88ae-8d22facebd42 tempest-VolumeDependencyTests-1064398708 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f24a1227-b57b-403f-8713-e8ac591e3997) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:34:29 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-451f45ce-e859-49c1-88ae-8d22facebd42 tempest-VolumeDependencyTests-1064398708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7a9a503-9a89-4e60-9c93-6ea1d725721c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:34:29 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-451f45ce-e859-49c1-88ae-8d22facebd42 tempest-VolumeDependencyTests-1064398708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7a9a503-9a89-4e60-9c93-6ea1d725721c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '87eacf0b-c8b8-46e9-9a62-91756ec23f1f', 'volume_name': 'volume-87eacf0b-c8b8-46e9-9a62-91756ec23f1f', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:34:29 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-451f45ce-e859-49c1-88ae-8d22facebd42 tempest-VolumeDependencyTests-1064398708 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22becea5-5213-4174-8e71-50e7ca9064f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:34:29 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-451f45ce-e859-49c1-88ae-8d22facebd42 tempest-VolumeDependencyTests-1064398708 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22becea5-5213-4174-8e71-50e7ca9064f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:34:29 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-451f45ce-e859-49c1-88ae-8d22facebd42 tempest-VolumeDependencyTests-1064398708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a61e514-bbbe-47e5-9498-1562a728bb85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:34:29 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-451f45ce-e859-49c1-88ae-8d22facebd42 tempest-VolumeDependencyTests-1064398708 None] Volume 87eacf0b-c8b8-46e9-9a62-91756ec23f1f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-87eacf0b-c8b8-46e9-9a62-91756ec23f1f', 'volume_size': 1} Jul 31 12:34:29 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-451f45ce-e859-49c1-88ae-8d22facebd42 tempest-VolumeDependencyTests-1064398708 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:34:29 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-451f45ce-e859-49c1-88ae-8d22facebd42 tempest-VolumeDependencyTests-1064398708 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:34:29 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-451f45ce-e859-49c1-88ae-8d22facebd42 tempest-VolumeDependencyTests-1064398708 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:34:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-810196629',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87eacf0b-c8b8-46e9-9a62-91756ec23f1f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af5708b20f594719a09679b9f56f242f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:34:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:34:29Z,use_quota=True,user_id='3fad3d5c7d5b44e6b70fa58e652f1cd2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)}" {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 12:34:29 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-451f45ce-e859-49c1-88ae-8d22facebd42 tempest-VolumeDependencyTests-1064398708 None] Creating volume 87eacf0b-c8b8-46e9-9a62-91756ec23f1f {{(pid=89182) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 12:34:29 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-451f45ce-e859-49c1-88ae-8d22facebd42 tempest-VolumeDependencyTests-1064398708 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:34:29 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-451f45ce-e859-49c1-88ae-8d22facebd42 tempest-VolumeDependencyTests-1064398708 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:34:29 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-451f45ce-e859-49c1-88ae-8d22facebd42 tempest-VolumeDependencyTests-1064398708 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:34:29 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-451f45ce-e859-49c1-88ae-8d22facebd42 tempest-VolumeDependencyTests-1064398708 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:34:29 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-451f45ce-e859-49c1-88ae-8d22facebd42 tempest-VolumeDependencyTests-1064398708 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:34:29 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-451f45ce-e859-49c1-88ae-8d22facebd42 tempest-VolumeDependencyTests-1064398708 None] Selected osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 as target Quobyte volume. {{(pid=89182) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 12:34:29 devstack cinder-volume[89182]: INFO cinder.volume.drivers.remotefs [None req-451f45ce-e859-49c1-88ae-8d22facebd42 tempest-VolumeDependencyTests-1064398708 None] casted to osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 Jul 31 12:34:29 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-451f45ce-e859-49c1-88ae-8d22facebd42 tempest-VolumeDependencyTests-1064398708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-87eacf0b-c8b8-46e9-9a62-91756ec23f1f 1073741824 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:34:29 devstack sudo[110179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-87eacf0b-c8b8-46e9-9a62-91756ec23f1f 1073741824 Jul 31 12:34:29 devstack sudo[110179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:34:30 devstack sudo[110179]: pam_unix(sudo:session): session closed for user root Jul 31 12:34:30 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-451f45ce-e859-49c1-88ae-8d22facebd42 tempest-VolumeDependencyTests-1064398708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-87eacf0b-c8b8-46e9-9a62-91756ec23f1f 1073741824" returned: 0 in 0.418s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:34:30 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-451f45ce-e859-49c1-88ae-8d22facebd42 tempest-VolumeDependencyTests-1064398708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-87eacf0b-c8b8-46e9-9a62-91756ec23f1f {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:34:30 devstack sudo[110184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-87eacf0b-c8b8-46e9-9a62-91756ec23f1f Jul 31 12:34:30 devstack sudo[110184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:34:30 devstack sudo[110184]: pam_unix(sudo:session): session closed for user root Jul 31 12:34:30 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-451f45ce-e859-49c1-88ae-8d22facebd42 tempest-VolumeDependencyTests-1064398708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-87eacf0b-c8b8-46e9-9a62-91756ec23f1f" returned: 0 in 0.246s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:34:30 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-451f45ce-e859-49c1-88ae-8d22facebd42 tempest-VolumeDependencyTests-1064398708 None] <== create_volume: return (704ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'} {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 12:34:30 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-451f45ce-e859-49c1-88ae-8d22facebd42 tempest-VolumeDependencyTests-1064398708 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.708s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:34:30 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-451f45ce-e859-49c1-88ae-8d22facebd42 tempest-VolumeDependencyTests-1064398708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a61e514-bbbe-47e5-9498-1562a728bb85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-87eacf0b-c8b8-46e9-9a62-91756ec23f1f', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:34:30 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-451f45ce-e859-49c1-88ae-8d22facebd42 tempest-VolumeDependencyTests-1064398708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2357bb6-3b22-4a10-8640-a1d2e541107c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:34:30 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-451f45ce-e859-49c1-88ae-8d22facebd42 tempest-VolumeDependencyTests-1064398708 None] Volume volume-87eacf0b-c8b8-46e9-9a62-91756ec23f1f (87eacf0b-c8b8-46e9-9a62-91756ec23f1f): created successfully Jul 31 12:34:30 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-451f45ce-e859-49c1-88ae-8d22facebd42 tempest-VolumeDependencyTests-1064398708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2357bb6-3b22-4a10-8640-a1d2e541107c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:34:30 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-451f45ce-e859-49c1-88ae-8d22facebd42 tempest-VolumeDependencyTests-1064398708 None] Flow 'volume_create_manager' (a236b467-063b-4918-96bb-05140cd212bd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:34:30 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-451f45ce-e859-49c1-88ae-8d22facebd42 tempest-VolumeDependencyTests-1064398708 None] Created volume successfully. Jul 31 12:34:30 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-416ef20c-3325-4f45-8b2b-8719f28659cd tempest-VolumeDependencyTests-1064398708 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:34:30 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-416ef20c-3325-4f45-8b2b-8719f28659cd tempest-VolumeDependencyTests-1064398708 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:34:30 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-416ef20c-3325-4f45-8b2b-8719f28659cd tempest-VolumeDependencyTests-1064398708 None] Creating offline snapshot 601daa67-8839-4f35-bcf7-3e3b8be7405a of volume 87eacf0b-c8b8-46e9-9a62-91756ec23f1f {{(pid=89182) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 31 12:34:30 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab901be7-ae9a-493e-bb3f-6993c174e807]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:34:30 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-416ef20c-3325-4f45-8b2b-8719f28659cd tempest-VolumeDependencyTests-1064398708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-87eacf0b-c8b8-46e9-9a62-91756ec23f1f {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:34:30 devstack sudo[110189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-87eacf0b-c8b8-46e9-9a62-91756ec23f1f Jul 31 12:34:30 devstack sudo[110189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:34:31 devstack sudo[110189]: pam_unix(sudo:session): session closed for user root Jul 31 12:34:31 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-416ef20c-3325-4f45-8b2b-8719f28659cd tempest-VolumeDependencyTests-1064398708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-87eacf0b-c8b8-46e9-9a62-91756ec23f1f" returned: 0 in 0.369s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:34:31 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-416ef20c-3325-4f45-8b2b-8719f28659cd tempest-VolumeDependencyTests-1064398708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-87eacf0b-c8b8-46e9-9a62-91756ec23f1f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-87eacf0b-c8b8-46e9-9a62-91756ec23f1f.601daa67-8839-4f35-bcf7-3e3b8be7405a 1G {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:34:31 devstack sudo[110194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-87eacf0b-c8b8-46e9-9a62-91756ec23f1f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-87eacf0b-c8b8-46e9-9a62-91756ec23f1f.601daa67-8839-4f35-bcf7-3e3b8be7405a 1G Jul 31 12:34:31 devstack sudo[110194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:34:31 devstack cinder-volume[89182]: DEBUG cinder.volume.flows.manager.create_volume [None req-cadc1b56-8884-4916-8d62-d05cf3186a29 tempest-TestServerVolumeAttachScenarioOldVersion-771386810 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89182) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 12:34:31 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-cadc1b56-8884-4916-8d62-d05cf3186a29 tempest-TestServerVolumeAttachScenarioOldVersion-771386810 None] Flow 'volume_create_manager' (e9e82737-b6ee-412b-9367-ae53c1812aa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:34:31 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-cadc1b56-8884-4916-8d62-d05cf3186a29 tempest-TestServerVolumeAttachScenarioOldVersion-771386810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c5bf4ad-a46d-4994-9161-bca250b31d71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:34:31 devstack sudo[110194]: pam_unix(sudo:session): session closed for user root Jul 31 12:34:31 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-cadc1b56-8884-4916-8d62-d05cf3186a29 tempest-TestServerVolumeAttachScenarioOldVersion-771386810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c5bf4ad-a46d-4994-9161-bca250b31d71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:34:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1437400732',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10789936-e840-4f44-bd5a-98c4654b6ec6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf4c302510e74b43ac4e305852d04d88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:34:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:34:31Z,use_quota=True,user_id='7095d65779d142e8a9a4a59f616058c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:34:31 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-cadc1b56-8884-4916-8d62-d05cf3186a29 tempest-TestServerVolumeAttachScenarioOldVersion-771386810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a64be3d8-2da5-465e-8f37-2dbc25ed8858) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:34:31 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-cadc1b56-8884-4916-8d62-d05cf3186a29 tempest-TestServerVolumeAttachScenarioOldVersion-771386810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a64be3d8-2da5-465e-8f37-2dbc25ed8858) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:34:31 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-cadc1b56-8884-4916-8d62-d05cf3186a29 tempest-TestServerVolumeAttachScenarioOldVersion-771386810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42985810-12bf-4b6f-888a-4b20dbde6d18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:34:31 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-cadc1b56-8884-4916-8d62-d05cf3186a29 tempest-TestServerVolumeAttachScenarioOldVersion-771386810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42985810-12bf-4b6f-888a-4b20dbde6d18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '10789936-e840-4f44-bd5a-98c4654b6ec6', 'volume_name': 'volume-10789936-e840-4f44-bd5a-98c4654b6ec6', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:34:31 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-cadc1b56-8884-4916-8d62-d05cf3186a29 tempest-TestServerVolumeAttachScenarioOldVersion-771386810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c10331ce-5c1d-44cc-8567-318e9f08f527) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:34:31 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-cadc1b56-8884-4916-8d62-d05cf3186a29 tempest-TestServerVolumeAttachScenarioOldVersion-771386810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c10331ce-5c1d-44cc-8567-318e9f08f527) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:34:31 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-cadc1b56-8884-4916-8d62-d05cf3186a29 tempest-TestServerVolumeAttachScenarioOldVersion-771386810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f593f7d5-9a90-448e-88ef-8216b7055ef5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:34:31 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-cadc1b56-8884-4916-8d62-d05cf3186a29 tempest-TestServerVolumeAttachScenarioOldVersion-771386810 None] Volume 10789936-e840-4f44-bd5a-98c4654b6ec6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-10789936-e840-4f44-bd5a-98c4654b6ec6', 'volume_size': 1} Jul 31 12:34:31 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-cadc1b56-8884-4916-8d62-d05cf3186a29 tempest-TestServerVolumeAttachScenarioOldVersion-771386810 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:34:31 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-416ef20c-3325-4f45-8b2b-8719f28659cd tempest-VolumeDependencyTests-1064398708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-87eacf0b-c8b8-46e9-9a62-91756ec23f1f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-87eacf0b-c8b8-46e9-9a62-91756ec23f1f.601daa67-8839-4f35-bcf7-3e3b8be7405a 1G" returned: 0 in 0.478s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:34:31 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-416ef20c-3325-4f45-8b2b-8719f28659cd tempest-VolumeDependencyTests-1064398708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-87eacf0b-c8b8-46e9-9a62-91756ec23f1f -F qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-87eacf0b-c8b8-46e9-9a62-91756ec23f1f.601daa67-8839-4f35-bcf7-3e3b8be7405a {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:34:31 devstack sudo[110200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-87eacf0b-c8b8-46e9-9a62-91756ec23f1f -F qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-87eacf0b-c8b8-46e9-9a62-91756ec23f1f.601daa67-8839-4f35-bcf7-3e3b8be7405a Jul 31 12:34:31 devstack sudo[110200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:34:31 devstack sudo[110200]: pam_unix(sudo:session): session closed for user root Jul 31 12:34:31 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-416ef20c-3325-4f45-8b2b-8719f28659cd tempest-VolumeDependencyTests-1064398708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-87eacf0b-c8b8-46e9-9a62-91756ec23f1f -F qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-87eacf0b-c8b8-46e9-9a62-91756ec23f1f.601daa67-8839-4f35-bcf7-3e3b8be7405a" returned: 0 in 0.307s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:34:31 devstack cinder-volume[89182]: WARNING cinder.volume.drivers.remotefs [None req-416ef20c-3325-4f45-8b2b-8719f28659cd tempest-VolumeDependencyTests-1064398708 None] /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-87eacf0b-c8b8-46e9-9a62-91756ec23f1f.601daa67-8839-4f35-bcf7-3e3b8be7405a is being set with open permissions: ugo+rw Jul 31 12:34:31 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-416ef20c-3325-4f45-8b2b-8719f28659cd tempest-VolumeDependencyTests-1064398708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-87eacf0b-c8b8-46e9-9a62-91756ec23f1f.601daa67-8839-4f35-bcf7-3e3b8be7405a {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:34:31 devstack sudo[110205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-87eacf0b-c8b8-46e9-9a62-91756ec23f1f.601daa67-8839-4f35-bcf7-3e3b8be7405a Jul 31 12:34:31 devstack sudo[110205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:34:32 devstack sudo[110205]: pam_unix(sudo:session): session closed for user root Jul 31 12:34:32 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-416ef20c-3325-4f45-8b2b-8719f28659cd tempest-VolumeDependencyTests-1064398708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-87eacf0b-c8b8-46e9-9a62-91756ec23f1f.601daa67-8839-4f35-bcf7-3e3b8be7405a" returned: 0 in 0.251s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:34:32 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-416ef20c-3325-4f45-8b2b-8719f28659cd tempest-VolumeDependencyTests-1064398708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-87eacf0b-c8b8-46e9-9a62-91756ec23f1f.info {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:34:32 devstack sudo[110208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-87eacf0b-c8b8-46e9-9a62-91756ec23f1f.info Jul 31 12:34:32 devstack sudo[110208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:34:32 devstack sudo[110208]: pam_unix(sudo:session): session closed for user root Jul 31 12:34:32 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-416ef20c-3325-4f45-8b2b-8719f28659cd tempest-VolumeDependencyTests-1064398708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-87eacf0b-c8b8-46e9-9a62-91756ec23f1f.info" returned: 0 in 0.251s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:34:32 devstack cinder-volume[89182]: WARNING cinder.volume.drivers.remotefs [None req-416ef20c-3325-4f45-8b2b-8719f28659cd tempest-VolumeDependencyTests-1064398708 None] /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-87eacf0b-c8b8-46e9-9a62-91756ec23f1f.info is being set with open permissions: ugo+rw Jul 31 12:34:32 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-416ef20c-3325-4f45-8b2b-8719f28659cd tempest-VolumeDependencyTests-1064398708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-87eacf0b-c8b8-46e9-9a62-91756ec23f1f.info {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:34:32 devstack sudo[110211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-87eacf0b-c8b8-46e9-9a62-91756ec23f1f.info Jul 31 12:34:32 devstack sudo[110211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:34:32 devstack sudo[110211]: pam_unix(sudo:session): session closed for user root Jul 31 12:34:32 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-416ef20c-3325-4f45-8b2b-8719f28659cd tempest-VolumeDependencyTests-1064398708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-87eacf0b-c8b8-46e9-9a62-91756ec23f1f.info" returned: 0 in 0.248s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:34:32 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-416ef20c-3325-4f45-8b2b-8719f28659cd tempest-VolumeDependencyTests-1064398708 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.999s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:34:32 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-cadc1b56-8884-4916-8d62-d05cf3186a29 tempest-TestServerVolumeAttachScenarioOldVersion-771386810 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.112s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:34:32 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-cadc1b56-8884-4916-8d62-d05cf3186a29 tempest-TestServerVolumeAttachScenarioOldVersion-771386810 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:34:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1437400732',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10789936-e840-4f44-bd5a-98c4654b6ec6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf4c302510e74b43ac4e305852d04d88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:34:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:34:31Z,use_quota=True,user_id='7095d65779d142e8a9a4a59f616058c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)}" {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 12:34:32 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-cadc1b56-8884-4916-8d62-d05cf3186a29 tempest-TestServerVolumeAttachScenarioOldVersion-771386810 None] Creating volume 10789936-e840-4f44-bd5a-98c4654b6ec6 {{(pid=89182) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 12:34:32 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-cadc1b56-8884-4916-8d62-d05cf3186a29 tempest-TestServerVolumeAttachScenarioOldVersion-771386810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:34:32 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-cadc1b56-8884-4916-8d62-d05cf3186a29 tempest-TestServerVolumeAttachScenarioOldVersion-771386810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:34:32 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-cadc1b56-8884-4916-8d62-d05cf3186a29 tempest-TestServerVolumeAttachScenarioOldVersion-771386810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:34:32 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-cadc1b56-8884-4916-8d62-d05cf3186a29 tempest-TestServerVolumeAttachScenarioOldVersion-771386810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:34:32 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-cadc1b56-8884-4916-8d62-d05cf3186a29 tempest-TestServerVolumeAttachScenarioOldVersion-771386810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:34:32 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-cadc1b56-8884-4916-8d62-d05cf3186a29 tempest-TestServerVolumeAttachScenarioOldVersion-771386810 None] Selected osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 as target Quobyte volume. {{(pid=89182) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 12:34:32 devstack cinder-volume[89182]: INFO cinder.volume.drivers.remotefs [None req-cadc1b56-8884-4916-8d62-d05cf3186a29 tempest-TestServerVolumeAttachScenarioOldVersion-771386810 None] casted to osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 Jul 31 12:34:32 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-cadc1b56-8884-4916-8d62-d05cf3186a29 tempest-TestServerVolumeAttachScenarioOldVersion-771386810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-10789936-e840-4f44-bd5a-98c4654b6ec6 1073741824 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:34:32 devstack sudo[110214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-10789936-e840-4f44-bd5a-98c4654b6ec6 1073741824 Jul 31 12:34:32 devstack sudo[110214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:34:32 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-416ef20c-3325-4f45-8b2b-8719f28659cd tempest-VolumeDependencyTests-1064398708 None] Create snapshot completed successfully Jul 31 12:34:33 devstack sudo[110214]: pam_unix(sudo:session): session closed for user root Jul 31 12:34:33 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-cadc1b56-8884-4916-8d62-d05cf3186a29 tempest-TestServerVolumeAttachScenarioOldVersion-771386810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-10789936-e840-4f44-bd5a-98c4654b6ec6 1073741824" returned: 0 in 0.404s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:34:33 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-cadc1b56-8884-4916-8d62-d05cf3186a29 tempest-TestServerVolumeAttachScenarioOldVersion-771386810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-10789936-e840-4f44-bd5a-98c4654b6ec6 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:34:33 devstack sudo[110220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-10789936-e840-4f44-bd5a-98c4654b6ec6 Jul 31 12:34:33 devstack sudo[110220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:34:33 devstack sudo[110220]: pam_unix(sudo:session): session closed for user root Jul 31 12:34:33 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-cadc1b56-8884-4916-8d62-d05cf3186a29 tempest-TestServerVolumeAttachScenarioOldVersion-771386810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-10789936-e840-4f44-bd5a-98c4654b6ec6" returned: 0 in 0.238s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:34:33 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-cadc1b56-8884-4916-8d62-d05cf3186a29 tempest-TestServerVolumeAttachScenarioOldVersion-771386810 None] <== create_volume: return (679ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'} {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 12:34:33 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-cadc1b56-8884-4916-8d62-d05cf3186a29 tempest-TestServerVolumeAttachScenarioOldVersion-771386810 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.682s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:34:33 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-cadc1b56-8884-4916-8d62-d05cf3186a29 tempest-TestServerVolumeAttachScenarioOldVersion-771386810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f593f7d5-9a90-448e-88ef-8216b7055ef5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-10789936-e840-4f44-bd5a-98c4654b6ec6', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:34:33 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-cadc1b56-8884-4916-8d62-d05cf3186a29 tempest-TestServerVolumeAttachScenarioOldVersion-771386810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (051d2d18-876d-4936-b76d-cd844ff373ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:34:33 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-cadc1b56-8884-4916-8d62-d05cf3186a29 tempest-TestServerVolumeAttachScenarioOldVersion-771386810 None] Volume volume-10789936-e840-4f44-bd5a-98c4654b6ec6 (10789936-e840-4f44-bd5a-98c4654b6ec6): created successfully Jul 31 12:34:33 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-cadc1b56-8884-4916-8d62-d05cf3186a29 tempest-TestServerVolumeAttachScenarioOldVersion-771386810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (051d2d18-876d-4936-b76d-cd844ff373ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:34:33 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-cadc1b56-8884-4916-8d62-d05cf3186a29 tempest-TestServerVolumeAttachScenarioOldVersion-771386810 None] Flow 'volume_create_manager' (e9e82737-b6ee-412b-9367-ae53c1812aa2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:34:33 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-cadc1b56-8884-4916-8d62-d05cf3186a29 tempest-TestServerVolumeAttachScenarioOldVersion-771386810 None] Created volume successfully. Jul 31 12:34:34 devstack cinder-volume[89182]: DEBUG dbcounter [-] [89182] Writing DB stats cinder:SELECT=100,cinder:UPDATE=132,cinder:DELETE=13,cinder:INSERT=30 {{(pid=89182) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 12:34:34 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [req-11140fc0-4a65-4ca0-a446-fd5f2f7c0620 req-4474f58b-a662-4c9f-8f99-8d6c8e0b6579 tempest-TestServerVolumeAttachScenarioOldVersion-771386810 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:34:34 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [req-11140fc0-4a65-4ca0-a446-fd5f2f7c0620 req-4474f58b-a662-4c9f-8f99-8d6c8e0b6579 tempest-TestServerVolumeAttachScenarioOldVersion-771386810 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:34:34 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [req-11140fc0-4a65-4ca0-a446-fd5f2f7c0620 req-4474f58b-a662-4c9f-8f99-8d6c8e0b6579 tempest-TestServerVolumeAttachScenarioOldVersion-771386810 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:34:34 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [req-11140fc0-4a65-4ca0-a446-fd5f2f7c0620 req-4474f58b-a662-4c9f-8f99-8d6c8e0b6579 tempest-TestServerVolumeAttachScenarioOldVersion-771386810 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88', 'name': 'volume-10789936-e840-4f44-bd5a-98c4654b6ec6', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a3793b88-33ca-4aff-a20d-12adbe04d54e', 'enforce_multipath': True} {{(pid=89182) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 31 12:34:34 devstack cinder-volume[89182]: DEBUG cinder.volume.flows.manager.create_volume [None req-bdb8acaf-def7-432c-97ef-df2d0e62eb98 tempest-VolumeDependencyTests-1064398708 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89182) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 12:34:34 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-bdb8acaf-def7-432c-97ef-df2d0e62eb98 tempest-VolumeDependencyTests-1064398708 None] Flow 'volume_create_manager' (86dc3a8b-43af-4970-b900-db0decdf77d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:34:34 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-bdb8acaf-def7-432c-97ef-df2d0e62eb98 tempest-VolumeDependencyTests-1064398708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6c735b0-e641-4c23-a185-4cd8a9aee9c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:34:34 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-bdb8acaf-def7-432c-97ef-df2d0e62eb98 tempest-VolumeDependencyTests-1064398708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6c735b0-e641-4c23-a185-4cd8a9aee9c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:34:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-376314317',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7a1a7af-c1f3-4b21-be21-192cc0afcd51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af5708b20f594719a09679b9f56f242f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:34:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=601daa67-8839-4f35-bcf7-3e3b8be7405a,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:34:34Z,use_quota=True,user_id='3fad3d5c7d5b44e6b70fa58e652f1cd2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:34:34 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-bdb8acaf-def7-432c-97ef-df2d0e62eb98 tempest-VolumeDependencyTests-1064398708 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0bd4caf-852b-4a61-ba26-dd5b94a514c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:34:34 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-bdb8acaf-def7-432c-97ef-df2d0e62eb98 tempest-VolumeDependencyTests-1064398708 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0bd4caf-852b-4a61-ba26-dd5b94a514c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:34:34 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-bdb8acaf-def7-432c-97ef-df2d0e62eb98 tempest-VolumeDependencyTests-1064398708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d51bbd2e-9952-4478-972b-383837559ed4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:34:34 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-bdb8acaf-def7-432c-97ef-df2d0e62eb98 tempest-VolumeDependencyTests-1064398708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d51bbd2e-9952-4478-972b-383837559ed4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'e7a1a7af-c1f3-4b21-be21-192cc0afcd51', 'volume_name': 'volume-e7a1a7af-c1f3-4b21-be21-192cc0afcd51', 'volume_size': 1, 'snapshot_id': '601daa67-8839-4f35-bcf7-3e3b8be7405a'}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:34:34 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-bdb8acaf-def7-432c-97ef-df2d0e62eb98 tempest-VolumeDependencyTests-1064398708 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33a93127-c563-4e32-bedf-7bf90068d03f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:34:34 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-bdb8acaf-def7-432c-97ef-df2d0e62eb98 tempest-VolumeDependencyTests-1064398708 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33a93127-c563-4e32-bedf-7bf90068d03f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:34:34 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-bdb8acaf-def7-432c-97ef-df2d0e62eb98 tempest-VolumeDependencyTests-1064398708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8e4fda5-6a29-405f-9724-e30a4fafd594) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:34:34 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-bdb8acaf-def7-432c-97ef-df2d0e62eb98 tempest-VolumeDependencyTests-1064398708 None] Volume e7a1a7af-c1f3-4b21-be21-192cc0afcd51: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-e7a1a7af-c1f3-4b21-be21-192cc0afcd51', 'volume_size': 1, 'snapshot_id': '601daa67-8839-4f35-bcf7-3e3b8be7405a'} Jul 31 12:34:34 devstack cinder-volume[89182]: DEBUG dbcounter [-] [89182] Writing DB stats cinder:SELECT=113,cinder:UPDATE=135,cinder:INSERT=35,cinder:DELETE=12 {{(pid=89182) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 12:34:34 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-bdb8acaf-def7-432c-97ef-df2d0e62eb98 tempest-VolumeDependencyTests-1064398708 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:34:34 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-bdb8acaf-def7-432c-97ef-df2d0e62eb98 tempest-VolumeDependencyTests-1064398708 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:34:34 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-bdb8acaf-def7-432c-97ef-df2d0e62eb98 tempest-VolumeDependencyTests-1064398708 None] Acquiring lock "cinder-quobyte-601daa67-8839-4f35-bcf7-3e3b8be7405a-e7a1a7af-c1f3-4b21-be21-192cc0afcd51" by "_create_volume_from_snapshot" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:34:34 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-bdb8acaf-def7-432c-97ef-df2d0e62eb98 tempest-VolumeDependencyTests-1064398708 None] Lock "cinder-quobyte-601daa67-8839-4f35-bcf7-3e3b8be7405a-e7a1a7af-c1f3-4b21-be21-192cc0afcd51" acquired by "_create_volume_from_snapshot" :: waited 0.019s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:34:34 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-bdb8acaf-def7-432c-97ef-df2d0e62eb98 tempest-VolumeDependencyTests-1064398708 None] Creating volume e7a1a7af-c1f3-4b21-be21-192cc0afcd51 from snapshot 601daa67-8839-4f35-bcf7-3e3b8be7405a {{(pid=89182) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 31 12:34:34 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-bdb8acaf-def7-432c-97ef-df2d0e62eb98 tempest-VolumeDependencyTests-1064398708 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:34:34 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-bdb8acaf-def7-432c-97ef-df2d0e62eb98 tempest-VolumeDependencyTests-1064398708 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:34:34 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-bdb8acaf-def7-432c-97ef-df2d0e62eb98 tempest-VolumeDependencyTests-1064398708 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:34:34 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-bdb8acaf-def7-432c-97ef-df2d0e62eb98 tempest-VolumeDependencyTests-1064398708 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:34:34 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-bdb8acaf-def7-432c-97ef-df2d0e62eb98 tempest-VolumeDependencyTests-1064398708 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:34:34 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-bdb8acaf-def7-432c-97ef-df2d0e62eb98 tempest-VolumeDependencyTests-1064398708 None] Selected osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 as target Quobyte volume. {{(pid=89182) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 12:34:34 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-bdb8acaf-def7-432c-97ef-df2d0e62eb98 tempest-VolumeDependencyTests-1064398708 None] Acquiring lock "cinder-quobyte-e7a1a7af-c1f3-4b21-be21-192cc0afcd51" by "_copy_volume_from_snapshot" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:34:34 devstack cinder-volume[89182]: INFO cinder.volume.manager [req-11140fc0-4a65-4ca0-a446-fd5f2f7c0620 req-4474f58b-a662-4c9f-8f99-8d6c8e0b6579 tempest-TestServerVolumeAttachScenarioOldVersion-771386810 None] attachment_update completed successfully. Jul 31 12:34:34 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-bdb8acaf-def7-432c-97ef-df2d0e62eb98 tempest-VolumeDependencyTests-1064398708 None] Lock "cinder-quobyte-e7a1a7af-c1f3-4b21-be21-192cc0afcd51" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:34:34 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-bdb8acaf-def7-432c-97ef-df2d0e62eb98 tempest-VolumeDependencyTests-1064398708 None] snapshot: 601daa67-8839-4f35-bcf7-3e3b8be7405a, volume: e7a1a7af-c1f3-4b21-be21-192cc0afcd51, {{(pid=89182) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Jul 31 12:34:34 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-bdb8acaf-def7-432c-97ef-df2d0e62eb98 tempest-VolumeDependencyTests-1064398708 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:34:34 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-bdb8acaf-def7-432c-97ef-df2d0e62eb98 tempest-VolumeDependencyTests-1064398708 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:34:34 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-bdb8acaf-def7-432c-97ef-df2d0e62eb98 tempest-VolumeDependencyTests-1064398708 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:34:34 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-bdb8acaf-def7-432c-97ef-df2d0e62eb98 tempest-VolumeDependencyTests-1064398708 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:34:34 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-bdb8acaf-def7-432c-97ef-df2d0e62eb98 tempest-VolumeDependencyTests-1064398708 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:34:34 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[45e32f87-eeb4-405f-a942-78d9f8e4b327]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:34:34 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-bdb8acaf-def7-432c-97ef-df2d0e62eb98 tempest-VolumeDependencyTests-1064398708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-87eacf0b-c8b8-46e9-9a62-91756ec23f1f.601daa67-8839-4f35-bcf7-3e3b8be7405a {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:34:34 devstack sudo[110235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-87eacf0b-c8b8-46e9-9a62-91756ec23f1f.601daa67-8839-4f35-bcf7-3e3b8be7405a Jul 31 12:34:34 devstack sudo[110235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:34:35 devstack sudo[110235]: pam_unix(sudo:session): session closed for user root Jul 31 12:34:35 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-bdb8acaf-def7-432c-97ef-df2d0e62eb98 tempest-VolumeDependencyTests-1064398708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-87eacf0b-c8b8-46e9-9a62-91756ec23f1f.601daa67-8839-4f35-bcf7-3e3b8be7405a" returned: 0 in 0.376s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:34:35 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-bdb8acaf-def7-432c-97ef-df2d0e62eb98 tempest-VolumeDependencyTests-1064398708 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-87eacf0b-c8b8-46e9-9a62-91756ec23f1f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89182) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 12:34:35 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[861bbaf2-f12b-41e8-8283-633b0eaef7ad]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:34:35 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-bdb8acaf-def7-432c-97ef-df2d0e62eb98 tempest-VolumeDependencyTests-1064398708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-87eacf0b-c8b8-46e9-9a62-91756ec23f1f {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:34:35 devstack sudo[110623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-87eacf0b-c8b8-46e9-9a62-91756ec23f1f Jul 31 12:34:35 devstack sudo[110623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:34:35 devstack sudo[110623]: pam_unix(sudo:session): session closed for user root Jul 31 12:34:35 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-bdb8acaf-def7-432c-97ef-df2d0e62eb98 tempest-VolumeDependencyTests-1064398708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-87eacf0b-c8b8-46e9-9a62-91756ec23f1f" returned: 0 in 0.412s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:34:35 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-bdb8acaf-def7-432c-97ef-df2d0e62eb98 tempest-VolumeDependencyTests-1064398708 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-87eacf0b-c8b8-46e9-9a62-91756ec23f1f {{(pid=89182) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Jul 31 12:34:35 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-bdb8acaf-def7-432c-97ef-df2d0e62eb98 tempest-VolumeDependencyTests-1064398708 None] Creating direct copy from snapshot {{(pid=89182) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Jul 31 12:34:35 devstack cinder-volume[89182]: DEBUG cinder.utils [None req-bdb8acaf-def7-432c-97ef-df2d0e62eb98 tempest-VolumeDependencyTests-1064398708 None] Path /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e7a1a7af-c1f3-4b21-be21-192cc0afcd51 not found in is_blk_device check {{(pid=89182) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 31 12:34:35 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-bdb8acaf-def7-432c-97ef-df2d0e62eb98 tempest-VolumeDependencyTests-1064398708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-87eacf0b-c8b8-46e9-9a62-91756ec23f1f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e7a1a7af-c1f3-4b21-be21-192cc0afcd51 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:34:35 devstack sudo[110630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-87eacf0b-c8b8-46e9-9a62-91756ec23f1f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e7a1a7af-c1f3-4b21-be21-192cc0afcd51 Jul 31 12:34:35 devstack sudo[110630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:34:39 devstack cinder-volume[89182]: INFO cinder.volume.manager [req-6a49b469-d674-4871-9f99-d22411f1b2c4 req-12df719d-5dc2-4fa9-9e08-1d84ff59aa9e tempest-TestServerVolumeAttachScenarioOldVersion-771386810 None] Terminate volume connection completed successfully. Jul 31 12:34:39 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [req-6a49b469-d674-4871-9f99-d22411f1b2c4 req-12df719d-5dc2-4fa9-9e08-1d84ff59aa9e tempest-TestServerVolumeAttachScenarioOldVersion-771386810 None] Deleting attachment a3793b88-33ca-4aff-a20d-12adbe04d54e. {{(pid=89182) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 31 12:34:39 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-533b3035-0db0-4d34-97df-25683d14c12a tempest-TestServerVolumeAttachScenarioOldVersion-771386810 None] Acquiring lock "cinder-10789936-e840-4f44-bd5a-98c4654b6ec6-delete_volume" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:34:40 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-533b3035-0db0-4d34-97df-25683d14c12a tempest-TestServerVolumeAttachScenarioOldVersion-771386810 None] Lock "cinder-10789936-e840-4f44-bd5a-98c4654b6ec6-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:34:40 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-533b3035-0db0-4d34-97df-25683d14c12a tempest-TestServerVolumeAttachScenarioOldVersion-771386810 None] Acquiring lock "cinder-quobyte-10789936-e840-4f44-bd5a-98c4654b6ec6" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:34:40 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-533b3035-0db0-4d34-97df-25683d14c12a tempest-TestServerVolumeAttachScenarioOldVersion-771386810 None] Lock "cinder-quobyte-10789936-e840-4f44-bd5a-98c4654b6ec6" acquired by "delete_volume" :: waited 0.037s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:34:40 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6a131ea-f6f8-4cc2-b814-0d4329b8750b]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:34:40 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-533b3035-0db0-4d34-97df-25683d14c12a tempest-TestServerVolumeAttachScenarioOldVersion-771386810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-10789936-e840-4f44-bd5a-98c4654b6ec6 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:34:40 devstack sudo[110676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-10789936-e840-4f44-bd5a-98c4654b6ec6 Jul 31 12:34:40 devstack sudo[110676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:34:40 devstack sudo[110630]: pam_unix(sudo:session): session closed for user root Jul 31 12:34:40 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-bdb8acaf-def7-432c-97ef-df2d0e62eb98 tempest-VolumeDependencyTests-1064398708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-87eacf0b-c8b8-46e9-9a62-91756ec23f1f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e7a1a7af-c1f3-4b21-be21-192cc0afcd51" returned: 0 in 4.940s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:34:40 devstack cinder-volume[89182]: DEBUG cinder.image.image_utils [None req-bdb8acaf-def7-432c-97ef-df2d0e62eb98 tempest-VolumeDependencyTests-1064398708 None] Image conversion details: src /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-87eacf0b-c8b8-46e9-9a62-91756ec23f1f, size 1024.00 MB, duration 4.94 sec, destination /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e7a1a7af-c1f3-4b21-be21-192cc0afcd51 {{(pid=89182) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 31 12:34:40 devstack cinder-volume[89182]: INFO cinder.image.image_utils [None req-bdb8acaf-def7-432c-97ef-df2d0e62eb98 tempest-VolumeDependencyTests-1064398708 None] Converted 1024.00 MB image at 207.23 MB/s Jul 31 12:34:40 devstack cinder-volume[89182]: WARNING cinder.volume.drivers.remotefs [None req-bdb8acaf-def7-432c-97ef-df2d0e62eb98 tempest-VolumeDependencyTests-1064398708 None] /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e7a1a7af-c1f3-4b21-be21-192cc0afcd51 is being set with open permissions: ugo+rw Jul 31 12:34:40 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-bdb8acaf-def7-432c-97ef-df2d0e62eb98 tempest-VolumeDependencyTests-1064398708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e7a1a7af-c1f3-4b21-be21-192cc0afcd51 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:34:40 devstack sudo[110678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e7a1a7af-c1f3-4b21-be21-192cc0afcd51 Jul 31 12:34:40 devstack sudo[110678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:34:40 devstack sudo[110676]: pam_unix(sudo:session): session closed for user root Jul 31 12:34:40 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-533b3035-0db0-4d34-97df-25683d14c12a tempest-TestServerVolumeAttachScenarioOldVersion-771386810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-10789936-e840-4f44-bd5a-98c4654b6ec6" returned: 0 in 0.432s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:34:40 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-533b3035-0db0-4d34-97df-25683d14c12a tempest-TestServerVolumeAttachScenarioOldVersion-771386810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-10789936-e840-4f44-bd5a-98c4654b6ec6 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:34:40 devstack sudo[110678]: pam_unix(sudo:session): session closed for user root Jul 31 12:34:40 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-bdb8acaf-def7-432c-97ef-df2d0e62eb98 tempest-VolumeDependencyTests-1064398708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e7a1a7af-c1f3-4b21-be21-192cc0afcd51" returned: 0 in 0.269s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:34:40 devstack sudo[110684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-10789936-e840-4f44-bd5a-98c4654b6ec6 Jul 31 12:34:40 devstack sudo[110684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:34:40 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-bdb8acaf-def7-432c-97ef-df2d0e62eb98 tempest-VolumeDependencyTests-1064398708 None] Lock "cinder-quobyte-e7a1a7af-c1f3-4b21-be21-192cc0afcd51" released by "_copy_volume_from_snapshot" :: held 6.092s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:34:40 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-bdb8acaf-def7-432c-97ef-df2d0e62eb98 tempest-VolumeDependencyTests-1064398708 None] Lock "cinder-quobyte-601daa67-8839-4f35-bcf7-3e3b8be7405a-e7a1a7af-c1f3-4b21-be21-192cc0afcd51" released by "_create_volume_from_snapshot" :: held 6.156s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:34:40 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-bdb8acaf-def7-432c-97ef-df2d0e62eb98 tempest-VolumeDependencyTests-1064398708 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.177s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:34:40 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-bdb8acaf-def7-432c-97ef-df2d0e62eb98 tempest-VolumeDependencyTests-1064398708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8e4fda5-6a29-405f-9724-e30a4fafd594) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e7a1a7af-c1f3-4b21-be21-192cc0afcd51', 'volume_size': 1, 'snapshot_id': '601daa67-8839-4f35-bcf7-3e3b8be7405a'}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:34:40 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-bdb8acaf-def7-432c-97ef-df2d0e62eb98 tempest-VolumeDependencyTests-1064398708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31d06ae8-77d7-4651-9043-9f74c6ca00d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:34:40 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-bdb8acaf-def7-432c-97ef-df2d0e62eb98 tempest-VolumeDependencyTests-1064398708 None] Volume volume-e7a1a7af-c1f3-4b21-be21-192cc0afcd51 (e7a1a7af-c1f3-4b21-be21-192cc0afcd51): created successfully Jul 31 12:34:40 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-bdb8acaf-def7-432c-97ef-df2d0e62eb98 tempest-VolumeDependencyTests-1064398708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31d06ae8-77d7-4651-9043-9f74c6ca00d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:34:40 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-bdb8acaf-def7-432c-97ef-df2d0e62eb98 tempest-VolumeDependencyTests-1064398708 None] Flow 'volume_create_manager' (86dc3a8b-43af-4970-b900-db0decdf77d4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:34:40 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-bdb8acaf-def7-432c-97ef-df2d0e62eb98 tempest-VolumeDependencyTests-1064398708 None] Created volume successfully. Jul 31 12:34:40 devstack sudo[110684]: pam_unix(sudo:session): session closed for user root Jul 31 12:34:40 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-533b3035-0db0-4d34-97df-25683d14c12a tempest-TestServerVolumeAttachScenarioOldVersion-771386810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-10789936-e840-4f44-bd5a-98c4654b6ec6" returned: 0 in 0.254s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:34:40 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-533b3035-0db0-4d34-97df-25683d14c12a tempest-TestServerVolumeAttachScenarioOldVersion-771386810 None] Lock "cinder-quobyte-10789936-e840-4f44-bd5a-98c4654b6ec6" released by "delete_volume" :: held 0.752s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:34:40 devstack cinder-volume[89182]: DEBUG cinder.quota [None req-533b3035-0db0-4d34-97df-25683d14c12a tempest-TestServerVolumeAttachScenarioOldVersion-771386810 None] Created reservations ['36aa672f-6497-43c7-ac35-ae8647de0405', 'a06ffe98-7f9f-4735-b1fd-2c24abe243ce', 'abc1da5f-1ada-46f6-bfa6-3df0d87e92c5', 'fd9f6ca1-1db5-4e47-97f9-90a0ebb21772'] {{(pid=89182) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 12:34:41 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-533b3035-0db0-4d34-97df-25683d14c12a tempest-TestServerVolumeAttachScenarioOldVersion-771386810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:34:41 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-533b3035-0db0-4d34-97df-25683d14c12a tempest-TestServerVolumeAttachScenarioOldVersion-771386810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:34:41 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-533b3035-0db0-4d34-97df-25683d14c12a tempest-TestServerVolumeAttachScenarioOldVersion-771386810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:34:41 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-533b3035-0db0-4d34-97df-25683d14c12a tempest-TestServerVolumeAttachScenarioOldVersion-771386810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:34:41 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-533b3035-0db0-4d34-97df-25683d14c12a tempest-TestServerVolumeAttachScenarioOldVersion-771386810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:34:41 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-533b3035-0db0-4d34-97df-25683d14c12a tempest-TestServerVolumeAttachScenarioOldVersion-771386810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:34:41 devstack sudo[110687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 Jul 31 12:34:41 devstack sudo[110687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:34:41 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-1c084693-71b1-4d58-985a-3994f669f692 tempest-VolumeDependencyTests-1064398708 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:34:41 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-1c084693-71b1-4d58-985a-3994f669f692 tempest-VolumeDependencyTests-1064398708 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:34:41 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-1c084693-71b1-4d58-985a-3994f669f692 tempest-VolumeDependencyTests-1064398708 None] Creating offline snapshot 7bed25c6-d0fc-4fb1-a50a-58de7c7ae29a of volume e7a1a7af-c1f3-4b21-be21-192cc0afcd51 {{(pid=89182) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 31 12:34:41 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6ed4beb-2817-44fc-94f7-e0b8b4814c85]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:34:41 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-1c084693-71b1-4d58-985a-3994f669f692 tempest-VolumeDependencyTests-1064398708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e7a1a7af-c1f3-4b21-be21-192cc0afcd51 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:34:41 devstack sudo[110687]: pam_unix(sudo:session): session closed for user root Jul 31 12:34:41 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-533b3035-0db0-4d34-97df-25683d14c12a tempest-TestServerVolumeAttachScenarioOldVersion-771386810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2" returned: 0 in 0.320s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:34:41 devstack cinder-volume[89182]: DEBUG cinder.manager [None req-533b3035-0db0-4d34-97df-25683d14c12a tempest-TestServerVolumeAttachScenarioOldVersion-771386810 None] Notifying Schedulers of capabilities ... {{(pid=89182) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 12:34:41 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-533b3035-0db0-4d34-97df-25683d14c12a tempest-TestServerVolumeAttachScenarioOldVersion-771386810 None] Deleted volume successfully. Jul 31 12:34:41 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-533b3035-0db0-4d34-97df-25683d14c12a tempest-TestServerVolumeAttachScenarioOldVersion-771386810 None] Lock "cinder-10789936-e840-4f44-bd5a-98c4654b6ec6-delete_volume" released by "delete_volume" :: held 1.356s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:34:41 devstack sudo[110690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e7a1a7af-c1f3-4b21-be21-192cc0afcd51 Jul 31 12:34:41 devstack sudo[110690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:34:41 devstack sudo[110690]: pam_unix(sudo:session): session closed for user root Jul 31 12:34:41 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-1c084693-71b1-4d58-985a-3994f669f692 tempest-VolumeDependencyTests-1064398708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e7a1a7af-c1f3-4b21-be21-192cc0afcd51" returned: 0 in 0.414s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:34:41 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-1c084693-71b1-4d58-985a-3994f669f692 tempest-VolumeDependencyTests-1064398708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e7a1a7af-c1f3-4b21-be21-192cc0afcd51,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e7a1a7af-c1f3-4b21-be21-192cc0afcd51.7bed25c6-d0fc-4fb1-a50a-58de7c7ae29a 1G {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:34:41 devstack sudo[110703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e7a1a7af-c1f3-4b21-be21-192cc0afcd51,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e7a1a7af-c1f3-4b21-be21-192cc0afcd51.7bed25c6-d0fc-4fb1-a50a-58de7c7ae29a 1G Jul 31 12:34:41 devstack sudo[110703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:34:42 devstack sudo[110703]: pam_unix(sudo:session): session closed for user root Jul 31 12:34:42 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-1c084693-71b1-4d58-985a-3994f669f692 tempest-VolumeDependencyTests-1064398708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e7a1a7af-c1f3-4b21-be21-192cc0afcd51,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e7a1a7af-c1f3-4b21-be21-192cc0afcd51.7bed25c6-d0fc-4fb1-a50a-58de7c7ae29a 1G" returned: 0 in 0.620s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:34:42 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-1c084693-71b1-4d58-985a-3994f669f692 tempest-VolumeDependencyTests-1064398708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e7a1a7af-c1f3-4b21-be21-192cc0afcd51 -F qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e7a1a7af-c1f3-4b21-be21-192cc0afcd51.7bed25c6-d0fc-4fb1-a50a-58de7c7ae29a {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:34:42 devstack sudo[110731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e7a1a7af-c1f3-4b21-be21-192cc0afcd51 -F qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e7a1a7af-c1f3-4b21-be21-192cc0afcd51.7bed25c6-d0fc-4fb1-a50a-58de7c7ae29a Jul 31 12:34:42 devstack sudo[110731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:34:42 devstack sudo[110731]: pam_unix(sudo:session): session closed for user root Jul 31 12:34:42 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-1c084693-71b1-4d58-985a-3994f669f692 tempest-VolumeDependencyTests-1064398708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e7a1a7af-c1f3-4b21-be21-192cc0afcd51 -F qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e7a1a7af-c1f3-4b21-be21-192cc0afcd51.7bed25c6-d0fc-4fb1-a50a-58de7c7ae29a" returned: 0 in 0.348s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:34:42 devstack cinder-volume[89182]: WARNING cinder.volume.drivers.remotefs [None req-1c084693-71b1-4d58-985a-3994f669f692 tempest-VolumeDependencyTests-1064398708 None] /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e7a1a7af-c1f3-4b21-be21-192cc0afcd51.7bed25c6-d0fc-4fb1-a50a-58de7c7ae29a is being set with open permissions: ugo+rw Jul 31 12:34:42 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-1c084693-71b1-4d58-985a-3994f669f692 tempest-VolumeDependencyTests-1064398708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e7a1a7af-c1f3-4b21-be21-192cc0afcd51.7bed25c6-d0fc-4fb1-a50a-58de7c7ae29a {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:34:42 devstack sudo[110736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e7a1a7af-c1f3-4b21-be21-192cc0afcd51.7bed25c6-d0fc-4fb1-a50a-58de7c7ae29a Jul 31 12:34:42 devstack sudo[110736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:34:42 devstack sudo[110736]: pam_unix(sudo:session): session closed for user root Jul 31 12:34:42 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-1c084693-71b1-4d58-985a-3994f669f692 tempest-VolumeDependencyTests-1064398708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e7a1a7af-c1f3-4b21-be21-192cc0afcd51.7bed25c6-d0fc-4fb1-a50a-58de7c7ae29a" returned: 0 in 0.274s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:34:43 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-1c084693-71b1-4d58-985a-3994f669f692 tempest-VolumeDependencyTests-1064398708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e7a1a7af-c1f3-4b21-be21-192cc0afcd51.info {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:34:43 devstack sudo[110775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e7a1a7af-c1f3-4b21-be21-192cc0afcd51.info Jul 31 12:34:43 devstack sudo[110775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:34:43 devstack sudo[110775]: pam_unix(sudo:session): session closed for user root Jul 31 12:34:43 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-1c084693-71b1-4d58-985a-3994f669f692 tempest-VolumeDependencyTests-1064398708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e7a1a7af-c1f3-4b21-be21-192cc0afcd51.info" returned: 0 in 0.291s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:34:43 devstack cinder-volume[89182]: WARNING cinder.volume.drivers.remotefs [None req-1c084693-71b1-4d58-985a-3994f669f692 tempest-VolumeDependencyTests-1064398708 None] /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e7a1a7af-c1f3-4b21-be21-192cc0afcd51.info is being set with open permissions: ugo+rw Jul 31 12:34:43 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-1c084693-71b1-4d58-985a-3994f669f692 tempest-VolumeDependencyTests-1064398708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e7a1a7af-c1f3-4b21-be21-192cc0afcd51.info {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:34:43 devstack sudo[110778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e7a1a7af-c1f3-4b21-be21-192cc0afcd51.info Jul 31 12:34:43 devstack sudo[110778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:34:43 devstack sudo[110778]: pam_unix(sudo:session): session closed for user root Jul 31 12:34:43 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-1c084693-71b1-4d58-985a-3994f669f692 tempest-VolumeDependencyTests-1064398708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e7a1a7af-c1f3-4b21-be21-192cc0afcd51.info" returned: 0 in 0.307s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:34:43 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-1c084693-71b1-4d58-985a-3994f669f692 tempest-VolumeDependencyTests-1064398708 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.390s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:34:43 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-1c084693-71b1-4d58-985a-3994f669f692 tempest-VolumeDependencyTests-1064398708 None] Create snapshot completed successfully Jul 31 12:34:45 devstack cinder-volume[89182]: DEBUG cinder.volume.flows.manager.create_volume [None req-dd217a06-fe0a-466e-b805-ad9704d320e4 tempest-VolumeDependencyTests-1064398708 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89182) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 12:34:45 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-dd217a06-fe0a-466e-b805-ad9704d320e4 tempest-VolumeDependencyTests-1064398708 None] Flow 'volume_create_manager' (de8c60c2-cfd1-4e70-a1a6-eb2777b79d89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:34:45 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-dd217a06-fe0a-466e-b805-ad9704d320e4 tempest-VolumeDependencyTests-1064398708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ba1d292-7bba-4e37-b58d-1cf5d91e44b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:34:45 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-dd217a06-fe0a-466e-b805-ad9704d320e4 tempest-VolumeDependencyTests-1064398708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ba1d292-7bba-4e37-b58d-1cf5d91e44b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:34:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-581262947',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57575f0e-741f-4a9e-becf-a6e84040d829,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af5708b20f594719a09679b9f56f242f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:34:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=7bed25c6-d0fc-4fb1-a50a-58de7c7ae29a,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:34:45Z,use_quota=True,user_id='3fad3d5c7d5b44e6b70fa58e652f1cd2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:34:45 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-dd217a06-fe0a-466e-b805-ad9704d320e4 tempest-VolumeDependencyTests-1064398708 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca001f35-4e5a-4094-9264-afae1206ccfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:34:45 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-dd217a06-fe0a-466e-b805-ad9704d320e4 tempest-VolumeDependencyTests-1064398708 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca001f35-4e5a-4094-9264-afae1206ccfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:34:45 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-dd217a06-fe0a-466e-b805-ad9704d320e4 tempest-VolumeDependencyTests-1064398708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56a2408d-12c6-4b7a-b2b6-45914dac49ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:34:45 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-dd217a06-fe0a-466e-b805-ad9704d320e4 tempest-VolumeDependencyTests-1064398708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56a2408d-12c6-4b7a-b2b6-45914dac49ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '57575f0e-741f-4a9e-becf-a6e84040d829', 'volume_name': 'volume-57575f0e-741f-4a9e-becf-a6e84040d829', 'volume_size': 1, 'snapshot_id': '7bed25c6-d0fc-4fb1-a50a-58de7c7ae29a'}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:34:45 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-dd217a06-fe0a-466e-b805-ad9704d320e4 tempest-VolumeDependencyTests-1064398708 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6405bd45-5acc-40f9-851a-9e76ae6b20a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:34:45 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-dd217a06-fe0a-466e-b805-ad9704d320e4 tempest-VolumeDependencyTests-1064398708 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6405bd45-5acc-40f9-851a-9e76ae6b20a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:34:45 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-dd217a06-fe0a-466e-b805-ad9704d320e4 tempest-VolumeDependencyTests-1064398708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47aa3d30-f252-4857-869c-d5d7f1db9ccb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:34:45 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-dd217a06-fe0a-466e-b805-ad9704d320e4 tempest-VolumeDependencyTests-1064398708 None] Volume 57575f0e-741f-4a9e-becf-a6e84040d829: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-57575f0e-741f-4a9e-becf-a6e84040d829', 'volume_size': 1, 'snapshot_id': '7bed25c6-d0fc-4fb1-a50a-58de7c7ae29a'} Jul 31 12:34:45 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-dd217a06-fe0a-466e-b805-ad9704d320e4 tempest-VolumeDependencyTests-1064398708 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:34:45 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-dd217a06-fe0a-466e-b805-ad9704d320e4 tempest-VolumeDependencyTests-1064398708 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:34:45 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-dd217a06-fe0a-466e-b805-ad9704d320e4 tempest-VolumeDependencyTests-1064398708 None] Acquiring lock "cinder-quobyte-7bed25c6-d0fc-4fb1-a50a-58de7c7ae29a-57575f0e-741f-4a9e-becf-a6e84040d829" by "_create_volume_from_snapshot" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:34:45 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-dd217a06-fe0a-466e-b805-ad9704d320e4 tempest-VolumeDependencyTests-1064398708 None] Lock "cinder-quobyte-7bed25c6-d0fc-4fb1-a50a-58de7c7ae29a-57575f0e-741f-4a9e-becf-a6e84040d829" acquired by "_create_volume_from_snapshot" :: waited 0.017s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:34:45 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-dd217a06-fe0a-466e-b805-ad9704d320e4 tempest-VolumeDependencyTests-1064398708 None] Creating volume 57575f0e-741f-4a9e-becf-a6e84040d829 from snapshot 7bed25c6-d0fc-4fb1-a50a-58de7c7ae29a {{(pid=89182) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 31 12:34:45 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-dd217a06-fe0a-466e-b805-ad9704d320e4 tempest-VolumeDependencyTests-1064398708 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:34:45 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-dd217a06-fe0a-466e-b805-ad9704d320e4 tempest-VolumeDependencyTests-1064398708 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:34:45 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-dd217a06-fe0a-466e-b805-ad9704d320e4 tempest-VolumeDependencyTests-1064398708 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:34:45 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-dd217a06-fe0a-466e-b805-ad9704d320e4 tempest-VolumeDependencyTests-1064398708 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:34:45 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-dd217a06-fe0a-466e-b805-ad9704d320e4 tempest-VolumeDependencyTests-1064398708 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:34:45 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-dd217a06-fe0a-466e-b805-ad9704d320e4 tempest-VolumeDependencyTests-1064398708 None] Selected osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 as target Quobyte volume. {{(pid=89182) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 12:34:45 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-dd217a06-fe0a-466e-b805-ad9704d320e4 tempest-VolumeDependencyTests-1064398708 None] Acquiring lock "cinder-quobyte-57575f0e-741f-4a9e-becf-a6e84040d829" by "_copy_volume_from_snapshot" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:34:45 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-dd217a06-fe0a-466e-b805-ad9704d320e4 tempest-VolumeDependencyTests-1064398708 None] Lock "cinder-quobyte-57575f0e-741f-4a9e-becf-a6e84040d829" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:34:45 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-dd217a06-fe0a-466e-b805-ad9704d320e4 tempest-VolumeDependencyTests-1064398708 None] snapshot: 7bed25c6-d0fc-4fb1-a50a-58de7c7ae29a, volume: 57575f0e-741f-4a9e-becf-a6e84040d829, {{(pid=89182) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Jul 31 12:34:45 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-dd217a06-fe0a-466e-b805-ad9704d320e4 tempest-VolumeDependencyTests-1064398708 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:34:45 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-dd217a06-fe0a-466e-b805-ad9704d320e4 tempest-VolumeDependencyTests-1064398708 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:34:45 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-dd217a06-fe0a-466e-b805-ad9704d320e4 tempest-VolumeDependencyTests-1064398708 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:34:45 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-dd217a06-fe0a-466e-b805-ad9704d320e4 tempest-VolumeDependencyTests-1064398708 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:34:45 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-dd217a06-fe0a-466e-b805-ad9704d320e4 tempest-VolumeDependencyTests-1064398708 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:34:45 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ba88e12-002c-46b2-ab9d-e4022ac61d2a]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:34:45 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-dd217a06-fe0a-466e-b805-ad9704d320e4 tempest-VolumeDependencyTests-1064398708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e7a1a7af-c1f3-4b21-be21-192cc0afcd51.7bed25c6-d0fc-4fb1-a50a-58de7c7ae29a {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:34:45 devstack sudo[110786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e7a1a7af-c1f3-4b21-be21-192cc0afcd51.7bed25c6-d0fc-4fb1-a50a-58de7c7ae29a Jul 31 12:34:45 devstack sudo[110786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:34:45 devstack sudo[110786]: pam_unix(sudo:session): session closed for user root Jul 31 12:34:45 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-dd217a06-fe0a-466e-b805-ad9704d320e4 tempest-VolumeDependencyTests-1064398708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e7a1a7af-c1f3-4b21-be21-192cc0afcd51.7bed25c6-d0fc-4fb1-a50a-58de7c7ae29a" returned: 0 in 0.399s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:34:45 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-dd217a06-fe0a-466e-b805-ad9704d320e4 tempest-VolumeDependencyTests-1064398708 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e7a1a7af-c1f3-4b21-be21-192cc0afcd51(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89182) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 12:34:45 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[61d4be78-b81d-44ee-9457-367493d0caed]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:34:45 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-dd217a06-fe0a-466e-b805-ad9704d320e4 tempest-VolumeDependencyTests-1064398708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e7a1a7af-c1f3-4b21-be21-192cc0afcd51 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:34:45 devstack sudo[110791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e7a1a7af-c1f3-4b21-be21-192cc0afcd51 Jul 31 12:34:45 devstack sudo[110791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:34:45 devstack sudo[110791]: pam_unix(sudo:session): session closed for user root Jul 31 12:34:45 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-dd217a06-fe0a-466e-b805-ad9704d320e4 tempest-VolumeDependencyTests-1064398708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e7a1a7af-c1f3-4b21-be21-192cc0afcd51" returned: 0 in 0.375s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:34:45 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-dd217a06-fe0a-466e-b805-ad9704d320e4 tempest-VolumeDependencyTests-1064398708 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e7a1a7af-c1f3-4b21-be21-192cc0afcd51 {{(pid=89182) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Jul 31 12:34:45 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-dd217a06-fe0a-466e-b805-ad9704d320e4 tempest-VolumeDependencyTests-1064398708 None] Creating direct copy from snapshot {{(pid=89182) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Jul 31 12:34:45 devstack cinder-volume[89182]: DEBUG cinder.utils [None req-dd217a06-fe0a-466e-b805-ad9704d320e4 tempest-VolumeDependencyTests-1064398708 None] Path /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-57575f0e-741f-4a9e-becf-a6e84040d829 not found in is_blk_device check {{(pid=89182) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 31 12:34:45 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-dd217a06-fe0a-466e-b805-ad9704d320e4 tempest-VolumeDependencyTests-1064398708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e7a1a7af-c1f3-4b21-be21-192cc0afcd51 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-57575f0e-741f-4a9e-becf-a6e84040d829 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:34:46 devstack sudo[110796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e7a1a7af-c1f3-4b21-be21-192cc0afcd51 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-57575f0e-741f-4a9e-becf-a6e84040d829 Jul 31 12:34:46 devstack sudo[110796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:34:46 devstack sudo[110796]: pam_unix(sudo:session): session closed for user root Jul 31 12:34:46 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-dd217a06-fe0a-466e-b805-ad9704d320e4 tempest-VolumeDependencyTests-1064398708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e7a1a7af-c1f3-4b21-be21-192cc0afcd51 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-57575f0e-741f-4a9e-becf-a6e84040d829" returned: 0 in 0.456s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:34:46 devstack cinder-volume[89182]: DEBUG cinder.image.image_utils [None req-dd217a06-fe0a-466e-b805-ad9704d320e4 tempest-VolumeDependencyTests-1064398708 None] Image conversion details: src /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e7a1a7af-c1f3-4b21-be21-192cc0afcd51, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-57575f0e-741f-4a9e-becf-a6e84040d829 {{(pid=89182) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 31 12:34:46 devstack cinder-volume[89182]: INFO cinder.image.image_utils [None req-dd217a06-fe0a-466e-b805-ad9704d320e4 tempest-VolumeDependencyTests-1064398708 None] Converted 1024.00 MB image at 1024.00 MB/s Jul 31 12:34:46 devstack cinder-volume[89182]: WARNING cinder.volume.drivers.remotefs [None req-dd217a06-fe0a-466e-b805-ad9704d320e4 tempest-VolumeDependencyTests-1064398708 None] /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-57575f0e-741f-4a9e-becf-a6e84040d829 is being set with open permissions: ugo+rw Jul 31 12:34:46 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-dd217a06-fe0a-466e-b805-ad9704d320e4 tempest-VolumeDependencyTests-1064398708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-57575f0e-741f-4a9e-becf-a6e84040d829 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:34:46 devstack sudo[110803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-57575f0e-741f-4a9e-becf-a6e84040d829 Jul 31 12:34:46 devstack sudo[110803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:34:46 devstack sudo[110803]: pam_unix(sudo:session): session closed for user root Jul 31 12:34:46 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-dd217a06-fe0a-466e-b805-ad9704d320e4 tempest-VolumeDependencyTests-1064398708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-57575f0e-741f-4a9e-becf-a6e84040d829" returned: 0 in 0.258s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:34:46 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-dd217a06-fe0a-466e-b805-ad9704d320e4 tempest-VolumeDependencyTests-1064398708 None] Lock "cinder-quobyte-57575f0e-741f-4a9e-becf-a6e84040d829" released by "_copy_volume_from_snapshot" :: held 1.573s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:34:46 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-dd217a06-fe0a-466e-b805-ad9704d320e4 tempest-VolumeDependencyTests-1064398708 None] Lock "cinder-quobyte-7bed25c6-d0fc-4fb1-a50a-58de7c7ae29a-57575f0e-741f-4a9e-becf-a6e84040d829" released by "_create_volume_from_snapshot" :: held 1.633s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:34:46 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-dd217a06-fe0a-466e-b805-ad9704d320e4 tempest-VolumeDependencyTests-1064398708 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 1.651s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:34:46 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-dd217a06-fe0a-466e-b805-ad9704d320e4 tempest-VolumeDependencyTests-1064398708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47aa3d30-f252-4857-869c-d5d7f1db9ccb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-57575f0e-741f-4a9e-becf-a6e84040d829', 'volume_size': 1, 'snapshot_id': '7bed25c6-d0fc-4fb1-a50a-58de7c7ae29a'}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:34:46 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-dd217a06-fe0a-466e-b805-ad9704d320e4 tempest-VolumeDependencyTests-1064398708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c558b003-7e57-4bc6-bd46-23b41767baaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:34:46 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-dd217a06-fe0a-466e-b805-ad9704d320e4 tempest-VolumeDependencyTests-1064398708 None] Volume volume-57575f0e-741f-4a9e-becf-a6e84040d829 (57575f0e-741f-4a9e-becf-a6e84040d829): created successfully Jul 31 12:34:46 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-dd217a06-fe0a-466e-b805-ad9704d320e4 tempest-VolumeDependencyTests-1064398708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c558b003-7e57-4bc6-bd46-23b41767baaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:34:46 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-dd217a06-fe0a-466e-b805-ad9704d320e4 tempest-VolumeDependencyTests-1064398708 None] Flow 'volume_create_manager' (de8c60c2-cfd1-4e70-a1a6-eb2777b79d89) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:34:46 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-dd217a06-fe0a-466e-b805-ad9704d320e4 tempest-VolumeDependencyTests-1064398708 None] Created volume successfully. Jul 31 12:34:47 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-3b2f5983-81b2-401e-825a-adfcbee3901b tempest-VolumeDependencyTests-1064398708 None] Acquiring lock "cinder-601daa67-8839-4f35-bcf7-3e3b8be7405a-delete_snapshot" by "delete_snapshot" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:34:47 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-3b2f5983-81b2-401e-825a-adfcbee3901b tempest-VolumeDependencyTests-1064398708 None] Lock "cinder-601daa67-8839-4f35-bcf7-3e3b8be7405a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:34:47 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-3b2f5983-81b2-401e-825a-adfcbee3901b tempest-VolumeDependencyTests-1064398708 None] Acquiring lock "cinder-quobyte-87eacf0b-c8b8-46e9-9a62-91756ec23f1f" by "delete_snapshot" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:34:47 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-3b2f5983-81b2-401e-825a-adfcbee3901b tempest-VolumeDependencyTests-1064398708 None] Lock "cinder-quobyte-87eacf0b-c8b8-46e9-9a62-91756ec23f1f" acquired by "delete_snapshot" :: waited 0.021s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:34:47 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-3b2f5983-81b2-401e-825a-adfcbee3901b tempest-VolumeDependencyTests-1064398708 None] Acquiring lock "cinder-quobyte-601daa67-8839-4f35-bcf7-3e3b8be7405a" by "_delete_snapshot" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:34:47 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-3b2f5983-81b2-401e-825a-adfcbee3901b tempest-VolumeDependencyTests-1064398708 None] Lock "cinder-quobyte-601daa67-8839-4f35-bcf7-3e3b8be7405a" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:34:47 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-3b2f5983-81b2-401e-825a-adfcbee3901b tempest-VolumeDependencyTests-1064398708 None] Deleting offline snapshot 601daa67-8839-4f35-bcf7-3e3b8be7405a of volume 87eacf0b-c8b8-46e9-9a62-91756ec23f1f {{(pid=89182) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 31 12:34:47 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-3b2f5983-81b2-401e-825a-adfcbee3901b tempest-VolumeDependencyTests-1064398708 None] snapshot_file for this snap is: volume-87eacf0b-c8b8-46e9-9a62-91756ec23f1f.601daa67-8839-4f35-bcf7-3e3b8be7405a {{(pid=89182) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 31 12:34:47 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[19c4cfac-a59f-4385-85d7-08ab4194ac3f]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:34:47 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-3b2f5983-81b2-401e-825a-adfcbee3901b tempest-VolumeDependencyTests-1064398708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-87eacf0b-c8b8-46e9-9a62-91756ec23f1f.601daa67-8839-4f35-bcf7-3e3b8be7405a {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:34:47 devstack sudo[110807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-87eacf0b-c8b8-46e9-9a62-91756ec23f1f.601daa67-8839-4f35-bcf7-3e3b8be7405a Jul 31 12:34:47 devstack sudo[110807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:34:47 devstack sudo[110807]: pam_unix(sudo:session): session closed for user root Jul 31 12:34:47 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-3b2f5983-81b2-401e-825a-adfcbee3901b tempest-VolumeDependencyTests-1064398708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-87eacf0b-c8b8-46e9-9a62-91756ec23f1f.601daa67-8839-4f35-bcf7-3e3b8be7405a" returned: 0 in 0.419s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:34:47 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-3b2f5983-81b2-401e-825a-adfcbee3901b tempest-VolumeDependencyTests-1064398708 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-87eacf0b-c8b8-46e9-9a62-91756ec23f1f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89182) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 12:34:47 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb8b816b-f4fa-48a0-a4f1-5be267ec592f]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:34:47 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-3b2f5983-81b2-401e-825a-adfcbee3901b tempest-VolumeDependencyTests-1064398708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-87eacf0b-c8b8-46e9-9a62-91756ec23f1f {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:34:47 devstack sudo[110812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-87eacf0b-c8b8-46e9-9a62-91756ec23f1f Jul 31 12:34:47 devstack sudo[110812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:34:48 devstack sudo[110812]: pam_unix(sudo:session): session closed for user root Jul 31 12:34:48 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-3b2f5983-81b2-401e-825a-adfcbee3901b tempest-VolumeDependencyTests-1064398708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-87eacf0b-c8b8-46e9-9a62-91756ec23f1f" returned: 0 in 0.602s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:34:48 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-3b2f5983-81b2-401e-825a-adfcbee3901b tempest-VolumeDependencyTests-1064398708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-87eacf0b-c8b8-46e9-9a62-91756ec23f1f.601daa67-8839-4f35-bcf7-3e3b8be7405a {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:34:48 devstack sudo[110819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-87eacf0b-c8b8-46e9-9a62-91756ec23f1f.601daa67-8839-4f35-bcf7-3e3b8be7405a Jul 31 12:34:48 devstack sudo[110819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:34:48 devstack sudo[110819]: pam_unix(sudo:session): session closed for user root Jul 31 12:34:48 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-3b2f5983-81b2-401e-825a-adfcbee3901b tempest-VolumeDependencyTests-1064398708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-87eacf0b-c8b8-46e9-9a62-91756ec23f1f.601daa67-8839-4f35-bcf7-3e3b8be7405a" returned: 0 in 0.372s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:34:48 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-3b2f5983-81b2-401e-825a-adfcbee3901b tempest-VolumeDependencyTests-1064398708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-87eacf0b-c8b8-46e9-9a62-91756ec23f1f.601daa67-8839-4f35-bcf7-3e3b8be7405a {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:34:48 devstack sudo[110824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-87eacf0b-c8b8-46e9-9a62-91756ec23f1f.601daa67-8839-4f35-bcf7-3e3b8be7405a Jul 31 12:34:48 devstack sudo[110824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:34:48 devstack sudo[110824]: pam_unix(sudo:session): session closed for user root Jul 31 12:34:48 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-3b2f5983-81b2-401e-825a-adfcbee3901b tempest-VolumeDependencyTests-1064398708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-87eacf0b-c8b8-46e9-9a62-91756ec23f1f.601daa67-8839-4f35-bcf7-3e3b8be7405a" returned: 0 in 0.274s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:34:48 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-3b2f5983-81b2-401e-825a-adfcbee3901b tempest-VolumeDependencyTests-1064398708 None] Lock "cinder-quobyte-601daa67-8839-4f35-bcf7-3e3b8be7405a" released by "_delete_snapshot" :: held 1.787s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:34:48 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-3b2f5983-81b2-401e-825a-adfcbee3901b tempest-VolumeDependencyTests-1064398708 None] Lock "cinder-quobyte-87eacf0b-c8b8-46e9-9a62-91756ec23f1f" released by "delete_snapshot" :: held 1.811s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:34:48 devstack cinder-volume[89182]: DEBUG cinder.quota [None req-3b2f5983-81b2-401e-825a-adfcbee3901b tempest-VolumeDependencyTests-1064398708 None] Created reservations ['70ba008b-4886-411c-9e45-93de952e53d0', 'f8060494-519a-41da-94c7-7bbb5b6791ac', 'f5d9d008-1ec5-4b8b-b901-4a1aa26d4d65', '512f47c2-47e8-44f5-944f-01f9f5dadcf5'] {{(pid=89182) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 12:34:49 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-3b2f5983-81b2-401e-825a-adfcbee3901b tempest-VolumeDependencyTests-1064398708 None] Delete snapshot completed successfully. Jul 31 12:34:49 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-3b2f5983-81b2-401e-825a-adfcbee3901b tempest-VolumeDependencyTests-1064398708 None] Lock "cinder-601daa67-8839-4f35-bcf7-3e3b8be7405a-delete_snapshot" released by "delete_snapshot" :: held 1.964s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:34:49 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-29c8ed52-52c3-416c-8384-421cd95e4cbe tempest-VolumeDependencyTests-1064398708 None] Acquiring lock "cinder-7bed25c6-d0fc-4fb1-a50a-58de7c7ae29a-delete_snapshot" by "delete_snapshot" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:34:49 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-29c8ed52-52c3-416c-8384-421cd95e4cbe tempest-VolumeDependencyTests-1064398708 None] Lock "cinder-7bed25c6-d0fc-4fb1-a50a-58de7c7ae29a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:34:49 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-29c8ed52-52c3-416c-8384-421cd95e4cbe tempest-VolumeDependencyTests-1064398708 None] Acquiring lock "cinder-quobyte-e7a1a7af-c1f3-4b21-be21-192cc0afcd51" by "delete_snapshot" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:34:49 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-29c8ed52-52c3-416c-8384-421cd95e4cbe tempest-VolumeDependencyTests-1064398708 None] Lock "cinder-quobyte-e7a1a7af-c1f3-4b21-be21-192cc0afcd51" acquired by "delete_snapshot" :: waited 0.019s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:34:49 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-29c8ed52-52c3-416c-8384-421cd95e4cbe tempest-VolumeDependencyTests-1064398708 None] Acquiring lock "cinder-quobyte-7bed25c6-d0fc-4fb1-a50a-58de7c7ae29a" by "_delete_snapshot" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:34:49 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-29c8ed52-52c3-416c-8384-421cd95e4cbe tempest-VolumeDependencyTests-1064398708 None] Lock "cinder-quobyte-7bed25c6-d0fc-4fb1-a50a-58de7c7ae29a" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:34:49 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-29c8ed52-52c3-416c-8384-421cd95e4cbe tempest-VolumeDependencyTests-1064398708 None] Deleting offline snapshot 7bed25c6-d0fc-4fb1-a50a-58de7c7ae29a of volume e7a1a7af-c1f3-4b21-be21-192cc0afcd51 {{(pid=89182) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 31 12:34:49 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-29c8ed52-52c3-416c-8384-421cd95e4cbe tempest-VolumeDependencyTests-1064398708 None] snapshot_file for this snap is: volume-e7a1a7af-c1f3-4b21-be21-192cc0afcd51.7bed25c6-d0fc-4fb1-a50a-58de7c7ae29a {{(pid=89182) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 31 12:34:49 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[43c19c8c-1956-4db7-a229-97daf6583b56]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:34:49 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-29c8ed52-52c3-416c-8384-421cd95e4cbe tempest-VolumeDependencyTests-1064398708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e7a1a7af-c1f3-4b21-be21-192cc0afcd51.7bed25c6-d0fc-4fb1-a50a-58de7c7ae29a {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:34:49 devstack sudo[110827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e7a1a7af-c1f3-4b21-be21-192cc0afcd51.7bed25c6-d0fc-4fb1-a50a-58de7c7ae29a Jul 31 12:34:49 devstack sudo[110827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:34:49 devstack sudo[110827]: pam_unix(sudo:session): session closed for user root Jul 31 12:34:49 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-29c8ed52-52c3-416c-8384-421cd95e4cbe tempest-VolumeDependencyTests-1064398708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e7a1a7af-c1f3-4b21-be21-192cc0afcd51.7bed25c6-d0fc-4fb1-a50a-58de7c7ae29a" returned: 0 in 0.401s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:34:49 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-29c8ed52-52c3-416c-8384-421cd95e4cbe tempest-VolumeDependencyTests-1064398708 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e7a1a7af-c1f3-4b21-be21-192cc0afcd51(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89182) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 12:34:49 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff9c18e2-366a-465c-9fb5-efb707c51792]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:34:49 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-29c8ed52-52c3-416c-8384-421cd95e4cbe tempest-VolumeDependencyTests-1064398708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e7a1a7af-c1f3-4b21-be21-192cc0afcd51 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:34:49 devstack sudo[110836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e7a1a7af-c1f3-4b21-be21-192cc0afcd51 Jul 31 12:34:49 devstack sudo[110836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:34:50 devstack sudo[110836]: pam_unix(sudo:session): session closed for user root Jul 31 12:34:50 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-29c8ed52-52c3-416c-8384-421cd95e4cbe tempest-VolumeDependencyTests-1064398708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e7a1a7af-c1f3-4b21-be21-192cc0afcd51" returned: 0 in 0.377s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:34:50 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-29c8ed52-52c3-416c-8384-421cd95e4cbe tempest-VolumeDependencyTests-1064398708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e7a1a7af-c1f3-4b21-be21-192cc0afcd51.7bed25c6-d0fc-4fb1-a50a-58de7c7ae29a {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:34:50 devstack sudo[110844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e7a1a7af-c1f3-4b21-be21-192cc0afcd51.7bed25c6-d0fc-4fb1-a50a-58de7c7ae29a Jul 31 12:34:50 devstack sudo[110844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:34:50 devstack sudo[110844]: pam_unix(sudo:session): session closed for user root Jul 31 12:34:50 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-29c8ed52-52c3-416c-8384-421cd95e4cbe tempest-VolumeDependencyTests-1064398708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e7a1a7af-c1f3-4b21-be21-192cc0afcd51.7bed25c6-d0fc-4fb1-a50a-58de7c7ae29a" returned: 0 in 0.367s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:34:50 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-29c8ed52-52c3-416c-8384-421cd95e4cbe tempest-VolumeDependencyTests-1064398708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e7a1a7af-c1f3-4b21-be21-192cc0afcd51.7bed25c6-d0fc-4fb1-a50a-58de7c7ae29a {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:34:50 devstack sudo[110850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e7a1a7af-c1f3-4b21-be21-192cc0afcd51.7bed25c6-d0fc-4fb1-a50a-58de7c7ae29a Jul 31 12:34:50 devstack sudo[110850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:34:50 devstack sudo[110850]: pam_unix(sudo:session): session closed for user root Jul 31 12:34:50 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-29c8ed52-52c3-416c-8384-421cd95e4cbe tempest-VolumeDependencyTests-1064398708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e7a1a7af-c1f3-4b21-be21-192cc0afcd51.7bed25c6-d0fc-4fb1-a50a-58de7c7ae29a" returned: 0 in 0.256s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:34:50 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-29c8ed52-52c3-416c-8384-421cd95e4cbe tempest-VolumeDependencyTests-1064398708 None] Lock "cinder-quobyte-7bed25c6-d0fc-4fb1-a50a-58de7c7ae29a" released by "_delete_snapshot" :: held 1.513s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:34:50 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-29c8ed52-52c3-416c-8384-421cd95e4cbe tempest-VolumeDependencyTests-1064398708 None] Lock "cinder-quobyte-e7a1a7af-c1f3-4b21-be21-192cc0afcd51" released by "delete_snapshot" :: held 1.540s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:34:50 devstack cinder-volume[89182]: DEBUG cinder.quota [None req-29c8ed52-52c3-416c-8384-421cd95e4cbe tempest-VolumeDependencyTests-1064398708 None] Created reservations ['8fe4b8e6-494a-404e-9b90-72e4bf685de5', '21b32493-199a-434d-a794-c2e5f2699738', '332cedd6-fe2e-4e81-ad98-9870ab173725', '2db65510-0812-42cc-89d8-fe2f87159697'] {{(pid=89182) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 12:34:50 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-29c8ed52-52c3-416c-8384-421cd95e4cbe tempest-VolumeDependencyTests-1064398708 None] Delete snapshot completed successfully. Jul 31 12:34:50 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-29c8ed52-52c3-416c-8384-421cd95e4cbe tempest-VolumeDependencyTests-1064398708 None] Lock "cinder-7bed25c6-d0fc-4fb1-a50a-58de7c7ae29a-delete_snapshot" released by "delete_snapshot" :: held 1.680s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:34:51 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-f2d77f13-838d-4a0c-8a5c-9b0105f16209 tempest-VolumeDependencyTests-1064398708 None] Acquiring lock "cinder-87eacf0b-c8b8-46e9-9a62-91756ec23f1f-delete_volume" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:34:51 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-f2d77f13-838d-4a0c-8a5c-9b0105f16209 tempest-VolumeDependencyTests-1064398708 None] Lock "cinder-87eacf0b-c8b8-46e9-9a62-91756ec23f1f-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:34:51 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-f2d77f13-838d-4a0c-8a5c-9b0105f16209 tempest-VolumeDependencyTests-1064398708 None] Acquiring lock "cinder-quobyte-87eacf0b-c8b8-46e9-9a62-91756ec23f1f" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:34:51 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-f2d77f13-838d-4a0c-8a5c-9b0105f16209 tempest-VolumeDependencyTests-1064398708 None] Lock "cinder-quobyte-87eacf0b-c8b8-46e9-9a62-91756ec23f1f" acquired by "delete_volume" :: waited 0.017s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:34:51 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[95ca6a59-0aa1-4351-81dc-2214ed41b8a2]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:34:51 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-f2d77f13-838d-4a0c-8a5c-9b0105f16209 tempest-VolumeDependencyTests-1064398708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-87eacf0b-c8b8-46e9-9a62-91756ec23f1f {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:34:51 devstack sudo[110853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-87eacf0b-c8b8-46e9-9a62-91756ec23f1f Jul 31 12:34:51 devstack sudo[110853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:34:51 devstack sudo[110853]: pam_unix(sudo:session): session closed for user root Jul 31 12:34:51 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-f2d77f13-838d-4a0c-8a5c-9b0105f16209 tempest-VolumeDependencyTests-1064398708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-87eacf0b-c8b8-46e9-9a62-91756ec23f1f" returned: 0 in 0.398s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:34:51 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-f2d77f13-838d-4a0c-8a5c-9b0105f16209 tempest-VolumeDependencyTests-1064398708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-87eacf0b-c8b8-46e9-9a62-91756ec23f1f {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:34:51 devstack sudo[110858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-87eacf0b-c8b8-46e9-9a62-91756ec23f1f Jul 31 12:34:51 devstack sudo[110858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:34:52 devstack sudo[110858]: pam_unix(sudo:session): session closed for user root Jul 31 12:34:52 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-f2d77f13-838d-4a0c-8a5c-9b0105f16209 tempest-VolumeDependencyTests-1064398708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-87eacf0b-c8b8-46e9-9a62-91756ec23f1f" returned: 0 in 0.290s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:34:52 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-f2d77f13-838d-4a0c-8a5c-9b0105f16209 tempest-VolumeDependencyTests-1064398708 None] Lock "cinder-quobyte-87eacf0b-c8b8-46e9-9a62-91756ec23f1f" released by "delete_volume" :: held 0.761s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:34:52 devstack cinder-volume[89182]: DEBUG cinder.quota [None req-f2d77f13-838d-4a0c-8a5c-9b0105f16209 tempest-VolumeDependencyTests-1064398708 None] Created reservations ['e851c959-7906-4669-ade7-eaa9dc9fd2da', 'd46f1fcb-319c-441c-8c4f-5890dda6d125', '2e584d2f-66de-45dc-bdad-bc1016fd9695', 'd90b5769-a192-492b-bac1-e0670c5b3df6'] {{(pid=89182) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 12:34:52 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-f2d77f13-838d-4a0c-8a5c-9b0105f16209 tempest-VolumeDependencyTests-1064398708 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:34:52 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-f2d77f13-838d-4a0c-8a5c-9b0105f16209 tempest-VolumeDependencyTests-1064398708 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:34:52 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-f2d77f13-838d-4a0c-8a5c-9b0105f16209 tempest-VolumeDependencyTests-1064398708 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:34:52 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-f2d77f13-838d-4a0c-8a5c-9b0105f16209 tempest-VolumeDependencyTests-1064398708 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:34:52 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-f2d77f13-838d-4a0c-8a5c-9b0105f16209 tempest-VolumeDependencyTests-1064398708 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:34:52 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-f2d77f13-838d-4a0c-8a5c-9b0105f16209 tempest-VolumeDependencyTests-1064398708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:34:52 devstack sudo[110862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 Jul 31 12:34:52 devstack sudo[110862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:34:52 devstack sudo[110862]: pam_unix(sudo:session): session closed for user root Jul 31 12:34:52 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-40ba7d8d-ff94-47d8-8364-b9ec0eb09f21 tempest-VolumeDependencyTests-1064398708 None] Acquiring lock "cinder-e7a1a7af-c1f3-4b21-be21-192cc0afcd51-delete_volume" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:34:52 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-f2d77f13-838d-4a0c-8a5c-9b0105f16209 tempest-VolumeDependencyTests-1064398708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2" returned: 0 in 0.257s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:34:52 devstack cinder-volume[89182]: DEBUG cinder.manager [None req-f2d77f13-838d-4a0c-8a5c-9b0105f16209 tempest-VolumeDependencyTests-1064398708 None] Notifying Schedulers of capabilities ... {{(pid=89182) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 12:34:52 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-f2d77f13-838d-4a0c-8a5c-9b0105f16209 tempest-VolumeDependencyTests-1064398708 None] Deleted volume successfully. Jul 31 12:34:52 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-40ba7d8d-ff94-47d8-8364-b9ec0eb09f21 tempest-VolumeDependencyTests-1064398708 None] Lock "cinder-e7a1a7af-c1f3-4b21-be21-192cc0afcd51-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:34:52 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-f2d77f13-838d-4a0c-8a5c-9b0105f16209 tempest-VolumeDependencyTests-1064398708 None] Lock "cinder-87eacf0b-c8b8-46e9-9a62-91756ec23f1f-delete_volume" released by "delete_volume" :: held 1.231s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:34:52 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-40ba7d8d-ff94-47d8-8364-b9ec0eb09f21 tempest-VolumeDependencyTests-1064398708 None] Acquiring lock "cinder-quobyte-e7a1a7af-c1f3-4b21-be21-192cc0afcd51" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:34:52 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-40ba7d8d-ff94-47d8-8364-b9ec0eb09f21 tempest-VolumeDependencyTests-1064398708 None] Lock "cinder-quobyte-e7a1a7af-c1f3-4b21-be21-192cc0afcd51" acquired by "delete_volume" :: waited 0.025s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:34:52 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cd9d177-1d90-4e85-8063-7e624d7fd12b]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:34:52 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-40ba7d8d-ff94-47d8-8364-b9ec0eb09f21 tempest-VolumeDependencyTests-1064398708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e7a1a7af-c1f3-4b21-be21-192cc0afcd51 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:34:52 devstack sudo[110865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e7a1a7af-c1f3-4b21-be21-192cc0afcd51 Jul 31 12:34:52 devstack sudo[110865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:34:53 devstack sudo[110865]: pam_unix(sudo:session): session closed for user root Jul 31 12:34:53 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-40ba7d8d-ff94-47d8-8364-b9ec0eb09f21 tempest-VolumeDependencyTests-1064398708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e7a1a7af-c1f3-4b21-be21-192cc0afcd51" returned: 0 in 0.391s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:34:53 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-40ba7d8d-ff94-47d8-8364-b9ec0eb09f21 tempest-VolumeDependencyTests-1064398708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e7a1a7af-c1f3-4b21-be21-192cc0afcd51 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:34:53 devstack sudo[110870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e7a1a7af-c1f3-4b21-be21-192cc0afcd51 Jul 31 12:34:53 devstack sudo[110870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:34:53 devstack sudo[110870]: pam_unix(sudo:session): session closed for user root Jul 31 12:34:53 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-40ba7d8d-ff94-47d8-8364-b9ec0eb09f21 tempest-VolumeDependencyTests-1064398708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e7a1a7af-c1f3-4b21-be21-192cc0afcd51" returned: 0 in 0.255s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:34:53 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-40ba7d8d-ff94-47d8-8364-b9ec0eb09f21 tempest-VolumeDependencyTests-1064398708 None] Lock "cinder-quobyte-e7a1a7af-c1f3-4b21-be21-192cc0afcd51" released by "delete_volume" :: held 0.716s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:34:53 devstack cinder-volume[89182]: DEBUG cinder.quota [None req-40ba7d8d-ff94-47d8-8364-b9ec0eb09f21 tempest-VolumeDependencyTests-1064398708 None] Created reservations ['233251ed-8eeb-4b05-b738-86d466d2d8f6', '7fae2b04-36e0-41b5-9434-213b8edac968', '41f75d13-b4a6-4cdf-a70c-4b433de576b3', 'bb759355-8a81-43d5-91ee-2bf2bdefa793'] {{(pid=89182) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 12:34:53 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-40ba7d8d-ff94-47d8-8364-b9ec0eb09f21 tempest-VolumeDependencyTests-1064398708 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:34:53 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-40ba7d8d-ff94-47d8-8364-b9ec0eb09f21 tempest-VolumeDependencyTests-1064398708 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:34:53 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-40ba7d8d-ff94-47d8-8364-b9ec0eb09f21 tempest-VolumeDependencyTests-1064398708 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:34:53 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-40ba7d8d-ff94-47d8-8364-b9ec0eb09f21 tempest-VolumeDependencyTests-1064398708 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:34:53 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-40ba7d8d-ff94-47d8-8364-b9ec0eb09f21 tempest-VolumeDependencyTests-1064398708 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:34:53 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-40ba7d8d-ff94-47d8-8364-b9ec0eb09f21 tempest-VolumeDependencyTests-1064398708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:34:53 devstack sudo[110873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 Jul 31 12:34:53 devstack sudo[110873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:34:53 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-ec56bd8a-921c-40ab-b46d-0a1c3b693e05 tempest-VolumeDependencyTests-1064398708 None] Acquiring lock "cinder-57575f0e-741f-4a9e-becf-a6e84040d829-delete_volume" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:34:53 devstack sudo[110873]: pam_unix(sudo:session): session closed for user root Jul 31 12:34:53 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-40ba7d8d-ff94-47d8-8364-b9ec0eb09f21 tempest-VolumeDependencyTests-1064398708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2" returned: 0 in 0.294s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:34:53 devstack cinder-volume[89182]: DEBUG cinder.manager [None req-40ba7d8d-ff94-47d8-8364-b9ec0eb09f21 tempest-VolumeDependencyTests-1064398708 None] Notifying Schedulers of capabilities ... {{(pid=89182) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 12:34:53 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-40ba7d8d-ff94-47d8-8364-b9ec0eb09f21 tempest-VolumeDependencyTests-1064398708 None] Deleted volume successfully. Jul 31 12:34:53 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-ec56bd8a-921c-40ab-b46d-0a1c3b693e05 tempest-VolumeDependencyTests-1064398708 None] Lock "cinder-57575f0e-741f-4a9e-becf-a6e84040d829-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:34:53 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-40ba7d8d-ff94-47d8-8364-b9ec0eb09f21 tempest-VolumeDependencyTests-1064398708 None] Lock "cinder-e7a1a7af-c1f3-4b21-be21-192cc0afcd51-delete_volume" released by "delete_volume" :: held 1.229s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:34:53 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-ec56bd8a-921c-40ab-b46d-0a1c3b693e05 tempest-VolumeDependencyTests-1064398708 None] Acquiring lock "cinder-quobyte-57575f0e-741f-4a9e-becf-a6e84040d829" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:34:53 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-ec56bd8a-921c-40ab-b46d-0a1c3b693e05 tempest-VolumeDependencyTests-1064398708 None] Lock "cinder-quobyte-57575f0e-741f-4a9e-becf-a6e84040d829" acquired by "delete_volume" :: waited 0.015s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:34:53 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[34edd66b-80a5-46d8-aa32-dba5ef40f7fb]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:34:53 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-ec56bd8a-921c-40ab-b46d-0a1c3b693e05 tempest-VolumeDependencyTests-1064398708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-57575f0e-741f-4a9e-becf-a6e84040d829 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:34:54 devstack sudo[110876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-57575f0e-741f-4a9e-becf-a6e84040d829 Jul 31 12:34:54 devstack sudo[110876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:34:54 devstack sudo[110876]: pam_unix(sudo:session): session closed for user root Jul 31 12:34:54 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-ec56bd8a-921c-40ab-b46d-0a1c3b693e05 tempest-VolumeDependencyTests-1064398708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-57575f0e-741f-4a9e-becf-a6e84040d829" returned: 0 in 0.377s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:34:54 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-ec56bd8a-921c-40ab-b46d-0a1c3b693e05 tempest-VolumeDependencyTests-1064398708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-57575f0e-741f-4a9e-becf-a6e84040d829 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:34:54 devstack sudo[110881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-57575f0e-741f-4a9e-becf-a6e84040d829 Jul 31 12:34:54 devstack sudo[110881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:34:54 devstack sudo[110881]: pam_unix(sudo:session): session closed for user root Jul 31 12:34:54 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-ec56bd8a-921c-40ab-b46d-0a1c3b693e05 tempest-VolumeDependencyTests-1064398708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-57575f0e-741f-4a9e-becf-a6e84040d829" returned: 0 in 0.263s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:34:54 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-ec56bd8a-921c-40ab-b46d-0a1c3b693e05 tempest-VolumeDependencyTests-1064398708 None] Lock "cinder-quobyte-57575f0e-741f-4a9e-becf-a6e84040d829" released by "delete_volume" :: held 0.678s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:34:54 devstack cinder-volume[89182]: DEBUG cinder.quota [None req-ec56bd8a-921c-40ab-b46d-0a1c3b693e05 tempest-VolumeDependencyTests-1064398708 None] Created reservations ['5aca8f14-d499-40ab-a8be-d1769304b116', 'ef5bd5c1-da37-4958-9018-63d02dbde218', '15d6db46-fb4b-4ab6-9960-e5ee2c3d4dde', '747566e0-0da6-482a-8201-208b128d4006'] {{(pid=89182) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 12:34:54 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-ec56bd8a-921c-40ab-b46d-0a1c3b693e05 tempest-VolumeDependencyTests-1064398708 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:34:54 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-ec56bd8a-921c-40ab-b46d-0a1c3b693e05 tempest-VolumeDependencyTests-1064398708 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:34:54 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-ec56bd8a-921c-40ab-b46d-0a1c3b693e05 tempest-VolumeDependencyTests-1064398708 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:34:54 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-ec56bd8a-921c-40ab-b46d-0a1c3b693e05 tempest-VolumeDependencyTests-1064398708 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:34:54 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-ec56bd8a-921c-40ab-b46d-0a1c3b693e05 tempest-VolumeDependencyTests-1064398708 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:34:54 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-ec56bd8a-921c-40ab-b46d-0a1c3b693e05 tempest-VolumeDependencyTests-1064398708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:34:54 devstack sudo[110884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 Jul 31 12:34:54 devstack sudo[110884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:34:55 devstack sudo[110884]: pam_unix(sudo:session): session closed for user root Jul 31 12:34:55 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-ec56bd8a-921c-40ab-b46d-0a1c3b693e05 tempest-VolumeDependencyTests-1064398708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2" returned: 0 in 0.270s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:34:55 devstack cinder-volume[89182]: DEBUG cinder.manager [None req-ec56bd8a-921c-40ab-b46d-0a1c3b693e05 tempest-VolumeDependencyTests-1064398708 None] Notifying Schedulers of capabilities ... {{(pid=89182) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 12:34:55 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-ec56bd8a-921c-40ab-b46d-0a1c3b693e05 tempest-VolumeDependencyTests-1064398708 None] Deleted volume successfully. Jul 31 12:34:55 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-ec56bd8a-921c-40ab-b46d-0a1c3b693e05 tempest-VolumeDependencyTests-1064398708 None] Lock "cinder-57575f0e-741f-4a9e-becf-a6e84040d829-delete_volume" released by "delete_volume" :: held 1.184s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:34:55 devstack cinder-volume[89182]: DEBUG cinder.volume.flows.manager.create_volume [None req-52bd65ac-6143-4e27-9a21-d7bb9a42d298 tempest-VolumeDependencyTests-1064398708 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89182) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 12:34:55 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-52bd65ac-6143-4e27-9a21-d7bb9a42d298 tempest-VolumeDependencyTests-1064398708 None] Flow 'volume_create_manager' (88a9542a-b965-4989-aafb-47af78a7ff70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:34:55 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-52bd65ac-6143-4e27-9a21-d7bb9a42d298 tempest-VolumeDependencyTests-1064398708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a00daeb-9aff-4b6e-a9eb-342458b15372) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:34:55 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-52bd65ac-6143-4e27-9a21-d7bb9a42d298 tempest-VolumeDependencyTests-1064398708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a00daeb-9aff-4b6e-a9eb-342458b15372) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:34:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-206895002',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51b954d8-2d82-465b-8492-57d373ab74c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af5708b20f594719a09679b9f56f242f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:34:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:34:56Z,use_quota=True,user_id='3fad3d5c7d5b44e6b70fa58e652f1cd2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:34:55 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-52bd65ac-6143-4e27-9a21-d7bb9a42d298 tempest-VolumeDependencyTests-1064398708 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67283b4b-913f-4440-8dc3-3753da104ff2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:34:55 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-52bd65ac-6143-4e27-9a21-d7bb9a42d298 tempest-VolumeDependencyTests-1064398708 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67283b4b-913f-4440-8dc3-3753da104ff2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:34:55 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-52bd65ac-6143-4e27-9a21-d7bb9a42d298 tempest-VolumeDependencyTests-1064398708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f83b4522-d5f8-4fb8-b8db-15d32d5aa877) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:34:55 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-52bd65ac-6143-4e27-9a21-d7bb9a42d298 tempest-VolumeDependencyTests-1064398708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f83b4522-d5f8-4fb8-b8db-15d32d5aa877) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '51b954d8-2d82-465b-8492-57d373ab74c4', 'volume_name': 'volume-51b954d8-2d82-465b-8492-57d373ab74c4', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:34:55 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-52bd65ac-6143-4e27-9a21-d7bb9a42d298 tempest-VolumeDependencyTests-1064398708 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8440c60a-c221-428f-b921-271f74c620dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:34:55 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-52bd65ac-6143-4e27-9a21-d7bb9a42d298 tempest-VolumeDependencyTests-1064398708 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8440c60a-c221-428f-b921-271f74c620dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:34:55 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-52bd65ac-6143-4e27-9a21-d7bb9a42d298 tempest-VolumeDependencyTests-1064398708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb9a8a28-35d2-41ff-becb-1039772e49bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:34:55 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-52bd65ac-6143-4e27-9a21-d7bb9a42d298 tempest-VolumeDependencyTests-1064398708 None] Volume 51b954d8-2d82-465b-8492-57d373ab74c4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-51b954d8-2d82-465b-8492-57d373ab74c4', 'volume_size': 1} Jul 31 12:34:55 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-52bd65ac-6143-4e27-9a21-d7bb9a42d298 tempest-VolumeDependencyTests-1064398708 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:34:55 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-52bd65ac-6143-4e27-9a21-d7bb9a42d298 tempest-VolumeDependencyTests-1064398708 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:34:55 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-52bd65ac-6143-4e27-9a21-d7bb9a42d298 tempest-VolumeDependencyTests-1064398708 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:34:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-206895002',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51b954d8-2d82-465b-8492-57d373ab74c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af5708b20f594719a09679b9f56f242f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:34:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:34:56Z,use_quota=True,user_id='3fad3d5c7d5b44e6b70fa58e652f1cd2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)}" {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 12:34:55 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-52bd65ac-6143-4e27-9a21-d7bb9a42d298 tempest-VolumeDependencyTests-1064398708 None] Creating volume 51b954d8-2d82-465b-8492-57d373ab74c4 {{(pid=89182) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 12:34:55 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-52bd65ac-6143-4e27-9a21-d7bb9a42d298 tempest-VolumeDependencyTests-1064398708 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:34:55 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-52bd65ac-6143-4e27-9a21-d7bb9a42d298 tempest-VolumeDependencyTests-1064398708 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:34:55 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-52bd65ac-6143-4e27-9a21-d7bb9a42d298 tempest-VolumeDependencyTests-1064398708 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:34:55 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-52bd65ac-6143-4e27-9a21-d7bb9a42d298 tempest-VolumeDependencyTests-1064398708 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:34:55 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-52bd65ac-6143-4e27-9a21-d7bb9a42d298 tempest-VolumeDependencyTests-1064398708 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:34:55 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-52bd65ac-6143-4e27-9a21-d7bb9a42d298 tempest-VolumeDependencyTests-1064398708 None] Selected osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 as target Quobyte volume. {{(pid=89182) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 12:34:55 devstack cinder-volume[89182]: INFO cinder.volume.drivers.remotefs [None req-52bd65ac-6143-4e27-9a21-d7bb9a42d298 tempest-VolumeDependencyTests-1064398708 None] casted to osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 Jul 31 12:34:55 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-52bd65ac-6143-4e27-9a21-d7bb9a42d298 tempest-VolumeDependencyTests-1064398708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-51b954d8-2d82-465b-8492-57d373ab74c4 1073741824 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:34:55 devstack sudo[110887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-51b954d8-2d82-465b-8492-57d373ab74c4 1073741824 Jul 31 12:34:55 devstack sudo[110887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:34:55 devstack cinder-volume[89182]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f8351fd-a5f4-4c58-9035-a82182ea9b2c tempest-CinderUnicodeTest-880391660 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89182) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 12:34:55 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-9f8351fd-a5f4-4c58-9035-a82182ea9b2c tempest-CinderUnicodeTest-880391660 None] Flow 'volume_create_manager' (7a4e910c-d3f8-49cd-965e-0d5b1444744f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:34:55 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-9f8351fd-a5f4-4c58-9035-a82182ea9b2c tempest-CinderUnicodeTest-880391660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6aceff4d-ae26-4340-a63b-5990d9b1b55c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:34:55 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-9f8351fd-a5f4-4c58-9035-a82182ea9b2c tempest-CinderUnicodeTest-880391660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6aceff4d-ae26-4340-a63b-5990d9b1b55c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:34:55Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0207af4d-6eb3-4e9e-87e5-3728115d5297,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8039b6017630400badd6c1dc0635ab5a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:34:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:34:56Z,use_quota=True,user_id='8d8ac03d494845a0aadc3b4242b119b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:34:55 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-9f8351fd-a5f4-4c58-9035-a82182ea9b2c tempest-CinderUnicodeTest-880391660 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b914a46-fa73-4965-a08d-6687609df48d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:34:55 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-9f8351fd-a5f4-4c58-9035-a82182ea9b2c tempest-CinderUnicodeTest-880391660 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b914a46-fa73-4965-a08d-6687609df48d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:34:55 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-9f8351fd-a5f4-4c58-9035-a82182ea9b2c tempest-CinderUnicodeTest-880391660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74fffa12-7bc6-4ffb-ac95-39f0e803f26f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:34:55 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-9f8351fd-a5f4-4c58-9035-a82182ea9b2c tempest-CinderUnicodeTest-880391660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74fffa12-7bc6-4ffb-ac95-39f0e803f26f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0207af4d-6eb3-4e9e-87e5-3728115d5297', 'volume_name': 'volume-0207af4d-6eb3-4e9e-87e5-3728115d5297', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:34:55 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-9f8351fd-a5f4-4c58-9035-a82182ea9b2c tempest-CinderUnicodeTest-880391660 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a00d1fd-8b1d-468b-b9cc-0877db67e300) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:34:55 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-9f8351fd-a5f4-4c58-9035-a82182ea9b2c tempest-CinderUnicodeTest-880391660 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a00d1fd-8b1d-468b-b9cc-0877db67e300) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:34:55 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-9f8351fd-a5f4-4c58-9035-a82182ea9b2c tempest-CinderUnicodeTest-880391660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (039a8ec9-77f5-47c8-a77a-bb1521d295c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:34:55 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-9f8351fd-a5f4-4c58-9035-a82182ea9b2c tempest-CinderUnicodeTest-880391660 None] Volume 0207af4d-6eb3-4e9e-87e5-3728115d5297: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0207af4d-6eb3-4e9e-87e5-3728115d5297', 'volume_size': 1} Jul 31 12:34:55 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-9f8351fd-a5f4-4c58-9035-a82182ea9b2c tempest-CinderUnicodeTest-880391660 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:34:56 devstack sudo[110887]: pam_unix(sudo:session): session closed for user root Jul 31 12:34:56 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-52bd65ac-6143-4e27-9a21-d7bb9a42d298 tempest-VolumeDependencyTests-1064398708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-51b954d8-2d82-465b-8492-57d373ab74c4 1073741824" returned: 0 in 0.411s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:34:56 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-52bd65ac-6143-4e27-9a21-d7bb9a42d298 tempest-VolumeDependencyTests-1064398708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-51b954d8-2d82-465b-8492-57d373ab74c4 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:34:56 devstack sudo[110892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-51b954d8-2d82-465b-8492-57d373ab74c4 Jul 31 12:34:56 devstack sudo[110892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:34:56 devstack sudo[110892]: pam_unix(sudo:session): session closed for user root Jul 31 12:34:56 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-52bd65ac-6143-4e27-9a21-d7bb9a42d298 tempest-VolumeDependencyTests-1064398708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-51b954d8-2d82-465b-8492-57d373ab74c4" returned: 0 in 0.240s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:34:56 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-52bd65ac-6143-4e27-9a21-d7bb9a42d298 tempest-VolumeDependencyTests-1064398708 None] <== create_volume: return (688ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'} {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 12:34:56 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-52bd65ac-6143-4e27-9a21-d7bb9a42d298 tempest-VolumeDependencyTests-1064398708 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.691s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:34:56 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-9f8351fd-a5f4-4c58-9035-a82182ea9b2c tempest-CinderUnicodeTest-880391660 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.520s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:34:56 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-9f8351fd-a5f4-4c58-9035-a82182ea9b2c tempest-CinderUnicodeTest-880391660 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:34:55Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0207af4d-6eb3-4e9e-87e5-3728115d5297,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8039b6017630400badd6c1dc0635ab5a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:34:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:34:56Z,use_quota=True,user_id='8d8ac03d494845a0aadc3b4242b119b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)}" {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 12:34:56 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-9f8351fd-a5f4-4c58-9035-a82182ea9b2c tempest-CinderUnicodeTest-880391660 None] Creating volume 0207af4d-6eb3-4e9e-87e5-3728115d5297 {{(pid=89182) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 12:34:56 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-9f8351fd-a5f4-4c58-9035-a82182ea9b2c tempest-CinderUnicodeTest-880391660 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:34:56 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-9f8351fd-a5f4-4c58-9035-a82182ea9b2c tempest-CinderUnicodeTest-880391660 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:34:56 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-9f8351fd-a5f4-4c58-9035-a82182ea9b2c tempest-CinderUnicodeTest-880391660 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:34:56 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-9f8351fd-a5f4-4c58-9035-a82182ea9b2c tempest-CinderUnicodeTest-880391660 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:34:56 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-9f8351fd-a5f4-4c58-9035-a82182ea9b2c tempest-CinderUnicodeTest-880391660 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:34:56 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-9f8351fd-a5f4-4c58-9035-a82182ea9b2c tempest-CinderUnicodeTest-880391660 None] Selected osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 as target Quobyte volume. {{(pid=89182) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 12:34:56 devstack cinder-volume[89182]: INFO cinder.volume.drivers.remotefs [None req-9f8351fd-a5f4-4c58-9035-a82182ea9b2c tempest-CinderUnicodeTest-880391660 None] casted to osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 Jul 31 12:34:56 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-9f8351fd-a5f4-4c58-9035-a82182ea9b2c tempest-CinderUnicodeTest-880391660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0207af4d-6eb3-4e9e-87e5-3728115d5297 1073741824 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:34:56 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-52bd65ac-6143-4e27-9a21-d7bb9a42d298 tempest-VolumeDependencyTests-1064398708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb9a8a28-35d2-41ff-becb-1039772e49bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-51b954d8-2d82-465b-8492-57d373ab74c4', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:34:56 devstack sudo[110895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0207af4d-6eb3-4e9e-87e5-3728115d5297 1073741824 Jul 31 12:34:56 devstack sudo[110895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:34:56 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-52bd65ac-6143-4e27-9a21-d7bb9a42d298 tempest-VolumeDependencyTests-1064398708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28f223e4-6dd3-4179-b6c9-e405035106e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:34:56 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-52bd65ac-6143-4e27-9a21-d7bb9a42d298 tempest-VolumeDependencyTests-1064398708 None] Volume volume-51b954d8-2d82-465b-8492-57d373ab74c4 (51b954d8-2d82-465b-8492-57d373ab74c4): created successfully Jul 31 12:34:56 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-52bd65ac-6143-4e27-9a21-d7bb9a42d298 tempest-VolumeDependencyTests-1064398708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28f223e4-6dd3-4179-b6c9-e405035106e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:34:56 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-52bd65ac-6143-4e27-9a21-d7bb9a42d298 tempest-VolumeDependencyTests-1064398708 None] Flow 'volume_create_manager' (88a9542a-b965-4989-aafb-47af78a7ff70) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:34:56 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-52bd65ac-6143-4e27-9a21-d7bb9a42d298 tempest-VolumeDependencyTests-1064398708 None] Created volume successfully. Jul 31 12:34:56 devstack sudo[110895]: pam_unix(sudo:session): session closed for user root Jul 31 12:34:56 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-9f8351fd-a5f4-4c58-9035-a82182ea9b2c tempest-CinderUnicodeTest-880391660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0207af4d-6eb3-4e9e-87e5-3728115d5297 1073741824" returned: 0 in 0.422s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:34:56 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-9f8351fd-a5f4-4c58-9035-a82182ea9b2c tempest-CinderUnicodeTest-880391660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0207af4d-6eb3-4e9e-87e5-3728115d5297 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:34:56 devstack sudo[110901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0207af4d-6eb3-4e9e-87e5-3728115d5297 Jul 31 12:34:56 devstack sudo[110901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:34:57 devstack sudo[110901]: pam_unix(sudo:session): session closed for user root Jul 31 12:34:57 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-9f8351fd-a5f4-4c58-9035-a82182ea9b2c tempest-CinderUnicodeTest-880391660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0207af4d-6eb3-4e9e-87e5-3728115d5297" returned: 0 in 0.240s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:34:57 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-9f8351fd-a5f4-4c58-9035-a82182ea9b2c tempest-CinderUnicodeTest-880391660 None] <== create_volume: return (703ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'} {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 12:34:57 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-9f8351fd-a5f4-4c58-9035-a82182ea9b2c tempest-CinderUnicodeTest-880391660 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.708s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:34:57 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-9f8351fd-a5f4-4c58-9035-a82182ea9b2c tempest-CinderUnicodeTest-880391660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (039a8ec9-77f5-47c8-a77a-bb1521d295c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0207af4d-6eb3-4e9e-87e5-3728115d5297', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:34:57 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-9f8351fd-a5f4-4c58-9035-a82182ea9b2c tempest-CinderUnicodeTest-880391660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90921b12-03a8-4558-ad20-7901ff612e1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:34:57 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-9f8351fd-a5f4-4c58-9035-a82182ea9b2c tempest-CinderUnicodeTest-880391660 None] Volume volume-0207af4d-6eb3-4e9e-87e5-3728115d5297 (0207af4d-6eb3-4e9e-87e5-3728115d5297): created successfully Jul 31 12:34:57 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-9f8351fd-a5f4-4c58-9035-a82182ea9b2c tempest-CinderUnicodeTest-880391660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90921b12-03a8-4558-ad20-7901ff612e1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:34:57 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-9f8351fd-a5f4-4c58-9035-a82182ea9b2c tempest-CinderUnicodeTest-880391660 None] Flow 'volume_create_manager' (7a4e910c-d3f8-49cd-965e-0d5b1444744f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:34:57 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-9f8351fd-a5f4-4c58-9035-a82182ea9b2c tempest-CinderUnicodeTest-880391660 None] Created volume successfully. Jul 31 12:34:57 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-d6ed51bb-aada-467d-8b0c-fbdc6b7b1e1e tempest-VolumeDependencyTests-1064398708 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:34:57 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-d6ed51bb-aada-467d-8b0c-fbdc6b7b1e1e tempest-VolumeDependencyTests-1064398708 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:34:57 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-d6ed51bb-aada-467d-8b0c-fbdc6b7b1e1e tempest-VolumeDependencyTests-1064398708 None] Creating offline snapshot d890fb25-9517-454e-8ed0-2c65d5c7088f of volume 51b954d8-2d82-465b-8492-57d373ab74c4 {{(pid=89182) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 31 12:34:57 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b5a6733-a7e4-43cf-a170-1ceead02dd18]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:34:57 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-d6ed51bb-aada-467d-8b0c-fbdc6b7b1e1e tempest-VolumeDependencyTests-1064398708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-51b954d8-2d82-465b-8492-57d373ab74c4 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:34:57 devstack sudo[110905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-51b954d8-2d82-465b-8492-57d373ab74c4 Jul 31 12:34:57 devstack sudo[110905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:34:58 devstack sudo[110905]: pam_unix(sudo:session): session closed for user root Jul 31 12:34:58 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-d6ed51bb-aada-467d-8b0c-fbdc6b7b1e1e tempest-VolumeDependencyTests-1064398708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-51b954d8-2d82-465b-8492-57d373ab74c4" returned: 0 in 0.434s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:34:58 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-d6ed51bb-aada-467d-8b0c-fbdc6b7b1e1e tempest-VolumeDependencyTests-1064398708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-51b954d8-2d82-465b-8492-57d373ab74c4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-51b954d8-2d82-465b-8492-57d373ab74c4.d890fb25-9517-454e-8ed0-2c65d5c7088f 1G {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:34:58 devstack sudo[110912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-51b954d8-2d82-465b-8492-57d373ab74c4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-51b954d8-2d82-465b-8492-57d373ab74c4.d890fb25-9517-454e-8ed0-2c65d5c7088f 1G Jul 31 12:34:58 devstack sudo[110912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:34:58 devstack cinder-volume[89182]: DEBUG cinder.volume.flows.manager.create_volume [None req-f820498f-a2a3-411c-beba-de5ab469b108 tempest-CinderUnicodeTest-880391660 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89182) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 12:34:58 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-f820498f-a2a3-411c-beba-de5ab469b108 tempest-CinderUnicodeTest-880391660 None] Flow 'volume_create_manager' (9dca71e1-10cb-4528-b7b8-bee873dbbeac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:34:58 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-f820498f-a2a3-411c-beba-de5ab469b108 tempest-CinderUnicodeTest-880391660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ea10476-38df-42f4-bba7-d4d2520b5599) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:34:58 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-f820498f-a2a3-411c-beba-de5ab469b108 tempest-CinderUnicodeTest-880391660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ea10476-38df-42f4-bba7-d4d2520b5599) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:34:58Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1296223668',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58a581aa-d009-4613-a2e5-558ee3616835,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8039b6017630400badd6c1dc0635ab5a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:34:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:34:58Z,use_quota=True,user_id='8d8ac03d494845a0aadc3b4242b119b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:34:58 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-f820498f-a2a3-411c-beba-de5ab469b108 tempest-CinderUnicodeTest-880391660 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b984eda3-da7f-40e6-befa-968576006f0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:34:58 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-f820498f-a2a3-411c-beba-de5ab469b108 tempest-CinderUnicodeTest-880391660 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b984eda3-da7f-40e6-befa-968576006f0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:34:58 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-f820498f-a2a3-411c-beba-de5ab469b108 tempest-CinderUnicodeTest-880391660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (820fd904-ca5e-4649-81ef-106bb51062dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:34:58 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-f820498f-a2a3-411c-beba-de5ab469b108 tempest-CinderUnicodeTest-880391660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (820fd904-ca5e-4649-81ef-106bb51062dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '58a581aa-d009-4613-a2e5-558ee3616835', 'volume_name': 'volume-58a581aa-d009-4613-a2e5-558ee3616835', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:34:58 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-f820498f-a2a3-411c-beba-de5ab469b108 tempest-CinderUnicodeTest-880391660 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (025f44f3-5b28-49e6-b331-901a22d2e495) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:34:58 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-f820498f-a2a3-411c-beba-de5ab469b108 tempest-CinderUnicodeTest-880391660 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (025f44f3-5b28-49e6-b331-901a22d2e495) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:34:58 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-f820498f-a2a3-411c-beba-de5ab469b108 tempest-CinderUnicodeTest-880391660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (821096f9-6a2d-418c-8134-0aa10ad6b356) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:34:58 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-f820498f-a2a3-411c-beba-de5ab469b108 tempest-CinderUnicodeTest-880391660 None] Volume 58a581aa-d009-4613-a2e5-558ee3616835: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-58a581aa-d009-4613-a2e5-558ee3616835', 'volume_size': 1} Jul 31 12:34:58 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-f820498f-a2a3-411c-beba-de5ab469b108 tempest-CinderUnicodeTest-880391660 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:34:58 devstack sudo[110912]: pam_unix(sudo:session): session closed for user root Jul 31 12:34:58 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-d6ed51bb-aada-467d-8b0c-fbdc6b7b1e1e tempest-VolumeDependencyTests-1064398708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-51b954d8-2d82-465b-8492-57d373ab74c4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-51b954d8-2d82-465b-8492-57d373ab74c4.d890fb25-9517-454e-8ed0-2c65d5c7088f 1G" returned: 0 in 0.404s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:34:58 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-d6ed51bb-aada-467d-8b0c-fbdc6b7b1e1e tempest-VolumeDependencyTests-1064398708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-51b954d8-2d82-465b-8492-57d373ab74c4 -F qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-51b954d8-2d82-465b-8492-57d373ab74c4.d890fb25-9517-454e-8ed0-2c65d5c7088f {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:34:58 devstack sudo[110918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-51b954d8-2d82-465b-8492-57d373ab74c4 -F qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-51b954d8-2d82-465b-8492-57d373ab74c4.d890fb25-9517-454e-8ed0-2c65d5c7088f Jul 31 12:34:58 devstack sudo[110918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:34:58 devstack sudo[110918]: pam_unix(sudo:session): session closed for user root Jul 31 12:34:58 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-d6ed51bb-aada-467d-8b0c-fbdc6b7b1e1e tempest-VolumeDependencyTests-1064398708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-51b954d8-2d82-465b-8492-57d373ab74c4 -F qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-51b954d8-2d82-465b-8492-57d373ab74c4.d890fb25-9517-454e-8ed0-2c65d5c7088f" returned: 0 in 0.295s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:34:58 devstack cinder-volume[89182]: WARNING cinder.volume.drivers.remotefs [None req-d6ed51bb-aada-467d-8b0c-fbdc6b7b1e1e tempest-VolumeDependencyTests-1064398708 None] /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-51b954d8-2d82-465b-8492-57d373ab74c4.d890fb25-9517-454e-8ed0-2c65d5c7088f is being set with open permissions: ugo+rw Jul 31 12:34:58 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-d6ed51bb-aada-467d-8b0c-fbdc6b7b1e1e tempest-VolumeDependencyTests-1064398708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-51b954d8-2d82-465b-8492-57d373ab74c4.d890fb25-9517-454e-8ed0-2c65d5c7088f {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:34:58 devstack sudo[110923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-51b954d8-2d82-465b-8492-57d373ab74c4.d890fb25-9517-454e-8ed0-2c65d5c7088f Jul 31 12:34:58 devstack sudo[110923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:34:59 devstack sudo[110923]: pam_unix(sudo:session): session closed for user root Jul 31 12:34:59 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-d6ed51bb-aada-467d-8b0c-fbdc6b7b1e1e tempest-VolumeDependencyTests-1064398708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-51b954d8-2d82-465b-8492-57d373ab74c4.d890fb25-9517-454e-8ed0-2c65d5c7088f" returned: 0 in 0.242s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:34:59 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-d6ed51bb-aada-467d-8b0c-fbdc6b7b1e1e tempest-VolumeDependencyTests-1064398708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-51b954d8-2d82-465b-8492-57d373ab74c4.info {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:34:59 devstack sudo[110926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-51b954d8-2d82-465b-8492-57d373ab74c4.info Jul 31 12:34:59 devstack sudo[110926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:34:59 devstack sudo[110926]: pam_unix(sudo:session): session closed for user root Jul 31 12:34:59 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-d6ed51bb-aada-467d-8b0c-fbdc6b7b1e1e tempest-VolumeDependencyTests-1064398708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-51b954d8-2d82-465b-8492-57d373ab74c4.info" returned: 0 in 0.249s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:34:59 devstack cinder-volume[89182]: WARNING cinder.volume.drivers.remotefs [None req-d6ed51bb-aada-467d-8b0c-fbdc6b7b1e1e tempest-VolumeDependencyTests-1064398708 None] /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-51b954d8-2d82-465b-8492-57d373ab74c4.info is being set with open permissions: ugo+rw Jul 31 12:34:59 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-d6ed51bb-aada-467d-8b0c-fbdc6b7b1e1e tempest-VolumeDependencyTests-1064398708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-51b954d8-2d82-465b-8492-57d373ab74c4.info {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:34:59 devstack sudo[110929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-51b954d8-2d82-465b-8492-57d373ab74c4.info Jul 31 12:34:59 devstack sudo[110929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:34:59 devstack sudo[110929]: pam_unix(sudo:session): session closed for user root Jul 31 12:34:59 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-d6ed51bb-aada-467d-8b0c-fbdc6b7b1e1e tempest-VolumeDependencyTests-1064398708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-51b954d8-2d82-465b-8492-57d373ab74c4.info" returned: 0 in 0.246s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:34:59 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-d6ed51bb-aada-467d-8b0c-fbdc6b7b1e1e tempest-VolumeDependencyTests-1064398708 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.956s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:34:59 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-f820498f-a2a3-411c-beba-de5ab469b108 tempest-CinderUnicodeTest-880391660 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.367s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:34:59 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-f820498f-a2a3-411c-beba-de5ab469b108 tempest-CinderUnicodeTest-880391660 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:34:58Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1296223668',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58a581aa-d009-4613-a2e5-558ee3616835,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8039b6017630400badd6c1dc0635ab5a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:34:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:34:58Z,use_quota=True,user_id='8d8ac03d494845a0aadc3b4242b119b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)}" {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 12:34:59 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-f820498f-a2a3-411c-beba-de5ab469b108 tempest-CinderUnicodeTest-880391660 None] Creating volume 58a581aa-d009-4613-a2e5-558ee3616835 {{(pid=89182) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 12:34:59 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-f820498f-a2a3-411c-beba-de5ab469b108 tempest-CinderUnicodeTest-880391660 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:34:59 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-f820498f-a2a3-411c-beba-de5ab469b108 tempest-CinderUnicodeTest-880391660 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:34:59 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-f820498f-a2a3-411c-beba-de5ab469b108 tempest-CinderUnicodeTest-880391660 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:34:59 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-f820498f-a2a3-411c-beba-de5ab469b108 tempest-CinderUnicodeTest-880391660 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:34:59 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-f820498f-a2a3-411c-beba-de5ab469b108 tempest-CinderUnicodeTest-880391660 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:34:59 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-f820498f-a2a3-411c-beba-de5ab469b108 tempest-CinderUnicodeTest-880391660 None] Selected osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 as target Quobyte volume. {{(pid=89182) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 12:34:59 devstack cinder-volume[89182]: INFO cinder.volume.drivers.remotefs [None req-f820498f-a2a3-411c-beba-de5ab469b108 tempest-CinderUnicodeTest-880391660 None] casted to osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 Jul 31 12:34:59 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-f820498f-a2a3-411c-beba-de5ab469b108 tempest-CinderUnicodeTest-880391660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-58a581aa-d009-4613-a2e5-558ee3616835 1073741824 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:34:59 devstack sudo[110932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-58a581aa-d009-4613-a2e5-558ee3616835 1073741824 Jul 31 12:34:59 devstack sudo[110932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:34:59 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-d6ed51bb-aada-467d-8b0c-fbdc6b7b1e1e tempest-VolumeDependencyTests-1064398708 None] Create snapshot completed successfully Jul 31 12:35:00 devstack sudo[110932]: pam_unix(sudo:session): session closed for user root Jul 31 12:35:00 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-f820498f-a2a3-411c-beba-de5ab469b108 tempest-CinderUnicodeTest-880391660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-58a581aa-d009-4613-a2e5-558ee3616835 1073741824" returned: 0 in 0.446s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:35:00 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-f820498f-a2a3-411c-beba-de5ab469b108 tempest-CinderUnicodeTest-880391660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-58a581aa-d009-4613-a2e5-558ee3616835 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:35:00 devstack sudo[110938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-58a581aa-d009-4613-a2e5-558ee3616835 Jul 31 12:35:00 devstack sudo[110938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:35:00 devstack cinder-volume[89182]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e0f0277-08ee-4d8f-ae9d-996ff024f21e tempest-VolumeDependencyTests-1064398708 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89182) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 12:35:00 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-1e0f0277-08ee-4d8f-ae9d-996ff024f21e tempest-VolumeDependencyTests-1064398708 None] Flow 'volume_create_manager' (524ac69c-228b-4039-9277-1a4d5dc65fd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:35:00 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-1e0f0277-08ee-4d8f-ae9d-996ff024f21e tempest-VolumeDependencyTests-1064398708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9775353c-f0b9-42e3-a951-c9210b797f52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:35:00 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-1e0f0277-08ee-4d8f-ae9d-996ff024f21e tempest-VolumeDependencyTests-1064398708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9775353c-f0b9-42e3-a951-c9210b797f52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:35:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1871512524',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2390c21e-ec67-4c65-aac3-1135f5e527f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af5708b20f594719a09679b9f56f242f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:35:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=d890fb25-9517-454e-8ed0-2c65d5c7088f,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:35:00Z,use_quota=True,user_id='3fad3d5c7d5b44e6b70fa58e652f1cd2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:35:00 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-1e0f0277-08ee-4d8f-ae9d-996ff024f21e tempest-VolumeDependencyTests-1064398708 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d3e8d38-07f5-4705-b9c0-4d9feba511de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:35:00 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-1e0f0277-08ee-4d8f-ae9d-996ff024f21e tempest-VolumeDependencyTests-1064398708 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d3e8d38-07f5-4705-b9c0-4d9feba511de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:35:00 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-1e0f0277-08ee-4d8f-ae9d-996ff024f21e tempest-VolumeDependencyTests-1064398708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe57ce62-f1c4-491b-9f0c-31875de9d4de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:35:00 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-1e0f0277-08ee-4d8f-ae9d-996ff024f21e tempest-VolumeDependencyTests-1064398708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe57ce62-f1c4-491b-9f0c-31875de9d4de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '2390c21e-ec67-4c65-aac3-1135f5e527f6', 'volume_name': 'volume-2390c21e-ec67-4c65-aac3-1135f5e527f6', 'volume_size': 1, 'snapshot_id': 'd890fb25-9517-454e-8ed0-2c65d5c7088f'}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:35:00 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-1e0f0277-08ee-4d8f-ae9d-996ff024f21e tempest-VolumeDependencyTests-1064398708 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5be31f4-a029-438a-9bd5-1a89e547528e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:35:00 devstack sudo[110938]: pam_unix(sudo:session): session closed for user root Jul 31 12:35:00 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-1e0f0277-08ee-4d8f-ae9d-996ff024f21e tempest-VolumeDependencyTests-1064398708 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5be31f4-a029-438a-9bd5-1a89e547528e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:35:00 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-1e0f0277-08ee-4d8f-ae9d-996ff024f21e tempest-VolumeDependencyTests-1064398708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16d14c16-efd6-4c6f-93f7-cfef9d1865f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:35:00 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-1e0f0277-08ee-4d8f-ae9d-996ff024f21e tempest-VolumeDependencyTests-1064398708 None] Volume 2390c21e-ec67-4c65-aac3-1135f5e527f6: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-2390c21e-ec67-4c65-aac3-1135f5e527f6', 'volume_size': 1, 'snapshot_id': 'd890fb25-9517-454e-8ed0-2c65d5c7088f'} Jul 31 12:35:00 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-f820498f-a2a3-411c-beba-de5ab469b108 tempest-CinderUnicodeTest-880391660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-58a581aa-d009-4613-a2e5-558ee3616835" returned: 0 in 0.264s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:35:00 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-f820498f-a2a3-411c-beba-de5ab469b108 tempest-CinderUnicodeTest-880391660 None] <== create_volume: return (774ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'} {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 12:35:00 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-f820498f-a2a3-411c-beba-de5ab469b108 tempest-CinderUnicodeTest-880391660 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.777s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:35:00 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-1e0f0277-08ee-4d8f-ae9d-996ff024f21e tempest-VolumeDependencyTests-1064398708 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:35:00 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-1e0f0277-08ee-4d8f-ae9d-996ff024f21e tempest-VolumeDependencyTests-1064398708 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.000s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:35:00 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-1e0f0277-08ee-4d8f-ae9d-996ff024f21e tempest-VolumeDependencyTests-1064398708 None] Acquiring lock "cinder-quobyte-d890fb25-9517-454e-8ed0-2c65d5c7088f-2390c21e-ec67-4c65-aac3-1135f5e527f6" by "_create_volume_from_snapshot" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:35:00 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-f820498f-a2a3-411c-beba-de5ab469b108 tempest-CinderUnicodeTest-880391660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (821096f9-6a2d-418c-8134-0aa10ad6b356) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-58a581aa-d009-4613-a2e5-558ee3616835', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:35:00 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-f820498f-a2a3-411c-beba-de5ab469b108 tempest-CinderUnicodeTest-880391660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb9f28b6-d289-4df5-9ad5-8f5c906dd347) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:35:00 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-1e0f0277-08ee-4d8f-ae9d-996ff024f21e tempest-VolumeDependencyTests-1064398708 None] Lock "cinder-quobyte-d890fb25-9517-454e-8ed0-2c65d5c7088f-2390c21e-ec67-4c65-aac3-1135f5e527f6" acquired by "_create_volume_from_snapshot" :: waited 0.024s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:35:00 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-1e0f0277-08ee-4d8f-ae9d-996ff024f21e tempest-VolumeDependencyTests-1064398708 None] Creating volume 2390c21e-ec67-4c65-aac3-1135f5e527f6 from snapshot d890fb25-9517-454e-8ed0-2c65d5c7088f {{(pid=89182) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 31 12:35:00 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-1e0f0277-08ee-4d8f-ae9d-996ff024f21e tempest-VolumeDependencyTests-1064398708 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:35:00 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-1e0f0277-08ee-4d8f-ae9d-996ff024f21e tempest-VolumeDependencyTests-1064398708 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:35:00 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-1e0f0277-08ee-4d8f-ae9d-996ff024f21e tempest-VolumeDependencyTests-1064398708 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:35:00 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-1e0f0277-08ee-4d8f-ae9d-996ff024f21e tempest-VolumeDependencyTests-1064398708 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:35:00 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-1e0f0277-08ee-4d8f-ae9d-996ff024f21e tempest-VolumeDependencyTests-1064398708 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:35:00 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-1e0f0277-08ee-4d8f-ae9d-996ff024f21e tempest-VolumeDependencyTests-1064398708 None] Selected osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 as target Quobyte volume. {{(pid=89182) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 12:35:00 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-1e0f0277-08ee-4d8f-ae9d-996ff024f21e tempest-VolumeDependencyTests-1064398708 None] Acquiring lock "cinder-quobyte-2390c21e-ec67-4c65-aac3-1135f5e527f6" by "_copy_volume_from_snapshot" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:35:00 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-f820498f-a2a3-411c-beba-de5ab469b108 tempest-CinderUnicodeTest-880391660 None] Volume volume-58a581aa-d009-4613-a2e5-558ee3616835 (58a581aa-d009-4613-a2e5-558ee3616835): created successfully Jul 31 12:35:00 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-f820498f-a2a3-411c-beba-de5ab469b108 tempest-CinderUnicodeTest-880391660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb9f28b6-d289-4df5-9ad5-8f5c906dd347) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:35:00 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-f820498f-a2a3-411c-beba-de5ab469b108 tempest-CinderUnicodeTest-880391660 None] Flow 'volume_create_manager' (9dca71e1-10cb-4528-b7b8-bee873dbbeac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:35:00 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-1e0f0277-08ee-4d8f-ae9d-996ff024f21e tempest-VolumeDependencyTests-1064398708 None] Lock "cinder-quobyte-2390c21e-ec67-4c65-aac3-1135f5e527f6" acquired by "_copy_volume_from_snapshot" :: waited 0.024s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:35:00 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-1e0f0277-08ee-4d8f-ae9d-996ff024f21e tempest-VolumeDependencyTests-1064398708 None] snapshot: d890fb25-9517-454e-8ed0-2c65d5c7088f, volume: 2390c21e-ec67-4c65-aac3-1135f5e527f6, {{(pid=89182) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Jul 31 12:35:00 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-f820498f-a2a3-411c-beba-de5ab469b108 tempest-CinderUnicodeTest-880391660 None] Created volume successfully. Jul 31 12:35:00 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-1e0f0277-08ee-4d8f-ae9d-996ff024f21e tempest-VolumeDependencyTests-1064398708 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:35:00 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-1e0f0277-08ee-4d8f-ae9d-996ff024f21e tempest-VolumeDependencyTests-1064398708 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:35:00 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-1e0f0277-08ee-4d8f-ae9d-996ff024f21e tempest-VolumeDependencyTests-1064398708 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:35:00 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-1e0f0277-08ee-4d8f-ae9d-996ff024f21e tempest-VolumeDependencyTests-1064398708 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:35:00 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-1e0f0277-08ee-4d8f-ae9d-996ff024f21e tempest-VolumeDependencyTests-1064398708 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:35:00 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[40142181-d1aa-471f-8b57-63e4dc655d07]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:35:00 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-1e0f0277-08ee-4d8f-ae9d-996ff024f21e tempest-VolumeDependencyTests-1064398708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-51b954d8-2d82-465b-8492-57d373ab74c4.d890fb25-9517-454e-8ed0-2c65d5c7088f {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:35:00 devstack sudo[110941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-51b954d8-2d82-465b-8492-57d373ab74c4.d890fb25-9517-454e-8ed0-2c65d5c7088f Jul 31 12:35:00 devstack sudo[110941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:35:00 devstack sudo[110941]: pam_unix(sudo:session): session closed for user root Jul 31 12:35:00 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-1e0f0277-08ee-4d8f-ae9d-996ff024f21e tempest-VolumeDependencyTests-1064398708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-51b954d8-2d82-465b-8492-57d373ab74c4.d890fb25-9517-454e-8ed0-2c65d5c7088f" returned: 0 in 0.350s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:35:00 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-1e0f0277-08ee-4d8f-ae9d-996ff024f21e tempest-VolumeDependencyTests-1064398708 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-51b954d8-2d82-465b-8492-57d373ab74c4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89182) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 12:35:00 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[75815af8-dff6-4605-b7bd-76c1ec7e17a8]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:35:00 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-1e0f0277-08ee-4d8f-ae9d-996ff024f21e tempest-VolumeDependencyTests-1064398708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-51b954d8-2d82-465b-8492-57d373ab74c4 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:35:01 devstack sudo[110946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-51b954d8-2d82-465b-8492-57d373ab74c4 Jul 31 12:35:01 devstack sudo[110946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:35:01 devstack sudo[110946]: pam_unix(sudo:session): session closed for user root Jul 31 12:35:01 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-1e0f0277-08ee-4d8f-ae9d-996ff024f21e tempest-VolumeDependencyTests-1064398708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-51b954d8-2d82-465b-8492-57d373ab74c4" returned: 0 in 0.362s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:35:01 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-1e0f0277-08ee-4d8f-ae9d-996ff024f21e tempest-VolumeDependencyTests-1064398708 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-51b954d8-2d82-465b-8492-57d373ab74c4 {{(pid=89182) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Jul 31 12:35:01 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-1e0f0277-08ee-4d8f-ae9d-996ff024f21e tempest-VolumeDependencyTests-1064398708 None] Creating direct copy from snapshot {{(pid=89182) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Jul 31 12:35:01 devstack cinder-volume[89182]: DEBUG cinder.utils [None req-1e0f0277-08ee-4d8f-ae9d-996ff024f21e tempest-VolumeDependencyTests-1064398708 None] Path /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-2390c21e-ec67-4c65-aac3-1135f5e527f6 not found in is_blk_device check {{(pid=89182) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 31 12:35:01 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-1e0f0277-08ee-4d8f-ae9d-996ff024f21e tempest-VolumeDependencyTests-1064398708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-51b954d8-2d82-465b-8492-57d373ab74c4 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-2390c21e-ec67-4c65-aac3-1135f5e527f6 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:35:01 devstack sudo[110951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-51b954d8-2d82-465b-8492-57d373ab74c4 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-2390c21e-ec67-4c65-aac3-1135f5e527f6 Jul 31 12:35:01 devstack sudo[110951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:35:01 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-75f64ff5-661d-4812-9dda-9b9315a63976 tempest-CinderUnicodeTest-880391660 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:35:05 devstack sudo[110951]: pam_unix(sudo:session): session closed for user root Jul 31 12:35:05 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-1e0f0277-08ee-4d8f-ae9d-996ff024f21e tempest-VolumeDependencyTests-1064398708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-51b954d8-2d82-465b-8492-57d373ab74c4 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-2390c21e-ec67-4c65-aac3-1135f5e527f6" returned: 0 in 4.296s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:35:05 devstack cinder-volume[89182]: DEBUG cinder.image.image_utils [None req-1e0f0277-08ee-4d8f-ae9d-996ff024f21e tempest-VolumeDependencyTests-1064398708 None] Image conversion details: src /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-51b954d8-2d82-465b-8492-57d373ab74c4, size 1024.00 MB, duration 4.30 sec, destination /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-2390c21e-ec67-4c65-aac3-1135f5e527f6 {{(pid=89182) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 31 12:35:05 devstack cinder-volume[89182]: INFO cinder.image.image_utils [None req-1e0f0277-08ee-4d8f-ae9d-996ff024f21e tempest-VolumeDependencyTests-1064398708 None] Converted 1024.00 MB image at 238.29 MB/s Jul 31 12:35:05 devstack cinder-volume[89182]: WARNING cinder.volume.drivers.remotefs [None req-1e0f0277-08ee-4d8f-ae9d-996ff024f21e tempest-VolumeDependencyTests-1064398708 None] /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-2390c21e-ec67-4c65-aac3-1135f5e527f6 is being set with open permissions: ugo+rw Jul 31 12:35:05 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-1e0f0277-08ee-4d8f-ae9d-996ff024f21e tempest-VolumeDependencyTests-1064398708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-2390c21e-ec67-4c65-aac3-1135f5e527f6 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:35:05 devstack sudo[110968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-2390c21e-ec67-4c65-aac3-1135f5e527f6 Jul 31 12:35:05 devstack sudo[110968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:35:05 devstack sudo[110968]: pam_unix(sudo:session): session closed for user root Jul 31 12:35:05 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-1e0f0277-08ee-4d8f-ae9d-996ff024f21e tempest-VolumeDependencyTests-1064398708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-2390c21e-ec67-4c65-aac3-1135f5e527f6" returned: 0 in 0.261s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:35:05 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-1e0f0277-08ee-4d8f-ae9d-996ff024f21e tempest-VolumeDependencyTests-1064398708 None] Lock "cinder-quobyte-2390c21e-ec67-4c65-aac3-1135f5e527f6" released by "_copy_volume_from_snapshot" :: held 5.351s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:35:05 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-1e0f0277-08ee-4d8f-ae9d-996ff024f21e tempest-VolumeDependencyTests-1064398708 None] Lock "cinder-quobyte-d890fb25-9517-454e-8ed0-2c65d5c7088f-2390c21e-ec67-4c65-aac3-1135f5e527f6" released by "_create_volume_from_snapshot" :: held 5.428s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:35:05 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-1e0f0277-08ee-4d8f-ae9d-996ff024f21e tempest-VolumeDependencyTests-1064398708 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.453s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:35:05 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-75f64ff5-661d-4812-9dda-9b9315a63976 tempest-CinderUnicodeTest-880391660 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.315s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:35:05 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-75f64ff5-661d-4812-9dda-9b9315a63976 tempest-CinderUnicodeTest-880391660 None] Creating offline snapshot 601be4b7-ded4-4b44-8d7a-02e267f12174 of volume 58a581aa-d009-4613-a2e5-558ee3616835 {{(pid=89182) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 31 12:35:05 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-1e0f0277-08ee-4d8f-ae9d-996ff024f21e tempest-VolumeDependencyTests-1064398708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16d14c16-efd6-4c6f-93f7-cfef9d1865f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2390c21e-ec67-4c65-aac3-1135f5e527f6', 'volume_size': 1, 'snapshot_id': 'd890fb25-9517-454e-8ed0-2c65d5c7088f'}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:35:05 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-1e0f0277-08ee-4d8f-ae9d-996ff024f21e tempest-VolumeDependencyTests-1064398708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd6a5549-2dca-448a-badf-cd96baf129d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:35:05 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[f23959b8-d698-4e4e-aee0-f18894689394]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:35:05 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-75f64ff5-661d-4812-9dda-9b9315a63976 tempest-CinderUnicodeTest-880391660 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-58a581aa-d009-4613-a2e5-558ee3616835 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:35:05 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-1e0f0277-08ee-4d8f-ae9d-996ff024f21e tempest-VolumeDependencyTests-1064398708 None] Volume volume-2390c21e-ec67-4c65-aac3-1135f5e527f6 (2390c21e-ec67-4c65-aac3-1135f5e527f6): created successfully Jul 31 12:35:05 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-1e0f0277-08ee-4d8f-ae9d-996ff024f21e tempest-VolumeDependencyTests-1064398708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd6a5549-2dca-448a-badf-cd96baf129d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:35:05 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-1e0f0277-08ee-4d8f-ae9d-996ff024f21e tempest-VolumeDependencyTests-1064398708 None] Flow 'volume_create_manager' (524ac69c-228b-4039-9277-1a4d5dc65fd7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:35:06 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-1e0f0277-08ee-4d8f-ae9d-996ff024f21e tempest-VolumeDependencyTests-1064398708 None] Created volume successfully. Jul 31 12:35:06 devstack sudo[110973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-58a581aa-d009-4613-a2e5-558ee3616835 Jul 31 12:35:06 devstack sudo[110973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:35:06 devstack sudo[110973]: pam_unix(sudo:session): session closed for user root Jul 31 12:35:06 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-75f64ff5-661d-4812-9dda-9b9315a63976 tempest-CinderUnicodeTest-880391660 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-58a581aa-d009-4613-a2e5-558ee3616835" returned: 0 in 0.353s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:35:06 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-75f64ff5-661d-4812-9dda-9b9315a63976 tempest-CinderUnicodeTest-880391660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-58a581aa-d009-4613-a2e5-558ee3616835,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-58a581aa-d009-4613-a2e5-558ee3616835.601be4b7-ded4-4b44-8d7a-02e267f12174 1G {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:35:06 devstack sudo[110979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-58a581aa-d009-4613-a2e5-558ee3616835,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-58a581aa-d009-4613-a2e5-558ee3616835.601be4b7-ded4-4b44-8d7a-02e267f12174 1G Jul 31 12:35:06 devstack sudo[110979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:35:06 devstack sudo[110979]: pam_unix(sudo:session): session closed for user root Jul 31 12:35:06 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-75f64ff5-661d-4812-9dda-9b9315a63976 tempest-CinderUnicodeTest-880391660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-58a581aa-d009-4613-a2e5-558ee3616835,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-58a581aa-d009-4613-a2e5-558ee3616835.601be4b7-ded4-4b44-8d7a-02e267f12174 1G" returned: 0 in 0.387s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:35:06 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-75f64ff5-661d-4812-9dda-9b9315a63976 tempest-CinderUnicodeTest-880391660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-58a581aa-d009-4613-a2e5-558ee3616835 -F qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-58a581aa-d009-4613-a2e5-558ee3616835.601be4b7-ded4-4b44-8d7a-02e267f12174 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:35:06 devstack sudo[110984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-58a581aa-d009-4613-a2e5-558ee3616835 -F qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-58a581aa-d009-4613-a2e5-558ee3616835.601be4b7-ded4-4b44-8d7a-02e267f12174 Jul 31 12:35:06 devstack sudo[110984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:35:06 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-b2b4dfad-758c-4857-bf09-f78ae0524884 tempest-VolumeDependencyTests-1064398708 None] Acquiring lock "cinder-d890fb25-9517-454e-8ed0-2c65d5c7088f-delete_snapshot" by "delete_snapshot" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:35:06 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-b2b4dfad-758c-4857-bf09-f78ae0524884 tempest-VolumeDependencyTests-1064398708 None] Lock "cinder-d890fb25-9517-454e-8ed0-2c65d5c7088f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:35:06 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-b2b4dfad-758c-4857-bf09-f78ae0524884 tempest-VolumeDependencyTests-1064398708 None] Acquiring lock "cinder-quobyte-51b954d8-2d82-465b-8492-57d373ab74c4" by "delete_snapshot" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:35:06 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-b2b4dfad-758c-4857-bf09-f78ae0524884 tempest-VolumeDependencyTests-1064398708 None] Lock "cinder-quobyte-51b954d8-2d82-465b-8492-57d373ab74c4" acquired by "delete_snapshot" :: waited 0.014s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:35:06 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-b2b4dfad-758c-4857-bf09-f78ae0524884 tempest-VolumeDependencyTests-1064398708 None] Acquiring lock "cinder-quobyte-d890fb25-9517-454e-8ed0-2c65d5c7088f" by "_delete_snapshot" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:35:06 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-b2b4dfad-758c-4857-bf09-f78ae0524884 tempest-VolumeDependencyTests-1064398708 None] Lock "cinder-quobyte-d890fb25-9517-454e-8ed0-2c65d5c7088f" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:35:06 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-b2b4dfad-758c-4857-bf09-f78ae0524884 tempest-VolumeDependencyTests-1064398708 None] Deleting offline snapshot d890fb25-9517-454e-8ed0-2c65d5c7088f of volume 51b954d8-2d82-465b-8492-57d373ab74c4 {{(pid=89182) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 31 12:35:06 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-b2b4dfad-758c-4857-bf09-f78ae0524884 tempest-VolumeDependencyTests-1064398708 None] snapshot_file for this snap is: volume-51b954d8-2d82-465b-8492-57d373ab74c4.d890fb25-9517-454e-8ed0-2c65d5c7088f {{(pid=89182) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 31 12:35:06 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[895eaf0d-38ce-4da8-bfa0-0b5f86dd6f4a]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:35:06 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-b2b4dfad-758c-4857-bf09-f78ae0524884 tempest-VolumeDependencyTests-1064398708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-51b954d8-2d82-465b-8492-57d373ab74c4.d890fb25-9517-454e-8ed0-2c65d5c7088f {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:35:07 devstack sudo[110984]: pam_unix(sudo:session): session closed for user root Jul 31 12:35:07 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-75f64ff5-661d-4812-9dda-9b9315a63976 tempest-CinderUnicodeTest-880391660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-58a581aa-d009-4613-a2e5-558ee3616835 -F qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-58a581aa-d009-4613-a2e5-558ee3616835.601be4b7-ded4-4b44-8d7a-02e267f12174" returned: 0 in 0.317s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:35:07 devstack cinder-volume[89182]: WARNING cinder.volume.drivers.remotefs [None req-75f64ff5-661d-4812-9dda-9b9315a63976 tempest-CinderUnicodeTest-880391660 None] /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-58a581aa-d009-4613-a2e5-558ee3616835.601be4b7-ded4-4b44-8d7a-02e267f12174 is being set with open permissions: ugo+rw Jul 31 12:35:07 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-75f64ff5-661d-4812-9dda-9b9315a63976 tempest-CinderUnicodeTest-880391660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-58a581aa-d009-4613-a2e5-558ee3616835.601be4b7-ded4-4b44-8d7a-02e267f12174 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:35:07 devstack sudo[110986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-51b954d8-2d82-465b-8492-57d373ab74c4.d890fb25-9517-454e-8ed0-2c65d5c7088f Jul 31 12:35:07 devstack sudo[110986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:35:07 devstack sudo[110991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-58a581aa-d009-4613-a2e5-558ee3616835.601be4b7-ded4-4b44-8d7a-02e267f12174 Jul 31 12:35:07 devstack sudo[110991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:35:07 devstack sudo[110991]: pam_unix(sudo:session): session closed for user root Jul 31 12:35:07 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-75f64ff5-661d-4812-9dda-9b9315a63976 tempest-CinderUnicodeTest-880391660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-58a581aa-d009-4613-a2e5-558ee3616835.601be4b7-ded4-4b44-8d7a-02e267f12174" returned: 0 in 0.245s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:35:07 devstack sudo[110986]: pam_unix(sudo:session): session closed for user root Jul 31 12:35:07 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-b2b4dfad-758c-4857-bf09-f78ae0524884 tempest-VolumeDependencyTests-1064398708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-51b954d8-2d82-465b-8492-57d373ab74c4.d890fb25-9517-454e-8ed0-2c65d5c7088f" returned: 0 in 0.356s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:35:07 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-b2b4dfad-758c-4857-bf09-f78ae0524884 tempest-VolumeDependencyTests-1064398708 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-51b954d8-2d82-465b-8492-57d373ab74c4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89182) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 12:35:07 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[721b8077-832c-41c1-81f3-3560cf8d2cdc]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:35:07 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-b2b4dfad-758c-4857-bf09-f78ae0524884 tempest-VolumeDependencyTests-1064398708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-51b954d8-2d82-465b-8492-57d373ab74c4 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:35:07 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-75f64ff5-661d-4812-9dda-9b9315a63976 tempest-CinderUnicodeTest-880391660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-58a581aa-d009-4613-a2e5-558ee3616835.info {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:35:07 devstack sudo[110999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-58a581aa-d009-4613-a2e5-558ee3616835.info Jul 31 12:35:07 devstack sudo[110999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:35:07 devstack sudo[110998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-51b954d8-2d82-465b-8492-57d373ab74c4 Jul 31 12:35:07 devstack sudo[110998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:35:07 devstack sudo[110999]: pam_unix(sudo:session): session closed for user root Jul 31 12:35:07 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-75f64ff5-661d-4812-9dda-9b9315a63976 tempest-CinderUnicodeTest-880391660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-58a581aa-d009-4613-a2e5-558ee3616835.info" returned: 0 in 0.255s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:35:07 devstack cinder-volume[89182]: WARNING cinder.volume.drivers.remotefs [None req-75f64ff5-661d-4812-9dda-9b9315a63976 tempest-CinderUnicodeTest-880391660 None] /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-58a581aa-d009-4613-a2e5-558ee3616835.info is being set with open permissions: ugo+rw Jul 31 12:35:07 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-75f64ff5-661d-4812-9dda-9b9315a63976 tempest-CinderUnicodeTest-880391660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-58a581aa-d009-4613-a2e5-558ee3616835.info {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:35:07 devstack sudo[111003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-58a581aa-d009-4613-a2e5-558ee3616835.info Jul 31 12:35:07 devstack sudo[111003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:35:07 devstack sudo[111003]: pam_unix(sudo:session): session closed for user root Jul 31 12:35:07 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-75f64ff5-661d-4812-9dda-9b9315a63976 tempest-CinderUnicodeTest-880391660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-58a581aa-d009-4613-a2e5-558ee3616835.info" returned: 0 in 0.256s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:35:07 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-75f64ff5-661d-4812-9dda-9b9315a63976 tempest-CinderUnicodeTest-880391660 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.937s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:35:07 devstack sudo[110998]: pam_unix(sudo:session): session closed for user root Jul 31 12:35:07 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-b2b4dfad-758c-4857-bf09-f78ae0524884 tempest-VolumeDependencyTests-1064398708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-51b954d8-2d82-465b-8492-57d373ab74c4" returned: 0 in 0.571s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:35:07 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-b2b4dfad-758c-4857-bf09-f78ae0524884 tempest-VolumeDependencyTests-1064398708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-51b954d8-2d82-465b-8492-57d373ab74c4.d890fb25-9517-454e-8ed0-2c65d5c7088f {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:35:07 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-75f64ff5-661d-4812-9dda-9b9315a63976 tempest-CinderUnicodeTest-880391660 None] Create snapshot completed successfully Jul 31 12:35:07 devstack sudo[111009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-51b954d8-2d82-465b-8492-57d373ab74c4.d890fb25-9517-454e-8ed0-2c65d5c7088f Jul 31 12:35:07 devstack sudo[111009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:35:08 devstack sudo[111009]: pam_unix(sudo:session): session closed for user root Jul 31 12:35:08 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-b2b4dfad-758c-4857-bf09-f78ae0524884 tempest-VolumeDependencyTests-1064398708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-51b954d8-2d82-465b-8492-57d373ab74c4.d890fb25-9517-454e-8ed0-2c65d5c7088f" returned: 0 in 0.339s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:35:08 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-b2b4dfad-758c-4857-bf09-f78ae0524884 tempest-VolumeDependencyTests-1064398708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-51b954d8-2d82-465b-8492-57d373ab74c4.d890fb25-9517-454e-8ed0-2c65d5c7088f {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:35:08 devstack sudo[111014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-51b954d8-2d82-465b-8492-57d373ab74c4.d890fb25-9517-454e-8ed0-2c65d5c7088f Jul 31 12:35:08 devstack sudo[111014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:35:08 devstack sudo[111014]: pam_unix(sudo:session): session closed for user root Jul 31 12:35:08 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-b2b4dfad-758c-4857-bf09-f78ae0524884 tempest-VolumeDependencyTests-1064398708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-51b954d8-2d82-465b-8492-57d373ab74c4.d890fb25-9517-454e-8ed0-2c65d5c7088f" returned: 0 in 0.241s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:35:08 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-b2b4dfad-758c-4857-bf09-f78ae0524884 tempest-VolumeDependencyTests-1064398708 None] Lock "cinder-quobyte-d890fb25-9517-454e-8ed0-2c65d5c7088f" released by "_delete_snapshot" :: held 1.597s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:35:08 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-b2b4dfad-758c-4857-bf09-f78ae0524884 tempest-VolumeDependencyTests-1064398708 None] Lock "cinder-quobyte-51b954d8-2d82-465b-8492-57d373ab74c4" released by "delete_snapshot" :: held 1.619s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:35:08 devstack cinder-volume[89182]: DEBUG cinder.quota [None req-b2b4dfad-758c-4857-bf09-f78ae0524884 tempest-VolumeDependencyTests-1064398708 None] Created reservations ['79c6eb96-2aa9-4b63-aac6-1284c5c9fe1e', 'ad353e31-43b9-409e-b007-14adefa0f18b', '176116ae-9695-41ed-85ea-526363e27ee2', '621afad5-5340-4d03-97fb-1cd8518c7c56'] {{(pid=89182) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 12:35:08 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-b2b4dfad-758c-4857-bf09-f78ae0524884 tempest-VolumeDependencyTests-1064398708 None] Delete snapshot completed successfully. Jul 31 12:35:08 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-b2b4dfad-758c-4857-bf09-f78ae0524884 tempest-VolumeDependencyTests-1064398708 None] Lock "cinder-d890fb25-9517-454e-8ed0-2c65d5c7088f-delete_snapshot" released by "delete_snapshot" :: held 1.747s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:35:09 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-1b90728f-3bf9-464e-a4e5-c8c8f328ff2e tempest-VolumeDependencyTests-1064398708 None] Acquiring lock "cinder-51b954d8-2d82-465b-8492-57d373ab74c4-delete_volume" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:35:09 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-9f7027c6-7c0a-46fe-a02a-ea0e18673471 tempest-CinderUnicodeTest-880391660 None] Acquiring lock "cinder-601be4b7-ded4-4b44-8d7a-02e267f12174-delete_snapshot" by "delete_snapshot" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:35:09 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-1b90728f-3bf9-464e-a4e5-c8c8f328ff2e tempest-VolumeDependencyTests-1064398708 None] Lock "cinder-51b954d8-2d82-465b-8492-57d373ab74c4-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:35:09 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-9f7027c6-7c0a-46fe-a02a-ea0e18673471 tempest-CinderUnicodeTest-880391660 None] Lock "cinder-601be4b7-ded4-4b44-8d7a-02e267f12174-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:35:09 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-9f7027c6-7c0a-46fe-a02a-ea0e18673471 tempest-CinderUnicodeTest-880391660 None] Acquiring lock "cinder-quobyte-58a581aa-d009-4613-a2e5-558ee3616835" by "delete_snapshot" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:35:09 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-9f7027c6-7c0a-46fe-a02a-ea0e18673471 tempest-CinderUnicodeTest-880391660 None] Lock "cinder-quobyte-58a581aa-d009-4613-a2e5-558ee3616835" acquired by "delete_snapshot" :: waited 0.026s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:35:09 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-9f7027c6-7c0a-46fe-a02a-ea0e18673471 tempest-CinderUnicodeTest-880391660 None] Acquiring lock "cinder-quobyte-601be4b7-ded4-4b44-8d7a-02e267f12174" by "_delete_snapshot" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:35:09 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-1b90728f-3bf9-464e-a4e5-c8c8f328ff2e tempest-VolumeDependencyTests-1064398708 None] Acquiring lock "cinder-quobyte-51b954d8-2d82-465b-8492-57d373ab74c4" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:35:09 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-9f7027c6-7c0a-46fe-a02a-ea0e18673471 tempest-CinderUnicodeTest-880391660 None] Lock "cinder-quobyte-601be4b7-ded4-4b44-8d7a-02e267f12174" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:35:09 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-9f7027c6-7c0a-46fe-a02a-ea0e18673471 tempest-CinderUnicodeTest-880391660 None] Deleting offline snapshot 601be4b7-ded4-4b44-8d7a-02e267f12174 of volume 58a581aa-d009-4613-a2e5-558ee3616835 {{(pid=89182) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 31 12:35:09 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-9f7027c6-7c0a-46fe-a02a-ea0e18673471 tempest-CinderUnicodeTest-880391660 None] snapshot_file for this snap is: volume-58a581aa-d009-4613-a2e5-558ee3616835.601be4b7-ded4-4b44-8d7a-02e267f12174 {{(pid=89182) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 31 12:35:09 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-1b90728f-3bf9-464e-a4e5-c8c8f328ff2e tempest-VolumeDependencyTests-1064398708 None] Lock "cinder-quobyte-51b954d8-2d82-465b-8492-57d373ab74c4" acquired by "delete_volume" :: waited 0.037s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:35:09 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdc27c64-0243-4d57-89d2-c98cf87c5a1f]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:35:09 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-9f7027c6-7c0a-46fe-a02a-ea0e18673471 tempest-CinderUnicodeTest-880391660 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-58a581aa-d009-4613-a2e5-558ee3616835.601be4b7-ded4-4b44-8d7a-02e267f12174 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:35:09 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[76017ba3-ff0c-4f6f-a176-d22b335d8d16]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:35:09 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-1b90728f-3bf9-464e-a4e5-c8c8f328ff2e tempest-VolumeDependencyTests-1064398708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-51b954d8-2d82-465b-8492-57d373ab74c4 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:35:09 devstack sudo[111017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-58a581aa-d009-4613-a2e5-558ee3616835.601be4b7-ded4-4b44-8d7a-02e267f12174 Jul 31 12:35:09 devstack sudo[111017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:35:09 devstack sudo[111018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-51b954d8-2d82-465b-8492-57d373ab74c4 Jul 31 12:35:09 devstack sudo[111018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:35:09 devstack sudo[111017]: pam_unix(sudo:session): session closed for user root Jul 31 12:35:09 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-9f7027c6-7c0a-46fe-a02a-ea0e18673471 tempest-CinderUnicodeTest-880391660 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-58a581aa-d009-4613-a2e5-558ee3616835.601be4b7-ded4-4b44-8d7a-02e267f12174" returned: 0 in 0.357s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:35:09 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-9f7027c6-7c0a-46fe-a02a-ea0e18673471 tempest-CinderUnicodeTest-880391660 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-58a581aa-d009-4613-a2e5-558ee3616835(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89182) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 12:35:09 devstack sudo[111018]: pam_unix(sudo:session): session closed for user root Jul 31 12:35:09 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-1b90728f-3bf9-464e-a4e5-c8c8f328ff2e tempest-VolumeDependencyTests-1064398708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-51b954d8-2d82-465b-8492-57d373ab74c4" returned: 0 in 0.366s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:35:09 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-1b90728f-3bf9-464e-a4e5-c8c8f328ff2e tempest-VolumeDependencyTests-1064398708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-51b954d8-2d82-465b-8492-57d373ab74c4 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:35:09 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[36a00b59-7f8f-4e1a-b49b-e092f056bc5f]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:35:09 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-9f7027c6-7c0a-46fe-a02a-ea0e18673471 tempest-CinderUnicodeTest-880391660 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-58a581aa-d009-4613-a2e5-558ee3616835 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:35:09 devstack sudo[111027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-51b954d8-2d82-465b-8492-57d373ab74c4 Jul 31 12:35:09 devstack sudo[111027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:35:09 devstack sudo[111028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-58a581aa-d009-4613-a2e5-558ee3616835 Jul 31 12:35:09 devstack sudo[111028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:35:09 devstack sudo[111027]: pam_unix(sudo:session): session closed for user root Jul 31 12:35:09 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-1b90728f-3bf9-464e-a4e5-c8c8f328ff2e tempest-VolumeDependencyTests-1064398708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-51b954d8-2d82-465b-8492-57d373ab74c4" returned: 0 in 0.254s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:35:09 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-1b90728f-3bf9-464e-a4e5-c8c8f328ff2e tempest-VolumeDependencyTests-1064398708 None] Lock "cinder-quobyte-51b954d8-2d82-465b-8492-57d373ab74c4" released by "delete_volume" :: held 0.681s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:35:09 devstack cinder-volume[89182]: DEBUG cinder.quota [None req-1b90728f-3bf9-464e-a4e5-c8c8f328ff2e tempest-VolumeDependencyTests-1064398708 None] Created reservations ['0e7810a3-59f6-43d3-a515-08b2b6b0275c', '2f10b3a5-5364-459c-b2ee-0d34505e1c95', '53a4438a-43b0-47db-9333-aa0747402954', '137b4670-e30a-4fc4-8367-68464b4e253e'] {{(pid=89182) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 12:35:09 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-1b90728f-3bf9-464e-a4e5-c8c8f328ff2e tempest-VolumeDependencyTests-1064398708 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:35:09 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-1b90728f-3bf9-464e-a4e5-c8c8f328ff2e tempest-VolumeDependencyTests-1064398708 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:35:09 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-1b90728f-3bf9-464e-a4e5-c8c8f328ff2e tempest-VolumeDependencyTests-1064398708 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:35:09 devstack sudo[111028]: pam_unix(sudo:session): session closed for user root Jul 31 12:35:09 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-1b90728f-3bf9-464e-a4e5-c8c8f328ff2e tempest-VolumeDependencyTests-1064398708 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:35:09 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-1b90728f-3bf9-464e-a4e5-c8c8f328ff2e tempest-VolumeDependencyTests-1064398708 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:35:09 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-1b90728f-3bf9-464e-a4e5-c8c8f328ff2e tempest-VolumeDependencyTests-1064398708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:35:09 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-9f7027c6-7c0a-46fe-a02a-ea0e18673471 tempest-CinderUnicodeTest-880391660 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-58a581aa-d009-4613-a2e5-558ee3616835" returned: 0 in 0.392s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:35:09 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-9f7027c6-7c0a-46fe-a02a-ea0e18673471 tempest-CinderUnicodeTest-880391660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-58a581aa-d009-4613-a2e5-558ee3616835.601be4b7-ded4-4b44-8d7a-02e267f12174 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:35:09 devstack sudo[111035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 Jul 31 12:35:09 devstack sudo[111035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:35:09 devstack sudo[111036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-58a581aa-d009-4613-a2e5-558ee3616835.601be4b7-ded4-4b44-8d7a-02e267f12174 Jul 31 12:35:09 devstack sudo[111036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:35:10 devstack sudo[111035]: pam_unix(sudo:session): session closed for user root Jul 31 12:35:10 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-1b90728f-3bf9-464e-a4e5-c8c8f328ff2e tempest-VolumeDependencyTests-1064398708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2" returned: 0 in 0.256s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:35:10 devstack cinder-volume[89182]: DEBUG cinder.manager [None req-1b90728f-3bf9-464e-a4e5-c8c8f328ff2e tempest-VolumeDependencyTests-1064398708 None] Notifying Schedulers of capabilities ... {{(pid=89182) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 12:35:10 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-c6a952f6-2728-4e48-b669-f6b137ca830c tempest-VolumeDependencyTests-1064398708 None] Acquiring lock "cinder-2390c21e-ec67-4c65-aac3-1135f5e527f6-delete_volume" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:35:10 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-1b90728f-3bf9-464e-a4e5-c8c8f328ff2e tempest-VolumeDependencyTests-1064398708 None] Deleted volume successfully. Jul 31 12:35:10 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-c6a952f6-2728-4e48-b669-f6b137ca830c tempest-VolumeDependencyTests-1064398708 None] Lock "cinder-2390c21e-ec67-4c65-aac3-1135f5e527f6-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:35:10 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-1b90728f-3bf9-464e-a4e5-c8c8f328ff2e tempest-VolumeDependencyTests-1064398708 None] Lock "cinder-51b954d8-2d82-465b-8492-57d373ab74c4-delete_volume" released by "delete_volume" :: held 1.200s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:35:10 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-c6a952f6-2728-4e48-b669-f6b137ca830c tempest-VolumeDependencyTests-1064398708 None] Acquiring lock "cinder-quobyte-2390c21e-ec67-4c65-aac3-1135f5e527f6" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:35:10 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-c6a952f6-2728-4e48-b669-f6b137ca830c tempest-VolumeDependencyTests-1064398708 None] Lock "cinder-quobyte-2390c21e-ec67-4c65-aac3-1135f5e527f6" acquired by "delete_volume" :: waited 0.015s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:35:10 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[a906334d-04c2-4b64-860e-350a1e7b7332]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:35:10 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-c6a952f6-2728-4e48-b669-f6b137ca830c tempest-VolumeDependencyTests-1064398708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-2390c21e-ec67-4c65-aac3-1135f5e527f6 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:35:10 devstack sudo[111036]: pam_unix(sudo:session): session closed for user root Jul 31 12:35:10 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-9f7027c6-7c0a-46fe-a02a-ea0e18673471 tempest-CinderUnicodeTest-880391660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-58a581aa-d009-4613-a2e5-558ee3616835.601be4b7-ded4-4b44-8d7a-02e267f12174" returned: 0 in 0.399s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:35:10 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-9f7027c6-7c0a-46fe-a02a-ea0e18673471 tempest-CinderUnicodeTest-880391660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-58a581aa-d009-4613-a2e5-558ee3616835.601be4b7-ded4-4b44-8d7a-02e267f12174 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:35:10 devstack sudo[111045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-58a581aa-d009-4613-a2e5-558ee3616835.601be4b7-ded4-4b44-8d7a-02e267f12174 Jul 31 12:35:10 devstack sudo[111045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:35:10 devstack sudo[111044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-2390c21e-ec67-4c65-aac3-1135f5e527f6 Jul 31 12:35:10 devstack sudo[111044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:35:10 devstack sudo[111045]: pam_unix(sudo:session): session closed for user root Jul 31 12:35:10 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-9f7027c6-7c0a-46fe-a02a-ea0e18673471 tempest-CinderUnicodeTest-880391660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-58a581aa-d009-4613-a2e5-558ee3616835.601be4b7-ded4-4b44-8d7a-02e267f12174" returned: 0 in 0.252s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:35:10 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-9f7027c6-7c0a-46fe-a02a-ea0e18673471 tempest-CinderUnicodeTest-880391660 None] Lock "cinder-quobyte-601be4b7-ded4-4b44-8d7a-02e267f12174" released by "_delete_snapshot" :: held 1.540s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:35:10 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-9f7027c6-7c0a-46fe-a02a-ea0e18673471 tempest-CinderUnicodeTest-880391660 None] Lock "cinder-quobyte-58a581aa-d009-4613-a2e5-558ee3616835" released by "delete_snapshot" :: held 1.570s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:35:10 devstack sudo[111044]: pam_unix(sudo:session): session closed for user root Jul 31 12:35:10 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-c6a952f6-2728-4e48-b669-f6b137ca830c tempest-VolumeDependencyTests-1064398708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-2390c21e-ec67-4c65-aac3-1135f5e527f6" returned: 0 in 0.375s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:35:10 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-c6a952f6-2728-4e48-b669-f6b137ca830c tempest-VolumeDependencyTests-1064398708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-2390c21e-ec67-4c65-aac3-1135f5e527f6 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:35:10 devstack sudo[111053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-2390c21e-ec67-4c65-aac3-1135f5e527f6 Jul 31 12:35:10 devstack sudo[111053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:35:10 devstack cinder-volume[89182]: DEBUG cinder.quota [None req-9f7027c6-7c0a-46fe-a02a-ea0e18673471 tempest-CinderUnicodeTest-880391660 None] Created reservations ['600d22cb-17e8-4f28-a56f-d6baeba81a8f', '3ae63229-d6d2-455e-9756-8303cab89cc6', 'b45079cb-598c-4139-b7ff-3d5bb580620c', 'f3a2b1eb-1236-4fdb-bd22-90a61fcbe90c'] {{(pid=89182) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 12:35:10 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-9f7027c6-7c0a-46fe-a02a-ea0e18673471 tempest-CinderUnicodeTest-880391660 None] Delete snapshot completed successfully. Jul 31 12:35:10 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-9f7027c6-7c0a-46fe-a02a-ea0e18673471 tempest-CinderUnicodeTest-880391660 None] Lock "cinder-601be4b7-ded4-4b44-8d7a-02e267f12174-delete_snapshot" released by "delete_snapshot" :: held 1.731s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:35:10 devstack sudo[111053]: pam_unix(sudo:session): session closed for user root Jul 31 12:35:10 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-c6a952f6-2728-4e48-b669-f6b137ca830c tempest-VolumeDependencyTests-1064398708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-2390c21e-ec67-4c65-aac3-1135f5e527f6" returned: 0 in 0.251s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:35:10 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-c6a952f6-2728-4e48-b669-f6b137ca830c tempest-VolumeDependencyTests-1064398708 None] Lock "cinder-quobyte-2390c21e-ec67-4c65-aac3-1135f5e527f6" released by "delete_volume" :: held 0.665s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:35:10 devstack cinder-volume[89182]: DEBUG cinder.quota [None req-c6a952f6-2728-4e48-b669-f6b137ca830c tempest-VolumeDependencyTests-1064398708 None] Created reservations ['c0ccb740-6264-4fc7-9530-32c12d9892ad', 'cda30fd7-6596-4899-8958-dc8fc03cf01d', 'f992f3ee-5b71-4a7d-8848-683714d73d1c', 'da402a13-1c14-4093-93ef-6b2858afdb5d'] {{(pid=89182) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 12:35:11 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-c6a952f6-2728-4e48-b669-f6b137ca830c tempest-VolumeDependencyTests-1064398708 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:35:11 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-c6a952f6-2728-4e48-b669-f6b137ca830c tempest-VolumeDependencyTests-1064398708 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:35:11 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-c6a952f6-2728-4e48-b669-f6b137ca830c tempest-VolumeDependencyTests-1064398708 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:35:11 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-c6a952f6-2728-4e48-b669-f6b137ca830c tempest-VolumeDependencyTests-1064398708 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:35:11 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-c6a952f6-2728-4e48-b669-f6b137ca830c tempest-VolumeDependencyTests-1064398708 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:35:11 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-c6a952f6-2728-4e48-b669-f6b137ca830c tempest-VolumeDependencyTests-1064398708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:35:11 devstack sudo[111056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 Jul 31 12:35:11 devstack sudo[111056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:35:11 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-525e1257-3a17-4b0e-b337-116156390d87 tempest-CinderUnicodeTest-880391660 None] Acquiring lock "cinder-58a581aa-d009-4613-a2e5-558ee3616835-delete_volume" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:35:11 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-525e1257-3a17-4b0e-b337-116156390d87 tempest-CinderUnicodeTest-880391660 None] Lock "cinder-58a581aa-d009-4613-a2e5-558ee3616835-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:35:11 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-525e1257-3a17-4b0e-b337-116156390d87 tempest-CinderUnicodeTest-880391660 None] Acquiring lock "cinder-quobyte-58a581aa-d009-4613-a2e5-558ee3616835" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:35:11 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-525e1257-3a17-4b0e-b337-116156390d87 tempest-CinderUnicodeTest-880391660 None] Lock "cinder-quobyte-58a581aa-d009-4613-a2e5-558ee3616835" acquired by "delete_volume" :: waited 0.018s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:35:11 devstack sudo[111056]: pam_unix(sudo:session): session closed for user root Jul 31 12:35:11 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-c6a952f6-2728-4e48-b669-f6b137ca830c tempest-VolumeDependencyTests-1064398708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2" returned: 0 in 0.253s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:35:11 devstack cinder-volume[89182]: DEBUG cinder.manager [None req-c6a952f6-2728-4e48-b669-f6b137ca830c tempest-VolumeDependencyTests-1064398708 None] Notifying Schedulers of capabilities ... {{(pid=89182) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 12:35:11 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[a076a106-c3b6-47d1-8271-8e2e89d31a14]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:35:11 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-525e1257-3a17-4b0e-b337-116156390d87 tempest-CinderUnicodeTest-880391660 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-58a581aa-d009-4613-a2e5-558ee3616835 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:35:11 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-c6a952f6-2728-4e48-b669-f6b137ca830c tempest-VolumeDependencyTests-1064398708 None] Deleted volume successfully. Jul 31 12:35:11 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-c6a952f6-2728-4e48-b669-f6b137ca830c tempest-VolumeDependencyTests-1064398708 None] Lock "cinder-2390c21e-ec67-4c65-aac3-1135f5e527f6-delete_volume" released by "delete_volume" :: held 1.127s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:35:11 devstack sudo[111059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-58a581aa-d009-4613-a2e5-558ee3616835 Jul 31 12:35:11 devstack sudo[111059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:35:11 devstack sudo[111059]: pam_unix(sudo:session): session closed for user root Jul 31 12:35:11 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-525e1257-3a17-4b0e-b337-116156390d87 tempest-CinderUnicodeTest-880391660 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-58a581aa-d009-4613-a2e5-558ee3616835" returned: 0 in 0.394s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:35:11 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-525e1257-3a17-4b0e-b337-116156390d87 tempest-CinderUnicodeTest-880391660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-58a581aa-d009-4613-a2e5-558ee3616835 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:35:11 devstack sudo[111064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-58a581aa-d009-4613-a2e5-558ee3616835 Jul 31 12:35:11 devstack sudo[111064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:35:11 devstack sudo[111064]: pam_unix(sudo:session): session closed for user root Jul 31 12:35:11 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-525e1257-3a17-4b0e-b337-116156390d87 tempest-CinderUnicodeTest-880391660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-58a581aa-d009-4613-a2e5-558ee3616835" returned: 0 in 0.256s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:35:11 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-525e1257-3a17-4b0e-b337-116156390d87 tempest-CinderUnicodeTest-880391660 None] Lock "cinder-quobyte-58a581aa-d009-4613-a2e5-558ee3616835" released by "delete_volume" :: held 0.719s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:35:12 devstack cinder-volume[89182]: DEBUG cinder.quota [None req-525e1257-3a17-4b0e-b337-116156390d87 tempest-CinderUnicodeTest-880391660 None] Created reservations ['a930058b-a477-4571-a3c1-1dee333b04fc', 'f5617545-e682-409a-baee-23af01e6c527', 'ee210620-2e5c-498f-8f10-82bd255f3d81', '3427dc13-cad3-4c26-8dc7-2bfbacf75f71'] {{(pid=89182) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 12:35:12 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-525e1257-3a17-4b0e-b337-116156390d87 tempest-CinderUnicodeTest-880391660 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:35:12 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-525e1257-3a17-4b0e-b337-116156390d87 tempest-CinderUnicodeTest-880391660 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:35:12 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-525e1257-3a17-4b0e-b337-116156390d87 tempest-CinderUnicodeTest-880391660 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:35:12 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-525e1257-3a17-4b0e-b337-116156390d87 tempest-CinderUnicodeTest-880391660 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:35:12 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-525e1257-3a17-4b0e-b337-116156390d87 tempest-CinderUnicodeTest-880391660 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:35:12 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-525e1257-3a17-4b0e-b337-116156390d87 tempest-CinderUnicodeTest-880391660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:35:12 devstack sudo[111067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 Jul 31 12:35:12 devstack sudo[111067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:35:12 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-3d06c1f8-6b84-4b4f-9a2c-285074f59d9e tempest-CinderUnicodeTest-880391660 None] Acquiring lock "cinder-0207af4d-6eb3-4e9e-87e5-3728115d5297-delete_volume" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:35:12 devstack sudo[111067]: pam_unix(sudo:session): session closed for user root Jul 31 12:35:12 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-525e1257-3a17-4b0e-b337-116156390d87 tempest-CinderUnicodeTest-880391660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2" returned: 0 in 0.288s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:35:12 devstack cinder-volume[89182]: DEBUG cinder.manager [None req-525e1257-3a17-4b0e-b337-116156390d87 tempest-CinderUnicodeTest-880391660 None] Notifying Schedulers of capabilities ... {{(pid=89182) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 12:35:12 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-3d06c1f8-6b84-4b4f-9a2c-285074f59d9e tempest-CinderUnicodeTest-880391660 None] Lock "cinder-0207af4d-6eb3-4e9e-87e5-3728115d5297-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:35:12 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-525e1257-3a17-4b0e-b337-116156390d87 tempest-CinderUnicodeTest-880391660 None] Deleted volume successfully. Jul 31 12:35:12 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-525e1257-3a17-4b0e-b337-116156390d87 tempest-CinderUnicodeTest-880391660 None] Lock "cinder-58a581aa-d009-4613-a2e5-558ee3616835-delete_volume" released by "delete_volume" :: held 1.231s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:35:12 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-3d06c1f8-6b84-4b4f-9a2c-285074f59d9e tempest-CinderUnicodeTest-880391660 None] Acquiring lock "cinder-quobyte-0207af4d-6eb3-4e9e-87e5-3728115d5297" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:35:12 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-3d06c1f8-6b84-4b4f-9a2c-285074f59d9e tempest-CinderUnicodeTest-880391660 None] Lock "cinder-quobyte-0207af4d-6eb3-4e9e-87e5-3728115d5297" acquired by "delete_volume" :: waited 0.015s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:35:12 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[039819e0-4b79-41d5-bd96-436112414e79]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:35:12 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-3d06c1f8-6b84-4b4f-9a2c-285074f59d9e tempest-CinderUnicodeTest-880391660 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0207af4d-6eb3-4e9e-87e5-3728115d5297 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:35:12 devstack sudo[111070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0207af4d-6eb3-4e9e-87e5-3728115d5297 Jul 31 12:35:12 devstack sudo[111070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:35:12 devstack sudo[111070]: pam_unix(sudo:session): session closed for user root Jul 31 12:35:12 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-3d06c1f8-6b84-4b4f-9a2c-285074f59d9e tempest-CinderUnicodeTest-880391660 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0207af4d-6eb3-4e9e-87e5-3728115d5297" returned: 0 in 0.432s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:35:12 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-3d06c1f8-6b84-4b4f-9a2c-285074f59d9e tempest-CinderUnicodeTest-880391660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0207af4d-6eb3-4e9e-87e5-3728115d5297 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:35:12 devstack sudo[111075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0207af4d-6eb3-4e9e-87e5-3728115d5297 Jul 31 12:35:12 devstack sudo[111075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:35:13 devstack sudo[111075]: pam_unix(sudo:session): session closed for user root Jul 31 12:35:13 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-3d06c1f8-6b84-4b4f-9a2c-285074f59d9e tempest-CinderUnicodeTest-880391660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0207af4d-6eb3-4e9e-87e5-3728115d5297" returned: 0 in 0.258s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:35:13 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-3d06c1f8-6b84-4b4f-9a2c-285074f59d9e tempest-CinderUnicodeTest-880391660 None] Lock "cinder-quobyte-0207af4d-6eb3-4e9e-87e5-3728115d5297" released by "delete_volume" :: held 0.744s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:35:13 devstack cinder-volume[89182]: DEBUG cinder.quota [None req-3d06c1f8-6b84-4b4f-9a2c-285074f59d9e tempest-CinderUnicodeTest-880391660 None] Created reservations ['d8b4f36c-2e83-4bc2-97b2-fdec5d8fb7c0', '3b5c2467-382b-4b40-81cb-70331be57d14', '01716194-d2dc-44f9-9290-20bc560a2e0f', '439d1fee-751b-48b9-bf3f-166c65a37256'] {{(pid=89182) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 12:35:13 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-3d06c1f8-6b84-4b4f-9a2c-285074f59d9e tempest-CinderUnicodeTest-880391660 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:35:13 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-3d06c1f8-6b84-4b4f-9a2c-285074f59d9e tempest-CinderUnicodeTest-880391660 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:35:13 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-3d06c1f8-6b84-4b4f-9a2c-285074f59d9e tempest-CinderUnicodeTest-880391660 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:35:13 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-3d06c1f8-6b84-4b4f-9a2c-285074f59d9e tempest-CinderUnicodeTest-880391660 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:35:13 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-3d06c1f8-6b84-4b4f-9a2c-285074f59d9e tempest-CinderUnicodeTest-880391660 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:35:13 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-3d06c1f8-6b84-4b4f-9a2c-285074f59d9e tempest-CinderUnicodeTest-880391660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:35:13 devstack sudo[111078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 Jul 31 12:35:13 devstack sudo[111078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:35:13 devstack sudo[111078]: pam_unix(sudo:session): session closed for user root Jul 31 12:35:13 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-3d06c1f8-6b84-4b4f-9a2c-285074f59d9e tempest-CinderUnicodeTest-880391660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2" returned: 0 in 0.283s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:35:13 devstack cinder-volume[89182]: DEBUG cinder.manager [None req-3d06c1f8-6b84-4b4f-9a2c-285074f59d9e tempest-CinderUnicodeTest-880391660 None] Notifying Schedulers of capabilities ... {{(pid=89182) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 12:35:13 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-3d06c1f8-6b84-4b4f-9a2c-285074f59d9e tempest-CinderUnicodeTest-880391660 None] Deleted volume successfully. Jul 31 12:35:13 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-3d06c1f8-6b84-4b4f-9a2c-285074f59d9e tempest-CinderUnicodeTest-880391660 None] Lock "cinder-0207af4d-6eb3-4e9e-87e5-3728115d5297-delete_volume" released by "delete_volume" :: held 1.257s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:35:17 devstack cinder-volume[89182]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a4c24df-29dc-42ee-b24d-5dae9a72faab tempest-ProjectReaderTests-1379833141 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89182) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 12:35:17 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-6a4c24df-29dc-42ee-b24d-5dae9a72faab tempest-ProjectReaderTests-1379833141 None] Flow 'volume_create_manager' (6bb56ced-d484-478d-885e-df57b0d45512) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:35:17 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-6a4c24df-29dc-42ee-b24d-5dae9a72faab tempest-ProjectReaderTests-1379833141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca412ebe-e99f-441b-a4d8-05a7e9f46a50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:35:17 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-6a4c24df-29dc-42ee-b24d-5dae9a72faab tempest-ProjectReaderTests-1379833141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca412ebe-e99f-441b-a4d8-05a7e9f46a50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:35:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-866361545',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=baef01d4-646a-4a73-89bd-97759eefeca1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8b898503d7d4efcb06616b8aa63ad8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:35:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:35:17Z,use_quota=True,user_id='87769b1fb0e14f8ca9e99a11029e773a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:35:17 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-6a4c24df-29dc-42ee-b24d-5dae9a72faab tempest-ProjectReaderTests-1379833141 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4febfe0a-7c90-42f1-a813-31bc16145cd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:35:17 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-6a4c24df-29dc-42ee-b24d-5dae9a72faab tempest-ProjectReaderTests-1379833141 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4febfe0a-7c90-42f1-a813-31bc16145cd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:35:17 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-6a4c24df-29dc-42ee-b24d-5dae9a72faab tempest-ProjectReaderTests-1379833141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08d1c008-78b3-4bfd-8278-f9d4dc1ca1f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:35:17 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-6a4c24df-29dc-42ee-b24d-5dae9a72faab tempest-ProjectReaderTests-1379833141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08d1c008-78b3-4bfd-8278-f9d4dc1ca1f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'baef01d4-646a-4a73-89bd-97759eefeca1', 'volume_name': 'volume-baef01d4-646a-4a73-89bd-97759eefeca1', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:35:17 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-6a4c24df-29dc-42ee-b24d-5dae9a72faab tempest-ProjectReaderTests-1379833141 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8cd22d19-cff1-4d53-8a1e-b27aa7d9f7c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:35:17 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-6a4c24df-29dc-42ee-b24d-5dae9a72faab tempest-ProjectReaderTests-1379833141 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8cd22d19-cff1-4d53-8a1e-b27aa7d9f7c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:35:17 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-6a4c24df-29dc-42ee-b24d-5dae9a72faab tempest-ProjectReaderTests-1379833141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be42a0ce-87d5-4320-84dc-37930a66f47d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:35:17 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-6a4c24df-29dc-42ee-b24d-5dae9a72faab tempest-ProjectReaderTests-1379833141 None] Volume baef01d4-646a-4a73-89bd-97759eefeca1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-baef01d4-646a-4a73-89bd-97759eefeca1', 'volume_size': 1} Jul 31 12:35:17 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-6a4c24df-29dc-42ee-b24d-5dae9a72faab tempest-ProjectReaderTests-1379833141 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:35:17 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-6a4c24df-29dc-42ee-b24d-5dae9a72faab tempest-ProjectReaderTests-1379833141 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:35:17 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-6a4c24df-29dc-42ee-b24d-5dae9a72faab tempest-ProjectReaderTests-1379833141 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:35:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-866361545',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=baef01d4-646a-4a73-89bd-97759eefeca1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8b898503d7d4efcb06616b8aa63ad8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:35:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:35:17Z,use_quota=True,user_id='87769b1fb0e14f8ca9e99a11029e773a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)}" {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 12:35:17 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-6a4c24df-29dc-42ee-b24d-5dae9a72faab tempest-ProjectReaderTests-1379833141 None] Creating volume baef01d4-646a-4a73-89bd-97759eefeca1 {{(pid=89182) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 12:35:17 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-6a4c24df-29dc-42ee-b24d-5dae9a72faab tempest-ProjectReaderTests-1379833141 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:35:17 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-6a4c24df-29dc-42ee-b24d-5dae9a72faab tempest-ProjectReaderTests-1379833141 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:35:17 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-6a4c24df-29dc-42ee-b24d-5dae9a72faab tempest-ProjectReaderTests-1379833141 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:35:17 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-6a4c24df-29dc-42ee-b24d-5dae9a72faab tempest-ProjectReaderTests-1379833141 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:35:17 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-6a4c24df-29dc-42ee-b24d-5dae9a72faab tempest-ProjectReaderTests-1379833141 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:35:17 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-6a4c24df-29dc-42ee-b24d-5dae9a72faab tempest-ProjectReaderTests-1379833141 None] Selected osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 as target Quobyte volume. {{(pid=89182) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 12:35:17 devstack cinder-volume[89182]: INFO cinder.volume.drivers.remotefs [None req-6a4c24df-29dc-42ee-b24d-5dae9a72faab tempest-ProjectReaderTests-1379833141 None] casted to osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 Jul 31 12:35:17 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-6a4c24df-29dc-42ee-b24d-5dae9a72faab tempest-ProjectReaderTests-1379833141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-baef01d4-646a-4a73-89bd-97759eefeca1 1073741824 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:35:17 devstack sudo[111082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-baef01d4-646a-4a73-89bd-97759eefeca1 1073741824 Jul 31 12:35:17 devstack sudo[111082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:35:17 devstack cinder-volume[89182]: DEBUG cinder.volume.flows.manager.create_volume [None req-69f538ab-32db-4b45-8b45-58095868209c tempest-VolumeImageDependencyTests-1312082570 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89182) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 12:35:17 devstack sudo[111082]: pam_unix(sudo:session): session closed for user root Jul 31 12:35:17 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-69f538ab-32db-4b45-8b45-58095868209c tempest-VolumeImageDependencyTests-1312082570 None] Flow 'volume_create_manager' (0ea08922-0f8e-4b2f-a058-97aaf45891b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:35:17 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-69f538ab-32db-4b45-8b45-58095868209c tempest-VolumeImageDependencyTests-1312082570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09c83c3b-9bac-4056-9fb8-55a969427143) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:35:17 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-6a4c24df-29dc-42ee-b24d-5dae9a72faab tempest-ProjectReaderTests-1379833141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-baef01d4-646a-4a73-89bd-97759eefeca1 1073741824" returned: 0 in 0.470s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:35:17 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-69f538ab-32db-4b45-8b45-58095868209c tempest-VolumeImageDependencyTests-1312082570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09c83c3b-9bac-4056-9fb8-55a969427143) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:35:17Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a76ecef6-c617-47cc-90c2-1ca2fef82784,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82a4ae047b294dd6980ed8ee242ed2a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:35:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:35:18Z,use_quota=True,user_id='ac62fb5bd782416aa9109655a79c6a24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:35:17 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-69f538ab-32db-4b45-8b45-58095868209c tempest-VolumeImageDependencyTests-1312082570 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2600b00a-2dcd-4417-8679-df5ee0e591cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:35:17 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-69f538ab-32db-4b45-8b45-58095868209c tempest-VolumeImageDependencyTests-1312082570 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2600b00a-2dcd-4417-8679-df5ee0e591cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:35:17 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-69f538ab-32db-4b45-8b45-58095868209c tempest-VolumeImageDependencyTests-1312082570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e85f24d1-0162-452b-8ca0-81195a08fd8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:35:17 devstack cinder-volume[89182]: DEBUG cinder.image.glance [None req-69f538ab-32db-4b45-8b45-58095868209c tempest-VolumeImageDependencyTests-1312082570 None] Creating Keystone auth plugin from conf {{(pid=89182) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 31 12:35:17 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-6a4c24df-29dc-42ee-b24d-5dae9a72faab tempest-ProjectReaderTests-1379833141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-baef01d4-646a-4a73-89bd-97759eefeca1 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:35:17 devstack sudo[111088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-baef01d4-646a-4a73-89bd-97759eefeca1 Jul 31 12:35:17 devstack sudo[111088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:35:18 devstack sudo[111088]: pam_unix(sudo:session): session closed for user root Jul 31 12:35:18 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-6a4c24df-29dc-42ee-b24d-5dae9a72faab tempest-ProjectReaderTests-1379833141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-baef01d4-646a-4a73-89bd-97759eefeca1" returned: 0 in 0.253s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:35:18 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-6a4c24df-29dc-42ee-b24d-5dae9a72faab tempest-ProjectReaderTests-1379833141 None] <== create_volume: return (795ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'} {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 12:35:18 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-6a4c24df-29dc-42ee-b24d-5dae9a72faab tempest-ProjectReaderTests-1379833141 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.798s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:35:18 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-6a4c24df-29dc-42ee-b24d-5dae9a72faab tempest-ProjectReaderTests-1379833141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be42a0ce-87d5-4320-84dc-37930a66f47d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-baef01d4-646a-4a73-89bd-97759eefeca1', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:35:18 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-6a4c24df-29dc-42ee-b24d-5dae9a72faab tempest-ProjectReaderTests-1379833141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (542f5e9c-6d50-45b6-9135-eabe01ae8103) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:35:18 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-69f538ab-32db-4b45-8b45-58095868209c tempest-VolumeImageDependencyTests-1312082570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e85f24d1-0162-452b-8ca0-81195a08fd8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'a76ecef6-c617-47cc-90c2-1ca2fef82784', 'volume_name': 'volume-a76ecef6-c617-47cc-90c2-1ca2fef82784', 'volume_size': 1, 'image_id': '961fd68b-c934-40f1-a3b5-1885de10b5bd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/961fd68b-c934-40f1-a3b5-1885de10b5bd', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'eaf519762d42db27c037b15f846d10e8', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '82a4ae047b294dd6980ed8ee242ed2a5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'cc3d8c648c4fc860ab43ba6542560813ad89d9a78100e6927de294747b1148aa1f555c65d2ea1ac58fbf2ab05b4e744fca54233b0325e02e0a26b613c1933103', 'id': '961fd68b-c934-40f1-a3b5-1885de10b5bd', 'created_at': datetime.datetime(2026, 7, 31, 10, 35, 15, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 31, 10, 35, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/961fd68b-c934-40f1-a3b5-1885de10b5bd/file', 'properties': {}}, 'image_service': }' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:35:18 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-69f538ab-32db-4b45-8b45-58095868209c tempest-VolumeImageDependencyTests-1312082570 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36e8672b-3499-4220-a75c-e841f5d7c2c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:35:18 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-69f538ab-32db-4b45-8b45-58095868209c tempest-VolumeImageDependencyTests-1312082570 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36e8672b-3499-4220-a75c-e841f5d7c2c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:35:18 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-69f538ab-32db-4b45-8b45-58095868209c tempest-VolumeImageDependencyTests-1312082570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d6a8386-49df-4efd-8475-99ea3ffa0eab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:35:18 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-69f538ab-32db-4b45-8b45-58095868209c tempest-VolumeImageDependencyTests-1312082570 None] Volume a76ecef6-c617-47cc-90c2-1ca2fef82784: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-a76ecef6-c617-47cc-90c2-1ca2fef82784', 'volume_size': 1, 'image_id': '961fd68b-c934-40f1-a3b5-1885de10b5bd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/961fd68b-c934-40f1-a3b5-1885de10b5bd', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'eaf519762d42db27c037b15f846d10e8', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '82a4ae047b294dd6980ed8ee242ed2a5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'cc3d8c648c4fc860ab43ba6542560813ad89d9a78100e6927de294747b1148aa1f555c65d2ea1ac58fbf2ab05b4e744fca54233b0325e02e0a26b613c1933103', 'id': '961fd68b-c934-40f1-a3b5-1885de10b5bd', 'created_at': datetime.datetime(2026, 7, 31, 10, 35, 15, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 31, 10, 35, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/961fd68b-c934-40f1-a3b5-1885de10b5bd/file', 'properties': {}}, 'image_service': } Jul 31 12:35:18 devstack cinder-volume[89182]: DEBUG cinder.volume.flows.manager.create_volume [None req-69f538ab-32db-4b45-8b45-58095868209c tempest-VolumeImageDependencyTests-1312082570 None] Trying to clone a76ecef6-c617-47cc-90c2-1ca2fef82784 from image 961fd68b-c934-40f1-a3b5-1885de10b5bd at location (None, [{'url': 'file:///opt/stack/data/glance/images/961fd68b-c934-40f1-a3b5-1885de10b5bd', 'metadata': {}}]). {{(pid=89182) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 31 12:35:18 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-6a4c24df-29dc-42ee-b24d-5dae9a72faab tempest-ProjectReaderTests-1379833141 None] Volume volume-baef01d4-646a-4a73-89bd-97759eefeca1 (baef01d4-646a-4a73-89bd-97759eefeca1): created successfully Jul 31 12:35:18 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-6a4c24df-29dc-42ee-b24d-5dae9a72faab tempest-ProjectReaderTests-1379833141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (542f5e9c-6d50-45b6-9135-eabe01ae8103) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:35:18 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-6a4c24df-29dc-42ee-b24d-5dae9a72faab tempest-ProjectReaderTests-1379833141 None] Flow 'volume_create_manager' (6bb56ced-d484-478d-885e-df57b0d45512) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:35:18 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-6a4c24df-29dc-42ee-b24d-5dae9a72faab tempest-ProjectReaderTests-1379833141 None] Created volume successfully. Jul 31 12:35:18 devstack cinder-volume[89182]: DEBUG cinder.image.image_utils [None req-69f538ab-32db-4b45-8b45-58095868209c tempest-VolumeImageDependencyTests-1312082570 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_961fd68b-c934-40f1-a3b5-1885de10b5bd_q8mw1_gbdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=89182) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 31 12:35:18 devstack cinder-volume[89182]: INFO cinder.image.image_utils [None req-69f538ab-32db-4b45-8b45-58095868209c tempest-VolumeImageDependencyTests-1312082570 None] Image download 0.00 MB at 0.00 MB/s Jul 31 12:35:18 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[281a4ebc-cbda-4285-a2cb-c58b06f8032e]: (4, 'raw') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:35:18 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-69f538ab-32db-4b45-8b45-58095868209c tempest-VolumeImageDependencyTests-1312082570 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_961fd68b-c934-40f1-a3b5-1885de10b5bd_q8mw1_gbdevstack@QuobyteHD {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:35:18 devstack sudo[111091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_961fd68b-c934-40f1-a3b5-1885de10b5bd_q8mw1_gbdevstack@QuobyteHD Jul 31 12:35:18 devstack sudo[111091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:35:18 devstack sudo[111091]: pam_unix(sudo:session): session closed for user root Jul 31 12:35:18 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-69f538ab-32db-4b45-8b45-58095868209c tempest-VolumeImageDependencyTests-1312082570 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_961fd68b-c934-40f1-a3b5-1885de10b5bd_q8mw1_gbdevstack@QuobyteHD" returned: 0 in 0.325s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:35:18 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-69f538ab-32db-4b45-8b45-58095868209c tempest-VolumeImageDependencyTests-1312082570 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_961fd68b-c934-40f1-a3b5-1885de10b5bd_q8mw1_gbdevstack@QuobyteHD {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:35:18 devstack sudo[111095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_961fd68b-c934-40f1-a3b5-1885de10b5bd_q8mw1_gbdevstack@QuobyteHD Jul 31 12:35:18 devstack sudo[111095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:35:18 devstack sudo[111095]: pam_unix(sudo:session): session closed for user root Jul 31 12:35:18 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-69f538ab-32db-4b45-8b45-58095868209c tempest-VolumeImageDependencyTests-1312082570 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_961fd68b-c934-40f1-a3b5-1885de10b5bd_q8mw1_gbdevstack@QuobyteHD" returned: 1 in 0.328s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:35:18 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-69f538ab-32db-4b45-8b45-58095868209c tempest-VolumeImageDependencyTests-1312082570 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_961fd68b-c934-40f1-a3b5-1885de10b5bd_q8mw1_gbdevstack@QuobyteHD' failed. Not Retrying. {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 31 12:35:18 devstack cinder-volume[89182]: DEBUG cinder.image.image_utils [None req-69f538ab-32db-4b45-8b45-58095868209c tempest-VolumeImageDependencyTests-1312082570 None] Temporary image 961fd68b-c934-40f1-a3b5-1885de10b5bd is fetched for user ac62fb5bd782416aa9109655a79c6a24. {{(pid=89182) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 31 12:35:18 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a324212-0bca-48f3-8f67-1803c8dd0864]: (4, 'raw') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:35:18 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-69f538ab-32db-4b45-8b45-58095868209c tempest-VolumeImageDependencyTests-1312082570 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_961fd68b-c934-40f1-a3b5-1885de10b5bd_q8mw1_gbdevstack@QuobyteHD {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:35:19 devstack sudo[111100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_961fd68b-c934-40f1-a3b5-1885de10b5bd_q8mw1_gbdevstack@QuobyteHD Jul 31 12:35:19 devstack sudo[111100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:35:19 devstack sudo[111100]: pam_unix(sudo:session): session closed for user root Jul 31 12:35:19 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-69f538ab-32db-4b45-8b45-58095868209c tempest-VolumeImageDependencyTests-1312082570 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_961fd68b-c934-40f1-a3b5-1885de10b5bd_q8mw1_gbdevstack@QuobyteHD" returned: 0 in 0.332s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:35:19 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-69f538ab-32db-4b45-8b45-58095868209c tempest-VolumeImageDependencyTests-1312082570 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_961fd68b-c934-40f1-a3b5-1885de10b5bd_q8mw1_gbdevstack@QuobyteHD {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:35:19 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-3351df4b-48e4-4012-92c9-828753a1b2c0 tempest-ProjectReaderTests-1379833141 None] Acquiring lock "cinder-baef01d4-646a-4a73-89bd-97759eefeca1-delete_volume" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:35:19 devstack sudo[111104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_961fd68b-c934-40f1-a3b5-1885de10b5bd_q8mw1_gbdevstack@QuobyteHD Jul 31 12:35:19 devstack sudo[111104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:35:19 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-3351df4b-48e4-4012-92c9-828753a1b2c0 tempest-ProjectReaderTests-1379833141 None] Lock "cinder-baef01d4-646a-4a73-89bd-97759eefeca1-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:35:19 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-3351df4b-48e4-4012-92c9-828753a1b2c0 tempest-ProjectReaderTests-1379833141 None] Acquiring lock "cinder-quobyte-baef01d4-646a-4a73-89bd-97759eefeca1" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:35:19 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-3351df4b-48e4-4012-92c9-828753a1b2c0 tempest-ProjectReaderTests-1379833141 None] Lock "cinder-quobyte-baef01d4-646a-4a73-89bd-97759eefeca1" acquired by "delete_volume" :: waited 0.018s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:35:19 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[77d3fe8f-f3d6-4076-a57d-b035b7f05cbd]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:35:19 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-3351df4b-48e4-4012-92c9-828753a1b2c0 tempest-ProjectReaderTests-1379833141 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-baef01d4-646a-4a73-89bd-97759eefeca1 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:35:19 devstack sudo[111106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-baef01d4-646a-4a73-89bd-97759eefeca1 Jul 31 12:35:19 devstack sudo[111106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:35:19 devstack sudo[111104]: pam_unix(sudo:session): session closed for user root Jul 31 12:35:19 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-69f538ab-32db-4b45-8b45-58095868209c tempest-VolumeImageDependencyTests-1312082570 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_961fd68b-c934-40f1-a3b5-1885de10b5bd_q8mw1_gbdevstack@QuobyteHD" returned: 1 in 0.361s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:35:19 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-69f538ab-32db-4b45-8b45-58095868209c tempest-VolumeImageDependencyTests-1312082570 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_961fd68b-c934-40f1-a3b5-1885de10b5bd_q8mw1_gbdevstack@QuobyteHD' failed. Not Retrying. {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 31 12:35:19 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-69f538ab-32db-4b45-8b45-58095868209c tempest-VolumeImageDependencyTests-1312082570 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:35:19 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-69f538ab-32db-4b45-8b45-58095868209c tempest-VolumeImageDependencyTests-1312082570 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:35:19 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-69f538ab-32db-4b45-8b45-58095868209c tempest-VolumeImageDependencyTests-1312082570 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:35:17Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a76ecef6-c617-47cc-90c2-1ca2fef82784,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82a4ae047b294dd6980ed8ee242ed2a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:35:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:35:18Z,use_quota=True,user_id='ac62fb5bd782416aa9109655a79c6a24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)}" {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 12:35:19 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-69f538ab-32db-4b45-8b45-58095868209c tempest-VolumeImageDependencyTests-1312082570 None] Creating volume a76ecef6-c617-47cc-90c2-1ca2fef82784 {{(pid=89182) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 12:35:19 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-69f538ab-32db-4b45-8b45-58095868209c tempest-VolumeImageDependencyTests-1312082570 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:35:19 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-69f538ab-32db-4b45-8b45-58095868209c tempest-VolumeImageDependencyTests-1312082570 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:35:19 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-69f538ab-32db-4b45-8b45-58095868209c tempest-VolumeImageDependencyTests-1312082570 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:35:19 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-69f538ab-32db-4b45-8b45-58095868209c tempest-VolumeImageDependencyTests-1312082570 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:35:19 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-69f538ab-32db-4b45-8b45-58095868209c tempest-VolumeImageDependencyTests-1312082570 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:35:19 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-69f538ab-32db-4b45-8b45-58095868209c tempest-VolumeImageDependencyTests-1312082570 None] Selected osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 as target Quobyte volume. {{(pid=89182) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 12:35:19 devstack cinder-volume[89182]: INFO cinder.volume.drivers.remotefs [None req-69f538ab-32db-4b45-8b45-58095868209c tempest-VolumeImageDependencyTests-1312082570 None] casted to osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 Jul 31 12:35:19 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-69f538ab-32db-4b45-8b45-58095868209c tempest-VolumeImageDependencyTests-1312082570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-a76ecef6-c617-47cc-90c2-1ca2fef82784 1073741824 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:35:19 devstack sudo[111111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-a76ecef6-c617-47cc-90c2-1ca2fef82784 1073741824 Jul 31 12:35:19 devstack sudo[111111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:35:19 devstack sudo[111106]: pam_unix(sudo:session): session closed for user root Jul 31 12:35:19 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-3351df4b-48e4-4012-92c9-828753a1b2c0 tempest-ProjectReaderTests-1379833141 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-baef01d4-646a-4a73-89bd-97759eefeca1" returned: 0 in 0.369s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:35:19 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-3351df4b-48e4-4012-92c9-828753a1b2c0 tempest-ProjectReaderTests-1379833141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-baef01d4-646a-4a73-89bd-97759eefeca1 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:35:19 devstack sudo[111116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-baef01d4-646a-4a73-89bd-97759eefeca1 Jul 31 12:35:19 devstack sudo[111116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:35:20 devstack sudo[111111]: pam_unix(sudo:session): session closed for user root Jul 31 12:35:20 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-69f538ab-32db-4b45-8b45-58095868209c tempest-VolumeImageDependencyTests-1312082570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-a76ecef6-c617-47cc-90c2-1ca2fef82784 1073741824" returned: 0 in 0.419s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:35:20 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-69f538ab-32db-4b45-8b45-58095868209c tempest-VolumeImageDependencyTests-1312082570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-a76ecef6-c617-47cc-90c2-1ca2fef82784 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:35:20 devstack sudo[111116]: pam_unix(sudo:session): session closed for user root Jul 31 12:35:20 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-3351df4b-48e4-4012-92c9-828753a1b2c0 tempest-ProjectReaderTests-1379833141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-baef01d4-646a-4a73-89bd-97759eefeca1" returned: 0 in 0.264s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:35:20 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-3351df4b-48e4-4012-92c9-828753a1b2c0 tempest-ProjectReaderTests-1379833141 None] Lock "cinder-quobyte-baef01d4-646a-4a73-89bd-97759eefeca1" released by "delete_volume" :: held 0.681s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:35:20 devstack sudo[111122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-a76ecef6-c617-47cc-90c2-1ca2fef82784 Jul 31 12:35:20 devstack sudo[111122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:35:20 devstack cinder-volume[89182]: DEBUG cinder.quota [None req-3351df4b-48e4-4012-92c9-828753a1b2c0 tempest-ProjectReaderTests-1379833141 None] Created reservations ['2f4c328b-c2e4-475e-a823-523b72c15040', '1118fd70-f2b2-4f0d-8fc0-45aacc6cbd94', '0a38850e-4f5a-4113-b837-1619b6b48c84', 'b7757e28-0e4b-4d7c-b226-f1c6e71fdffa'] {{(pid=89182) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 12:35:20 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-3351df4b-48e4-4012-92c9-828753a1b2c0 tempest-ProjectReaderTests-1379833141 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:35:20 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-3351df4b-48e4-4012-92c9-828753a1b2c0 tempest-ProjectReaderTests-1379833141 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:35:20 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-3351df4b-48e4-4012-92c9-828753a1b2c0 tempest-ProjectReaderTests-1379833141 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:35:20 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-3351df4b-48e4-4012-92c9-828753a1b2c0 tempest-ProjectReaderTests-1379833141 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:35:20 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-3351df4b-48e4-4012-92c9-828753a1b2c0 tempest-ProjectReaderTests-1379833141 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:35:20 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-3351df4b-48e4-4012-92c9-828753a1b2c0 tempest-ProjectReaderTests-1379833141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:35:20 devstack sudo[111124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 Jul 31 12:35:20 devstack sudo[111124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:35:20 devstack sudo[111122]: pam_unix(sudo:session): session closed for user root Jul 31 12:35:20 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-69f538ab-32db-4b45-8b45-58095868209c tempest-VolumeImageDependencyTests-1312082570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-a76ecef6-c617-47cc-90c2-1ca2fef82784" returned: 0 in 0.253s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:35:20 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-69f538ab-32db-4b45-8b45-58095868209c tempest-VolumeImageDependencyTests-1312082570 None] <== create_volume: return (715ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'} {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 12:35:20 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-69f538ab-32db-4b45-8b45-58095868209c tempest-VolumeImageDependencyTests-1312082570 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.718s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:35:20 devstack cinder-volume[89182]: DEBUG cinder.volume.volume_utils [None req-69f538ab-32db-4b45-8b45-58095868209c tempest-VolumeImageDependencyTests-1312082570 None] Attempting download of 961fd68b-c934-40f1-a3b5-1885de10b5bd ((None, [{'url': 'file:///opt/stack/data/glance/images/961fd68b-c934-40f1-a3b5-1885de10b5bd', 'metadata': {}}])) to volume a76ecef6-c617-47cc-90c2-1ca2fef82784. {{(pid=89182) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 31 12:35:20 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ffc3c25-0c62-4d65-b475-cfb614064451]: (4, 'raw') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:35:20 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-69f538ab-32db-4b45-8b45-58095868209c tempest-VolumeImageDependencyTests-1312082570 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_961fd68b-c934-40f1-a3b5-1885de10b5bd_6qds2yx3 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:35:20 devstack sudo[111124]: pam_unix(sudo:session): session closed for user root Jul 31 12:35:20 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-3351df4b-48e4-4012-92c9-828753a1b2c0 tempest-ProjectReaderTests-1379833141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2" returned: 0 in 0.265s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:35:20 devstack cinder-volume[89182]: DEBUG cinder.manager [None req-3351df4b-48e4-4012-92c9-828753a1b2c0 tempest-ProjectReaderTests-1379833141 None] Notifying Schedulers of capabilities ... {{(pid=89182) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 12:35:20 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-3351df4b-48e4-4012-92c9-828753a1b2c0 tempest-ProjectReaderTests-1379833141 None] Deleted volume successfully. Jul 31 12:35:20 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-3351df4b-48e4-4012-92c9-828753a1b2c0 tempest-ProjectReaderTests-1379833141 None] Lock "cinder-baef01d4-646a-4a73-89bd-97759eefeca1-delete_volume" released by "delete_volume" :: held 1.150s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:35:20 devstack sudo[111127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_961fd68b-c934-40f1-a3b5-1885de10b5bd_6qds2yx3 Jul 31 12:35:20 devstack sudo[111127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:35:20 devstack sudo[111127]: pam_unix(sudo:session): session closed for user root Jul 31 12:35:20 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-69f538ab-32db-4b45-8b45-58095868209c tempest-VolumeImageDependencyTests-1312082570 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_961fd68b-c934-40f1-a3b5-1885de10b5bd_6qds2yx3" returned: 0 in 0.355s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:35:20 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-69f538ab-32db-4b45-8b45-58095868209c tempest-VolumeImageDependencyTests-1312082570 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_961fd68b-c934-40f1-a3b5-1885de10b5bd_6qds2yx3 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:35:20 devstack sudo[111132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_961fd68b-c934-40f1-a3b5-1885de10b5bd_6qds2yx3 Jul 31 12:35:20 devstack sudo[111132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:35:21 devstack cinder-volume[89182]: DEBUG cinder.volume.flows.manager.create_volume [None req-e39ab808-f31c-4a8c-8e58-24fc1a71f047 tempest-ProjectReaderTests-1379833141 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89182) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 12:35:21 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-e39ab808-f31c-4a8c-8e58-24fc1a71f047 tempest-ProjectReaderTests-1379833141 None] Flow 'volume_create_manager' (ac9fdf07-84de-4682-878f-9047979c764b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:35:21 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-e39ab808-f31c-4a8c-8e58-24fc1a71f047 tempest-ProjectReaderTests-1379833141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91f62725-782d-4a83-bdcd-338390b6ee0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:35:21 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-e39ab808-f31c-4a8c-8e58-24fc1a71f047 tempest-ProjectReaderTests-1379833141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91f62725-782d-4a83-bdcd-338390b6ee0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:35:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-639423877',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b41232d-0973-4a0d-93a8-4d2f898768ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8b898503d7d4efcb06616b8aa63ad8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:35:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:35:21Z,use_quota=True,user_id='87769b1fb0e14f8ca9e99a11029e773a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:35:21 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-e39ab808-f31c-4a8c-8e58-24fc1a71f047 tempest-ProjectReaderTests-1379833141 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce58bd1f-db2f-432e-875f-a9e899042192) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:35:21 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-e39ab808-f31c-4a8c-8e58-24fc1a71f047 tempest-ProjectReaderTests-1379833141 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce58bd1f-db2f-432e-875f-a9e899042192) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:35:21 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-e39ab808-f31c-4a8c-8e58-24fc1a71f047 tempest-ProjectReaderTests-1379833141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b4687b9-80a6-42ec-88a6-20a72e6fd75d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:35:21 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-e39ab808-f31c-4a8c-8e58-24fc1a71f047 tempest-ProjectReaderTests-1379833141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b4687b9-80a6-42ec-88a6-20a72e6fd75d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5b41232d-0973-4a0d-93a8-4d2f898768ce', 'volume_name': 'volume-5b41232d-0973-4a0d-93a8-4d2f898768ce', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:35:21 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-e39ab808-f31c-4a8c-8e58-24fc1a71f047 tempest-ProjectReaderTests-1379833141 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ceb2710-c949-42ee-a767-074ae864e11f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:35:21 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-e39ab808-f31c-4a8c-8e58-24fc1a71f047 tempest-ProjectReaderTests-1379833141 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ceb2710-c949-42ee-a767-074ae864e11f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:35:21 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-e39ab808-f31c-4a8c-8e58-24fc1a71f047 tempest-ProjectReaderTests-1379833141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92c3fe95-dd6e-48ba-a19f-44c487ae26d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:35:21 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-e39ab808-f31c-4a8c-8e58-24fc1a71f047 tempest-ProjectReaderTests-1379833141 None] Volume 5b41232d-0973-4a0d-93a8-4d2f898768ce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5b41232d-0973-4a0d-93a8-4d2f898768ce', 'volume_size': 1} Jul 31 12:35:21 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-e39ab808-f31c-4a8c-8e58-24fc1a71f047 tempest-ProjectReaderTests-1379833141 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:35:21 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-e39ab808-f31c-4a8c-8e58-24fc1a71f047 tempest-ProjectReaderTests-1379833141 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:35:21 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-e39ab808-f31c-4a8c-8e58-24fc1a71f047 tempest-ProjectReaderTests-1379833141 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:35:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-639423877',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b41232d-0973-4a0d-93a8-4d2f898768ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8b898503d7d4efcb06616b8aa63ad8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:35:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:35:21Z,use_quota=True,user_id='87769b1fb0e14f8ca9e99a11029e773a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)}" {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 12:35:21 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-e39ab808-f31c-4a8c-8e58-24fc1a71f047 tempest-ProjectReaderTests-1379833141 None] Creating volume 5b41232d-0973-4a0d-93a8-4d2f898768ce {{(pid=89182) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 12:35:21 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-e39ab808-f31c-4a8c-8e58-24fc1a71f047 tempest-ProjectReaderTests-1379833141 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:35:21 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-e39ab808-f31c-4a8c-8e58-24fc1a71f047 tempest-ProjectReaderTests-1379833141 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:35:21 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-e39ab808-f31c-4a8c-8e58-24fc1a71f047 tempest-ProjectReaderTests-1379833141 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:35:21 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-e39ab808-f31c-4a8c-8e58-24fc1a71f047 tempest-ProjectReaderTests-1379833141 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:35:21 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-e39ab808-f31c-4a8c-8e58-24fc1a71f047 tempest-ProjectReaderTests-1379833141 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:35:21 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-e39ab808-f31c-4a8c-8e58-24fc1a71f047 tempest-ProjectReaderTests-1379833141 None] Selected osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 as target Quobyte volume. {{(pid=89182) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 12:35:21 devstack cinder-volume[89182]: INFO cinder.volume.drivers.remotefs [None req-e39ab808-f31c-4a8c-8e58-24fc1a71f047 tempest-ProjectReaderTests-1379833141 None] casted to osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 Jul 31 12:35:21 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-e39ab808-f31c-4a8c-8e58-24fc1a71f047 tempest-ProjectReaderTests-1379833141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-5b41232d-0973-4a0d-93a8-4d2f898768ce 1073741824 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:35:21 devstack sudo[111132]: pam_unix(sudo:session): session closed for user root Jul 31 12:35:21 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-69f538ab-32db-4b45-8b45-58095868209c tempest-VolumeImageDependencyTests-1312082570 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_961fd68b-c934-40f1-a3b5-1885de10b5bd_6qds2yx3" returned: 1 in 0.350s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:35:21 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-69f538ab-32db-4b45-8b45-58095868209c tempest-VolumeImageDependencyTests-1312082570 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_961fd68b-c934-40f1-a3b5-1885de10b5bd_6qds2yx3' failed. Not Retrying. {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 31 12:35:21 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7331349-d94f-496c-9677-46c4febcfb3d]: (4, 'raw') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:35:21 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-69f538ab-32db-4b45-8b45-58095868209c tempest-VolumeImageDependencyTests-1312082570 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_961fd68b-c934-40f1-a3b5-1885de10b5bd_q8mw1_gbdevstack@QuobyteHD {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:35:21 devstack sudo[111136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-5b41232d-0973-4a0d-93a8-4d2f898768ce 1073741824 Jul 31 12:35:21 devstack sudo[111136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:35:21 devstack sudo[111137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_961fd68b-c934-40f1-a3b5-1885de10b5bd_q8mw1_gbdevstack@QuobyteHD Jul 31 12:35:21 devstack sudo[111137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:35:21 devstack sudo[111137]: pam_unix(sudo:session): session closed for user root Jul 31 12:35:21 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-69f538ab-32db-4b45-8b45-58095868209c tempest-VolumeImageDependencyTests-1312082570 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_961fd68b-c934-40f1-a3b5-1885de10b5bd_q8mw1_gbdevstack@QuobyteHD" returned: 0 in 0.345s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:35:21 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-69f538ab-32db-4b45-8b45-58095868209c tempest-VolumeImageDependencyTests-1312082570 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_961fd68b-c934-40f1-a3b5-1885de10b5bd_q8mw1_gbdevstack@QuobyteHD {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:35:21 devstack sudo[111136]: pam_unix(sudo:session): session closed for user root Jul 31 12:35:21 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-e39ab808-f31c-4a8c-8e58-24fc1a71f047 tempest-ProjectReaderTests-1379833141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-5b41232d-0973-4a0d-93a8-4d2f898768ce 1073741824" returned: 0 in 0.422s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:35:21 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-e39ab808-f31c-4a8c-8e58-24fc1a71f047 tempest-ProjectReaderTests-1379833141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-5b41232d-0973-4a0d-93a8-4d2f898768ce {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:35:21 devstack sudo[111146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_961fd68b-c934-40f1-a3b5-1885de10b5bd_q8mw1_gbdevstack@QuobyteHD Jul 31 12:35:21 devstack sudo[111146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:35:21 devstack sudo[111147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-5b41232d-0973-4a0d-93a8-4d2f898768ce Jul 31 12:35:21 devstack sudo[111147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:35:21 devstack sudo[111146]: pam_unix(sudo:session): session closed for user root Jul 31 12:35:21 devstack sudo[111147]: pam_unix(sudo:session): session closed for user root Jul 31 12:35:21 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-e39ab808-f31c-4a8c-8e58-24fc1a71f047 tempest-ProjectReaderTests-1379833141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-5b41232d-0973-4a0d-93a8-4d2f898768ce" returned: 0 in 0.263s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:35:21 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-e39ab808-f31c-4a8c-8e58-24fc1a71f047 tempest-ProjectReaderTests-1379833141 None] <== create_volume: return (726ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'} {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 12:35:21 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-e39ab808-f31c-4a8c-8e58-24fc1a71f047 tempest-ProjectReaderTests-1379833141 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.728s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:35:21 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-69f538ab-32db-4b45-8b45-58095868209c tempest-VolumeImageDependencyTests-1312082570 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_961fd68b-c934-40f1-a3b5-1885de10b5bd_q8mw1_gbdevstack@QuobyteHD" returned: 1 in 0.357s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:35:21 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-69f538ab-32db-4b45-8b45-58095868209c tempest-VolumeImageDependencyTests-1312082570 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_961fd68b-c934-40f1-a3b5-1885de10b5bd_q8mw1_gbdevstack@QuobyteHD' failed. Not Retrying. {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 31 12:35:21 devstack cinder-volume[89182]: DEBUG cinder.image.image_utils [None req-69f538ab-32db-4b45-8b45-58095868209c tempest-VolumeImageDependencyTests-1312082570 None] 961fd68b-c934-40f1-a3b5-1885de10b5bd was raw, converting to qcow2 {{(pid=89182) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 31 12:35:21 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-69f538ab-32db-4b45-8b45-58095868209c tempest-VolumeImageDependencyTests-1312082570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_961fd68b-c934-40f1-a3b5-1885de10b5bd_q8mw1_gbdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-a76ecef6-c617-47cc-90c2-1ca2fef82784 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:35:21 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-e39ab808-f31c-4a8c-8e58-24fc1a71f047 tempest-ProjectReaderTests-1379833141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92c3fe95-dd6e-48ba-a19f-44c487ae26d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5b41232d-0973-4a0d-93a8-4d2f898768ce', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:35:21 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-e39ab808-f31c-4a8c-8e58-24fc1a71f047 tempest-ProjectReaderTests-1379833141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8efb8af0-8c8f-4a1e-8ccd-9435105c5884) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:35:21 devstack sudo[111154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_961fd68b-c934-40f1-a3b5-1885de10b5bd_q8mw1_gbdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-a76ecef6-c617-47cc-90c2-1ca2fef82784 Jul 31 12:35:21 devstack sudo[111154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:35:21 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-e39ab808-f31c-4a8c-8e58-24fc1a71f047 tempest-ProjectReaderTests-1379833141 None] Volume volume-5b41232d-0973-4a0d-93a8-4d2f898768ce (5b41232d-0973-4a0d-93a8-4d2f898768ce): created successfully Jul 31 12:35:21 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-e39ab808-f31c-4a8c-8e58-24fc1a71f047 tempest-ProjectReaderTests-1379833141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8efb8af0-8c8f-4a1e-8ccd-9435105c5884) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:35:21 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-e39ab808-f31c-4a8c-8e58-24fc1a71f047 tempest-ProjectReaderTests-1379833141 None] Flow 'volume_create_manager' (ac9fdf07-84de-4682-878f-9047979c764b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:35:21 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-e39ab808-f31c-4a8c-8e58-24fc1a71f047 tempest-ProjectReaderTests-1379833141 None] Created volume successfully. Jul 31 12:35:21 devstack cinder-volume[89182]: DEBUG oslo_service.periodic_task [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89182) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 31 12:35:21 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:35:21 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:35:21 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:35:21 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:35:21 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:35:21 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:35:22 devstack sudo[111156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 Jul 31 12:35:22 devstack sudo[111156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:35:22 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-8a056462-bcee-4467-a69a-debbc6c65c19 tempest-ProjectReaderTests-1379833141 None] Acquiring lock "cinder-5b41232d-0973-4a0d-93a8-4d2f898768ce-delete_volume" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:35:22 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-8a056462-bcee-4467-a69a-debbc6c65c19 tempest-ProjectReaderTests-1379833141 None] Lock "cinder-5b41232d-0973-4a0d-93a8-4d2f898768ce-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:35:22 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-8a056462-bcee-4467-a69a-debbc6c65c19 tempest-ProjectReaderTests-1379833141 None] Acquiring lock "cinder-quobyte-5b41232d-0973-4a0d-93a8-4d2f898768ce" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:35:22 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-8a056462-bcee-4467-a69a-debbc6c65c19 tempest-ProjectReaderTests-1379833141 None] Lock "cinder-quobyte-5b41232d-0973-4a0d-93a8-4d2f898768ce" acquired by "delete_volume" :: waited 0.020s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:35:22 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c0bc0c3-0017-4f2a-9458-5d08261557cd]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:35:22 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-8a056462-bcee-4467-a69a-debbc6c65c19 tempest-ProjectReaderTests-1379833141 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-5b41232d-0973-4a0d-93a8-4d2f898768ce {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:35:22 devstack sudo[111156]: pam_unix(sudo:session): session closed for user root Jul 31 12:35:22 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2" returned: 0 in 0.279s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:35:22 devstack cinder-volume[89182]: DEBUG cinder.manager [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] Notifying Schedulers of capabilities ... {{(pid=89182) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 12:35:22 devstack cinder-volume[89182]: DEBUG oslo_service.periodic_task [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] Running periodic task VolumeManager._thread_info {{(pid=89182) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 31 12:35:22 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] thread count: 28 {{(pid=89182) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 31 12:35:22 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] thread info: [<_MainThread(MainThread, started 136154603720832)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=89182) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 31 12:35:22 devstack sudo[111162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-5b41232d-0973-4a0d-93a8-4d2f898768ce Jul 31 12:35:22 devstack sudo[111162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:35:22 devstack sudo[111154]: pam_unix(sudo:session): session closed for user root Jul 31 12:35:22 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-69f538ab-32db-4b45-8b45-58095868209c tempest-VolumeImageDependencyTests-1312082570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_961fd68b-c934-40f1-a3b5-1885de10b5bd_q8mw1_gbdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-a76ecef6-c617-47cc-90c2-1ca2fef82784" returned: 0 in 0.529s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:35:22 devstack cinder-volume[89182]: DEBUG cinder.image.image_utils [None req-69f538ab-32db-4b45-8b45-58095868209c tempest-VolumeImageDependencyTests-1312082570 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_961fd68b-c934-40f1-a3b5-1885de10b5bd_q8mw1_gbdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-a76ecef6-c617-47cc-90c2-1ca2fef82784 {{(pid=89182) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 31 12:35:22 devstack cinder-volume[89182]: INFO cinder.image.image_utils [None req-69f538ab-32db-4b45-8b45-58095868209c tempest-VolumeImageDependencyTests-1312082570 None] Converted 0.00 MB image at 0.00 MB/s Jul 31 12:35:22 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-69f538ab-32db-4b45-8b45-58095868209c tempest-VolumeImageDependencyTests-1312082570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-a76ecef6-c617-47cc-90c2-1ca2fef82784 1G {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:35:22 devstack sudo[111165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-a76ecef6-c617-47cc-90c2-1ca2fef82784 1G Jul 31 12:35:22 devstack sudo[111165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:35:22 devstack sudo[111162]: pam_unix(sudo:session): session closed for user root Jul 31 12:35:22 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-8a056462-bcee-4467-a69a-debbc6c65c19 tempest-ProjectReaderTests-1379833141 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-5b41232d-0973-4a0d-93a8-4d2f898768ce" returned: 0 in 0.378s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:35:22 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-8a056462-bcee-4467-a69a-debbc6c65c19 tempest-ProjectReaderTests-1379833141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-5b41232d-0973-4a0d-93a8-4d2f898768ce {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:35:22 devstack sudo[111170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-5b41232d-0973-4a0d-93a8-4d2f898768ce Jul 31 12:35:22 devstack sudo[111170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:35:22 devstack sudo[111165]: pam_unix(sudo:session): session closed for user root Jul 31 12:35:22 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-69f538ab-32db-4b45-8b45-58095868209c tempest-VolumeImageDependencyTests-1312082570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-a76ecef6-c617-47cc-90c2-1ca2fef82784 1G" returned: 0 in 0.341s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:35:22 devstack cinder-volume[89182]: DEBUG cinder.volume.volume_utils [None req-69f538ab-32db-4b45-8b45-58095868209c tempest-VolumeImageDependencyTests-1312082570 None] Downloaded image 961fd68b-c934-40f1-a3b5-1885de10b5bd ((None, [{'url': 'file:///opt/stack/data/glance/images/961fd68b-c934-40f1-a3b5-1885de10b5bd', 'metadata': {}}])) to volume a76ecef6-c617-47cc-90c2-1ca2fef82784 successfully. {{(pid=89182) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 31 12:35:22 devstack cinder-volume[89182]: DEBUG cinder.image.image_utils [None req-69f538ab-32db-4b45-8b45-58095868209c tempest-VolumeImageDependencyTests-1312082570 None] Temporary image 961fd68b-c934-40f1-a3b5-1885de10b5bd for user ac62fb5bd782416aa9109655a79c6a24 is deleted. {{(pid=89182) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 31 12:35:22 devstack cinder-volume[89182]: DEBUG cinder.volume.volume_utils [None req-69f538ab-32db-4b45-8b45-58095868209c tempest-VolumeImageDependencyTests-1312082570 None] Marking volume a76ecef6-c617-47cc-90c2-1ca2fef82784 as bootable. {{(pid=89182) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 31 12:35:22 devstack cinder-volume[89182]: DEBUG cinder.volume.flows.manager.create_volume [None req-69f538ab-32db-4b45-8b45-58095868209c tempest-VolumeImageDependencyTests-1312082570 None] Copying metadata from image 961fd68b-c934-40f1-a3b5-1885de10b5bd to a76ecef6-c617-47cc-90c2-1ca2fef82784. {{(pid=89182) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 31 12:35:22 devstack cinder-volume[89182]: DEBUG cinder.volume.flows.manager.create_volume [None req-69f538ab-32db-4b45-8b45-58095868209c tempest-VolumeImageDependencyTests-1312082570 None] Creating volume glance metadata for volume a76ecef6-c617-47cc-90c2-1ca2fef82784 backed by image 961fd68b-c934-40f1-a3b5-1885de10b5bd with: {'image_id': '961fd68b-c934-40f1-a3b5-1885de10b5bd', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'eaf519762d42db27c037b15f846d10e8', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=89182) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 31 12:35:22 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-69f538ab-32db-4b45-8b45-58095868209c tempest-VolumeImageDependencyTests-1312082570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d6a8386-49df-4efd-8475-99ea3ffa0eab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a76ecef6-c617-47cc-90c2-1ca2fef82784', 'volume_size': 1, 'image_id': '961fd68b-c934-40f1-a3b5-1885de10b5bd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/961fd68b-c934-40f1-a3b5-1885de10b5bd', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'eaf519762d42db27c037b15f846d10e8', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '82a4ae047b294dd6980ed8ee242ed2a5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'cc3d8c648c4fc860ab43ba6542560813ad89d9a78100e6927de294747b1148aa1f555c65d2ea1ac58fbf2ab05b4e744fca54233b0325e02e0a26b613c1933103', 'id': '961fd68b-c934-40f1-a3b5-1885de10b5bd', 'created_at': datetime.datetime(2026, 7, 31, 10, 35, 15, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 31, 10, 35, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/961fd68b-c934-40f1-a3b5-1885de10b5bd/file', 'properties': {}}, 'image_service': }' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:35:22 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-69f538ab-32db-4b45-8b45-58095868209c tempest-VolumeImageDependencyTests-1312082570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00a5ac4f-d6c3-4f55-b55a-3847c18e79a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:35:22 devstack sudo[111170]: pam_unix(sudo:session): session closed for user root Jul 31 12:35:22 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-8a056462-bcee-4467-a69a-debbc6c65c19 tempest-ProjectReaderTests-1379833141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-5b41232d-0973-4a0d-93a8-4d2f898768ce" returned: 0 in 0.256s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:35:22 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-69f538ab-32db-4b45-8b45-58095868209c tempest-VolumeImageDependencyTests-1312082570 None] Volume volume-a76ecef6-c617-47cc-90c2-1ca2fef82784 (a76ecef6-c617-47cc-90c2-1ca2fef82784): created successfully Jul 31 12:35:22 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-69f538ab-32db-4b45-8b45-58095868209c tempest-VolumeImageDependencyTests-1312082570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00a5ac4f-d6c3-4f55-b55a-3847c18e79a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:35:22 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-69f538ab-32db-4b45-8b45-58095868209c tempest-VolumeImageDependencyTests-1312082570 None] Flow 'volume_create_manager' (0ea08922-0f8e-4b2f-a058-97aaf45891b7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:35:22 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-8a056462-bcee-4467-a69a-debbc6c65c19 tempest-ProjectReaderTests-1379833141 None] Lock "cinder-quobyte-5b41232d-0973-4a0d-93a8-4d2f898768ce" released by "delete_volume" :: held 0.687s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:35:22 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-69f538ab-32db-4b45-8b45-58095868209c tempest-VolumeImageDependencyTests-1312082570 None] Created volume successfully. Jul 31 12:35:22 devstack cinder-volume[89182]: DEBUG cinder.quota [None req-8a056462-bcee-4467-a69a-debbc6c65c19 tempest-ProjectReaderTests-1379833141 None] Created reservations ['fc49e175-403e-4d05-8e9e-dcc0c5f5debf', 'b42b6061-2658-4ed1-9fb5-51ab86bbc62e', 'a851d9a9-baa5-478d-9fec-46ca50b617f4', 'bf0be276-3167-4f5f-885f-e46b607d3885'] {{(pid=89182) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 12:35:23 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-8a056462-bcee-4467-a69a-debbc6c65c19 tempest-ProjectReaderTests-1379833141 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:35:23 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-8a056462-bcee-4467-a69a-debbc6c65c19 tempest-ProjectReaderTests-1379833141 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:35:23 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-8a056462-bcee-4467-a69a-debbc6c65c19 tempest-ProjectReaderTests-1379833141 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:35:23 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-8a056462-bcee-4467-a69a-debbc6c65c19 tempest-ProjectReaderTests-1379833141 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:35:23 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-8a056462-bcee-4467-a69a-debbc6c65c19 tempest-ProjectReaderTests-1379833141 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:35:23 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-8a056462-bcee-4467-a69a-debbc6c65c19 tempest-ProjectReaderTests-1379833141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:35:23 devstack sudo[111176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 Jul 31 12:35:23 devstack sudo[111176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:35:23 devstack sudo[111176]: pam_unix(sudo:session): session closed for user root Jul 31 12:35:23 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-8a056462-bcee-4467-a69a-debbc6c65c19 tempest-ProjectReaderTests-1379833141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2" returned: 0 in 0.253s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:35:23 devstack cinder-volume[89182]: DEBUG cinder.manager [None req-8a056462-bcee-4467-a69a-debbc6c65c19 tempest-ProjectReaderTests-1379833141 None] Notifying Schedulers of capabilities ... {{(pid=89182) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 12:35:23 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-8a056462-bcee-4467-a69a-debbc6c65c19 tempest-ProjectReaderTests-1379833141 None] Deleted volume successfully. Jul 31 12:35:23 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-8a056462-bcee-4467-a69a-debbc6c65c19 tempest-ProjectReaderTests-1379833141 None] Lock "cinder-5b41232d-0973-4a0d-93a8-4d2f898768ce-delete_volume" released by "delete_volume" :: held 1.170s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:35:24 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-70b1c0ca-d584-44c8-88f6-26fbb197aa62 tempest-VolumeImageDependencyTests-1312082570 None] Acquiring lock "cinder-a76ecef6-c617-47cc-90c2-1ca2fef82784-delete_volume" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:35:24 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-70b1c0ca-d584-44c8-88f6-26fbb197aa62 tempest-VolumeImageDependencyTests-1312082570 None] Lock "cinder-a76ecef6-c617-47cc-90c2-1ca2fef82784-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:35:24 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-70b1c0ca-d584-44c8-88f6-26fbb197aa62 tempest-VolumeImageDependencyTests-1312082570 None] Acquiring lock "cinder-quobyte-a76ecef6-c617-47cc-90c2-1ca2fef82784" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:35:24 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-70b1c0ca-d584-44c8-88f6-26fbb197aa62 tempest-VolumeImageDependencyTests-1312082570 None] Lock "cinder-quobyte-a76ecef6-c617-47cc-90c2-1ca2fef82784" acquired by "delete_volume" :: waited 0.022s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:35:24 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[b969b879-a4a9-4720-b2d0-32c53ec91afb]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:35:24 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-70b1c0ca-d584-44c8-88f6-26fbb197aa62 tempest-VolumeImageDependencyTests-1312082570 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-a76ecef6-c617-47cc-90c2-1ca2fef82784 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:35:24 devstack sudo[111179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-a76ecef6-c617-47cc-90c2-1ca2fef82784 Jul 31 12:35:24 devstack sudo[111179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:35:24 devstack sudo[111179]: pam_unix(sudo:session): session closed for user root Jul 31 12:35:24 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-70b1c0ca-d584-44c8-88f6-26fbb197aa62 tempest-VolumeImageDependencyTests-1312082570 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-a76ecef6-c617-47cc-90c2-1ca2fef82784" returned: 0 in 0.386s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:35:24 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-70b1c0ca-d584-44c8-88f6-26fbb197aa62 tempest-VolumeImageDependencyTests-1312082570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-a76ecef6-c617-47cc-90c2-1ca2fef82784 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:35:24 devstack sudo[111184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-a76ecef6-c617-47cc-90c2-1ca2fef82784 Jul 31 12:35:24 devstack sudo[111184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:35:24 devstack sudo[111184]: pam_unix(sudo:session): session closed for user root Jul 31 12:35:24 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-70b1c0ca-d584-44c8-88f6-26fbb197aa62 tempest-VolumeImageDependencyTests-1312082570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-a76ecef6-c617-47cc-90c2-1ca2fef82784" returned: 0 in 0.280s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:35:24 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-70b1c0ca-d584-44c8-88f6-26fbb197aa62 tempest-VolumeImageDependencyTests-1312082570 None] Lock "cinder-quobyte-a76ecef6-c617-47cc-90c2-1ca2fef82784" released by "delete_volume" :: held 0.730s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:35:24 devstack cinder-volume[89182]: DEBUG cinder.quota [None req-70b1c0ca-d584-44c8-88f6-26fbb197aa62 tempest-VolumeImageDependencyTests-1312082570 None] Created reservations ['97e74749-109e-4860-a73f-91ac0eca89e2', 'fa860ac5-9996-4aea-b5bd-ec29cf938ab5', '0ff0f227-de9f-4ffc-aa73-be706b6932e9', 'c0865d69-bdb7-45e6-9acd-a5f3d96579a0'] {{(pid=89182) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 12:35:25 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-70b1c0ca-d584-44c8-88f6-26fbb197aa62 tempest-VolumeImageDependencyTests-1312082570 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:35:25 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-70b1c0ca-d584-44c8-88f6-26fbb197aa62 tempest-VolumeImageDependencyTests-1312082570 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:35:25 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-70b1c0ca-d584-44c8-88f6-26fbb197aa62 tempest-VolumeImageDependencyTests-1312082570 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:35:25 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-70b1c0ca-d584-44c8-88f6-26fbb197aa62 tempest-VolumeImageDependencyTests-1312082570 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:35:25 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-70b1c0ca-d584-44c8-88f6-26fbb197aa62 tempest-VolumeImageDependencyTests-1312082570 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:35:25 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-70b1c0ca-d584-44c8-88f6-26fbb197aa62 tempest-VolumeImageDependencyTests-1312082570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:35:25 devstack sudo[111187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 Jul 31 12:35:25 devstack sudo[111187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:35:25 devstack sudo[111187]: pam_unix(sudo:session): session closed for user root Jul 31 12:35:25 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-70b1c0ca-d584-44c8-88f6-26fbb197aa62 tempest-VolumeImageDependencyTests-1312082570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2" returned: 0 in 0.272s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:35:25 devstack cinder-volume[89182]: DEBUG cinder.manager [None req-70b1c0ca-d584-44c8-88f6-26fbb197aa62 tempest-VolumeImageDependencyTests-1312082570 None] Notifying Schedulers of capabilities ... {{(pid=89182) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 12:35:25 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-70b1c0ca-d584-44c8-88f6-26fbb197aa62 tempest-VolumeImageDependencyTests-1312082570 None] Deleted volume successfully. Jul 31 12:35:25 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-70b1c0ca-d584-44c8-88f6-26fbb197aa62 tempest-VolumeImageDependencyTests-1312082570 None] Lock "cinder-a76ecef6-c617-47cc-90c2-1ca2fef82784-delete_volume" released by "delete_volume" :: held 1.232s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:35:28 devstack cinder-volume[89182]: DEBUG cinder.volume.flows.manager.create_volume [None req-b7faca8f-919a-40fa-944a-5b68f9fc055d tempest-VolumeImageDependencyTests-1312082570 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89182) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 12:35:28 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-b7faca8f-919a-40fa-944a-5b68f9fc055d tempest-VolumeImageDependencyTests-1312082570 None] Flow 'volume_create_manager' (4ab8d88f-8090-4b4c-b895-3978ffc7e8b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:35:28 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-b7faca8f-919a-40fa-944a-5b68f9fc055d tempest-VolumeImageDependencyTests-1312082570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb385b9f-dc9f-47b7-8b66-1c8f484c814c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:35:28 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-b7faca8f-919a-40fa-944a-5b68f9fc055d tempest-VolumeImageDependencyTests-1312082570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb385b9f-dc9f-47b7-8b66-1c8f484c814c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:35:28Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test0e20bd6e-440f-41d8-9b5d-fc047ac00423',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0ddfb60-ad41-4198-80db-5948cdb2053c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82a4ae047b294dd6980ed8ee242ed2a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:35:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:35:28Z,use_quota=True,user_id='ac62fb5bd782416aa9109655a79c6a24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:35:28 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-b7faca8f-919a-40fa-944a-5b68f9fc055d tempest-VolumeImageDependencyTests-1312082570 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89f7e522-ea63-47fe-a3b8-7f0ff8539e54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:35:28 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-b7faca8f-919a-40fa-944a-5b68f9fc055d tempest-VolumeImageDependencyTests-1312082570 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89f7e522-ea63-47fe-a3b8-7f0ff8539e54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:35:28 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-b7faca8f-919a-40fa-944a-5b68f9fc055d tempest-VolumeImageDependencyTests-1312082570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5060755b-4877-425a-9ed3-594b6b85f2e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:35:28 devstack cinder-volume[89182]: DEBUG cinder.image.glance [None req-b7faca8f-919a-40fa-944a-5b68f9fc055d tempest-VolumeImageDependencyTests-1312082570 None] Creating Keystone auth plugin from conf {{(pid=89182) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 31 12:35:28 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-b7faca8f-919a-40fa-944a-5b68f9fc055d tempest-VolumeImageDependencyTests-1312082570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5060755b-4877-425a-9ed3-594b6b85f2e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'e0ddfb60-ad41-4198-80db-5948cdb2053c', 'volume_name': 'volume-e0ddfb60-ad41-4198-80db-5948cdb2053c', 'volume_size': 1, 'image_id': 'b4f5ed77-4a5f-42c8-81eb-f26ac9c13468', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b4f5ed77-4a5f-42c8-81eb-f26ac9c13468', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-0e20bd6e-440f-41d8-9b5d-fc047ac00423', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'f3f8555eb6731aec4e075a646b6694de', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '82a4ae047b294dd6980ed8ee242ed2a5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '7062d3f081f75da2eb7c69c64ccf4d301e05a22b916084f1c8c550c32f0bc3f4e98d7441f7adaaa30390ea4caadbe583139b505a11b83258700fb97417f55f0b', 'id': 'b4f5ed77-4a5f-42c8-81eb-f26ac9c13468', 'created_at': datetime.datetime(2026, 7, 31, 10, 35, 26, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 31, 10, 35, 27, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b4f5ed77-4a5f-42c8-81eb-f26ac9c13468/file', 'properties': {}}, 'image_service': }' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:35:28 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-b7faca8f-919a-40fa-944a-5b68f9fc055d tempest-VolumeImageDependencyTests-1312082570 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec1bd403-ab07-4449-9f2b-0e44e9c3532c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:35:28 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-b7faca8f-919a-40fa-944a-5b68f9fc055d tempest-VolumeImageDependencyTests-1312082570 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec1bd403-ab07-4449-9f2b-0e44e9c3532c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:35:28 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-b7faca8f-919a-40fa-944a-5b68f9fc055d tempest-VolumeImageDependencyTests-1312082570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d702e7e5-cf7b-4710-9324-dc3a95bc2766) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:35:28 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-b7faca8f-919a-40fa-944a-5b68f9fc055d tempest-VolumeImageDependencyTests-1312082570 None] Volume e0ddfb60-ad41-4198-80db-5948cdb2053c: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-e0ddfb60-ad41-4198-80db-5948cdb2053c', 'volume_size': 1, 'image_id': 'b4f5ed77-4a5f-42c8-81eb-f26ac9c13468', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b4f5ed77-4a5f-42c8-81eb-f26ac9c13468', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-0e20bd6e-440f-41d8-9b5d-fc047ac00423', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'f3f8555eb6731aec4e075a646b6694de', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '82a4ae047b294dd6980ed8ee242ed2a5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '7062d3f081f75da2eb7c69c64ccf4d301e05a22b916084f1c8c550c32f0bc3f4e98d7441f7adaaa30390ea4caadbe583139b505a11b83258700fb97417f55f0b', 'id': 'b4f5ed77-4a5f-42c8-81eb-f26ac9c13468', 'created_at': datetime.datetime(2026, 7, 31, 10, 35, 26, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 31, 10, 35, 27, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b4f5ed77-4a5f-42c8-81eb-f26ac9c13468/file', 'properties': {}}, 'image_service': } Jul 31 12:35:28 devstack cinder-volume[89182]: DEBUG cinder.volume.flows.manager.create_volume [None req-b7faca8f-919a-40fa-944a-5b68f9fc055d tempest-VolumeImageDependencyTests-1312082570 None] Trying to clone e0ddfb60-ad41-4198-80db-5948cdb2053c from image b4f5ed77-4a5f-42c8-81eb-f26ac9c13468 at location (None, [{'url': 'file:///opt/stack/data/glance/images/b4f5ed77-4a5f-42c8-81eb-f26ac9c13468', 'metadata': {}}]). {{(pid=89182) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 31 12:35:28 devstack cinder-volume[89182]: DEBUG cinder.image.image_utils [None req-b7faca8f-919a-40fa-944a-5b68f9fc055d tempest-VolumeImageDependencyTests-1312082570 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_b4f5ed77-4a5f-42c8-81eb-f26ac9c13468_kxcac4yndevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=89182) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 31 12:35:28 devstack cinder-volume[89182]: INFO cinder.image.image_utils [None req-b7faca8f-919a-40fa-944a-5b68f9fc055d tempest-VolumeImageDependencyTests-1312082570 None] Image download 0.00 MB at 0.00 MB/s Jul 31 12:35:28 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[3153b534-5d88-42a8-96c4-bfa4475964cc]: (4, 'raw') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:35:28 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-b7faca8f-919a-40fa-944a-5b68f9fc055d tempest-VolumeImageDependencyTests-1312082570 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b4f5ed77-4a5f-42c8-81eb-f26ac9c13468_kxcac4yndevstack@QuobyteHD {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:35:29 devstack sudo[111191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b4f5ed77-4a5f-42c8-81eb-f26ac9c13468_kxcac4yndevstack@QuobyteHD Jul 31 12:35:29 devstack sudo[111191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:35:29 devstack sudo[111191]: pam_unix(sudo:session): session closed for user root Jul 31 12:35:29 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-b7faca8f-919a-40fa-944a-5b68f9fc055d tempest-VolumeImageDependencyTests-1312082570 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b4f5ed77-4a5f-42c8-81eb-f26ac9c13468_kxcac4yndevstack@QuobyteHD" returned: 0 in 0.351s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:35:29 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-b7faca8f-919a-40fa-944a-5b68f9fc055d tempest-VolumeImageDependencyTests-1312082570 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b4f5ed77-4a5f-42c8-81eb-f26ac9c13468_kxcac4yndevstack@QuobyteHD {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:35:29 devstack sudo[111195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b4f5ed77-4a5f-42c8-81eb-f26ac9c13468_kxcac4yndevstack@QuobyteHD Jul 31 12:35:29 devstack sudo[111195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:35:29 devstack sudo[111195]: pam_unix(sudo:session): session closed for user root Jul 31 12:35:29 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-b7faca8f-919a-40fa-944a-5b68f9fc055d tempest-VolumeImageDependencyTests-1312082570 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b4f5ed77-4a5f-42c8-81eb-f26ac9c13468_kxcac4yndevstack@QuobyteHD" returned: 1 in 0.331s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:35:29 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-b7faca8f-919a-40fa-944a-5b68f9fc055d tempest-VolumeImageDependencyTests-1312082570 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b4f5ed77-4a5f-42c8-81eb-f26ac9c13468_kxcac4yndevstack@QuobyteHD' failed. Not Retrying. {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 31 12:35:29 devstack cinder-volume[89182]: DEBUG cinder.image.image_utils [None req-b7faca8f-919a-40fa-944a-5b68f9fc055d tempest-VolumeImageDependencyTests-1312082570 None] Temporary image b4f5ed77-4a5f-42c8-81eb-f26ac9c13468 is fetched for user ac62fb5bd782416aa9109655a79c6a24. {{(pid=89182) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 31 12:35:29 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[e12194b1-c4c0-4c2a-b3f7-15f0919b1287]: (4, 'raw') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:35:29 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-b7faca8f-919a-40fa-944a-5b68f9fc055d tempest-VolumeImageDependencyTests-1312082570 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b4f5ed77-4a5f-42c8-81eb-f26ac9c13468_kxcac4yndevstack@QuobyteHD {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:35:29 devstack sudo[111200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b4f5ed77-4a5f-42c8-81eb-f26ac9c13468_kxcac4yndevstack@QuobyteHD Jul 31 12:35:29 devstack sudo[111200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:35:30 devstack sudo[111200]: pam_unix(sudo:session): session closed for user root Jul 31 12:35:30 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-b7faca8f-919a-40fa-944a-5b68f9fc055d tempest-VolumeImageDependencyTests-1312082570 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b4f5ed77-4a5f-42c8-81eb-f26ac9c13468_kxcac4yndevstack@QuobyteHD" returned: 0 in 0.364s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:35:30 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-b7faca8f-919a-40fa-944a-5b68f9fc055d tempest-VolumeImageDependencyTests-1312082570 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b4f5ed77-4a5f-42c8-81eb-f26ac9c13468_kxcac4yndevstack@QuobyteHD {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:35:30 devstack sudo[111204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b4f5ed77-4a5f-42c8-81eb-f26ac9c13468_kxcac4yndevstack@QuobyteHD Jul 31 12:35:30 devstack sudo[111204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:35:30 devstack sudo[111204]: pam_unix(sudo:session): session closed for user root Jul 31 12:35:30 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-b7faca8f-919a-40fa-944a-5b68f9fc055d tempest-VolumeImageDependencyTests-1312082570 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b4f5ed77-4a5f-42c8-81eb-f26ac9c13468_kxcac4yndevstack@QuobyteHD" returned: 1 in 0.342s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:35:30 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-b7faca8f-919a-40fa-944a-5b68f9fc055d tempest-VolumeImageDependencyTests-1312082570 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b4f5ed77-4a5f-42c8-81eb-f26ac9c13468_kxcac4yndevstack@QuobyteHD' failed. Not Retrying. {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 31 12:35:30 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-b7faca8f-919a-40fa-944a-5b68f9fc055d tempest-VolumeImageDependencyTests-1312082570 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:35:30 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-b7faca8f-919a-40fa-944a-5b68f9fc055d tempest-VolumeImageDependencyTests-1312082570 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:35:30 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-b7faca8f-919a-40fa-944a-5b68f9fc055d tempest-VolumeImageDependencyTests-1312082570 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:35:28Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test0e20bd6e-440f-41d8-9b5d-fc047ac00423',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0ddfb60-ad41-4198-80db-5948cdb2053c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82a4ae047b294dd6980ed8ee242ed2a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:35:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:35:28Z,use_quota=True,user_id='ac62fb5bd782416aa9109655a79c6a24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)}" {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 12:35:30 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-b7faca8f-919a-40fa-944a-5b68f9fc055d tempest-VolumeImageDependencyTests-1312082570 None] Creating volume e0ddfb60-ad41-4198-80db-5948cdb2053c {{(pid=89182) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 12:35:30 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-b7faca8f-919a-40fa-944a-5b68f9fc055d tempest-VolumeImageDependencyTests-1312082570 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:35:30 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-b7faca8f-919a-40fa-944a-5b68f9fc055d tempest-VolumeImageDependencyTests-1312082570 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:35:30 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-b7faca8f-919a-40fa-944a-5b68f9fc055d tempest-VolumeImageDependencyTests-1312082570 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:35:30 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-b7faca8f-919a-40fa-944a-5b68f9fc055d tempest-VolumeImageDependencyTests-1312082570 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:35:30 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-b7faca8f-919a-40fa-944a-5b68f9fc055d tempest-VolumeImageDependencyTests-1312082570 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:35:30 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-b7faca8f-919a-40fa-944a-5b68f9fc055d tempest-VolumeImageDependencyTests-1312082570 None] Selected osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 as target Quobyte volume. {{(pid=89182) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 12:35:30 devstack cinder-volume[89182]: INFO cinder.volume.drivers.remotefs [None req-b7faca8f-919a-40fa-944a-5b68f9fc055d tempest-VolumeImageDependencyTests-1312082570 None] casted to osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 Jul 31 12:35:30 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-b7faca8f-919a-40fa-944a-5b68f9fc055d tempest-VolumeImageDependencyTests-1312082570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e0ddfb60-ad41-4198-80db-5948cdb2053c 1073741824 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:35:30 devstack sudo[111209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e0ddfb60-ad41-4198-80db-5948cdb2053c 1073741824 Jul 31 12:35:30 devstack sudo[111209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:35:30 devstack sudo[111209]: pam_unix(sudo:session): session closed for user root Jul 31 12:35:30 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-b7faca8f-919a-40fa-944a-5b68f9fc055d tempest-VolumeImageDependencyTests-1312082570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e0ddfb60-ad41-4198-80db-5948cdb2053c 1073741824" returned: 0 in 0.506s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:35:30 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-b7faca8f-919a-40fa-944a-5b68f9fc055d tempest-VolumeImageDependencyTests-1312082570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e0ddfb60-ad41-4198-80db-5948cdb2053c {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:35:30 devstack sudo[111215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e0ddfb60-ad41-4198-80db-5948cdb2053c Jul 31 12:35:30 devstack sudo[111215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:35:31 devstack sudo[111215]: pam_unix(sudo:session): session closed for user root Jul 31 12:35:31 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-b7faca8f-919a-40fa-944a-5b68f9fc055d tempest-VolumeImageDependencyTests-1312082570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e0ddfb60-ad41-4198-80db-5948cdb2053c" returned: 0 in 0.273s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:35:31 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-b7faca8f-919a-40fa-944a-5b68f9fc055d tempest-VolumeImageDependencyTests-1312082570 None] <== create_volume: return (824ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'} {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 12:35:31 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-b7faca8f-919a-40fa-944a-5b68f9fc055d tempest-VolumeImageDependencyTests-1312082570 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.827s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:35:31 devstack cinder-volume[89182]: DEBUG cinder.volume.volume_utils [None req-b7faca8f-919a-40fa-944a-5b68f9fc055d tempest-VolumeImageDependencyTests-1312082570 None] Attempting download of b4f5ed77-4a5f-42c8-81eb-f26ac9c13468 ((None, [{'url': 'file:///opt/stack/data/glance/images/b4f5ed77-4a5f-42c8-81eb-f26ac9c13468', 'metadata': {}}])) to volume e0ddfb60-ad41-4198-80db-5948cdb2053c. {{(pid=89182) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 31 12:35:31 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd906009-c1aa-40df-960a-c9a078727215]: (4, 'raw') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:35:31 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-b7faca8f-919a-40fa-944a-5b68f9fc055d tempest-VolumeImageDependencyTests-1312082570 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b4f5ed77-4a5f-42c8-81eb-f26ac9c13468_irnnei4o {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:35:31 devstack sudo[111218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b4f5ed77-4a5f-42c8-81eb-f26ac9c13468_irnnei4o Jul 31 12:35:31 devstack sudo[111218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:35:31 devstack sudo[111218]: pam_unix(sudo:session): session closed for user root Jul 31 12:35:31 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-b7faca8f-919a-40fa-944a-5b68f9fc055d tempest-VolumeImageDependencyTests-1312082570 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b4f5ed77-4a5f-42c8-81eb-f26ac9c13468_irnnei4o" returned: 0 in 0.343s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:35:31 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-b7faca8f-919a-40fa-944a-5b68f9fc055d tempest-VolumeImageDependencyTests-1312082570 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b4f5ed77-4a5f-42c8-81eb-f26ac9c13468_irnnei4o {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:35:31 devstack sudo[111222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b4f5ed77-4a5f-42c8-81eb-f26ac9c13468_irnnei4o Jul 31 12:35:31 devstack sudo[111222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:35:31 devstack sudo[111222]: pam_unix(sudo:session): session closed for user root Jul 31 12:35:31 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-b7faca8f-919a-40fa-944a-5b68f9fc055d tempest-VolumeImageDependencyTests-1312082570 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b4f5ed77-4a5f-42c8-81eb-f26ac9c13468_irnnei4o" returned: 1 in 0.330s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:35:31 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-b7faca8f-919a-40fa-944a-5b68f9fc055d tempest-VolumeImageDependencyTests-1312082570 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b4f5ed77-4a5f-42c8-81eb-f26ac9c13468_irnnei4o' failed. Not Retrying. {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 31 12:35:31 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2a2884c-9eaa-4542-aef3-a09611a9cb3b]: (4, 'raw') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:35:31 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-b7faca8f-919a-40fa-944a-5b68f9fc055d tempest-VolumeImageDependencyTests-1312082570 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b4f5ed77-4a5f-42c8-81eb-f26ac9c13468_kxcac4yndevstack@QuobyteHD {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:35:32 devstack sudo[111226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b4f5ed77-4a5f-42c8-81eb-f26ac9c13468_kxcac4yndevstack@QuobyteHD Jul 31 12:35:32 devstack sudo[111226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:35:32 devstack sudo[111226]: pam_unix(sudo:session): session closed for user root Jul 31 12:35:32 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-b7faca8f-919a-40fa-944a-5b68f9fc055d tempest-VolumeImageDependencyTests-1312082570 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b4f5ed77-4a5f-42c8-81eb-f26ac9c13468_kxcac4yndevstack@QuobyteHD" returned: 0 in 0.332s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:35:32 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-b7faca8f-919a-40fa-944a-5b68f9fc055d tempest-VolumeImageDependencyTests-1312082570 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b4f5ed77-4a5f-42c8-81eb-f26ac9c13468_kxcac4yndevstack@QuobyteHD {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:35:32 devstack sudo[111230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b4f5ed77-4a5f-42c8-81eb-f26ac9c13468_kxcac4yndevstack@QuobyteHD Jul 31 12:35:32 devstack sudo[111230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:35:32 devstack sudo[111230]: pam_unix(sudo:session): session closed for user root Jul 31 12:35:32 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-b7faca8f-919a-40fa-944a-5b68f9fc055d tempest-VolumeImageDependencyTests-1312082570 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b4f5ed77-4a5f-42c8-81eb-f26ac9c13468_kxcac4yndevstack@QuobyteHD" returned: 1 in 0.352s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:35:32 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-b7faca8f-919a-40fa-944a-5b68f9fc055d tempest-VolumeImageDependencyTests-1312082570 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b4f5ed77-4a5f-42c8-81eb-f26ac9c13468_kxcac4yndevstack@QuobyteHD' failed. Not Retrying. {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 31 12:35:32 devstack cinder-volume[89182]: DEBUG cinder.image.image_utils [None req-b7faca8f-919a-40fa-944a-5b68f9fc055d tempest-VolumeImageDependencyTests-1312082570 None] b4f5ed77-4a5f-42c8-81eb-f26ac9c13468 was raw, converting to qcow2 {{(pid=89182) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 31 12:35:32 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-b7faca8f-919a-40fa-944a-5b68f9fc055d tempest-VolumeImageDependencyTests-1312082570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_b4f5ed77-4a5f-42c8-81eb-f26ac9c13468_kxcac4yndevstack@QuobyteHD /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e0ddfb60-ad41-4198-80db-5948cdb2053c {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:35:32 devstack sudo[111235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_b4f5ed77-4a5f-42c8-81eb-f26ac9c13468_kxcac4yndevstack@QuobyteHD /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e0ddfb60-ad41-4198-80db-5948cdb2053c Jul 31 12:35:32 devstack sudo[111235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:35:33 devstack sudo[111235]: pam_unix(sudo:session): session closed for user root Jul 31 12:35:33 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-b7faca8f-919a-40fa-944a-5b68f9fc055d tempest-VolumeImageDependencyTests-1312082570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_b4f5ed77-4a5f-42c8-81eb-f26ac9c13468_kxcac4yndevstack@QuobyteHD /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e0ddfb60-ad41-4198-80db-5948cdb2053c" returned: 0 in 0.471s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:35:33 devstack cinder-volume[89182]: DEBUG cinder.image.image_utils [None req-b7faca8f-919a-40fa-944a-5b68f9fc055d tempest-VolumeImageDependencyTests-1312082570 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_b4f5ed77-4a5f-42c8-81eb-f26ac9c13468_kxcac4yndevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e0ddfb60-ad41-4198-80db-5948cdb2053c {{(pid=89182) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 31 12:35:33 devstack cinder-volume[89182]: INFO cinder.image.image_utils [None req-b7faca8f-919a-40fa-944a-5b68f9fc055d tempest-VolumeImageDependencyTests-1312082570 None] Converted 0.00 MB image at 0.00 MB/s Jul 31 12:35:33 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-b7faca8f-919a-40fa-944a-5b68f9fc055d tempest-VolumeImageDependencyTests-1312082570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e0ddfb60-ad41-4198-80db-5948cdb2053c 1G {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:35:33 devstack sudo[111241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e0ddfb60-ad41-4198-80db-5948cdb2053c 1G Jul 31 12:35:33 devstack sudo[111241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:35:33 devstack sudo[111241]: pam_unix(sudo:session): session closed for user root Jul 31 12:35:33 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-b7faca8f-919a-40fa-944a-5b68f9fc055d tempest-VolumeImageDependencyTests-1312082570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e0ddfb60-ad41-4198-80db-5948cdb2053c 1G" returned: 0 in 0.342s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:35:33 devstack cinder-volume[89182]: DEBUG cinder.volume.volume_utils [None req-b7faca8f-919a-40fa-944a-5b68f9fc055d tempest-VolumeImageDependencyTests-1312082570 None] Downloaded image b4f5ed77-4a5f-42c8-81eb-f26ac9c13468 ((None, [{'url': 'file:///opt/stack/data/glance/images/b4f5ed77-4a5f-42c8-81eb-f26ac9c13468', 'metadata': {}}])) to volume e0ddfb60-ad41-4198-80db-5948cdb2053c successfully. {{(pid=89182) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 31 12:35:33 devstack cinder-volume[89182]: DEBUG cinder.image.image_utils [None req-b7faca8f-919a-40fa-944a-5b68f9fc055d tempest-VolumeImageDependencyTests-1312082570 None] Temporary image b4f5ed77-4a5f-42c8-81eb-f26ac9c13468 for user ac62fb5bd782416aa9109655a79c6a24 is deleted. {{(pid=89182) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 31 12:35:33 devstack cinder-volume[89182]: DEBUG cinder.volume.volume_utils [None req-b7faca8f-919a-40fa-944a-5b68f9fc055d tempest-VolumeImageDependencyTests-1312082570 None] Marking volume e0ddfb60-ad41-4198-80db-5948cdb2053c as bootable. {{(pid=89182) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 31 12:35:33 devstack cinder-volume[89182]: DEBUG cinder.volume.flows.manager.create_volume [None req-b7faca8f-919a-40fa-944a-5b68f9fc055d tempest-VolumeImageDependencyTests-1312082570 None] Copying metadata from image b4f5ed77-4a5f-42c8-81eb-f26ac9c13468 to e0ddfb60-ad41-4198-80db-5948cdb2053c. {{(pid=89182) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 31 12:35:33 devstack cinder-volume[89182]: DEBUG cinder.volume.flows.manager.create_volume [None req-b7faca8f-919a-40fa-944a-5b68f9fc055d tempest-VolumeImageDependencyTests-1312082570 None] Creating volume glance metadata for volume e0ddfb60-ad41-4198-80db-5948cdb2053c backed by image b4f5ed77-4a5f-42c8-81eb-f26ac9c13468 with: {'image_id': 'b4f5ed77-4a5f-42c8-81eb-f26ac9c13468', 'image_name': 'image-for-test-0e20bd6e-440f-41d8-9b5d-fc047ac00423', 'checksum': 'f3f8555eb6731aec4e075a646b6694de', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=89182) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 31 12:35:33 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-b7faca8f-919a-40fa-944a-5b68f9fc055d tempest-VolumeImageDependencyTests-1312082570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d702e7e5-cf7b-4710-9324-dc3a95bc2766) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e0ddfb60-ad41-4198-80db-5948cdb2053c', 'volume_size': 1, 'image_id': 'b4f5ed77-4a5f-42c8-81eb-f26ac9c13468', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b4f5ed77-4a5f-42c8-81eb-f26ac9c13468', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-0e20bd6e-440f-41d8-9b5d-fc047ac00423', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'f3f8555eb6731aec4e075a646b6694de', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '82a4ae047b294dd6980ed8ee242ed2a5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '7062d3f081f75da2eb7c69c64ccf4d301e05a22b916084f1c8c550c32f0bc3f4e98d7441f7adaaa30390ea4caadbe583139b505a11b83258700fb97417f55f0b', 'id': 'b4f5ed77-4a5f-42c8-81eb-f26ac9c13468', 'created_at': datetime.datetime(2026, 7, 31, 10, 35, 26, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 31, 10, 35, 27, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b4f5ed77-4a5f-42c8-81eb-f26ac9c13468/file', 'properties': {}}, 'image_service': }' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:35:33 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-b7faca8f-919a-40fa-944a-5b68f9fc055d tempest-VolumeImageDependencyTests-1312082570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0afd191-af2d-4fb7-bdfb-60c8efe4d6d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:35:33 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-b7faca8f-919a-40fa-944a-5b68f9fc055d tempest-VolumeImageDependencyTests-1312082570 None] Volume volume-e0ddfb60-ad41-4198-80db-5948cdb2053c (e0ddfb60-ad41-4198-80db-5948cdb2053c): created successfully Jul 31 12:35:33 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-b7faca8f-919a-40fa-944a-5b68f9fc055d tempest-VolumeImageDependencyTests-1312082570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0afd191-af2d-4fb7-bdfb-60c8efe4d6d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:35:33 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-b7faca8f-919a-40fa-944a-5b68f9fc055d tempest-VolumeImageDependencyTests-1312082570 None] Flow 'volume_create_manager' (4ab8d88f-8090-4b4c-b895-3978ffc7e8b2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:35:33 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-b7faca8f-919a-40fa-944a-5b68f9fc055d tempest-VolumeImageDependencyTests-1312082570 None] Created volume successfully. Jul 31 12:35:35 devstack cinder-volume[89182]: DEBUG dbcounter [-] [89182] Writing DB stats cinder:SELECT=129,cinder:UPDATE=157,cinder:DELETE=8,cinder:INSERT=49 {{(pid=89182) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 12:35:35 devstack cinder-volume[89182]: DEBUG dbcounter [-] [89182] Writing DB stats cinder:SELECT=124,cinder:UPDATE=142,cinder:INSERT=42,cinder:DELETE=16 {{(pid=89182) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 12:35:35 devstack cinder-volume[89182]: DEBUG cinder.volume.flows.manager.create_volume [None req-3926ea6a-2761-44be-bcb6-06460b908960 tempest-VolumeImageDependencyTests-1312082570 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89182) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 12:35:35 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-3926ea6a-2761-44be-bcb6-06460b908960 tempest-VolumeImageDependencyTests-1312082570 None] Flow 'volume_create_manager' (b7ab176a-be29-4802-acd9-deaee1878fdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:35:35 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-3926ea6a-2761-44be-bcb6-06460b908960 tempest-VolumeImageDependencyTests-1312082570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f10444e-a084-4099-b0e2-b9942a759eb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:35:35 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-3926ea6a-2761-44be-bcb6-06460b908960 tempest-VolumeImageDependencyTests-1312082570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f10444e-a084-4099-b0e2-b9942a759eb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=True,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:35:35Z,deleted=False,deleted_at=None,display_description=None,display_name='volume2-for-test-0e20bd6e-440f-41d8-9b5d-fc047ac00423',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e9b4a9a-db6f-4762-b29d-cf21e00254c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82a4ae047b294dd6980ed8ee242ed2a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:35:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=e0ddfb60-ad41-4198-80db-5948cdb2053c,status='creating',terminated_at=None,updated_at=2026-07-31T10:35:35Z,use_quota=True,user_id='ac62fb5bd782416aa9109655a79c6a24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:35:35 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-3926ea6a-2761-44be-bcb6-06460b908960 tempest-VolumeImageDependencyTests-1312082570 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0dcb430c-4c83-4106-8fa4-2884fc50ba12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:35:35 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-3926ea6a-2761-44be-bcb6-06460b908960 tempest-VolumeImageDependencyTests-1312082570 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0dcb430c-4c83-4106-8fa4-2884fc50ba12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:35:35 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-3926ea6a-2761-44be-bcb6-06460b908960 tempest-VolumeImageDependencyTests-1312082570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd965123-b0c2-4761-9357-31f25590875a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:35:35 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-3926ea6a-2761-44be-bcb6-06460b908960 tempest-VolumeImageDependencyTests-1312082570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd965123-b0c2-4761-9357-31f25590875a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '1e9b4a9a-db6f-4762-b29d-cf21e00254c2', 'volume_name': 'volume-1e9b4a9a-db6f-4762-b29d-cf21e00254c2', 'volume_size': 1, 'source_volid': 'e0ddfb60-ad41-4198-80db-5948cdb2053c', 'source_volstatus': 'available'}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:35:35 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-3926ea6a-2761-44be-bcb6-06460b908960 tempest-VolumeImageDependencyTests-1312082570 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (404b4cff-88b0-4128-bf2b-cd9ffb76334d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:35:35 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-3926ea6a-2761-44be-bcb6-06460b908960 tempest-VolumeImageDependencyTests-1312082570 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (404b4cff-88b0-4128-bf2b-cd9ffb76334d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:35:35 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-3926ea6a-2761-44be-bcb6-06460b908960 tempest-VolumeImageDependencyTests-1312082570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48248899-00aa-4b23-93e1-e05d8cea0b03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:35:35 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-3926ea6a-2761-44be-bcb6-06460b908960 tempest-VolumeImageDependencyTests-1312082570 None] Volume 1e9b4a9a-db6f-4762-b29d-cf21e00254c2: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-1e9b4a9a-db6f-4762-b29d-cf21e00254c2', 'volume_size': 1, 'source_volid': 'e0ddfb60-ad41-4198-80db-5948cdb2053c', 'source_volstatus': 'available'} Jul 31 12:35:35 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-3926ea6a-2761-44be-bcb6-06460b908960 tempest-VolumeImageDependencyTests-1312082570 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:35:35 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-3926ea6a-2761-44be-bcb6-06460b908960 tempest-VolumeImageDependencyTests-1312082570 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:35:35 devstack cinder-volume[89182]: INFO cinder.volume.drivers.remotefs [None req-3926ea6a-2761-44be-bcb6-06460b908960 tempest-VolumeImageDependencyTests-1312082570 None] Cloning volume e0ddfb60-ad41-4198-80db-5948cdb2053c to volume 1e9b4a9a-db6f-4762-b29d-cf21e00254c2 Jul 31 12:35:35 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-3926ea6a-2761-44be-bcb6-06460b908960 tempest-VolumeImageDependencyTests-1312082570 None] Creating offline snapshot 108c58d4-49a9-41fe-a4c5-3c7e90328398 of volume e0ddfb60-ad41-4198-80db-5948cdb2053c {{(pid=89182) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 31 12:35:35 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b646818-c662-4ee7-8ba0-02a81be7d195]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:35:35 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-3926ea6a-2761-44be-bcb6-06460b908960 tempest-VolumeImageDependencyTests-1312082570 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e0ddfb60-ad41-4198-80db-5948cdb2053c {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:35:35 devstack sudo[111246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e0ddfb60-ad41-4198-80db-5948cdb2053c Jul 31 12:35:35 devstack sudo[111246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:35:36 devstack sudo[111246]: pam_unix(sudo:session): session closed for user root Jul 31 12:35:36 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-3926ea6a-2761-44be-bcb6-06460b908960 tempest-VolumeImageDependencyTests-1312082570 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e0ddfb60-ad41-4198-80db-5948cdb2053c" returned: 0 in 0.449s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:35:36 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-3926ea6a-2761-44be-bcb6-06460b908960 tempest-VolumeImageDependencyTests-1312082570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e0ddfb60-ad41-4198-80db-5948cdb2053c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e0ddfb60-ad41-4198-80db-5948cdb2053c.108c58d4-49a9-41fe-a4c5-3c7e90328398 1G {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:35:36 devstack sudo[111251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e0ddfb60-ad41-4198-80db-5948cdb2053c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e0ddfb60-ad41-4198-80db-5948cdb2053c.108c58d4-49a9-41fe-a4c5-3c7e90328398 1G Jul 31 12:35:36 devstack sudo[111251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:35:36 devstack sudo[111251]: pam_unix(sudo:session): session closed for user root Jul 31 12:35:36 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-3926ea6a-2761-44be-bcb6-06460b908960 tempest-VolumeImageDependencyTests-1312082570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e0ddfb60-ad41-4198-80db-5948cdb2053c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e0ddfb60-ad41-4198-80db-5948cdb2053c.108c58d4-49a9-41fe-a4c5-3c7e90328398 1G" returned: 0 in 0.538s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:35:36 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-3926ea6a-2761-44be-bcb6-06460b908960 tempest-VolumeImageDependencyTests-1312082570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e0ddfb60-ad41-4198-80db-5948cdb2053c -F qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e0ddfb60-ad41-4198-80db-5948cdb2053c.108c58d4-49a9-41fe-a4c5-3c7e90328398 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:35:36 devstack sudo[111257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e0ddfb60-ad41-4198-80db-5948cdb2053c -F qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e0ddfb60-ad41-4198-80db-5948cdb2053c.108c58d4-49a9-41fe-a4c5-3c7e90328398 Jul 31 12:35:36 devstack sudo[111257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:35:36 devstack sudo[111257]: pam_unix(sudo:session): session closed for user root Jul 31 12:35:36 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-3926ea6a-2761-44be-bcb6-06460b908960 tempest-VolumeImageDependencyTests-1312082570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e0ddfb60-ad41-4198-80db-5948cdb2053c -F qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e0ddfb60-ad41-4198-80db-5948cdb2053c.108c58d4-49a9-41fe-a4c5-3c7e90328398" returned: 0 in 0.338s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:35:36 devstack cinder-volume[89182]: WARNING cinder.volume.drivers.remotefs [None req-3926ea6a-2761-44be-bcb6-06460b908960 tempest-VolumeImageDependencyTests-1312082570 None] /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e0ddfb60-ad41-4198-80db-5948cdb2053c.108c58d4-49a9-41fe-a4c5-3c7e90328398 is being set with open permissions: ugo+rw Jul 31 12:35:36 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-3926ea6a-2761-44be-bcb6-06460b908960 tempest-VolumeImageDependencyTests-1312082570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e0ddfb60-ad41-4198-80db-5948cdb2053c.108c58d4-49a9-41fe-a4c5-3c7e90328398 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:35:36 devstack sudo[111262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e0ddfb60-ad41-4198-80db-5948cdb2053c.108c58d4-49a9-41fe-a4c5-3c7e90328398 Jul 31 12:35:36 devstack sudo[111262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:35:37 devstack sudo[111262]: pam_unix(sudo:session): session closed for user root Jul 31 12:35:37 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-3926ea6a-2761-44be-bcb6-06460b908960 tempest-VolumeImageDependencyTests-1312082570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e0ddfb60-ad41-4198-80db-5948cdb2053c.108c58d4-49a9-41fe-a4c5-3c7e90328398" returned: 0 in 0.272s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:35:37 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-3926ea6a-2761-44be-bcb6-06460b908960 tempest-VolumeImageDependencyTests-1312082570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e0ddfb60-ad41-4198-80db-5948cdb2053c.info {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:35:37 devstack sudo[111266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e0ddfb60-ad41-4198-80db-5948cdb2053c.info Jul 31 12:35:37 devstack sudo[111266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:35:37 devstack sudo[111266]: pam_unix(sudo:session): session closed for user root Jul 31 12:35:37 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-3926ea6a-2761-44be-bcb6-06460b908960 tempest-VolumeImageDependencyTests-1312082570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e0ddfb60-ad41-4198-80db-5948cdb2053c.info" returned: 0 in 0.295s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:35:37 devstack cinder-volume[89182]: WARNING cinder.volume.drivers.remotefs [None req-3926ea6a-2761-44be-bcb6-06460b908960 tempest-VolumeImageDependencyTests-1312082570 None] /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e0ddfb60-ad41-4198-80db-5948cdb2053c.info is being set with open permissions: ugo+rw Jul 31 12:35:37 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-3926ea6a-2761-44be-bcb6-06460b908960 tempest-VolumeImageDependencyTests-1312082570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e0ddfb60-ad41-4198-80db-5948cdb2053c.info {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:35:37 devstack sudo[111269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e0ddfb60-ad41-4198-80db-5948cdb2053c.info Jul 31 12:35:37 devstack sudo[111269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:35:37 devstack sudo[111269]: pam_unix(sudo:session): session closed for user root Jul 31 12:35:37 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-3926ea6a-2761-44be-bcb6-06460b908960 tempest-VolumeImageDependencyTests-1312082570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e0ddfb60-ad41-4198-80db-5948cdb2053c.info" returned: 0 in 0.273s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:35:37 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-3926ea6a-2761-44be-bcb6-06460b908960 tempest-VolumeImageDependencyTests-1312082570 None] Acquiring lock "cinder-quobyte-1e9b4a9a-db6f-4762-b29d-cf21e00254c2" by "_copy_volume_from_snapshot" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:35:37 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-3926ea6a-2761-44be-bcb6-06460b908960 tempest-VolumeImageDependencyTests-1312082570 None] Lock "cinder-quobyte-1e9b4a9a-db6f-4762-b29d-cf21e00254c2" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:35:37 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-3926ea6a-2761-44be-bcb6-06460b908960 tempest-VolumeImageDependencyTests-1312082570 None] snapshot: 108c58d4-49a9-41fe-a4c5-3c7e90328398, volume: 1e9b4a9a-db6f-4762-b29d-cf21e00254c2, {{(pid=89182) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Jul 31 12:35:37 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-3926ea6a-2761-44be-bcb6-06460b908960 tempest-VolumeImageDependencyTests-1312082570 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:35:37 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-3926ea6a-2761-44be-bcb6-06460b908960 tempest-VolumeImageDependencyTests-1312082570 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:35:37 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-3926ea6a-2761-44be-bcb6-06460b908960 tempest-VolumeImageDependencyTests-1312082570 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:35:37 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-3926ea6a-2761-44be-bcb6-06460b908960 tempest-VolumeImageDependencyTests-1312082570 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:35:37 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-3926ea6a-2761-44be-bcb6-06460b908960 tempest-VolumeImageDependencyTests-1312082570 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:35:37 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[a159d6c3-3657-4a23-b7dd-78d683bc3f37]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:35:37 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-3926ea6a-2761-44be-bcb6-06460b908960 tempest-VolumeImageDependencyTests-1312082570 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e0ddfb60-ad41-4198-80db-5948cdb2053c.108c58d4-49a9-41fe-a4c5-3c7e90328398 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:35:37 devstack sudo[111272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e0ddfb60-ad41-4198-80db-5948cdb2053c.108c58d4-49a9-41fe-a4c5-3c7e90328398 Jul 31 12:35:37 devstack sudo[111272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:35:38 devstack sudo[111272]: pam_unix(sudo:session): session closed for user root Jul 31 12:35:38 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-3926ea6a-2761-44be-bcb6-06460b908960 tempest-VolumeImageDependencyTests-1312082570 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e0ddfb60-ad41-4198-80db-5948cdb2053c.108c58d4-49a9-41fe-a4c5-3c7e90328398" returned: 0 in 0.375s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:35:38 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-3926ea6a-2761-44be-bcb6-06460b908960 tempest-VolumeImageDependencyTests-1312082570 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e0ddfb60-ad41-4198-80db-5948cdb2053c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89182) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 12:35:38 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb08fe5b-6319-4237-83af-9402609ccbfc]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:35:38 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-3926ea6a-2761-44be-bcb6-06460b908960 tempest-VolumeImageDependencyTests-1312082570 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e0ddfb60-ad41-4198-80db-5948cdb2053c {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:35:38 devstack sudo[111278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e0ddfb60-ad41-4198-80db-5948cdb2053c Jul 31 12:35:38 devstack sudo[111278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:35:38 devstack sudo[111278]: pam_unix(sudo:session): session closed for user root Jul 31 12:35:38 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-3926ea6a-2761-44be-bcb6-06460b908960 tempest-VolumeImageDependencyTests-1312082570 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e0ddfb60-ad41-4198-80db-5948cdb2053c" returned: 0 in 0.393s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:35:38 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-3926ea6a-2761-44be-bcb6-06460b908960 tempest-VolumeImageDependencyTests-1312082570 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e0ddfb60-ad41-4198-80db-5948cdb2053c {{(pid=89182) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Jul 31 12:35:38 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-3926ea6a-2761-44be-bcb6-06460b908960 tempest-VolumeImageDependencyTests-1312082570 None] Creating direct copy from snapshot {{(pid=89182) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Jul 31 12:35:38 devstack cinder-volume[89182]: DEBUG cinder.utils [None req-3926ea6a-2761-44be-bcb6-06460b908960 tempest-VolumeImageDependencyTests-1312082570 None] Path /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-1e9b4a9a-db6f-4762-b29d-cf21e00254c2 not found in is_blk_device check {{(pid=89182) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 31 12:35:38 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-3926ea6a-2761-44be-bcb6-06460b908960 tempest-VolumeImageDependencyTests-1312082570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e0ddfb60-ad41-4198-80db-5948cdb2053c /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-1e9b4a9a-db6f-4762-b29d-cf21e00254c2 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:35:38 devstack sudo[111283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e0ddfb60-ad41-4198-80db-5948cdb2053c /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-1e9b4a9a-db6f-4762-b29d-cf21e00254c2 Jul 31 12:35:38 devstack sudo[111283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:35:39 devstack sudo[111283]: pam_unix(sudo:session): session closed for user root Jul 31 12:35:39 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-3926ea6a-2761-44be-bcb6-06460b908960 tempest-VolumeImageDependencyTests-1312082570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e0ddfb60-ad41-4198-80db-5948cdb2053c /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-1e9b4a9a-db6f-4762-b29d-cf21e00254c2" returned: 0 in 0.700s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:35:39 devstack cinder-volume[89182]: DEBUG cinder.image.image_utils [None req-3926ea6a-2761-44be-bcb6-06460b908960 tempest-VolumeImageDependencyTests-1312082570 None] Image conversion details: src /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e0ddfb60-ad41-4198-80db-5948cdb2053c, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-1e9b4a9a-db6f-4762-b29d-cf21e00254c2 {{(pid=89182) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 31 12:35:39 devstack cinder-volume[89182]: INFO cinder.image.image_utils [None req-3926ea6a-2761-44be-bcb6-06460b908960 tempest-VolumeImageDependencyTests-1312082570 None] Converted 1024.00 MB image at 1024.00 MB/s Jul 31 12:35:39 devstack cinder-volume[89182]: WARNING cinder.volume.drivers.remotefs [None req-3926ea6a-2761-44be-bcb6-06460b908960 tempest-VolumeImageDependencyTests-1312082570 None] /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-1e9b4a9a-db6f-4762-b29d-cf21e00254c2 is being set with open permissions: ugo+rw Jul 31 12:35:39 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-3926ea6a-2761-44be-bcb6-06460b908960 tempest-VolumeImageDependencyTests-1312082570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-1e9b4a9a-db6f-4762-b29d-cf21e00254c2 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:35:39 devstack sudo[111289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-1e9b4a9a-db6f-4762-b29d-cf21e00254c2 Jul 31 12:35:39 devstack sudo[111289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:35:39 devstack sudo[111289]: pam_unix(sudo:session): session closed for user root Jul 31 12:35:39 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-3926ea6a-2761-44be-bcb6-06460b908960 tempest-VolumeImageDependencyTests-1312082570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-1e9b4a9a-db6f-4762-b29d-cf21e00254c2" returned: 0 in 0.321s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:35:39 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-3926ea6a-2761-44be-bcb6-06460b908960 tempest-VolumeImageDependencyTests-1312082570 None] Lock "cinder-quobyte-1e9b4a9a-db6f-4762-b29d-cf21e00254c2" released by "_copy_volume_from_snapshot" :: held 1.868s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:35:39 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-3926ea6a-2761-44be-bcb6-06460b908960 tempest-VolumeImageDependencyTests-1312082570 None] Acquiring lock "cinder-quobyte-108c58d4-49a9-41fe-a4c5-3c7e90328398" by "_delete_snapshot" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:35:39 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-3926ea6a-2761-44be-bcb6-06460b908960 tempest-VolumeImageDependencyTests-1312082570 None] Lock "cinder-quobyte-108c58d4-49a9-41fe-a4c5-3c7e90328398" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:35:39 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-3926ea6a-2761-44be-bcb6-06460b908960 tempest-VolumeImageDependencyTests-1312082570 None] Deleting offline snapshot 108c58d4-49a9-41fe-a4c5-3c7e90328398 of volume e0ddfb60-ad41-4198-80db-5948cdb2053c {{(pid=89182) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 31 12:35:39 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-3926ea6a-2761-44be-bcb6-06460b908960 tempest-VolumeImageDependencyTests-1312082570 None] snapshot_file for this snap is: volume-e0ddfb60-ad41-4198-80db-5948cdb2053c.108c58d4-49a9-41fe-a4c5-3c7e90328398 {{(pid=89182) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 31 12:35:39 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fc6a660-343e-4a14-81e7-302651b2fa04]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:35:39 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-3926ea6a-2761-44be-bcb6-06460b908960 tempest-VolumeImageDependencyTests-1312082570 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e0ddfb60-ad41-4198-80db-5948cdb2053c.108c58d4-49a9-41fe-a4c5-3c7e90328398 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:35:39 devstack sudo[111292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e0ddfb60-ad41-4198-80db-5948cdb2053c.108c58d4-49a9-41fe-a4c5-3c7e90328398 Jul 31 12:35:39 devstack sudo[111292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:35:40 devstack sudo[111292]: pam_unix(sudo:session): session closed for user root Jul 31 12:35:40 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-3926ea6a-2761-44be-bcb6-06460b908960 tempest-VolumeImageDependencyTests-1312082570 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e0ddfb60-ad41-4198-80db-5948cdb2053c.108c58d4-49a9-41fe-a4c5-3c7e90328398" returned: 0 in 0.409s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:35:40 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-3926ea6a-2761-44be-bcb6-06460b908960 tempest-VolumeImageDependencyTests-1312082570 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e0ddfb60-ad41-4198-80db-5948cdb2053c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89182) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 12:35:40 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[bca0599d-e6d4-4d13-b671-9e5bb6468e1e]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:35:40 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-3926ea6a-2761-44be-bcb6-06460b908960 tempest-VolumeImageDependencyTests-1312082570 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e0ddfb60-ad41-4198-80db-5948cdb2053c {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:35:40 devstack sudo[111297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e0ddfb60-ad41-4198-80db-5948cdb2053c Jul 31 12:35:40 devstack sudo[111297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:35:40 devstack sudo[111297]: pam_unix(sudo:session): session closed for user root Jul 31 12:35:40 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-3926ea6a-2761-44be-bcb6-06460b908960 tempest-VolumeImageDependencyTests-1312082570 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e0ddfb60-ad41-4198-80db-5948cdb2053c" returned: 0 in 0.396s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:35:40 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-3926ea6a-2761-44be-bcb6-06460b908960 tempest-VolumeImageDependencyTests-1312082570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e0ddfb60-ad41-4198-80db-5948cdb2053c.108c58d4-49a9-41fe-a4c5-3c7e90328398 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:35:40 devstack sudo[111302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e0ddfb60-ad41-4198-80db-5948cdb2053c.108c58d4-49a9-41fe-a4c5-3c7e90328398 Jul 31 12:35:40 devstack sudo[111302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:35:40 devstack sudo[111302]: pam_unix(sudo:session): session closed for user root Jul 31 12:35:40 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-3926ea6a-2761-44be-bcb6-06460b908960 tempest-VolumeImageDependencyTests-1312082570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e0ddfb60-ad41-4198-80db-5948cdb2053c.108c58d4-49a9-41fe-a4c5-3c7e90328398" returned: 0 in 0.383s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:35:40 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-3926ea6a-2761-44be-bcb6-06460b908960 tempest-VolumeImageDependencyTests-1312082570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e0ddfb60-ad41-4198-80db-5948cdb2053c.108c58d4-49a9-41fe-a4c5-3c7e90328398 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:35:40 devstack sudo[111308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e0ddfb60-ad41-4198-80db-5948cdb2053c.108c58d4-49a9-41fe-a4c5-3c7e90328398 Jul 31 12:35:40 devstack sudo[111308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:35:41 devstack sudo[111308]: pam_unix(sudo:session): session closed for user root Jul 31 12:35:41 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-3926ea6a-2761-44be-bcb6-06460b908960 tempest-VolumeImageDependencyTests-1312082570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e0ddfb60-ad41-4198-80db-5948cdb2053c.108c58d4-49a9-41fe-a4c5-3c7e90328398" returned: 0 in 0.272s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:35:41 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-3926ea6a-2761-44be-bcb6-06460b908960 tempest-VolumeImageDependencyTests-1312082570 None] Lock "cinder-quobyte-108c58d4-49a9-41fe-a4c5-3c7e90328398" released by "_delete_snapshot" :: held 1.548s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:35:41 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-3926ea6a-2761-44be-bcb6-06460b908960 tempest-VolumeImageDependencyTests-1312082570 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 5.791s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:35:41 devstack cinder-volume[89182]: DEBUG cinder.volume.volume_utils [None req-3926ea6a-2761-44be-bcb6-06460b908960 tempest-VolumeImageDependencyTests-1312082570 None] Marking volume 1e9b4a9a-db6f-4762-b29d-cf21e00254c2 as bootable. {{(pid=89182) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 31 12:35:41 devstack cinder-volume[89182]: DEBUG cinder.volume.flows.manager.create_volume [None req-3926ea6a-2761-44be-bcb6-06460b908960 tempest-VolumeImageDependencyTests-1312082570 None] Copying metadata from source volume e0ddfb60-ad41-4198-80db-5948cdb2053c to 1e9b4a9a-db6f-4762-b29d-cf21e00254c2. {{(pid=89182) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:438}} Jul 31 12:35:41 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-3926ea6a-2761-44be-bcb6-06460b908960 tempest-VolumeImageDependencyTests-1312082570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48248899-00aa-4b23-93e1-e05d8cea0b03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1e9b4a9a-db6f-4762-b29d-cf21e00254c2', 'volume_size': 1, 'source_volid': 'e0ddfb60-ad41-4198-80db-5948cdb2053c', 'source_volstatus': 'available'}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:35:41 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-3926ea6a-2761-44be-bcb6-06460b908960 tempest-VolumeImageDependencyTests-1312082570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a027a167-2c93-473c-abe2-1c932e90bfe6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:35:41 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-3926ea6a-2761-44be-bcb6-06460b908960 tempest-VolumeImageDependencyTests-1312082570 None] Volume volume-1e9b4a9a-db6f-4762-b29d-cf21e00254c2 (1e9b4a9a-db6f-4762-b29d-cf21e00254c2): created successfully Jul 31 12:35:41 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-3926ea6a-2761-44be-bcb6-06460b908960 tempest-VolumeImageDependencyTests-1312082570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a027a167-2c93-473c-abe2-1c932e90bfe6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:35:41 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-3926ea6a-2761-44be-bcb6-06460b908960 tempest-VolumeImageDependencyTests-1312082570 None] Flow 'volume_create_manager' (b7ab176a-be29-4802-acd9-deaee1878fdb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:35:41 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-3926ea6a-2761-44be-bcb6-06460b908960 tempest-VolumeImageDependencyTests-1312082570 None] Created volume successfully. Jul 31 12:35:41 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-03f1eac6-dac5-48a6-b8eb-d882b846cf19 tempest-VolumeImageDependencyTests-1312082570 None] Acquiring lock "cinder-e0ddfb60-ad41-4198-80db-5948cdb2053c-delete_volume" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:35:41 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-03f1eac6-dac5-48a6-b8eb-d882b846cf19 tempest-VolumeImageDependencyTests-1312082570 None] Lock "cinder-e0ddfb60-ad41-4198-80db-5948cdb2053c-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:35:41 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-03f1eac6-dac5-48a6-b8eb-d882b846cf19 tempest-VolumeImageDependencyTests-1312082570 None] Acquiring lock "cinder-quobyte-e0ddfb60-ad41-4198-80db-5948cdb2053c" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:35:41 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-03f1eac6-dac5-48a6-b8eb-d882b846cf19 tempest-VolumeImageDependencyTests-1312082570 None] Lock "cinder-quobyte-e0ddfb60-ad41-4198-80db-5948cdb2053c" acquired by "delete_volume" :: waited 0.021s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:35:41 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[2de63598-7640-4c66-899a-1efefed374f1]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:35:41 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-03f1eac6-dac5-48a6-b8eb-d882b846cf19 tempest-VolumeImageDependencyTests-1312082570 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e0ddfb60-ad41-4198-80db-5948cdb2053c {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:35:42 devstack sudo[111311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e0ddfb60-ad41-4198-80db-5948cdb2053c Jul 31 12:35:42 devstack sudo[111311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:35:42 devstack sudo[111311]: pam_unix(sudo:session): session closed for user root Jul 31 12:35:42 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-03f1eac6-dac5-48a6-b8eb-d882b846cf19 tempest-VolumeImageDependencyTests-1312082570 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e0ddfb60-ad41-4198-80db-5948cdb2053c" returned: 0 in 0.384s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:35:42 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-03f1eac6-dac5-48a6-b8eb-d882b846cf19 tempest-VolumeImageDependencyTests-1312082570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e0ddfb60-ad41-4198-80db-5948cdb2053c {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:35:42 devstack sudo[111316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e0ddfb60-ad41-4198-80db-5948cdb2053c Jul 31 12:35:42 devstack sudo[111316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:35:42 devstack sudo[111316]: pam_unix(sudo:session): session closed for user root Jul 31 12:35:42 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-03f1eac6-dac5-48a6-b8eb-d882b846cf19 tempest-VolumeImageDependencyTests-1312082570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e0ddfb60-ad41-4198-80db-5948cdb2053c" returned: 0 in 0.247s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:35:42 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-03f1eac6-dac5-48a6-b8eb-d882b846cf19 tempest-VolumeImageDependencyTests-1312082570 None] Lock "cinder-quobyte-e0ddfb60-ad41-4198-80db-5948cdb2053c" released by "delete_volume" :: held 0.700s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:35:42 devstack cinder-volume[89182]: DEBUG cinder.quota [None req-03f1eac6-dac5-48a6-b8eb-d882b846cf19 tempest-VolumeImageDependencyTests-1312082570 None] Created reservations ['250a9150-1108-4d41-8e6a-9012af1d30f1', 'fe731ede-f7ad-4d8b-97a1-6cf5aa5b1fc3', 'e2e3b104-2385-41e9-9472-8ee64cb3c23c', '31f0ffbe-9674-41a8-aac4-0a43930c207f'] {{(pid=89182) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 12:35:42 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-03f1eac6-dac5-48a6-b8eb-d882b846cf19 tempest-VolumeImageDependencyTests-1312082570 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:35:42 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-03f1eac6-dac5-48a6-b8eb-d882b846cf19 tempest-VolumeImageDependencyTests-1312082570 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:35:42 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-03f1eac6-dac5-48a6-b8eb-d882b846cf19 tempest-VolumeImageDependencyTests-1312082570 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:35:42 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-03f1eac6-dac5-48a6-b8eb-d882b846cf19 tempest-VolumeImageDependencyTests-1312082570 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:35:42 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-03f1eac6-dac5-48a6-b8eb-d882b846cf19 tempest-VolumeImageDependencyTests-1312082570 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:35:42 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-03f1eac6-dac5-48a6-b8eb-d882b846cf19 tempest-VolumeImageDependencyTests-1312082570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:35:42 devstack sudo[111319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 Jul 31 12:35:42 devstack sudo[111319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:35:42 devstack sudo[111319]: pam_unix(sudo:session): session closed for user root Jul 31 12:35:42 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-03f1eac6-dac5-48a6-b8eb-d882b846cf19 tempest-VolumeImageDependencyTests-1312082570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2" returned: 0 in 0.244s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:35:42 devstack cinder-volume[89182]: DEBUG cinder.manager [None req-03f1eac6-dac5-48a6-b8eb-d882b846cf19 tempest-VolumeImageDependencyTests-1312082570 None] Notifying Schedulers of capabilities ... {{(pid=89182) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 12:35:42 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-03f1eac6-dac5-48a6-b8eb-d882b846cf19 tempest-VolumeImageDependencyTests-1312082570 None] Deleted volume successfully. Jul 31 12:35:42 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-03f1eac6-dac5-48a6-b8eb-d882b846cf19 tempest-VolumeImageDependencyTests-1312082570 None] Lock "cinder-e0ddfb60-ad41-4198-80db-5948cdb2053c-delete_volume" released by "delete_volume" :: held 1.205s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:35:46 devstack cinder-volume[89182]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5220286-6c5b-42ba-8c47-9758fd5db67a tempest-VolumeImageDependencyTests-1312082570 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89182) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 12:35:46 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-c5220286-6c5b-42ba-8c47-9758fd5db67a tempest-VolumeImageDependencyTests-1312082570 None] Flow 'volume_create_manager' (b7b7f372-786f-46ff-902b-ebe3d704a88a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:35:46 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-c5220286-6c5b-42ba-8c47-9758fd5db67a tempest-VolumeImageDependencyTests-1312082570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45f41187-47fc-49e6-9f2f-77c5a48c74d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:35:46 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-c5220286-6c5b-42ba-8c47-9758fd5db67a tempest-VolumeImageDependencyTests-1312082570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45f41187-47fc-49e6-9f2f-77c5a48c74d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:35:46Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-teste6050452-06bd-4c7f-9912-45178c83e379',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ccdc9ca-96d4-4704-b63e-6f4ae7702293,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82a4ae047b294dd6980ed8ee242ed2a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:35:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:35:46Z,use_quota=True,user_id='ac62fb5bd782416aa9109655a79c6a24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:35:46 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-c5220286-6c5b-42ba-8c47-9758fd5db67a tempest-VolumeImageDependencyTests-1312082570 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ae1facf-6a7d-4cb1-8394-e7559f5659d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:35:46 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-c5220286-6c5b-42ba-8c47-9758fd5db67a tempest-VolumeImageDependencyTests-1312082570 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ae1facf-6a7d-4cb1-8394-e7559f5659d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:35:46 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-c5220286-6c5b-42ba-8c47-9758fd5db67a tempest-VolumeImageDependencyTests-1312082570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5436956c-42d0-4261-87f1-ed182e22ae2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:35:46 devstack cinder-volume[89182]: DEBUG cinder.image.glance [None req-c5220286-6c5b-42ba-8c47-9758fd5db67a tempest-VolumeImageDependencyTests-1312082570 None] Creating Keystone auth plugin from conf {{(pid=89182) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 31 12:35:46 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-c5220286-6c5b-42ba-8c47-9758fd5db67a tempest-VolumeImageDependencyTests-1312082570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5436956c-42d0-4261-87f1-ed182e22ae2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '0ccdc9ca-96d4-4704-b63e-6f4ae7702293', 'volume_name': 'volume-0ccdc9ca-96d4-4704-b63e-6f4ae7702293', 'volume_size': 1, 'image_id': 'e7ecb02d-57b4-44e6-a143-ff10c48d4da7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e7ecb02d-57b4-44e6-a143-ff10c48d4da7', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-e6050452-06bd-4c7f-9912-45178c83e379', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '89f2b89fddc67a6d9b7cf0b05bbabeac', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '82a4ae047b294dd6980ed8ee242ed2a5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '0138172500a81647c8c28e9ca281d840975a37c0468002fa9e811a7138255edcd14eb635755fd0092d8c8cd1f55c4aee7102351ff43b013cf9952b4e5d953d90', 'id': 'e7ecb02d-57b4-44e6-a143-ff10c48d4da7', 'created_at': datetime.datetime(2026, 7, 31, 10, 35, 44, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 31, 10, 35, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e7ecb02d-57b4-44e6-a143-ff10c48d4da7/file', 'properties': {}}, 'image_service': }' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:35:46 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-c5220286-6c5b-42ba-8c47-9758fd5db67a tempest-VolumeImageDependencyTests-1312082570 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64516c3d-0fd0-4735-b1b6-e455f2903eba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:35:46 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-c5220286-6c5b-42ba-8c47-9758fd5db67a tempest-VolumeImageDependencyTests-1312082570 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64516c3d-0fd0-4735-b1b6-e455f2903eba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:35:46 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-c5220286-6c5b-42ba-8c47-9758fd5db67a tempest-VolumeImageDependencyTests-1312082570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8739e25d-9f5d-458f-a2a6-3c8523b6d14e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:35:46 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-c5220286-6c5b-42ba-8c47-9758fd5db67a tempest-VolumeImageDependencyTests-1312082570 None] Volume 0ccdc9ca-96d4-4704-b63e-6f4ae7702293: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-0ccdc9ca-96d4-4704-b63e-6f4ae7702293', 'volume_size': 1, 'image_id': 'e7ecb02d-57b4-44e6-a143-ff10c48d4da7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e7ecb02d-57b4-44e6-a143-ff10c48d4da7', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-e6050452-06bd-4c7f-9912-45178c83e379', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '89f2b89fddc67a6d9b7cf0b05bbabeac', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '82a4ae047b294dd6980ed8ee242ed2a5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '0138172500a81647c8c28e9ca281d840975a37c0468002fa9e811a7138255edcd14eb635755fd0092d8c8cd1f55c4aee7102351ff43b013cf9952b4e5d953d90', 'id': 'e7ecb02d-57b4-44e6-a143-ff10c48d4da7', 'created_at': datetime.datetime(2026, 7, 31, 10, 35, 44, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 31, 10, 35, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e7ecb02d-57b4-44e6-a143-ff10c48d4da7/file', 'properties': {}}, 'image_service': } Jul 31 12:35:46 devstack cinder-volume[89182]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5220286-6c5b-42ba-8c47-9758fd5db67a tempest-VolumeImageDependencyTests-1312082570 None] Trying to clone 0ccdc9ca-96d4-4704-b63e-6f4ae7702293 from image e7ecb02d-57b4-44e6-a143-ff10c48d4da7 at location (None, [{'url': 'file:///opt/stack/data/glance/images/e7ecb02d-57b4-44e6-a143-ff10c48d4da7', 'metadata': {}}]). {{(pid=89182) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 31 12:35:46 devstack cinder-volume[89182]: DEBUG cinder.image.image_utils [None req-c5220286-6c5b-42ba-8c47-9758fd5db67a tempest-VolumeImageDependencyTests-1312082570 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_e7ecb02d-57b4-44e6-a143-ff10c48d4da7_aa_rnu6rdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=89182) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 31 12:35:46 devstack cinder-volume[89182]: INFO cinder.image.image_utils [None req-c5220286-6c5b-42ba-8c47-9758fd5db67a tempest-VolumeImageDependencyTests-1312082570 None] Image download 0.00 MB at 0.00 MB/s Jul 31 12:35:46 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[2eeb86d5-9597-40d8-adb5-749c6f694be8]: (4, 'raw') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:35:46 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-c5220286-6c5b-42ba-8c47-9758fd5db67a tempest-VolumeImageDependencyTests-1312082570 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e7ecb02d-57b4-44e6-a143-ff10c48d4da7_aa_rnu6rdevstack@QuobyteHD {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:35:46 devstack sudo[111361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e7ecb02d-57b4-44e6-a143-ff10c48d4da7_aa_rnu6rdevstack@QuobyteHD Jul 31 12:35:46 devstack sudo[111361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:35:47 devstack sudo[111361]: pam_unix(sudo:session): session closed for user root Jul 31 12:35:47 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-c5220286-6c5b-42ba-8c47-9758fd5db67a tempest-VolumeImageDependencyTests-1312082570 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e7ecb02d-57b4-44e6-a143-ff10c48d4da7_aa_rnu6rdevstack@QuobyteHD" returned: 0 in 0.345s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:35:47 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-c5220286-6c5b-42ba-8c47-9758fd5db67a tempest-VolumeImageDependencyTests-1312082570 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e7ecb02d-57b4-44e6-a143-ff10c48d4da7_aa_rnu6rdevstack@QuobyteHD {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:35:47 devstack sudo[111366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e7ecb02d-57b4-44e6-a143-ff10c48d4da7_aa_rnu6rdevstack@QuobyteHD Jul 31 12:35:47 devstack sudo[111366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:35:47 devstack sudo[111366]: pam_unix(sudo:session): session closed for user root Jul 31 12:35:47 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-c5220286-6c5b-42ba-8c47-9758fd5db67a tempest-VolumeImageDependencyTests-1312082570 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e7ecb02d-57b4-44e6-a143-ff10c48d4da7_aa_rnu6rdevstack@QuobyteHD" returned: 1 in 0.322s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:35:47 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-c5220286-6c5b-42ba-8c47-9758fd5db67a tempest-VolumeImageDependencyTests-1312082570 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e7ecb02d-57b4-44e6-a143-ff10c48d4da7_aa_rnu6rdevstack@QuobyteHD' failed. Not Retrying. {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 31 12:35:47 devstack cinder-volume[89182]: DEBUG cinder.image.image_utils [None req-c5220286-6c5b-42ba-8c47-9758fd5db67a tempest-VolumeImageDependencyTests-1312082570 None] Temporary image e7ecb02d-57b4-44e6-a143-ff10c48d4da7 is fetched for user ac62fb5bd782416aa9109655a79c6a24. {{(pid=89182) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 31 12:35:47 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6e38880-6f86-40f3-92e8-c0c01a67bc50]: (4, 'raw') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:35:47 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-c5220286-6c5b-42ba-8c47-9758fd5db67a tempest-VolumeImageDependencyTests-1312082570 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e7ecb02d-57b4-44e6-a143-ff10c48d4da7_aa_rnu6rdevstack@QuobyteHD {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:35:47 devstack sudo[111371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e7ecb02d-57b4-44e6-a143-ff10c48d4da7_aa_rnu6rdevstack@QuobyteHD Jul 31 12:35:47 devstack sudo[111371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:35:47 devstack sudo[111371]: pam_unix(sudo:session): session closed for user root Jul 31 12:35:47 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-c5220286-6c5b-42ba-8c47-9758fd5db67a tempest-VolumeImageDependencyTests-1312082570 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e7ecb02d-57b4-44e6-a143-ff10c48d4da7_aa_rnu6rdevstack@QuobyteHD" returned: 0 in 0.344s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:35:47 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-c5220286-6c5b-42ba-8c47-9758fd5db67a tempest-VolumeImageDependencyTests-1312082570 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e7ecb02d-57b4-44e6-a143-ff10c48d4da7_aa_rnu6rdevstack@QuobyteHD {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:35:48 devstack sudo[111375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e7ecb02d-57b4-44e6-a143-ff10c48d4da7_aa_rnu6rdevstack@QuobyteHD Jul 31 12:35:48 devstack sudo[111375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:35:48 devstack sudo[111375]: pam_unix(sudo:session): session closed for user root Jul 31 12:35:48 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-c5220286-6c5b-42ba-8c47-9758fd5db67a tempest-VolumeImageDependencyTests-1312082570 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e7ecb02d-57b4-44e6-a143-ff10c48d4da7_aa_rnu6rdevstack@QuobyteHD" returned: 1 in 0.335s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:35:48 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-c5220286-6c5b-42ba-8c47-9758fd5db67a tempest-VolumeImageDependencyTests-1312082570 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e7ecb02d-57b4-44e6-a143-ff10c48d4da7_aa_rnu6rdevstack@QuobyteHD' failed. Not Retrying. {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 31 12:35:48 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-c5220286-6c5b-42ba-8c47-9758fd5db67a tempest-VolumeImageDependencyTests-1312082570 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:35:48 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-c5220286-6c5b-42ba-8c47-9758fd5db67a tempest-VolumeImageDependencyTests-1312082570 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:35:48 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-c5220286-6c5b-42ba-8c47-9758fd5db67a tempest-VolumeImageDependencyTests-1312082570 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:35:46Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-teste6050452-06bd-4c7f-9912-45178c83e379',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ccdc9ca-96d4-4704-b63e-6f4ae7702293,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82a4ae047b294dd6980ed8ee242ed2a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:35:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:35:46Z,use_quota=True,user_id='ac62fb5bd782416aa9109655a79c6a24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)}" {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 12:35:48 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-c5220286-6c5b-42ba-8c47-9758fd5db67a tempest-VolumeImageDependencyTests-1312082570 None] Creating volume 0ccdc9ca-96d4-4704-b63e-6f4ae7702293 {{(pid=89182) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 12:35:48 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-c5220286-6c5b-42ba-8c47-9758fd5db67a tempest-VolumeImageDependencyTests-1312082570 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:35:48 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-c5220286-6c5b-42ba-8c47-9758fd5db67a tempest-VolumeImageDependencyTests-1312082570 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:35:48 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-c5220286-6c5b-42ba-8c47-9758fd5db67a tempest-VolumeImageDependencyTests-1312082570 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:35:48 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-c5220286-6c5b-42ba-8c47-9758fd5db67a tempest-VolumeImageDependencyTests-1312082570 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:35:48 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-c5220286-6c5b-42ba-8c47-9758fd5db67a tempest-VolumeImageDependencyTests-1312082570 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:35:48 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-c5220286-6c5b-42ba-8c47-9758fd5db67a tempest-VolumeImageDependencyTests-1312082570 None] Selected osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 as target Quobyte volume. {{(pid=89182) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 12:35:48 devstack cinder-volume[89182]: INFO cinder.volume.drivers.remotefs [None req-c5220286-6c5b-42ba-8c47-9758fd5db67a tempest-VolumeImageDependencyTests-1312082570 None] casted to osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 Jul 31 12:35:48 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-c5220286-6c5b-42ba-8c47-9758fd5db67a tempest-VolumeImageDependencyTests-1312082570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0ccdc9ca-96d4-4704-b63e-6f4ae7702293 1073741824 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:35:48 devstack sudo[111380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0ccdc9ca-96d4-4704-b63e-6f4ae7702293 1073741824 Jul 31 12:35:48 devstack sudo[111380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:35:48 devstack sudo[111380]: pam_unix(sudo:session): session closed for user root Jul 31 12:35:48 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-c5220286-6c5b-42ba-8c47-9758fd5db67a tempest-VolumeImageDependencyTests-1312082570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0ccdc9ca-96d4-4704-b63e-6f4ae7702293 1073741824" returned: 0 in 0.464s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:35:48 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-c5220286-6c5b-42ba-8c47-9758fd5db67a tempest-VolumeImageDependencyTests-1312082570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0ccdc9ca-96d4-4704-b63e-6f4ae7702293 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:35:48 devstack sudo[111386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0ccdc9ca-96d4-4704-b63e-6f4ae7702293 Jul 31 12:35:48 devstack sudo[111386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:35:49 devstack sudo[111386]: pam_unix(sudo:session): session closed for user root Jul 31 12:35:49 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-c5220286-6c5b-42ba-8c47-9758fd5db67a tempest-VolumeImageDependencyTests-1312082570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0ccdc9ca-96d4-4704-b63e-6f4ae7702293" returned: 0 in 0.257s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:35:49 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-c5220286-6c5b-42ba-8c47-9758fd5db67a tempest-VolumeImageDependencyTests-1312082570 None] <== create_volume: return (767ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'} {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 12:35:49 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-c5220286-6c5b-42ba-8c47-9758fd5db67a tempest-VolumeImageDependencyTests-1312082570 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.770s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:35:49 devstack cinder-volume[89182]: DEBUG cinder.volume.volume_utils [None req-c5220286-6c5b-42ba-8c47-9758fd5db67a tempest-VolumeImageDependencyTests-1312082570 None] Attempting download of e7ecb02d-57b4-44e6-a143-ff10c48d4da7 ((None, [{'url': 'file:///opt/stack/data/glance/images/e7ecb02d-57b4-44e6-a143-ff10c48d4da7', 'metadata': {}}])) to volume 0ccdc9ca-96d4-4704-b63e-6f4ae7702293. {{(pid=89182) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 31 12:35:49 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[9da16d9f-f4b0-4cfa-8aa4-2f896dfb98ec]: (4, 'raw') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:35:49 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-c5220286-6c5b-42ba-8c47-9758fd5db67a tempest-VolumeImageDependencyTests-1312082570 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e7ecb02d-57b4-44e6-a143-ff10c48d4da7_oozunlli {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:35:49 devstack sudo[111389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e7ecb02d-57b4-44e6-a143-ff10c48d4da7_oozunlli Jul 31 12:35:49 devstack sudo[111389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:35:49 devstack sudo[111389]: pam_unix(sudo:session): session closed for user root Jul 31 12:35:49 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-c5220286-6c5b-42ba-8c47-9758fd5db67a tempest-VolumeImageDependencyTests-1312082570 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e7ecb02d-57b4-44e6-a143-ff10c48d4da7_oozunlli" returned: 0 in 0.362s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:35:49 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-c5220286-6c5b-42ba-8c47-9758fd5db67a tempest-VolumeImageDependencyTests-1312082570 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e7ecb02d-57b4-44e6-a143-ff10c48d4da7_oozunlli {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:35:49 devstack sudo[111393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e7ecb02d-57b4-44e6-a143-ff10c48d4da7_oozunlli Jul 31 12:35:49 devstack sudo[111393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:35:49 devstack sudo[111393]: pam_unix(sudo:session): session closed for user root Jul 31 12:35:49 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-c5220286-6c5b-42ba-8c47-9758fd5db67a tempest-VolumeImageDependencyTests-1312082570 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e7ecb02d-57b4-44e6-a143-ff10c48d4da7_oozunlli" returned: 1 in 0.381s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:35:49 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-c5220286-6c5b-42ba-8c47-9758fd5db67a tempest-VolumeImageDependencyTests-1312082570 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e7ecb02d-57b4-44e6-a143-ff10c48d4da7_oozunlli' failed. Not Retrying. {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 31 12:35:49 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[340c21ec-8370-47c8-a95e-33a8b2ea9592]: (4, 'raw') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:35:49 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-c5220286-6c5b-42ba-8c47-9758fd5db67a tempest-VolumeImageDependencyTests-1312082570 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e7ecb02d-57b4-44e6-a143-ff10c48d4da7_aa_rnu6rdevstack@QuobyteHD {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:35:50 devstack sudo[111403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e7ecb02d-57b4-44e6-a143-ff10c48d4da7_aa_rnu6rdevstack@QuobyteHD Jul 31 12:35:50 devstack sudo[111403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:35:50 devstack sudo[111403]: pam_unix(sudo:session): session closed for user root Jul 31 12:35:50 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-c5220286-6c5b-42ba-8c47-9758fd5db67a tempest-VolumeImageDependencyTests-1312082570 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e7ecb02d-57b4-44e6-a143-ff10c48d4da7_aa_rnu6rdevstack@QuobyteHD" returned: 0 in 0.387s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:35:50 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-c5220286-6c5b-42ba-8c47-9758fd5db67a tempest-VolumeImageDependencyTests-1312082570 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e7ecb02d-57b4-44e6-a143-ff10c48d4da7_aa_rnu6rdevstack@QuobyteHD {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:35:50 devstack sudo[111407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e7ecb02d-57b4-44e6-a143-ff10c48d4da7_aa_rnu6rdevstack@QuobyteHD Jul 31 12:35:50 devstack sudo[111407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:35:50 devstack sudo[111407]: pam_unix(sudo:session): session closed for user root Jul 31 12:35:50 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-c5220286-6c5b-42ba-8c47-9758fd5db67a tempest-VolumeImageDependencyTests-1312082570 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e7ecb02d-57b4-44e6-a143-ff10c48d4da7_aa_rnu6rdevstack@QuobyteHD" returned: 1 in 0.344s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:35:50 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-c5220286-6c5b-42ba-8c47-9758fd5db67a tempest-VolumeImageDependencyTests-1312082570 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e7ecb02d-57b4-44e6-a143-ff10c48d4da7_aa_rnu6rdevstack@QuobyteHD' failed. Not Retrying. {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 31 12:35:50 devstack cinder-volume[89182]: DEBUG cinder.image.image_utils [None req-c5220286-6c5b-42ba-8c47-9758fd5db67a tempest-VolumeImageDependencyTests-1312082570 None] e7ecb02d-57b4-44e6-a143-ff10c48d4da7 was raw, converting to qcow2 {{(pid=89182) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 31 12:35:50 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-c5220286-6c5b-42ba-8c47-9758fd5db67a tempest-VolumeImageDependencyTests-1312082570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_e7ecb02d-57b4-44e6-a143-ff10c48d4da7_aa_rnu6rdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0ccdc9ca-96d4-4704-b63e-6f4ae7702293 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:35:50 devstack sudo[111412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_e7ecb02d-57b4-44e6-a143-ff10c48d4da7_aa_rnu6rdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0ccdc9ca-96d4-4704-b63e-6f4ae7702293 Jul 31 12:35:50 devstack sudo[111412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:35:50 devstack cinder-volume[89182]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e77123f-a53a-4417-9902-7a357692bd86 tempest-SnapshotDependencyTests-757469785 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89182) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 12:35:50 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-8e77123f-a53a-4417-9902-7a357692bd86 tempest-SnapshotDependencyTests-757469785 None] Flow 'volume_create_manager' (9594da20-cd39-4b01-8e79-d72db48ea199) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:35:50 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-8e77123f-a53a-4417-9902-7a357692bd86 tempest-SnapshotDependencyTests-757469785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54ece17e-d80e-42e6-ab5b-6315f9642d7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:35:50 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-8e77123f-a53a-4417-9902-7a357692bd86 tempest-SnapshotDependencyTests-757469785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54ece17e-d80e-42e6-ab5b-6315f9642d7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:35:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-285454821',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad8324f3-f618-4d70-90c6-d853fc933756,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17aaa7d30fd24e90a42d50b9cf80a33e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:35:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:35:51Z,use_quota=True,user_id='38e2fad7ebe249f88eac35fec8739de8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:35:50 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-8e77123f-a53a-4417-9902-7a357692bd86 tempest-SnapshotDependencyTests-757469785 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dcb96ff1-bbba-41de-a016-14323e22510e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:35:50 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-8e77123f-a53a-4417-9902-7a357692bd86 tempest-SnapshotDependencyTests-757469785 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dcb96ff1-bbba-41de-a016-14323e22510e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:35:50 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-8e77123f-a53a-4417-9902-7a357692bd86 tempest-SnapshotDependencyTests-757469785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa35e513-cab5-4f79-b7ed-2bec46ec67af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:35:50 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-8e77123f-a53a-4417-9902-7a357692bd86 tempest-SnapshotDependencyTests-757469785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa35e513-cab5-4f79-b7ed-2bec46ec67af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ad8324f3-f618-4d70-90c6-d853fc933756', 'volume_name': 'volume-ad8324f3-f618-4d70-90c6-d853fc933756', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:35:50 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-8e77123f-a53a-4417-9902-7a357692bd86 tempest-SnapshotDependencyTests-757469785 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e306f12-9d8f-4cba-83d0-18c2cf83697c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:35:50 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-8e77123f-a53a-4417-9902-7a357692bd86 tempest-SnapshotDependencyTests-757469785 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e306f12-9d8f-4cba-83d0-18c2cf83697c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:35:50 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-8e77123f-a53a-4417-9902-7a357692bd86 tempest-SnapshotDependencyTests-757469785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d177fc32-d402-4d50-814e-f7e7ef3f5e1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:35:50 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-8e77123f-a53a-4417-9902-7a357692bd86 tempest-SnapshotDependencyTests-757469785 None] Volume ad8324f3-f618-4d70-90c6-d853fc933756: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ad8324f3-f618-4d70-90c6-d853fc933756', 'volume_size': 1} Jul 31 12:35:50 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-8e77123f-a53a-4417-9902-7a357692bd86 tempest-SnapshotDependencyTests-757469785 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:35:50 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-8e77123f-a53a-4417-9902-7a357692bd86 tempest-SnapshotDependencyTests-757469785 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:35:50 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-8e77123f-a53a-4417-9902-7a357692bd86 tempest-SnapshotDependencyTests-757469785 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:35:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-285454821',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad8324f3-f618-4d70-90c6-d853fc933756,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17aaa7d30fd24e90a42d50b9cf80a33e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:35:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:35:51Z,use_quota=True,user_id='38e2fad7ebe249f88eac35fec8739de8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)}" {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 12:35:50 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-8e77123f-a53a-4417-9902-7a357692bd86 tempest-SnapshotDependencyTests-757469785 None] Creating volume ad8324f3-f618-4d70-90c6-d853fc933756 {{(pid=89182) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 12:35:50 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-8e77123f-a53a-4417-9902-7a357692bd86 tempest-SnapshotDependencyTests-757469785 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:35:50 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-8e77123f-a53a-4417-9902-7a357692bd86 tempest-SnapshotDependencyTests-757469785 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:35:50 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-8e77123f-a53a-4417-9902-7a357692bd86 tempest-SnapshotDependencyTests-757469785 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:35:50 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-8e77123f-a53a-4417-9902-7a357692bd86 tempest-SnapshotDependencyTests-757469785 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:35:50 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-8e77123f-a53a-4417-9902-7a357692bd86 tempest-SnapshotDependencyTests-757469785 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:35:50 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-8e77123f-a53a-4417-9902-7a357692bd86 tempest-SnapshotDependencyTests-757469785 None] Selected osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 as target Quobyte volume. {{(pid=89182) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 12:35:50 devstack cinder-volume[89182]: INFO cinder.volume.drivers.remotefs [None req-8e77123f-a53a-4417-9902-7a357692bd86 tempest-SnapshotDependencyTests-757469785 None] casted to osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 Jul 31 12:35:50 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-8e77123f-a53a-4417-9902-7a357692bd86 tempest-SnapshotDependencyTests-757469785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-ad8324f3-f618-4d70-90c6-d853fc933756 1073741824 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:35:50 devstack sudo[111417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-ad8324f3-f618-4d70-90c6-d853fc933756 1073741824 Jul 31 12:35:50 devstack sudo[111417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:35:51 devstack sudo[111412]: pam_unix(sudo:session): session closed for user root Jul 31 12:35:51 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-c5220286-6c5b-42ba-8c47-9758fd5db67a tempest-VolumeImageDependencyTests-1312082570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_e7ecb02d-57b4-44e6-a143-ff10c48d4da7_aa_rnu6rdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0ccdc9ca-96d4-4704-b63e-6f4ae7702293" returned: 0 in 0.467s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:35:51 devstack cinder-volume[89182]: DEBUG cinder.image.image_utils [None req-c5220286-6c5b-42ba-8c47-9758fd5db67a tempest-VolumeImageDependencyTests-1312082570 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_e7ecb02d-57b4-44e6-a143-ff10c48d4da7_aa_rnu6rdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0ccdc9ca-96d4-4704-b63e-6f4ae7702293 {{(pid=89182) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 31 12:35:51 devstack cinder-volume[89182]: INFO cinder.image.image_utils [None req-c5220286-6c5b-42ba-8c47-9758fd5db67a tempest-VolumeImageDependencyTests-1312082570 None] Converted 0.00 MB image at 0.00 MB/s Jul 31 12:35:51 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-c5220286-6c5b-42ba-8c47-9758fd5db67a tempest-VolumeImageDependencyTests-1312082570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0ccdc9ca-96d4-4704-b63e-6f4ae7702293 1G {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:35:51 devstack sudo[111420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0ccdc9ca-96d4-4704-b63e-6f4ae7702293 1G Jul 31 12:35:51 devstack sudo[111420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:35:51 devstack sudo[111417]: pam_unix(sudo:session): session closed for user root Jul 31 12:35:51 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-8e77123f-a53a-4417-9902-7a357692bd86 tempest-SnapshotDependencyTests-757469785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-ad8324f3-f618-4d70-90c6-d853fc933756 1073741824" returned: 0 in 0.467s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:35:51 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-8e77123f-a53a-4417-9902-7a357692bd86 tempest-SnapshotDependencyTests-757469785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-ad8324f3-f618-4d70-90c6-d853fc933756 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:35:51 devstack sudo[111420]: pam_unix(sudo:session): session closed for user root Jul 31 12:35:51 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-c5220286-6c5b-42ba-8c47-9758fd5db67a tempest-VolumeImageDependencyTests-1312082570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0ccdc9ca-96d4-4704-b63e-6f4ae7702293 1G" returned: 0 in 0.340s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:35:51 devstack cinder-volume[89182]: DEBUG cinder.volume.volume_utils [None req-c5220286-6c5b-42ba-8c47-9758fd5db67a tempest-VolumeImageDependencyTests-1312082570 None] Downloaded image e7ecb02d-57b4-44e6-a143-ff10c48d4da7 ((None, [{'url': 'file:///opt/stack/data/glance/images/e7ecb02d-57b4-44e6-a143-ff10c48d4da7', 'metadata': {}}])) to volume 0ccdc9ca-96d4-4704-b63e-6f4ae7702293 successfully. {{(pid=89182) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 31 12:35:51 devstack cinder-volume[89182]: DEBUG cinder.image.image_utils [None req-c5220286-6c5b-42ba-8c47-9758fd5db67a tempest-VolumeImageDependencyTests-1312082570 None] Temporary image e7ecb02d-57b4-44e6-a143-ff10c48d4da7 for user ac62fb5bd782416aa9109655a79c6a24 is deleted. {{(pid=89182) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 31 12:35:51 devstack cinder-volume[89182]: DEBUG cinder.volume.volume_utils [None req-c5220286-6c5b-42ba-8c47-9758fd5db67a tempest-VolumeImageDependencyTests-1312082570 None] Marking volume 0ccdc9ca-96d4-4704-b63e-6f4ae7702293 as bootable. {{(pid=89182) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 31 12:35:51 devstack sudo[111430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-ad8324f3-f618-4d70-90c6-d853fc933756 Jul 31 12:35:51 devstack sudo[111430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:35:51 devstack cinder-volume[89182]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5220286-6c5b-42ba-8c47-9758fd5db67a tempest-VolumeImageDependencyTests-1312082570 None] Copying metadata from image e7ecb02d-57b4-44e6-a143-ff10c48d4da7 to 0ccdc9ca-96d4-4704-b63e-6f4ae7702293. {{(pid=89182) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 31 12:35:51 devstack cinder-volume[89182]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5220286-6c5b-42ba-8c47-9758fd5db67a tempest-VolumeImageDependencyTests-1312082570 None] Creating volume glance metadata for volume 0ccdc9ca-96d4-4704-b63e-6f4ae7702293 backed by image e7ecb02d-57b4-44e6-a143-ff10c48d4da7 with: {'image_id': 'e7ecb02d-57b4-44e6-a143-ff10c48d4da7', 'image_name': 'image-for-test-e6050452-06bd-4c7f-9912-45178c83e379', 'checksum': '89f2b89fddc67a6d9b7cf0b05bbabeac', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=89182) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 31 12:35:51 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-c5220286-6c5b-42ba-8c47-9758fd5db67a tempest-VolumeImageDependencyTests-1312082570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8739e25d-9f5d-458f-a2a6-3c8523b6d14e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0ccdc9ca-96d4-4704-b63e-6f4ae7702293', 'volume_size': 1, 'image_id': 'e7ecb02d-57b4-44e6-a143-ff10c48d4da7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e7ecb02d-57b4-44e6-a143-ff10c48d4da7', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-e6050452-06bd-4c7f-9912-45178c83e379', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '89f2b89fddc67a6d9b7cf0b05bbabeac', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '82a4ae047b294dd6980ed8ee242ed2a5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '0138172500a81647c8c28e9ca281d840975a37c0468002fa9e811a7138255edcd14eb635755fd0092d8c8cd1f55c4aee7102351ff43b013cf9952b4e5d953d90', 'id': 'e7ecb02d-57b4-44e6-a143-ff10c48d4da7', 'created_at': datetime.datetime(2026, 7, 31, 10, 35, 44, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 31, 10, 35, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e7ecb02d-57b4-44e6-a143-ff10c48d4da7/file', 'properties': {}}, 'image_service': }' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:35:51 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-c5220286-6c5b-42ba-8c47-9758fd5db67a tempest-VolumeImageDependencyTests-1312082570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11f23e93-558d-425d-a332-e6370f47cff8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:35:51 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-c5220286-6c5b-42ba-8c47-9758fd5db67a tempest-VolumeImageDependencyTests-1312082570 None] Volume volume-0ccdc9ca-96d4-4704-b63e-6f4ae7702293 (0ccdc9ca-96d4-4704-b63e-6f4ae7702293): created successfully Jul 31 12:35:51 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-c5220286-6c5b-42ba-8c47-9758fd5db67a tempest-VolumeImageDependencyTests-1312082570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11f23e93-558d-425d-a332-e6370f47cff8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:35:51 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-c5220286-6c5b-42ba-8c47-9758fd5db67a tempest-VolumeImageDependencyTests-1312082570 None] Flow 'volume_create_manager' (b7b7f372-786f-46ff-902b-ebe3d704a88a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:35:51 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-c5220286-6c5b-42ba-8c47-9758fd5db67a tempest-VolumeImageDependencyTests-1312082570 None] Created volume successfully. Jul 31 12:35:51 devstack sudo[111430]: pam_unix(sudo:session): session closed for user root Jul 31 12:35:51 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-8e77123f-a53a-4417-9902-7a357692bd86 tempest-SnapshotDependencyTests-757469785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-ad8324f3-f618-4d70-90c6-d853fc933756" returned: 0 in 0.266s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:35:51 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-8e77123f-a53a-4417-9902-7a357692bd86 tempest-SnapshotDependencyTests-757469785 None] <== create_volume: return (780ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'} {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 12:35:51 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-8e77123f-a53a-4417-9902-7a357692bd86 tempest-SnapshotDependencyTests-757469785 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.782s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:35:51 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-8e77123f-a53a-4417-9902-7a357692bd86 tempest-SnapshotDependencyTests-757469785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d177fc32-d402-4d50-814e-f7e7ef3f5e1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ad8324f3-f618-4d70-90c6-d853fc933756', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:35:51 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-8e77123f-a53a-4417-9902-7a357692bd86 tempest-SnapshotDependencyTests-757469785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f64ef5fb-0b5b-49dd-b548-f515b8a5ca50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:35:51 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-8e77123f-a53a-4417-9902-7a357692bd86 tempest-SnapshotDependencyTests-757469785 None] Volume volume-ad8324f3-f618-4d70-90c6-d853fc933756 (ad8324f3-f618-4d70-90c6-d853fc933756): created successfully Jul 31 12:35:51 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-8e77123f-a53a-4417-9902-7a357692bd86 tempest-SnapshotDependencyTests-757469785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f64ef5fb-0b5b-49dd-b548-f515b8a5ca50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:35:51 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-8e77123f-a53a-4417-9902-7a357692bd86 tempest-SnapshotDependencyTests-757469785 None] Flow 'volume_create_manager' (9594da20-cd39-4b01-8e79-d72db48ea199) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:35:51 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-8e77123f-a53a-4417-9902-7a357692bd86 tempest-SnapshotDependencyTests-757469785 None] Created volume successfully. Jul 31 12:35:52 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-0e83d128-7d2d-457f-ae13-4e68a9500220 tempest-VolumeImageDependencyTests-1312082570 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:35:52 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-0e83d128-7d2d-457f-ae13-4e68a9500220 tempest-VolumeImageDependencyTests-1312082570 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:35:52 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-0e83d128-7d2d-457f-ae13-4e68a9500220 tempest-VolumeImageDependencyTests-1312082570 None] Creating offline snapshot e15c19f0-99db-4401-9ec7-1a7aba7131f3 of volume 0ccdc9ca-96d4-4704-b63e-6f4ae7702293 {{(pid=89182) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 31 12:35:52 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[a503614a-9758-4a82-89ee-0e33a6f702d4]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:35:52 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-0e83d128-7d2d-457f-ae13-4e68a9500220 tempest-VolumeImageDependencyTests-1312082570 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0ccdc9ca-96d4-4704-b63e-6f4ae7702293 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:35:53 devstack sudo[111433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0ccdc9ca-96d4-4704-b63e-6f4ae7702293 Jul 31 12:35:53 devstack sudo[111433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:35:53 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-a1ebc520-ca88-4dd1-b1ef-d62f81048ee9 tempest-SnapshotDependencyTests-757469785 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:35:53 devstack sudo[111433]: pam_unix(sudo:session): session closed for user root Jul 31 12:35:53 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-0e83d128-7d2d-457f-ae13-4e68a9500220 tempest-VolumeImageDependencyTests-1312082570 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0ccdc9ca-96d4-4704-b63e-6f4ae7702293" returned: 0 in 0.373s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:35:53 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-0e83d128-7d2d-457f-ae13-4e68a9500220 tempest-VolumeImageDependencyTests-1312082570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0ccdc9ca-96d4-4704-b63e-6f4ae7702293,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0ccdc9ca-96d4-4704-b63e-6f4ae7702293.e15c19f0-99db-4401-9ec7-1a7aba7131f3 1G {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:35:53 devstack sudo[111438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0ccdc9ca-96d4-4704-b63e-6f4ae7702293,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0ccdc9ca-96d4-4704-b63e-6f4ae7702293.e15c19f0-99db-4401-9ec7-1a7aba7131f3 1G Jul 31 12:35:53 devstack sudo[111438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:35:53 devstack sudo[111438]: pam_unix(sudo:session): session closed for user root Jul 31 12:35:53 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-0e83d128-7d2d-457f-ae13-4e68a9500220 tempest-VolumeImageDependencyTests-1312082570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0ccdc9ca-96d4-4704-b63e-6f4ae7702293,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0ccdc9ca-96d4-4704-b63e-6f4ae7702293.e15c19f0-99db-4401-9ec7-1a7aba7131f3 1G" returned: 0 in 0.383s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:35:53 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-0e83d128-7d2d-457f-ae13-4e68a9500220 tempest-VolumeImageDependencyTests-1312082570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0ccdc9ca-96d4-4704-b63e-6f4ae7702293 -F qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0ccdc9ca-96d4-4704-b63e-6f4ae7702293.e15c19f0-99db-4401-9ec7-1a7aba7131f3 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:35:53 devstack sudo[111444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0ccdc9ca-96d4-4704-b63e-6f4ae7702293 -F qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0ccdc9ca-96d4-4704-b63e-6f4ae7702293.e15c19f0-99db-4401-9ec7-1a7aba7131f3 Jul 31 12:35:53 devstack sudo[111444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:35:53 devstack sudo[111444]: pam_unix(sudo:session): session closed for user root Jul 31 12:35:53 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-0e83d128-7d2d-457f-ae13-4e68a9500220 tempest-VolumeImageDependencyTests-1312082570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0ccdc9ca-96d4-4704-b63e-6f4ae7702293 -F qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0ccdc9ca-96d4-4704-b63e-6f4ae7702293.e15c19f0-99db-4401-9ec7-1a7aba7131f3" returned: 0 in 0.284s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:35:53 devstack cinder-volume[89182]: WARNING cinder.volume.drivers.remotefs [None req-0e83d128-7d2d-457f-ae13-4e68a9500220 tempest-VolumeImageDependencyTests-1312082570 None] /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0ccdc9ca-96d4-4704-b63e-6f4ae7702293.e15c19f0-99db-4401-9ec7-1a7aba7131f3 is being set with open permissions: ugo+rw Jul 31 12:35:53 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-0e83d128-7d2d-457f-ae13-4e68a9500220 tempest-VolumeImageDependencyTests-1312082570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0ccdc9ca-96d4-4704-b63e-6f4ae7702293.e15c19f0-99db-4401-9ec7-1a7aba7131f3 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:35:54 devstack sudo[111449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0ccdc9ca-96d4-4704-b63e-6f4ae7702293.e15c19f0-99db-4401-9ec7-1a7aba7131f3 Jul 31 12:35:54 devstack sudo[111449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:35:54 devstack sudo[111449]: pam_unix(sudo:session): session closed for user root Jul 31 12:35:54 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-0e83d128-7d2d-457f-ae13-4e68a9500220 tempest-VolumeImageDependencyTests-1312082570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0ccdc9ca-96d4-4704-b63e-6f4ae7702293.e15c19f0-99db-4401-9ec7-1a7aba7131f3" returned: 0 in 0.252s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:35:54 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-0e83d128-7d2d-457f-ae13-4e68a9500220 tempest-VolumeImageDependencyTests-1312082570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0ccdc9ca-96d4-4704-b63e-6f4ae7702293.info {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:35:54 devstack sudo[111452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0ccdc9ca-96d4-4704-b63e-6f4ae7702293.info Jul 31 12:35:54 devstack sudo[111452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:35:54 devstack sudo[111452]: pam_unix(sudo:session): session closed for user root Jul 31 12:35:54 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-0e83d128-7d2d-457f-ae13-4e68a9500220 tempest-VolumeImageDependencyTests-1312082570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0ccdc9ca-96d4-4704-b63e-6f4ae7702293.info" returned: 0 in 0.262s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:35:54 devstack cinder-volume[89182]: WARNING cinder.volume.drivers.remotefs [None req-0e83d128-7d2d-457f-ae13-4e68a9500220 tempest-VolumeImageDependencyTests-1312082570 None] /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0ccdc9ca-96d4-4704-b63e-6f4ae7702293.info is being set with open permissions: ugo+rw Jul 31 12:35:54 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-0e83d128-7d2d-457f-ae13-4e68a9500220 tempest-VolumeImageDependencyTests-1312082570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0ccdc9ca-96d4-4704-b63e-6f4ae7702293.info {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:35:54 devstack sudo[111455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0ccdc9ca-96d4-4704-b63e-6f4ae7702293.info Jul 31 12:35:54 devstack sudo[111455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:35:54 devstack sudo[111455]: pam_unix(sudo:session): session closed for user root Jul 31 12:35:54 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-0e83d128-7d2d-457f-ae13-4e68a9500220 tempest-VolumeImageDependencyTests-1312082570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0ccdc9ca-96d4-4704-b63e-6f4ae7702293.info" returned: 0 in 0.245s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:35:54 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-0e83d128-7d2d-457f-ae13-4e68a9500220 tempest-VolumeImageDependencyTests-1312082570 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.889s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:35:54 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-a1ebc520-ca88-4dd1-b1ef-d62f81048ee9 tempest-SnapshotDependencyTests-757469785 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.704s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:35:54 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-a1ebc520-ca88-4dd1-b1ef-d62f81048ee9 tempest-SnapshotDependencyTests-757469785 None] Creating offline snapshot a6d335b3-0f50-4f73-9f7e-9d74e80ba5e6 of volume ad8324f3-f618-4d70-90c6-d853fc933756 {{(pid=89182) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 31 12:35:54 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[257052be-913f-4b12-8db9-4112705d33fe]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:35:54 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-a1ebc520-ca88-4dd1-b1ef-d62f81048ee9 tempest-SnapshotDependencyTests-757469785 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-ad8324f3-f618-4d70-90c6-d853fc933756 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:35:54 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-0e83d128-7d2d-457f-ae13-4e68a9500220 tempest-VolumeImageDependencyTests-1312082570 None] Create snapshot completed successfully Jul 31 12:35:54 devstack sudo[111458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-ad8324f3-f618-4d70-90c6-d853fc933756 Jul 31 12:35:54 devstack sudo[111458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:35:55 devstack sudo[111458]: pam_unix(sudo:session): session closed for user root Jul 31 12:35:55 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-a1ebc520-ca88-4dd1-b1ef-d62f81048ee9 tempest-SnapshotDependencyTests-757469785 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-ad8324f3-f618-4d70-90c6-d853fc933756" returned: 0 in 0.388s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:35:55 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-a1ebc520-ca88-4dd1-b1ef-d62f81048ee9 tempest-SnapshotDependencyTests-757469785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-ad8324f3-f618-4d70-90c6-d853fc933756,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-ad8324f3-f618-4d70-90c6-d853fc933756.a6d335b3-0f50-4f73-9f7e-9d74e80ba5e6 1G {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:35:55 devstack sudo[111463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-ad8324f3-f618-4d70-90c6-d853fc933756,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-ad8324f3-f618-4d70-90c6-d853fc933756.a6d335b3-0f50-4f73-9f7e-9d74e80ba5e6 1G Jul 31 12:35:55 devstack sudo[111463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:35:55 devstack cinder-volume[89182]: DEBUG cinder.volume.flows.manager.create_volume [None req-175933c9-4b0a-4f31-92df-b19e4177563f tempest-VolumeImageDependencyTests-1312082570 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89182) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 12:35:55 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-175933c9-4b0a-4f31-92df-b19e4177563f tempest-VolumeImageDependencyTests-1312082570 None] Flow 'volume_create_manager' (9b844780-b085-4832-9188-80437853ded4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:35:55 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-175933c9-4b0a-4f31-92df-b19e4177563f tempest-VolumeImageDependencyTests-1312082570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f3a14ce-2f15-476c-891b-492e8fb47f7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:35:55 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-175933c9-4b0a-4f31-92df-b19e4177563f tempest-VolumeImageDependencyTests-1312082570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f3a14ce-2f15-476c-891b-492e8fb47f7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=True,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:35:55Z,deleted=False,deleted_at=None,display_description=None,display_name='volume2-for-test-e6050452-06bd-4c7f-9912-45178c83e379',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be44d114-010e-4ea6-ba21-cf912a973d8b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82a4ae047b294dd6980ed8ee242ed2a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:35:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=e15c19f0-99db-4401-9ec7-1a7aba7131f3,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:35:55Z,use_quota=True,user_id='ac62fb5bd782416aa9109655a79c6a24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:35:55 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-175933c9-4b0a-4f31-92df-b19e4177563f tempest-VolumeImageDependencyTests-1312082570 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1f66f03-1134-4de0-9779-82ecadcc9db0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:35:55 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-175933c9-4b0a-4f31-92df-b19e4177563f tempest-VolumeImageDependencyTests-1312082570 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1f66f03-1134-4de0-9779-82ecadcc9db0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:35:55 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-175933c9-4b0a-4f31-92df-b19e4177563f tempest-VolumeImageDependencyTests-1312082570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff71a96c-c6bf-48f5-8069-0df0a2a78201) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:35:55 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-175933c9-4b0a-4f31-92df-b19e4177563f tempest-VolumeImageDependencyTests-1312082570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff71a96c-c6bf-48f5-8069-0df0a2a78201) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'be44d114-010e-4ea6-ba21-cf912a973d8b', 'volume_name': 'volume-be44d114-010e-4ea6-ba21-cf912a973d8b', 'volume_size': 1, 'snapshot_id': 'e15c19f0-99db-4401-9ec7-1a7aba7131f3'}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:35:55 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-175933c9-4b0a-4f31-92df-b19e4177563f tempest-VolumeImageDependencyTests-1312082570 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1395185-dfb6-44e7-b608-827d3507b60e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:35:55 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-175933c9-4b0a-4f31-92df-b19e4177563f tempest-VolumeImageDependencyTests-1312082570 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1395185-dfb6-44e7-b608-827d3507b60e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:35:55 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-175933c9-4b0a-4f31-92df-b19e4177563f tempest-VolumeImageDependencyTests-1312082570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4800e10b-c73d-4f75-959f-90d8ed551172) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:35:55 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-175933c9-4b0a-4f31-92df-b19e4177563f tempest-VolumeImageDependencyTests-1312082570 None] Volume be44d114-010e-4ea6-ba21-cf912a973d8b: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-be44d114-010e-4ea6-ba21-cf912a973d8b', 'volume_size': 1, 'snapshot_id': 'e15c19f0-99db-4401-9ec7-1a7aba7131f3'} Jul 31 12:35:55 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-175933c9-4b0a-4f31-92df-b19e4177563f tempest-VolumeImageDependencyTests-1312082570 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:35:55 devstack sudo[111463]: pam_unix(sudo:session): session closed for user root Jul 31 12:35:55 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-a1ebc520-ca88-4dd1-b1ef-d62f81048ee9 tempest-SnapshotDependencyTests-757469785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-ad8324f3-f618-4d70-90c6-d853fc933756,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-ad8324f3-f618-4d70-90c6-d853fc933756.a6d335b3-0f50-4f73-9f7e-9d74e80ba5e6 1G" returned: 0 in 0.425s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:35:55 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-a1ebc520-ca88-4dd1-b1ef-d62f81048ee9 tempest-SnapshotDependencyTests-757469785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ad8324f3-f618-4d70-90c6-d853fc933756 -F qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-ad8324f3-f618-4d70-90c6-d853fc933756.a6d335b3-0f50-4f73-9f7e-9d74e80ba5e6 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:35:55 devstack sudo[111469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ad8324f3-f618-4d70-90c6-d853fc933756 -F qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-ad8324f3-f618-4d70-90c6-d853fc933756.a6d335b3-0f50-4f73-9f7e-9d74e80ba5e6 Jul 31 12:35:55 devstack sudo[111469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:35:55 devstack sudo[111469]: pam_unix(sudo:session): session closed for user root Jul 31 12:35:55 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-a1ebc520-ca88-4dd1-b1ef-d62f81048ee9 tempest-SnapshotDependencyTests-757469785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ad8324f3-f618-4d70-90c6-d853fc933756 -F qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-ad8324f3-f618-4d70-90c6-d853fc933756.a6d335b3-0f50-4f73-9f7e-9d74e80ba5e6" returned: 0 in 0.277s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:35:55 devstack cinder-volume[89182]: WARNING cinder.volume.drivers.remotefs [None req-a1ebc520-ca88-4dd1-b1ef-d62f81048ee9 tempest-SnapshotDependencyTests-757469785 None] /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-ad8324f3-f618-4d70-90c6-d853fc933756.a6d335b3-0f50-4f73-9f7e-9d74e80ba5e6 is being set with open permissions: ugo+rw Jul 31 12:35:55 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-a1ebc520-ca88-4dd1-b1ef-d62f81048ee9 tempest-SnapshotDependencyTests-757469785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-ad8324f3-f618-4d70-90c6-d853fc933756.a6d335b3-0f50-4f73-9f7e-9d74e80ba5e6 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:35:55 devstack sudo[111474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-ad8324f3-f618-4d70-90c6-d853fc933756.a6d335b3-0f50-4f73-9f7e-9d74e80ba5e6 Jul 31 12:35:55 devstack sudo[111474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:35:56 devstack sudo[111474]: pam_unix(sudo:session): session closed for user root Jul 31 12:35:56 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-a1ebc520-ca88-4dd1-b1ef-d62f81048ee9 tempest-SnapshotDependencyTests-757469785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-ad8324f3-f618-4d70-90c6-d853fc933756.a6d335b3-0f50-4f73-9f7e-9d74e80ba5e6" returned: 0 in 0.237s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:35:56 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-a1ebc520-ca88-4dd1-b1ef-d62f81048ee9 tempest-SnapshotDependencyTests-757469785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-ad8324f3-f618-4d70-90c6-d853fc933756.info {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:35:56 devstack sudo[111477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-ad8324f3-f618-4d70-90c6-d853fc933756.info Jul 31 12:35:56 devstack sudo[111477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:35:56 devstack sudo[111477]: pam_unix(sudo:session): session closed for user root Jul 31 12:35:56 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-a1ebc520-ca88-4dd1-b1ef-d62f81048ee9 tempest-SnapshotDependencyTests-757469785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-ad8324f3-f618-4d70-90c6-d853fc933756.info" returned: 0 in 0.243s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:35:56 devstack cinder-volume[89182]: WARNING cinder.volume.drivers.remotefs [None req-a1ebc520-ca88-4dd1-b1ef-d62f81048ee9 tempest-SnapshotDependencyTests-757469785 None] /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-ad8324f3-f618-4d70-90c6-d853fc933756.info is being set with open permissions: ugo+rw Jul 31 12:35:56 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-a1ebc520-ca88-4dd1-b1ef-d62f81048ee9 tempest-SnapshotDependencyTests-757469785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-ad8324f3-f618-4d70-90c6-d853fc933756.info {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:35:56 devstack sudo[111480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-ad8324f3-f618-4d70-90c6-d853fc933756.info Jul 31 12:35:56 devstack sudo[111480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:35:56 devstack sudo[111480]: pam_unix(sudo:session): session closed for user root Jul 31 12:35:56 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-a1ebc520-ca88-4dd1-b1ef-d62f81048ee9 tempest-SnapshotDependencyTests-757469785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-ad8324f3-f618-4d70-90c6-d853fc933756.info" returned: 0 in 0.242s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:35:56 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-a1ebc520-ca88-4dd1-b1ef-d62f81048ee9 tempest-SnapshotDependencyTests-757469785 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.899s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:35:56 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-175933c9-4b0a-4f31-92df-b19e4177563f tempest-VolumeImageDependencyTests-1312082570 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.067s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:35:56 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-175933c9-4b0a-4f31-92df-b19e4177563f tempest-VolumeImageDependencyTests-1312082570 None] Acquiring lock "cinder-quobyte-e15c19f0-99db-4401-9ec7-1a7aba7131f3-be44d114-010e-4ea6-ba21-cf912a973d8b" by "_create_volume_from_snapshot" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:35:56 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-a1ebc520-ca88-4dd1-b1ef-d62f81048ee9 tempest-SnapshotDependencyTests-757469785 None] Create snapshot completed successfully Jul 31 12:35:56 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-175933c9-4b0a-4f31-92df-b19e4177563f tempest-VolumeImageDependencyTests-1312082570 None] Lock "cinder-quobyte-e15c19f0-99db-4401-9ec7-1a7aba7131f3-be44d114-010e-4ea6-ba21-cf912a973d8b" acquired by "_create_volume_from_snapshot" :: waited 0.031s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:35:56 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-175933c9-4b0a-4f31-92df-b19e4177563f tempest-VolumeImageDependencyTests-1312082570 None] Creating volume be44d114-010e-4ea6-ba21-cf912a973d8b from snapshot e15c19f0-99db-4401-9ec7-1a7aba7131f3 {{(pid=89182) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 31 12:35:56 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-175933c9-4b0a-4f31-92df-b19e4177563f tempest-VolumeImageDependencyTests-1312082570 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:35:56 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-175933c9-4b0a-4f31-92df-b19e4177563f tempest-VolumeImageDependencyTests-1312082570 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:35:56 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-175933c9-4b0a-4f31-92df-b19e4177563f tempest-VolumeImageDependencyTests-1312082570 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:35:56 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-175933c9-4b0a-4f31-92df-b19e4177563f tempest-VolumeImageDependencyTests-1312082570 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:35:56 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-175933c9-4b0a-4f31-92df-b19e4177563f tempest-VolumeImageDependencyTests-1312082570 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:35:56 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-175933c9-4b0a-4f31-92df-b19e4177563f tempest-VolumeImageDependencyTests-1312082570 None] Selected osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 as target Quobyte volume. {{(pid=89182) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 12:35:56 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-175933c9-4b0a-4f31-92df-b19e4177563f tempest-VolumeImageDependencyTests-1312082570 None] Acquiring lock "cinder-quobyte-be44d114-010e-4ea6-ba21-cf912a973d8b" by "_copy_volume_from_snapshot" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:35:56 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-175933c9-4b0a-4f31-92df-b19e4177563f tempest-VolumeImageDependencyTests-1312082570 None] Lock "cinder-quobyte-be44d114-010e-4ea6-ba21-cf912a973d8b" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:35:56 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-175933c9-4b0a-4f31-92df-b19e4177563f tempest-VolumeImageDependencyTests-1312082570 None] snapshot: e15c19f0-99db-4401-9ec7-1a7aba7131f3, volume: be44d114-010e-4ea6-ba21-cf912a973d8b, {{(pid=89182) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Jul 31 12:35:56 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-175933c9-4b0a-4f31-92df-b19e4177563f tempest-VolumeImageDependencyTests-1312082570 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:35:56 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-175933c9-4b0a-4f31-92df-b19e4177563f tempest-VolumeImageDependencyTests-1312082570 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:35:56 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-175933c9-4b0a-4f31-92df-b19e4177563f tempest-VolumeImageDependencyTests-1312082570 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:35:56 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-175933c9-4b0a-4f31-92df-b19e4177563f tempest-VolumeImageDependencyTests-1312082570 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:35:56 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-175933c9-4b0a-4f31-92df-b19e4177563f tempest-VolumeImageDependencyTests-1312082570 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:35:56 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[a13c2ab9-ab40-4f5a-862a-b4851ca0c4e6]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:35:56 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-175933c9-4b0a-4f31-92df-b19e4177563f tempest-VolumeImageDependencyTests-1312082570 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0ccdc9ca-96d4-4704-b63e-6f4ae7702293.e15c19f0-99db-4401-9ec7-1a7aba7131f3 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:35:56 devstack sudo[111483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0ccdc9ca-96d4-4704-b63e-6f4ae7702293.e15c19f0-99db-4401-9ec7-1a7aba7131f3 Jul 31 12:35:56 devstack sudo[111483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:35:57 devstack sudo[111483]: pam_unix(sudo:session): session closed for user root Jul 31 12:35:57 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-175933c9-4b0a-4f31-92df-b19e4177563f tempest-VolumeImageDependencyTests-1312082570 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0ccdc9ca-96d4-4704-b63e-6f4ae7702293.e15c19f0-99db-4401-9ec7-1a7aba7131f3" returned: 0 in 0.349s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:35:57 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-175933c9-4b0a-4f31-92df-b19e4177563f tempest-VolumeImageDependencyTests-1312082570 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0ccdc9ca-96d4-4704-b63e-6f4ae7702293(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89182) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 12:35:57 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[57780ff1-6aed-4e4e-8b78-ea111d7ce67d]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:35:57 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-175933c9-4b0a-4f31-92df-b19e4177563f tempest-VolumeImageDependencyTests-1312082570 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0ccdc9ca-96d4-4704-b63e-6f4ae7702293 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:35:57 devstack sudo[111489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0ccdc9ca-96d4-4704-b63e-6f4ae7702293 Jul 31 12:35:57 devstack sudo[111489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:35:57 devstack sudo[111489]: pam_unix(sudo:session): session closed for user root Jul 31 12:35:57 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-175933c9-4b0a-4f31-92df-b19e4177563f tempest-VolumeImageDependencyTests-1312082570 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0ccdc9ca-96d4-4704-b63e-6f4ae7702293" returned: 0 in 0.386s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:35:57 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-175933c9-4b0a-4f31-92df-b19e4177563f tempest-VolumeImageDependencyTests-1312082570 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0ccdc9ca-96d4-4704-b63e-6f4ae7702293 {{(pid=89182) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Jul 31 12:35:57 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-175933c9-4b0a-4f31-92df-b19e4177563f tempest-VolumeImageDependencyTests-1312082570 None] Creating direct copy from snapshot {{(pid=89182) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Jul 31 12:35:57 devstack cinder-volume[89182]: DEBUG cinder.utils [None req-175933c9-4b0a-4f31-92df-b19e4177563f tempest-VolumeImageDependencyTests-1312082570 None] Path /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-be44d114-010e-4ea6-ba21-cf912a973d8b not found in is_blk_device check {{(pid=89182) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 31 12:35:57 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-175933c9-4b0a-4f31-92df-b19e4177563f tempest-VolumeImageDependencyTests-1312082570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0ccdc9ca-96d4-4704-b63e-6f4ae7702293 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-be44d114-010e-4ea6-ba21-cf912a973d8b {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:35:57 devstack sudo[111495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0ccdc9ca-96d4-4704-b63e-6f4ae7702293 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-be44d114-010e-4ea6-ba21-cf912a973d8b Jul 31 12:35:57 devstack sudo[111495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:35:57 devstack cinder-volume[89182]: DEBUG cinder.volume.flows.manager.create_volume [None req-e1456c71-aabf-4eaf-ac97-1250b97ad10d tempest-SnapshotDependencyTests-757469785 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89182) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 12:35:57 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-e1456c71-aabf-4eaf-ac97-1250b97ad10d tempest-SnapshotDependencyTests-757469785 None] Flow 'volume_create_manager' (ddd50d8d-095c-4679-94d4-9e5c3e1c0788) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:35:57 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-e1456c71-aabf-4eaf-ac97-1250b97ad10d tempest-SnapshotDependencyTests-757469785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3843a8b2-afe6-473f-a0f8-752e158e48a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:35:57 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-e1456c71-aabf-4eaf-ac97-1250b97ad10d tempest-SnapshotDependencyTests-757469785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3843a8b2-afe6-473f-a0f8-752e158e48a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:35:58Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4b5053f-6794-4441-9c6f-f12d78ed0464,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17aaa7d30fd24e90a42d50b9cf80a33e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:35:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=a6d335b3-0f50-4f73-9f7e-9d74e80ba5e6,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:35:58Z,use_quota=True,user_id='38e2fad7ebe249f88eac35fec8739de8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:35:57 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-e1456c71-aabf-4eaf-ac97-1250b97ad10d tempest-SnapshotDependencyTests-757469785 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7bcdfc85-c41e-4c72-890c-1501003081e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:35:57 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-e1456c71-aabf-4eaf-ac97-1250b97ad10d tempest-SnapshotDependencyTests-757469785 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7bcdfc85-c41e-4c72-890c-1501003081e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:35:57 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-e1456c71-aabf-4eaf-ac97-1250b97ad10d tempest-SnapshotDependencyTests-757469785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f0f5281-8f8e-4689-850a-7f5b6b802eee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:35:57 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-e1456c71-aabf-4eaf-ac97-1250b97ad10d tempest-SnapshotDependencyTests-757469785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f0f5281-8f8e-4689-850a-7f5b6b802eee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'f4b5053f-6794-4441-9c6f-f12d78ed0464', 'volume_name': 'volume-f4b5053f-6794-4441-9c6f-f12d78ed0464', 'volume_size': 1, 'snapshot_id': 'a6d335b3-0f50-4f73-9f7e-9d74e80ba5e6'}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:35:57 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-e1456c71-aabf-4eaf-ac97-1250b97ad10d tempest-SnapshotDependencyTests-757469785 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09ba270f-b748-46f9-9119-7d5f7051d939) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:35:57 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-e1456c71-aabf-4eaf-ac97-1250b97ad10d tempest-SnapshotDependencyTests-757469785 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09ba270f-b748-46f9-9119-7d5f7051d939) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:35:57 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-e1456c71-aabf-4eaf-ac97-1250b97ad10d tempest-SnapshotDependencyTests-757469785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0689925b-53bf-455d-bcf1-0807b42f5226) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:35:57 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-e1456c71-aabf-4eaf-ac97-1250b97ad10d tempest-SnapshotDependencyTests-757469785 None] Volume f4b5053f-6794-4441-9c6f-f12d78ed0464: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-f4b5053f-6794-4441-9c6f-f12d78ed0464', 'volume_size': 1, 'snapshot_id': 'a6d335b3-0f50-4f73-9f7e-9d74e80ba5e6'} Jul 31 12:35:57 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-e1456c71-aabf-4eaf-ac97-1250b97ad10d tempest-SnapshotDependencyTests-757469785 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:35:58 devstack sudo[111495]: pam_unix(sudo:session): session closed for user root Jul 31 12:35:58 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-175933c9-4b0a-4f31-92df-b19e4177563f tempest-VolumeImageDependencyTests-1312082570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0ccdc9ca-96d4-4704-b63e-6f4ae7702293 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-be44d114-010e-4ea6-ba21-cf912a973d8b" returned: 0 in 0.496s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:35:58 devstack cinder-volume[89182]: DEBUG cinder.image.image_utils [None req-175933c9-4b0a-4f31-92df-b19e4177563f tempest-VolumeImageDependencyTests-1312082570 None] Image conversion details: src /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0ccdc9ca-96d4-4704-b63e-6f4ae7702293, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-be44d114-010e-4ea6-ba21-cf912a973d8b {{(pid=89182) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 31 12:35:58 devstack cinder-volume[89182]: INFO cinder.image.image_utils [None req-175933c9-4b0a-4f31-92df-b19e4177563f tempest-VolumeImageDependencyTests-1312082570 None] Converted 1024.00 MB image at 1024.00 MB/s Jul 31 12:35:58 devstack cinder-volume[89182]: WARNING cinder.volume.drivers.remotefs [None req-175933c9-4b0a-4f31-92df-b19e4177563f tempest-VolumeImageDependencyTests-1312082570 None] /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-be44d114-010e-4ea6-ba21-cf912a973d8b is being set with open permissions: ugo+rw Jul 31 12:35:58 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-175933c9-4b0a-4f31-92df-b19e4177563f tempest-VolumeImageDependencyTests-1312082570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-be44d114-010e-4ea6-ba21-cf912a973d8b {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:35:58 devstack sudo[111501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-be44d114-010e-4ea6-ba21-cf912a973d8b Jul 31 12:35:58 devstack sudo[111501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:35:58 devstack sudo[111501]: pam_unix(sudo:session): session closed for user root Jul 31 12:35:58 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-175933c9-4b0a-4f31-92df-b19e4177563f tempest-VolumeImageDependencyTests-1312082570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-be44d114-010e-4ea6-ba21-cf912a973d8b" returned: 0 in 0.244s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:35:58 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-175933c9-4b0a-4f31-92df-b19e4177563f tempest-VolumeImageDependencyTests-1312082570 None] Lock "cinder-quobyte-be44d114-010e-4ea6-ba21-cf912a973d8b" released by "_copy_volume_from_snapshot" :: held 1.566s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:35:58 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-175933c9-4b0a-4f31-92df-b19e4177563f tempest-VolumeImageDependencyTests-1312082570 None] Lock "cinder-quobyte-e15c19f0-99db-4401-9ec7-1a7aba7131f3-be44d114-010e-4ea6-ba21-cf912a973d8b" released by "_create_volume_from_snapshot" :: held 1.628s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:35:58 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-175933c9-4b0a-4f31-92df-b19e4177563f tempest-VolumeImageDependencyTests-1312082570 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 1.662s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:35:58 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-e1456c71-aabf-4eaf-ac97-1250b97ad10d tempest-SnapshotDependencyTests-757469785 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.405s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:35:58 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-e1456c71-aabf-4eaf-ac97-1250b97ad10d tempest-SnapshotDependencyTests-757469785 None] Acquiring lock "cinder-quobyte-a6d335b3-0f50-4f73-9f7e-9d74e80ba5e6-f4b5053f-6794-4441-9c6f-f12d78ed0464" by "_create_volume_from_snapshot" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:35:58 devstack cinder-volume[89182]: DEBUG cinder.volume.volume_utils [None req-175933c9-4b0a-4f31-92df-b19e4177563f tempest-VolumeImageDependencyTests-1312082570 None] Marking volume be44d114-010e-4ea6-ba21-cf912a973d8b as bootable. {{(pid=89182) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 31 12:35:58 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-e1456c71-aabf-4eaf-ac97-1250b97ad10d tempest-SnapshotDependencyTests-757469785 None] Lock "cinder-quobyte-a6d335b3-0f50-4f73-9f7e-9d74e80ba5e6-f4b5053f-6794-4441-9c6f-f12d78ed0464" acquired by "_create_volume_from_snapshot" :: waited 0.022s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:35:58 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-e1456c71-aabf-4eaf-ac97-1250b97ad10d tempest-SnapshotDependencyTests-757469785 None] Creating volume f4b5053f-6794-4441-9c6f-f12d78ed0464 from snapshot a6d335b3-0f50-4f73-9f7e-9d74e80ba5e6 {{(pid=89182) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 31 12:35:58 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-e1456c71-aabf-4eaf-ac97-1250b97ad10d tempest-SnapshotDependencyTests-757469785 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:35:58 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-e1456c71-aabf-4eaf-ac97-1250b97ad10d tempest-SnapshotDependencyTests-757469785 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:35:58 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-e1456c71-aabf-4eaf-ac97-1250b97ad10d tempest-SnapshotDependencyTests-757469785 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:35:58 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-e1456c71-aabf-4eaf-ac97-1250b97ad10d tempest-SnapshotDependencyTests-757469785 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:35:58 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-e1456c71-aabf-4eaf-ac97-1250b97ad10d tempest-SnapshotDependencyTests-757469785 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:35:58 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-e1456c71-aabf-4eaf-ac97-1250b97ad10d tempest-SnapshotDependencyTests-757469785 None] Selected osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 as target Quobyte volume. {{(pid=89182) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 12:35:58 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-e1456c71-aabf-4eaf-ac97-1250b97ad10d tempest-SnapshotDependencyTests-757469785 None] Acquiring lock "cinder-quobyte-f4b5053f-6794-4441-9c6f-f12d78ed0464" by "_copy_volume_from_snapshot" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:35:58 devstack cinder-volume[89182]: DEBUG cinder.volume.flows.manager.create_volume [None req-175933c9-4b0a-4f31-92df-b19e4177563f tempest-VolumeImageDependencyTests-1312082570 None] Copying metadata from snapshot e15c19f0-99db-4401-9ec7-1a7aba7131f3 to be44d114-010e-4ea6-ba21-cf912a973d8b. {{(pid=89182) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:429}} Jul 31 12:35:58 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-e1456c71-aabf-4eaf-ac97-1250b97ad10d tempest-SnapshotDependencyTests-757469785 None] Lock "cinder-quobyte-f4b5053f-6794-4441-9c6f-f12d78ed0464" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:35:58 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-e1456c71-aabf-4eaf-ac97-1250b97ad10d tempest-SnapshotDependencyTests-757469785 None] snapshot: a6d335b3-0f50-4f73-9f7e-9d74e80ba5e6, volume: f4b5053f-6794-4441-9c6f-f12d78ed0464, {{(pid=89182) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Jul 31 12:35:58 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-e1456c71-aabf-4eaf-ac97-1250b97ad10d tempest-SnapshotDependencyTests-757469785 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:35:58 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-e1456c71-aabf-4eaf-ac97-1250b97ad10d tempest-SnapshotDependencyTests-757469785 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:35:58 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-e1456c71-aabf-4eaf-ac97-1250b97ad10d tempest-SnapshotDependencyTests-757469785 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:35:58 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-e1456c71-aabf-4eaf-ac97-1250b97ad10d tempest-SnapshotDependencyTests-757469785 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:35:58 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-e1456c71-aabf-4eaf-ac97-1250b97ad10d tempest-SnapshotDependencyTests-757469785 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:35:58 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e7b871c-106a-4cdb-9885-65ba5dbad394]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:35:58 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-e1456c71-aabf-4eaf-ac97-1250b97ad10d tempest-SnapshotDependencyTests-757469785 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-ad8324f3-f618-4d70-90c6-d853fc933756.a6d335b3-0f50-4f73-9f7e-9d74e80ba5e6 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:35:58 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-175933c9-4b0a-4f31-92df-b19e4177563f tempest-VolumeImageDependencyTests-1312082570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4800e10b-c73d-4f75-959f-90d8ed551172) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-be44d114-010e-4ea6-ba21-cf912a973d8b', 'volume_size': 1, 'snapshot_id': 'e15c19f0-99db-4401-9ec7-1a7aba7131f3'}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:35:58 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-175933c9-4b0a-4f31-92df-b19e4177563f tempest-VolumeImageDependencyTests-1312082570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e5a0d95-adb0-46ea-92ca-2a92cd9c52fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:35:58 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-175933c9-4b0a-4f31-92df-b19e4177563f tempest-VolumeImageDependencyTests-1312082570 None] Volume volume-be44d114-010e-4ea6-ba21-cf912a973d8b (be44d114-010e-4ea6-ba21-cf912a973d8b): created successfully Jul 31 12:35:58 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-175933c9-4b0a-4f31-92df-b19e4177563f tempest-VolumeImageDependencyTests-1312082570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e5a0d95-adb0-46ea-92ca-2a92cd9c52fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:35:58 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-175933c9-4b0a-4f31-92df-b19e4177563f tempest-VolumeImageDependencyTests-1312082570 None] Flow 'volume_create_manager' (9b844780-b085-4832-9188-80437853ded4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:35:58 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-175933c9-4b0a-4f31-92df-b19e4177563f tempest-VolumeImageDependencyTests-1312082570 None] Created volume successfully. Jul 31 12:35:58 devstack sudo[111504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-ad8324f3-f618-4d70-90c6-d853fc933756.a6d335b3-0f50-4f73-9f7e-9d74e80ba5e6 Jul 31 12:35:58 devstack sudo[111504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:35:58 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-ded2b524-656e-473b-b2ca-702c172c8d25 tempest-VolumeImageDependencyTests-1312082570 None] Acquiring lock "cinder-e15c19f0-99db-4401-9ec7-1a7aba7131f3-delete_snapshot" by "delete_snapshot" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:35:58 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-ded2b524-656e-473b-b2ca-702c172c8d25 tempest-VolumeImageDependencyTests-1312082570 None] Lock "cinder-e15c19f0-99db-4401-9ec7-1a7aba7131f3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:35:58 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-ded2b524-656e-473b-b2ca-702c172c8d25 tempest-VolumeImageDependencyTests-1312082570 None] Acquiring lock "cinder-quobyte-0ccdc9ca-96d4-4704-b63e-6f4ae7702293" by "delete_snapshot" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:35:58 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-ded2b524-656e-473b-b2ca-702c172c8d25 tempest-VolumeImageDependencyTests-1312082570 None] Lock "cinder-quobyte-0ccdc9ca-96d4-4704-b63e-6f4ae7702293" acquired by "delete_snapshot" :: waited 0.028s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:35:58 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-ded2b524-656e-473b-b2ca-702c172c8d25 tempest-VolumeImageDependencyTests-1312082570 None] Acquiring lock "cinder-quobyte-e15c19f0-99db-4401-9ec7-1a7aba7131f3" by "_delete_snapshot" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:35:58 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-ded2b524-656e-473b-b2ca-702c172c8d25 tempest-VolumeImageDependencyTests-1312082570 None] Lock "cinder-quobyte-e15c19f0-99db-4401-9ec7-1a7aba7131f3" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:35:58 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-ded2b524-656e-473b-b2ca-702c172c8d25 tempest-VolumeImageDependencyTests-1312082570 None] Deleting offline snapshot e15c19f0-99db-4401-9ec7-1a7aba7131f3 of volume 0ccdc9ca-96d4-4704-b63e-6f4ae7702293 {{(pid=89182) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 31 12:35:58 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-ded2b524-656e-473b-b2ca-702c172c8d25 tempest-VolumeImageDependencyTests-1312082570 None] snapshot_file for this snap is: volume-0ccdc9ca-96d4-4704-b63e-6f4ae7702293.e15c19f0-99db-4401-9ec7-1a7aba7131f3 {{(pid=89182) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 31 12:35:58 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[704af84f-bc38-41f7-bbf1-942f8712c6f4]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:35:58 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-ded2b524-656e-473b-b2ca-702c172c8d25 tempest-VolumeImageDependencyTests-1312082570 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0ccdc9ca-96d4-4704-b63e-6f4ae7702293.e15c19f0-99db-4401-9ec7-1a7aba7131f3 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:35:58 devstack sudo[111504]: pam_unix(sudo:session): session closed for user root Jul 31 12:35:58 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-e1456c71-aabf-4eaf-ac97-1250b97ad10d tempest-SnapshotDependencyTests-757469785 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-ad8324f3-f618-4d70-90c6-d853fc933756.a6d335b3-0f50-4f73-9f7e-9d74e80ba5e6" returned: 0 in 0.408s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:35:58 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-e1456c71-aabf-4eaf-ac97-1250b97ad10d tempest-SnapshotDependencyTests-757469785 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ad8324f3-f618-4d70-90c6-d853fc933756(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89182) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 12:35:58 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[af483574-d290-49b7-ad8f-ae2b01ae1e33]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:35:58 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-e1456c71-aabf-4eaf-ac97-1250b97ad10d tempest-SnapshotDependencyTests-757469785 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-ad8324f3-f618-4d70-90c6-d853fc933756 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:35:58 devstack sudo[111509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0ccdc9ca-96d4-4704-b63e-6f4ae7702293.e15c19f0-99db-4401-9ec7-1a7aba7131f3 Jul 31 12:35:58 devstack sudo[111509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:35:59 devstack sudo[111510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-ad8324f3-f618-4d70-90c6-d853fc933756 Jul 31 12:35:59 devstack sudo[111510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:35:59 devstack sudo[111509]: pam_unix(sudo:session): session closed for user root Jul 31 12:35:59 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-ded2b524-656e-473b-b2ca-702c172c8d25 tempest-VolumeImageDependencyTests-1312082570 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0ccdc9ca-96d4-4704-b63e-6f4ae7702293.e15c19f0-99db-4401-9ec7-1a7aba7131f3" returned: 0 in 0.369s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:35:59 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-ded2b524-656e-473b-b2ca-702c172c8d25 tempest-VolumeImageDependencyTests-1312082570 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0ccdc9ca-96d4-4704-b63e-6f4ae7702293(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89182) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 12:35:59 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[de556609-0feb-4770-becc-3efc29d640f7]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:35:59 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-ded2b524-656e-473b-b2ca-702c172c8d25 tempest-VolumeImageDependencyTests-1312082570 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0ccdc9ca-96d4-4704-b63e-6f4ae7702293 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:35:59 devstack sudo[111510]: pam_unix(sudo:session): session closed for user root Jul 31 12:35:59 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-e1456c71-aabf-4eaf-ac97-1250b97ad10d tempest-SnapshotDependencyTests-757469785 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-ad8324f3-f618-4d70-90c6-d853fc933756" returned: 0 in 0.366s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:35:59 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-e1456c71-aabf-4eaf-ac97-1250b97ad10d tempest-SnapshotDependencyTests-757469785 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-ad8324f3-f618-4d70-90c6-d853fc933756 {{(pid=89182) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Jul 31 12:35:59 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-e1456c71-aabf-4eaf-ac97-1250b97ad10d tempest-SnapshotDependencyTests-757469785 None] Creating direct copy from snapshot {{(pid=89182) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Jul 31 12:35:59 devstack cinder-volume[89182]: DEBUG cinder.utils [None req-e1456c71-aabf-4eaf-ac97-1250b97ad10d tempest-SnapshotDependencyTests-757469785 None] Path /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-f4b5053f-6794-4441-9c6f-f12d78ed0464 not found in is_blk_device check {{(pid=89182) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 31 12:35:59 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-e1456c71-aabf-4eaf-ac97-1250b97ad10d tempest-SnapshotDependencyTests-757469785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-ad8324f3-f618-4d70-90c6-d853fc933756 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-f4b5053f-6794-4441-9c6f-f12d78ed0464 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:35:59 devstack sudo[111520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-ad8324f3-f618-4d70-90c6-d853fc933756 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-f4b5053f-6794-4441-9c6f-f12d78ed0464 Jul 31 12:35:59 devstack sudo[111520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:35:59 devstack sudo[111519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0ccdc9ca-96d4-4704-b63e-6f4ae7702293 Jul 31 12:35:59 devstack sudo[111519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:35:59 devstack sudo[111519]: pam_unix(sudo:session): session closed for user root Jul 31 12:35:59 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-ded2b524-656e-473b-b2ca-702c172c8d25 tempest-VolumeImageDependencyTests-1312082570 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0ccdc9ca-96d4-4704-b63e-6f4ae7702293" returned: 0 in 0.385s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:35:59 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-ded2b524-656e-473b-b2ca-702c172c8d25 tempest-VolumeImageDependencyTests-1312082570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0ccdc9ca-96d4-4704-b63e-6f4ae7702293.e15c19f0-99db-4401-9ec7-1a7aba7131f3 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:35:59 devstack sudo[111531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0ccdc9ca-96d4-4704-b63e-6f4ae7702293.e15c19f0-99db-4401-9ec7-1a7aba7131f3 Jul 31 12:35:59 devstack sudo[111531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:36:00 devstack sudo[111531]: pam_unix(sudo:session): session closed for user root Jul 31 12:36:00 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-ded2b524-656e-473b-b2ca-702c172c8d25 tempest-VolumeImageDependencyTests-1312082570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0ccdc9ca-96d4-4704-b63e-6f4ae7702293.e15c19f0-99db-4401-9ec7-1a7aba7131f3" returned: 0 in 0.847s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:36:00 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-ded2b524-656e-473b-b2ca-702c172c8d25 tempest-VolumeImageDependencyTests-1312082570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0ccdc9ca-96d4-4704-b63e-6f4ae7702293.e15c19f0-99db-4401-9ec7-1a7aba7131f3 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:36:00 devstack sudo[111543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0ccdc9ca-96d4-4704-b63e-6f4ae7702293.e15c19f0-99db-4401-9ec7-1a7aba7131f3 Jul 31 12:36:00 devstack sudo[111543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:36:00 devstack sudo[111543]: pam_unix(sudo:session): session closed for user root Jul 31 12:36:00 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-ded2b524-656e-473b-b2ca-702c172c8d25 tempest-VolumeImageDependencyTests-1312082570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0ccdc9ca-96d4-4704-b63e-6f4ae7702293.e15c19f0-99db-4401-9ec7-1a7aba7131f3" returned: 0 in 0.512s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:36:01 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-ded2b524-656e-473b-b2ca-702c172c8d25 tempest-VolumeImageDependencyTests-1312082570 None] Lock "cinder-quobyte-e15c19f0-99db-4401-9ec7-1a7aba7131f3" released by "_delete_snapshot" :: held 2.312s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:36:01 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-ded2b524-656e-473b-b2ca-702c172c8d25 tempest-VolumeImageDependencyTests-1312082570 None] Lock "cinder-quobyte-0ccdc9ca-96d4-4704-b63e-6f4ae7702293" released by "delete_snapshot" :: held 2.365s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:36:01 devstack cinder-volume[89182]: DEBUG cinder.quota [None req-ded2b524-656e-473b-b2ca-702c172c8d25 tempest-VolumeImageDependencyTests-1312082570 None] Created reservations ['f30d7865-9397-40f5-bc7c-707e423e0eca', 'de81e89b-cce7-4871-8838-39201d03efe9', '46437f81-dcb1-4df1-b11f-12ba0dab4ad6', '1219662a-4a7a-401c-9f38-06f368b290dc'] {{(pid=89182) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 12:36:01 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-ded2b524-656e-473b-b2ca-702c172c8d25 tempest-VolumeImageDependencyTests-1312082570 None] Delete snapshot completed successfully. Jul 31 12:36:01 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-ded2b524-656e-473b-b2ca-702c172c8d25 tempest-VolumeImageDependencyTests-1312082570 None] Lock "cinder-e15c19f0-99db-4401-9ec7-1a7aba7131f3-delete_snapshot" released by "delete_snapshot" :: held 2.668s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:36:02 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-548f20e2-a692-49f4-998b-9cc5c85b7ae1 tempest-VolumeImageDependencyTests-1312082570 None] Acquiring lock "cinder-be44d114-010e-4ea6-ba21-cf912a973d8b-delete_volume" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:36:02 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-548f20e2-a692-49f4-998b-9cc5c85b7ae1 tempest-VolumeImageDependencyTests-1312082570 None] Lock "cinder-be44d114-010e-4ea6-ba21-cf912a973d8b-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:36:02 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-548f20e2-a692-49f4-998b-9cc5c85b7ae1 tempest-VolumeImageDependencyTests-1312082570 None] Acquiring lock "cinder-quobyte-be44d114-010e-4ea6-ba21-cf912a973d8b" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:36:02 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-548f20e2-a692-49f4-998b-9cc5c85b7ae1 tempest-VolumeImageDependencyTests-1312082570 None] Lock "cinder-quobyte-be44d114-010e-4ea6-ba21-cf912a973d8b" acquired by "delete_volume" :: waited 0.036s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:36:02 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c2523e5-e7ec-43f6-acc8-ef47edc6456a]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:36:02 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-548f20e2-a692-49f4-998b-9cc5c85b7ae1 tempest-VolumeImageDependencyTests-1312082570 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-be44d114-010e-4ea6-ba21-cf912a973d8b {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:36:02 devstack sudo[111546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-be44d114-010e-4ea6-ba21-cf912a973d8b Jul 31 12:36:02 devstack sudo[111546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:36:03 devstack sudo[111546]: pam_unix(sudo:session): session closed for user root Jul 31 12:36:03 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-548f20e2-a692-49f4-998b-9cc5c85b7ae1 tempest-VolumeImageDependencyTests-1312082570 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-be44d114-010e-4ea6-ba21-cf912a973d8b" returned: 0 in 0.700s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:36:03 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-548f20e2-a692-49f4-998b-9cc5c85b7ae1 tempest-VolumeImageDependencyTests-1312082570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-be44d114-010e-4ea6-ba21-cf912a973d8b {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:36:03 devstack sudo[111552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-be44d114-010e-4ea6-ba21-cf912a973d8b Jul 31 12:36:03 devstack sudo[111552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:36:03 devstack sudo[111552]: pam_unix(sudo:session): session closed for user root Jul 31 12:36:03 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-548f20e2-a692-49f4-998b-9cc5c85b7ae1 tempest-VolumeImageDependencyTests-1312082570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-be44d114-010e-4ea6-ba21-cf912a973d8b" returned: 0 in 0.545s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:36:03 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-548f20e2-a692-49f4-998b-9cc5c85b7ae1 tempest-VolumeImageDependencyTests-1312082570 None] Lock "cinder-quobyte-be44d114-010e-4ea6-ba21-cf912a973d8b" released by "delete_volume" :: held 1.338s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:36:03 devstack cinder-volume[89182]: DEBUG cinder.quota [None req-548f20e2-a692-49f4-998b-9cc5c85b7ae1 tempest-VolumeImageDependencyTests-1312082570 None] Created reservations ['cd76925a-8f15-4559-842f-2a331c436e5a', '91dc7baa-a5b4-4f7b-bf8f-36bb87ddf97f', '0009e982-f9fd-4c67-b682-7fc465700a2e', '2890bbab-cdb8-4aa4-bc3e-8c1e966e33d7'] {{(pid=89182) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 12:36:03 devstack sudo[111520]: pam_unix(sudo:session): session closed for user root Jul 31 12:36:03 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-e1456c71-aabf-4eaf-ac97-1250b97ad10d tempest-SnapshotDependencyTests-757469785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-ad8324f3-f618-4d70-90c6-d853fc933756 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-f4b5053f-6794-4441-9c6f-f12d78ed0464" returned: 0 in 4.616s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:36:03 devstack cinder-volume[89182]: DEBUG cinder.image.image_utils [None req-e1456c71-aabf-4eaf-ac97-1250b97ad10d tempest-SnapshotDependencyTests-757469785 None] Image conversion details: src /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-ad8324f3-f618-4d70-90c6-d853fc933756, size 1024.00 MB, duration 4.62 sec, destination /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-f4b5053f-6794-4441-9c6f-f12d78ed0464 {{(pid=89182) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 31 12:36:03 devstack cinder-volume[89182]: INFO cinder.image.image_utils [None req-e1456c71-aabf-4eaf-ac97-1250b97ad10d tempest-SnapshotDependencyTests-757469785 None] Converted 1024.00 MB image at 221.79 MB/s Jul 31 12:36:03 devstack cinder-volume[89182]: WARNING cinder.volume.drivers.remotefs [None req-e1456c71-aabf-4eaf-ac97-1250b97ad10d tempest-SnapshotDependencyTests-757469785 None] /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-f4b5053f-6794-4441-9c6f-f12d78ed0464 is being set with open permissions: ugo+rw Jul 31 12:36:03 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-e1456c71-aabf-4eaf-ac97-1250b97ad10d tempest-SnapshotDependencyTests-757469785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-f4b5053f-6794-4441-9c6f-f12d78ed0464 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:36:03 devstack sudo[111555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-f4b5053f-6794-4441-9c6f-f12d78ed0464 Jul 31 12:36:03 devstack sudo[111555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:36:03 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-548f20e2-a692-49f4-998b-9cc5c85b7ae1 tempest-VolumeImageDependencyTests-1312082570 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:36:03 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-548f20e2-a692-49f4-998b-9cc5c85b7ae1 tempest-VolumeImageDependencyTests-1312082570 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:36:03 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-548f20e2-a692-49f4-998b-9cc5c85b7ae1 tempest-VolumeImageDependencyTests-1312082570 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:36:03 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-548f20e2-a692-49f4-998b-9cc5c85b7ae1 tempest-VolumeImageDependencyTests-1312082570 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:36:03 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-548f20e2-a692-49f4-998b-9cc5c85b7ae1 tempest-VolumeImageDependencyTests-1312082570 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:36:03 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-548f20e2-a692-49f4-998b-9cc5c85b7ae1 tempest-VolumeImageDependencyTests-1312082570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:36:03 devstack sudo[111557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 Jul 31 12:36:03 devstack sudo[111557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:36:04 devstack sudo[111555]: pam_unix(sudo:session): session closed for user root Jul 31 12:36:04 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-e1456c71-aabf-4eaf-ac97-1250b97ad10d tempest-SnapshotDependencyTests-757469785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-f4b5053f-6794-4441-9c6f-f12d78ed0464" returned: 0 in 0.269s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:36:04 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-e1456c71-aabf-4eaf-ac97-1250b97ad10d tempest-SnapshotDependencyTests-757469785 None] Lock "cinder-quobyte-f4b5053f-6794-4441-9c6f-f12d78ed0464" released by "_copy_volume_from_snapshot" :: held 5.747s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:36:04 devstack sudo[111557]: pam_unix(sudo:session): session closed for user root Jul 31 12:36:04 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-548f20e2-a692-49f4-998b-9cc5c85b7ae1 tempest-VolumeImageDependencyTests-1312082570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2" returned: 0 in 0.254s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:36:04 devstack cinder-volume[89182]: DEBUG cinder.manager [None req-548f20e2-a692-49f4-998b-9cc5c85b7ae1 tempest-VolumeImageDependencyTests-1312082570 None] Notifying Schedulers of capabilities ... {{(pid=89182) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 12:36:04 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-548f20e2-a692-49f4-998b-9cc5c85b7ae1 tempest-VolumeImageDependencyTests-1312082570 None] Deleted volume successfully. Jul 31 12:36:04 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-548f20e2-a692-49f4-998b-9cc5c85b7ae1 tempest-VolumeImageDependencyTests-1312082570 None] Lock "cinder-be44d114-010e-4ea6-ba21-cf912a973d8b-delete_volume" released by "delete_volume" :: held 1.946s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:36:04 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-e1456c71-aabf-4eaf-ac97-1250b97ad10d tempest-SnapshotDependencyTests-757469785 None] Lock "cinder-quobyte-a6d335b3-0f50-4f73-9f7e-9d74e80ba5e6-f4b5053f-6794-4441-9c6f-f12d78ed0464" released by "_create_volume_from_snapshot" :: held 5.825s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:36:04 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-e1456c71-aabf-4eaf-ac97-1250b97ad10d tempest-SnapshotDependencyTests-757469785 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.849s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:36:04 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-e1456c71-aabf-4eaf-ac97-1250b97ad10d tempest-SnapshotDependencyTests-757469785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0689925b-53bf-455d-bcf1-0807b42f5226) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f4b5053f-6794-4441-9c6f-f12d78ed0464', 'volume_size': 1, 'snapshot_id': 'a6d335b3-0f50-4f73-9f7e-9d74e80ba5e6'}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:36:04 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-e1456c71-aabf-4eaf-ac97-1250b97ad10d tempest-SnapshotDependencyTests-757469785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38f4eb89-3654-452e-8437-6f1c3798698b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:36:04 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-e1456c71-aabf-4eaf-ac97-1250b97ad10d tempest-SnapshotDependencyTests-757469785 None] Volume volume-f4b5053f-6794-4441-9c6f-f12d78ed0464 (f4b5053f-6794-4441-9c6f-f12d78ed0464): created successfully Jul 31 12:36:04 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-e1456c71-aabf-4eaf-ac97-1250b97ad10d tempest-SnapshotDependencyTests-757469785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38f4eb89-3654-452e-8437-6f1c3798698b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:36:04 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-e1456c71-aabf-4eaf-ac97-1250b97ad10d tempest-SnapshotDependencyTests-757469785 None] Flow 'volume_create_manager' (ddd50d8d-095c-4679-94d4-9e5c3e1c0788) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:36:04 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-e1456c71-aabf-4eaf-ac97-1250b97ad10d tempest-SnapshotDependencyTests-757469785 None] Created volume successfully. Jul 31 12:36:04 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-dc6a4024-e164-46f2-9292-e762403c7346 tempest-SnapshotDependencyTests-757469785 None] Acquiring lock "cinder-a6d335b3-0f50-4f73-9f7e-9d74e80ba5e6-delete_snapshot" by "delete_snapshot" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:36:04 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-dc6a4024-e164-46f2-9292-e762403c7346 tempest-SnapshotDependencyTests-757469785 None] Lock "cinder-a6d335b3-0f50-4f73-9f7e-9d74e80ba5e6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:36:04 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-dc6a4024-e164-46f2-9292-e762403c7346 tempest-SnapshotDependencyTests-757469785 None] Acquiring lock "cinder-quobyte-ad8324f3-f618-4d70-90c6-d853fc933756" by "delete_snapshot" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:36:04 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-dc6a4024-e164-46f2-9292-e762403c7346 tempest-SnapshotDependencyTests-757469785 None] Lock "cinder-quobyte-ad8324f3-f618-4d70-90c6-d853fc933756" acquired by "delete_snapshot" :: waited 0.026s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:36:04 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-dc6a4024-e164-46f2-9292-e762403c7346 tempest-SnapshotDependencyTests-757469785 None] Acquiring lock "cinder-quobyte-a6d335b3-0f50-4f73-9f7e-9d74e80ba5e6" by "_delete_snapshot" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:36:04 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-7e144dd2-ba29-439b-93ee-1907c0af7773 tempest-VolumeImageDependencyTests-1312082570 None] Acquiring lock "cinder-0ccdc9ca-96d4-4704-b63e-6f4ae7702293-delete_volume" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:36:04 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-7e144dd2-ba29-439b-93ee-1907c0af7773 tempest-VolumeImageDependencyTests-1312082570 None] Lock "cinder-0ccdc9ca-96d4-4704-b63e-6f4ae7702293-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:36:04 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-dc6a4024-e164-46f2-9292-e762403c7346 tempest-SnapshotDependencyTests-757469785 None] Lock "cinder-quobyte-a6d335b3-0f50-4f73-9f7e-9d74e80ba5e6" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:36:04 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-dc6a4024-e164-46f2-9292-e762403c7346 tempest-SnapshotDependencyTests-757469785 None] Deleting offline snapshot a6d335b3-0f50-4f73-9f7e-9d74e80ba5e6 of volume ad8324f3-f618-4d70-90c6-d853fc933756 {{(pid=89182) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 31 12:36:04 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-dc6a4024-e164-46f2-9292-e762403c7346 tempest-SnapshotDependencyTests-757469785 None] snapshot_file for this snap is: volume-ad8324f3-f618-4d70-90c6-d853fc933756.a6d335b3-0f50-4f73-9f7e-9d74e80ba5e6 {{(pid=89182) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 31 12:36:04 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d1d4247-6ac8-4096-9d0f-066e2e180ca6]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:36:04 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-dc6a4024-e164-46f2-9292-e762403c7346 tempest-SnapshotDependencyTests-757469785 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-ad8324f3-f618-4d70-90c6-d853fc933756.a6d335b3-0f50-4f73-9f7e-9d74e80ba5e6 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:36:04 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-7e144dd2-ba29-439b-93ee-1907c0af7773 tempest-VolumeImageDependencyTests-1312082570 None] Acquiring lock "cinder-quobyte-0ccdc9ca-96d4-4704-b63e-6f4ae7702293" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:36:04 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-7e144dd2-ba29-439b-93ee-1907c0af7773 tempest-VolumeImageDependencyTests-1312082570 None] Lock "cinder-quobyte-0ccdc9ca-96d4-4704-b63e-6f4ae7702293" acquired by "delete_volume" :: waited 0.016s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:36:04 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e7c87c7-c300-46ab-99a6-bdb3c9ef154f]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:36:04 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-7e144dd2-ba29-439b-93ee-1907c0af7773 tempest-VolumeImageDependencyTests-1312082570 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0ccdc9ca-96d4-4704-b63e-6f4ae7702293 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:36:04 devstack sudo[111561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-ad8324f3-f618-4d70-90c6-d853fc933756.a6d335b3-0f50-4f73-9f7e-9d74e80ba5e6 Jul 31 12:36:04 devstack sudo[111561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:36:05 devstack sudo[111562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0ccdc9ca-96d4-4704-b63e-6f4ae7702293 Jul 31 12:36:05 devstack sudo[111562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:36:05 devstack sudo[111561]: pam_unix(sudo:session): session closed for user root Jul 31 12:36:05 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-dc6a4024-e164-46f2-9292-e762403c7346 tempest-SnapshotDependencyTests-757469785 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-ad8324f3-f618-4d70-90c6-d853fc933756.a6d335b3-0f50-4f73-9f7e-9d74e80ba5e6" returned: 0 in 0.373s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:36:05 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-dc6a4024-e164-46f2-9292-e762403c7346 tempest-SnapshotDependencyTests-757469785 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ad8324f3-f618-4d70-90c6-d853fc933756(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89182) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 12:36:05 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[baae43d6-30f0-4716-8f11-92f76e6c4b1b]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:36:05 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-dc6a4024-e164-46f2-9292-e762403c7346 tempest-SnapshotDependencyTests-757469785 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-ad8324f3-f618-4d70-90c6-d853fc933756 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:36:05 devstack sudo[111562]: pam_unix(sudo:session): session closed for user root Jul 31 12:36:05 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-7e144dd2-ba29-439b-93ee-1907c0af7773 tempest-VolumeImageDependencyTests-1312082570 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0ccdc9ca-96d4-4704-b63e-6f4ae7702293" returned: 0 in 0.380s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:36:05 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-7e144dd2-ba29-439b-93ee-1907c0af7773 tempest-VolumeImageDependencyTests-1312082570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0ccdc9ca-96d4-4704-b63e-6f4ae7702293 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:36:05 devstack sudo[111572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0ccdc9ca-96d4-4704-b63e-6f4ae7702293 Jul 31 12:36:05 devstack sudo[111572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:36:05 devstack sudo[111571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-ad8324f3-f618-4d70-90c6-d853fc933756 Jul 31 12:36:05 devstack sudo[111571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:36:05 devstack sudo[111572]: pam_unix(sudo:session): session closed for user root Jul 31 12:36:05 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-7e144dd2-ba29-439b-93ee-1907c0af7773 tempest-VolumeImageDependencyTests-1312082570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0ccdc9ca-96d4-4704-b63e-6f4ae7702293" returned: 0 in 0.260s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:36:05 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-7e144dd2-ba29-439b-93ee-1907c0af7773 tempest-VolumeImageDependencyTests-1312082570 None] Lock "cinder-quobyte-0ccdc9ca-96d4-4704-b63e-6f4ae7702293" released by "delete_volume" :: held 0.701s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:36:05 devstack cinder-volume[89182]: DEBUG cinder.quota [None req-7e144dd2-ba29-439b-93ee-1907c0af7773 tempest-VolumeImageDependencyTests-1312082570 None] Created reservations ['4372df3c-296e-42b6-8870-3c69077b1a4c', '086f6aff-8ae2-4aa9-90b9-db916c921f3e', 'c837b453-ad7f-4568-82ea-806fa812f505', '11f7c391-fd91-4298-92d2-7d633f8d0f21'] {{(pid=89182) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 12:36:05 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-7e144dd2-ba29-439b-93ee-1907c0af7773 tempest-VolumeImageDependencyTests-1312082570 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:36:05 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-7e144dd2-ba29-439b-93ee-1907c0af7773 tempest-VolumeImageDependencyTests-1312082570 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:36:05 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-7e144dd2-ba29-439b-93ee-1907c0af7773 tempest-VolumeImageDependencyTests-1312082570 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:36:05 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-7e144dd2-ba29-439b-93ee-1907c0af7773 tempest-VolumeImageDependencyTests-1312082570 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:36:05 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-7e144dd2-ba29-439b-93ee-1907c0af7773 tempest-VolumeImageDependencyTests-1312082570 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:36:05 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-7e144dd2-ba29-439b-93ee-1907c0af7773 tempest-VolumeImageDependencyTests-1312082570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:36:05 devstack sudo[111578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 Jul 31 12:36:05 devstack sudo[111578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:36:05 devstack sudo[111571]: pam_unix(sudo:session): session closed for user root Jul 31 12:36:05 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-dc6a4024-e164-46f2-9292-e762403c7346 tempest-SnapshotDependencyTests-757469785 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-ad8324f3-f618-4d70-90c6-d853fc933756" returned: 0 in 0.556s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:36:05 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-dc6a4024-e164-46f2-9292-e762403c7346 tempest-SnapshotDependencyTests-757469785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-ad8324f3-f618-4d70-90c6-d853fc933756.a6d335b3-0f50-4f73-9f7e-9d74e80ba5e6 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:36:05 devstack sudo[111581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-ad8324f3-f618-4d70-90c6-d853fc933756.a6d335b3-0f50-4f73-9f7e-9d74e80ba5e6 Jul 31 12:36:05 devstack sudo[111581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:36:05 devstack sudo[111578]: pam_unix(sudo:session): session closed for user root Jul 31 12:36:05 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-7e144dd2-ba29-439b-93ee-1907c0af7773 tempest-VolumeImageDependencyTests-1312082570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2" returned: 0 in 0.263s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:36:05 devstack cinder-volume[89182]: DEBUG cinder.manager [None req-7e144dd2-ba29-439b-93ee-1907c0af7773 tempest-VolumeImageDependencyTests-1312082570 None] Notifying Schedulers of capabilities ... {{(pid=89182) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 12:36:05 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-7e144dd2-ba29-439b-93ee-1907c0af7773 tempest-VolumeImageDependencyTests-1312082570 None] Deleted volume successfully. Jul 31 12:36:06 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-7e144dd2-ba29-439b-93ee-1907c0af7773 tempest-VolumeImageDependencyTests-1312082570 None] Lock "cinder-0ccdc9ca-96d4-4704-b63e-6f4ae7702293-delete_volume" released by "delete_volume" :: held 1.234s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:36:06 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-12f79dc0-a384-434a-b204-4395ed9d3629 tempest-VolumeImageDependencyTests-1312082570 None] Acquiring lock "cinder-1e9b4a9a-db6f-4762-b29d-cf21e00254c2-delete_volume" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:36:06 devstack sudo[111581]: pam_unix(sudo:session): session closed for user root Jul 31 12:36:06 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-12f79dc0-a384-434a-b204-4395ed9d3629 tempest-VolumeImageDependencyTests-1312082570 None] Lock "cinder-1e9b4a9a-db6f-4762-b29d-cf21e00254c2-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:36:06 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-dc6a4024-e164-46f2-9292-e762403c7346 tempest-SnapshotDependencyTests-757469785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-ad8324f3-f618-4d70-90c6-d853fc933756.a6d335b3-0f50-4f73-9f7e-9d74e80ba5e6" returned: 0 in 0.371s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:36:06 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-dc6a4024-e164-46f2-9292-e762403c7346 tempest-SnapshotDependencyTests-757469785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-ad8324f3-f618-4d70-90c6-d853fc933756.a6d335b3-0f50-4f73-9f7e-9d74e80ba5e6 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:36:06 devstack sudo[111591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-ad8324f3-f618-4d70-90c6-d853fc933756.a6d335b3-0f50-4f73-9f7e-9d74e80ba5e6 Jul 31 12:36:06 devstack sudo[111591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:36:06 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-12f79dc0-a384-434a-b204-4395ed9d3629 tempest-VolumeImageDependencyTests-1312082570 None] Acquiring lock "cinder-quobyte-1e9b4a9a-db6f-4762-b29d-cf21e00254c2" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:36:06 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-12f79dc0-a384-434a-b204-4395ed9d3629 tempest-VolumeImageDependencyTests-1312082570 None] Lock "cinder-quobyte-1e9b4a9a-db6f-4762-b29d-cf21e00254c2" acquired by "delete_volume" :: waited 0.016s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:36:06 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[263ca7fc-682d-4055-8b5c-28fa2cc0ee97]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:36:06 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-12f79dc0-a384-434a-b204-4395ed9d3629 tempest-VolumeImageDependencyTests-1312082570 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-1e9b4a9a-db6f-4762-b29d-cf21e00254c2 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:36:06 devstack sudo[111593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-1e9b4a9a-db6f-4762-b29d-cf21e00254c2 Jul 31 12:36:06 devstack sudo[111593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:36:06 devstack sudo[111591]: pam_unix(sudo:session): session closed for user root Jul 31 12:36:06 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-dc6a4024-e164-46f2-9292-e762403c7346 tempest-SnapshotDependencyTests-757469785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-ad8324f3-f618-4d70-90c6-d853fc933756.a6d335b3-0f50-4f73-9f7e-9d74e80ba5e6" returned: 0 in 0.260s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:36:06 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-dc6a4024-e164-46f2-9292-e762403c7346 tempest-SnapshotDependencyTests-757469785 None] Lock "cinder-quobyte-a6d335b3-0f50-4f73-9f7e-9d74e80ba5e6" released by "_delete_snapshot" :: held 1.679s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:36:06 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-dc6a4024-e164-46f2-9292-e762403c7346 tempest-SnapshotDependencyTests-757469785 None] Lock "cinder-quobyte-ad8324f3-f618-4d70-90c6-d853fc933756" released by "delete_snapshot" :: held 1.718s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:36:06 devstack cinder-volume[89182]: DEBUG cinder.quota [None req-dc6a4024-e164-46f2-9292-e762403c7346 tempest-SnapshotDependencyTests-757469785 None] Created reservations ['c12df1f0-a225-45b4-893a-9d1272bd124d', '7c4ae9da-8ddf-41f1-ad23-b3ec29dc36c6', '8d0065f6-63a0-4a99-a80f-145d87216835', '69e7e629-78d7-4a6a-876c-b7d24f1ac392'] {{(pid=89182) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 12:36:06 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-dc6a4024-e164-46f2-9292-e762403c7346 tempest-SnapshotDependencyTests-757469785 None] Delete snapshot completed successfully. Jul 31 12:36:06 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-dc6a4024-e164-46f2-9292-e762403c7346 tempest-SnapshotDependencyTests-757469785 None] Lock "cinder-a6d335b3-0f50-4f73-9f7e-9d74e80ba5e6-delete_snapshot" released by "delete_snapshot" :: held 1.870s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:36:06 devstack sudo[111593]: pam_unix(sudo:session): session closed for user root Jul 31 12:36:06 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-12f79dc0-a384-434a-b204-4395ed9d3629 tempest-VolumeImageDependencyTests-1312082570 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-1e9b4a9a-db6f-4762-b29d-cf21e00254c2" returned: 0 in 0.374s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:36:06 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-12f79dc0-a384-434a-b204-4395ed9d3629 tempest-VolumeImageDependencyTests-1312082570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-1e9b4a9a-db6f-4762-b29d-cf21e00254c2 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:36:06 devstack sudo[111599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-1e9b4a9a-db6f-4762-b29d-cf21e00254c2 Jul 31 12:36:06 devstack sudo[111599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:36:06 devstack sudo[111599]: pam_unix(sudo:session): session closed for user root Jul 31 12:36:06 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-c82fd5ef-fc51-4565-8500-c7938905c05f tempest-SnapshotDependencyTests-757469785 None] Acquiring lock "cinder-ad8324f3-f618-4d70-90c6-d853fc933756-delete_volume" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:36:06 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-12f79dc0-a384-434a-b204-4395ed9d3629 tempest-VolumeImageDependencyTests-1312082570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-1e9b4a9a-db6f-4762-b29d-cf21e00254c2" returned: 0 in 0.258s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:36:06 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-12f79dc0-a384-434a-b204-4395ed9d3629 tempest-VolumeImageDependencyTests-1312082570 None] Lock "cinder-quobyte-1e9b4a9a-db6f-4762-b29d-cf21e00254c2" released by "delete_volume" :: held 0.677s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:36:06 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-c82fd5ef-fc51-4565-8500-c7938905c05f tempest-SnapshotDependencyTests-757469785 None] Lock "cinder-ad8324f3-f618-4d70-90c6-d853fc933756-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:36:06 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-c82fd5ef-fc51-4565-8500-c7938905c05f tempest-SnapshotDependencyTests-757469785 None] Acquiring lock "cinder-quobyte-ad8324f3-f618-4d70-90c6-d853fc933756" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:36:06 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-c82fd5ef-fc51-4565-8500-c7938905c05f tempest-SnapshotDependencyTests-757469785 None] Lock "cinder-quobyte-ad8324f3-f618-4d70-90c6-d853fc933756" acquired by "delete_volume" :: waited 0.019s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:36:06 devstack cinder-volume[89182]: DEBUG cinder.quota [None req-12f79dc0-a384-434a-b204-4395ed9d3629 tempest-VolumeImageDependencyTests-1312082570 None] Created reservations ['36d84b83-3a89-4ff8-b780-1cde3db53351', '171b9acc-230a-4863-abb6-d0954a02bc11', '04738854-7771-44cd-99d8-e241a182f658', '632f0038-77d0-426b-a595-d432498db250'] {{(pid=89182) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 12:36:06 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[02860218-27b2-408d-8707-cc8a53f40fe7]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:36:06 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-c82fd5ef-fc51-4565-8500-c7938905c05f tempest-SnapshotDependencyTests-757469785 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-ad8324f3-f618-4d70-90c6-d853fc933756 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:36:07 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-12f79dc0-a384-434a-b204-4395ed9d3629 tempest-VolumeImageDependencyTests-1312082570 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:36:07 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-12f79dc0-a384-434a-b204-4395ed9d3629 tempest-VolumeImageDependencyTests-1312082570 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:36:07 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-12f79dc0-a384-434a-b204-4395ed9d3629 tempest-VolumeImageDependencyTests-1312082570 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:36:07 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-12f79dc0-a384-434a-b204-4395ed9d3629 tempest-VolumeImageDependencyTests-1312082570 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:36:07 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-12f79dc0-a384-434a-b204-4395ed9d3629 tempest-VolumeImageDependencyTests-1312082570 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:36:07 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-12f79dc0-a384-434a-b204-4395ed9d3629 tempest-VolumeImageDependencyTests-1312082570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:36:07 devstack sudo[111604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 Jul 31 12:36:07 devstack sudo[111604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:36:07 devstack sudo[111602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-ad8324f3-f618-4d70-90c6-d853fc933756 Jul 31 12:36:07 devstack sudo[111602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:36:07 devstack sudo[111604]: pam_unix(sudo:session): session closed for user root Jul 31 12:36:07 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-12f79dc0-a384-434a-b204-4395ed9d3629 tempest-VolumeImageDependencyTests-1312082570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2" returned: 0 in 0.251s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:36:07 devstack cinder-volume[89182]: DEBUG cinder.manager [None req-12f79dc0-a384-434a-b204-4395ed9d3629 tempest-VolumeImageDependencyTests-1312082570 None] Notifying Schedulers of capabilities ... {{(pid=89182) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 12:36:07 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-12f79dc0-a384-434a-b204-4395ed9d3629 tempest-VolumeImageDependencyTests-1312082570 None] Deleted volume successfully. Jul 31 12:36:07 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-12f79dc0-a384-434a-b204-4395ed9d3629 tempest-VolumeImageDependencyTests-1312082570 None] Lock "cinder-1e9b4a9a-db6f-4762-b29d-cf21e00254c2-delete_volume" released by "delete_volume" :: held 1.220s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:36:07 devstack sudo[111602]: pam_unix(sudo:session): session closed for user root Jul 31 12:36:07 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-c82fd5ef-fc51-4565-8500-c7938905c05f tempest-SnapshotDependencyTests-757469785 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-ad8324f3-f618-4d70-90c6-d853fc933756" returned: 0 in 0.389s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:36:07 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-c82fd5ef-fc51-4565-8500-c7938905c05f tempest-SnapshotDependencyTests-757469785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-ad8324f3-f618-4d70-90c6-d853fc933756 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:36:07 devstack sudo[111611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-ad8324f3-f618-4d70-90c6-d853fc933756 Jul 31 12:36:07 devstack sudo[111611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:36:07 devstack sudo[111611]: pam_unix(sudo:session): session closed for user root Jul 31 12:36:07 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-c82fd5ef-fc51-4565-8500-c7938905c05f tempest-SnapshotDependencyTests-757469785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-ad8324f3-f618-4d70-90c6-d853fc933756" returned: 0 in 0.256s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:36:07 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-c82fd5ef-fc51-4565-8500-c7938905c05f tempest-SnapshotDependencyTests-757469785 None] Lock "cinder-quobyte-ad8324f3-f618-4d70-90c6-d853fc933756" released by "delete_volume" :: held 0.708s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:36:07 devstack cinder-volume[89182]: DEBUG cinder.quota [None req-c82fd5ef-fc51-4565-8500-c7938905c05f tempest-SnapshotDependencyTests-757469785 None] Created reservations ['4a12b38c-c161-47c1-994e-e95a1e2be180', '0661c89a-c66c-43a3-8b1d-4b07f762169a', 'f98737be-e655-4d96-8ebc-02a66a27221b', '0c7d6498-e90d-4c75-911d-b047f605df58'] {{(pid=89182) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 12:36:07 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-c82fd5ef-fc51-4565-8500-c7938905c05f tempest-SnapshotDependencyTests-757469785 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:36:07 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-c82fd5ef-fc51-4565-8500-c7938905c05f tempest-SnapshotDependencyTests-757469785 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:36:07 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-c82fd5ef-fc51-4565-8500-c7938905c05f tempest-SnapshotDependencyTests-757469785 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:36:07 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-c82fd5ef-fc51-4565-8500-c7938905c05f tempest-SnapshotDependencyTests-757469785 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:36:07 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-c82fd5ef-fc51-4565-8500-c7938905c05f tempest-SnapshotDependencyTests-757469785 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:36:07 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-c82fd5ef-fc51-4565-8500-c7938905c05f tempest-SnapshotDependencyTests-757469785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:36:07 devstack sudo[111614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 Jul 31 12:36:07 devstack sudo[111614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:36:08 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-c0001db5-75ff-4640-b978-685dff463bf3 tempest-SnapshotDependencyTests-757469785 None] Acquiring lock "cinder-f4b5053f-6794-4441-9c6f-f12d78ed0464-delete_volume" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:36:08 devstack sudo[111614]: pam_unix(sudo:session): session closed for user root Jul 31 12:36:08 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-c82fd5ef-fc51-4565-8500-c7938905c05f tempest-SnapshotDependencyTests-757469785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2" returned: 0 in 0.267s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:36:08 devstack cinder-volume[89182]: DEBUG cinder.manager [None req-c82fd5ef-fc51-4565-8500-c7938905c05f tempest-SnapshotDependencyTests-757469785 None] Notifying Schedulers of capabilities ... {{(pid=89182) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 12:36:08 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-c0001db5-75ff-4640-b978-685dff463bf3 tempest-SnapshotDependencyTests-757469785 None] Lock "cinder-f4b5053f-6794-4441-9c6f-f12d78ed0464-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:36:08 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-c82fd5ef-fc51-4565-8500-c7938905c05f tempest-SnapshotDependencyTests-757469785 None] Deleted volume successfully. Jul 31 12:36:08 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-c82fd5ef-fc51-4565-8500-c7938905c05f tempest-SnapshotDependencyTests-757469785 None] Lock "cinder-ad8324f3-f618-4d70-90c6-d853fc933756-delete_volume" released by "delete_volume" :: held 1.238s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:36:08 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-c0001db5-75ff-4640-b978-685dff463bf3 tempest-SnapshotDependencyTests-757469785 None] Acquiring lock "cinder-quobyte-f4b5053f-6794-4441-9c6f-f12d78ed0464" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:36:08 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-c0001db5-75ff-4640-b978-685dff463bf3 tempest-SnapshotDependencyTests-757469785 None] Lock "cinder-quobyte-f4b5053f-6794-4441-9c6f-f12d78ed0464" acquired by "delete_volume" :: waited 0.013s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:36:08 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[b67f04a7-3854-4294-abd3-da2a28deea95]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:36:08 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-c0001db5-75ff-4640-b978-685dff463bf3 tempest-SnapshotDependencyTests-757469785 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-f4b5053f-6794-4441-9c6f-f12d78ed0464 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:36:08 devstack sudo[111617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-f4b5053f-6794-4441-9c6f-f12d78ed0464 Jul 31 12:36:08 devstack sudo[111617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:36:08 devstack sudo[111617]: pam_unix(sudo:session): session closed for user root Jul 31 12:36:08 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-c0001db5-75ff-4640-b978-685dff463bf3 tempest-SnapshotDependencyTests-757469785 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-f4b5053f-6794-4441-9c6f-f12d78ed0464" returned: 0 in 0.389s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:36:08 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-c0001db5-75ff-4640-b978-685dff463bf3 tempest-SnapshotDependencyTests-757469785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-f4b5053f-6794-4441-9c6f-f12d78ed0464 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:36:08 devstack sudo[111623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-f4b5053f-6794-4441-9c6f-f12d78ed0464 Jul 31 12:36:08 devstack sudo[111623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:36:08 devstack sudo[111623]: pam_unix(sudo:session): session closed for user root Jul 31 12:36:08 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-c0001db5-75ff-4640-b978-685dff463bf3 tempest-SnapshotDependencyTests-757469785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-f4b5053f-6794-4441-9c6f-f12d78ed0464" returned: 0 in 0.285s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:36:08 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-c0001db5-75ff-4640-b978-685dff463bf3 tempest-SnapshotDependencyTests-757469785 None] Lock "cinder-quobyte-f4b5053f-6794-4441-9c6f-f12d78ed0464" released by "delete_volume" :: held 0.721s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:36:08 devstack cinder-volume[89182]: DEBUG cinder.quota [None req-c0001db5-75ff-4640-b978-685dff463bf3 tempest-SnapshotDependencyTests-757469785 None] Created reservations ['c9d3f835-fbf1-43ea-8eb2-80e102dac9b7', 'e248c39a-ed2f-44ac-b0ce-1d19db0422c4', 'c6dea6ef-4611-4e03-a1ca-b4fe616b1164', 'cfc8202f-4e32-4bfb-9b44-a4d4562ba187'] {{(pid=89182) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 12:36:09 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-c0001db5-75ff-4640-b978-685dff463bf3 tempest-SnapshotDependencyTests-757469785 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:36:09 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-c0001db5-75ff-4640-b978-685dff463bf3 tempest-SnapshotDependencyTests-757469785 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:36:09 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-c0001db5-75ff-4640-b978-685dff463bf3 tempest-SnapshotDependencyTests-757469785 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:36:09 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-c0001db5-75ff-4640-b978-685dff463bf3 tempest-SnapshotDependencyTests-757469785 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:36:09 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-c0001db5-75ff-4640-b978-685dff463bf3 tempest-SnapshotDependencyTests-757469785 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:36:09 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-c0001db5-75ff-4640-b978-685dff463bf3 tempest-SnapshotDependencyTests-757469785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:36:09 devstack sudo[111626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 Jul 31 12:36:09 devstack sudo[111626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:36:09 devstack sudo[111626]: pam_unix(sudo:session): session closed for user root Jul 31 12:36:09 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-c0001db5-75ff-4640-b978-685dff463bf3 tempest-SnapshotDependencyTests-757469785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2" returned: 0 in 0.262s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:36:09 devstack cinder-volume[89182]: DEBUG cinder.manager [None req-c0001db5-75ff-4640-b978-685dff463bf3 tempest-SnapshotDependencyTests-757469785 None] Notifying Schedulers of capabilities ... {{(pid=89182) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 12:36:09 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-c0001db5-75ff-4640-b978-685dff463bf3 tempest-SnapshotDependencyTests-757469785 None] Deleted volume successfully. Jul 31 12:36:09 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-c0001db5-75ff-4640-b978-685dff463bf3 tempest-SnapshotDependencyTests-757469785 None] Lock "cinder-f4b5053f-6794-4441-9c6f-f12d78ed0464-delete_volume" released by "delete_volume" :: held 1.240s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:36:19 devstack cinder-volume[89182]: DEBUG dbcounter [-] [89182] Writing DB stats cinder:SELECT=74,cinder:UPDATE=82,cinder:INSERT=30,cinder:DELETE=9 {{(pid=89182) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 12:36:19 devstack cinder-volume[89182]: DEBUG dbcounter [-] [89182] Writing DB stats cinder:SELECT=72,cinder:INSERT=47,cinder:UPDATE=79,cinder:DELETE=4 {{(pid=89182) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 12:36:21 devstack cinder-volume[89182]: DEBUG oslo_service.periodic_task [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89182) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 31 12:36:21 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:36:21 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:36:21 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:36:21 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:36:21 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:36:21 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:36:22 devstack sudo[111658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 Jul 31 12:36:22 devstack sudo[111658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:36:22 devstack sudo[111658]: pam_unix(sudo:session): session closed for user root Jul 31 12:36:22 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2" returned: 0 in 0.257s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:36:22 devstack cinder-volume[89182]: DEBUG cinder.manager [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] Notifying Schedulers of capabilities ... {{(pid=89182) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 12:36:22 devstack cinder-volume[89182]: DEBUG oslo_service.periodic_task [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] Running periodic task VolumeManager._thread_info {{(pid=89182) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 31 12:36:22 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] thread count: 28 {{(pid=89182) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 31 12:36:22 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] thread info: [<_MainThread(MainThread, started 136154603720832)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=89182) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 31 12:36:28 devstack cinder-volume[89182]: DEBUG cinder.volume.flows.manager.create_volume [None req-5087e30c-c266-4d04-bda3-4af0b165fc3d tempest-VolumeDependencyTests-442009576 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89182) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 12:36:28 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-5087e30c-c266-4d04-bda3-4af0b165fc3d tempest-VolumeDependencyTests-442009576 None] Flow 'volume_create_manager' (2d9534af-e345-4248-9723-4fa80386991c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:36:28 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-5087e30c-c266-4d04-bda3-4af0b165fc3d tempest-VolumeDependencyTests-442009576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c91a3ed-31a0-4e17-862f-d2508315906e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:36:28 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-5087e30c-c266-4d04-bda3-4af0b165fc3d tempest-VolumeDependencyTests-442009576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c91a3ed-31a0-4e17-862f-d2508315906e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:36:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1721095856',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca5d8c89-9ec6-4058-8d58-5c1e42ac9371,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c622d586c4c9404ead8c06d764810df1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:36:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:36:28Z,use_quota=True,user_id='cfc528fe8ec2487bb4171d283c222b1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:36:28 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-5087e30c-c266-4d04-bda3-4af0b165fc3d tempest-VolumeDependencyTests-442009576 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (080bf6b3-b9a6-436b-bc48-fff3c5f2c92e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:36:28 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-5087e30c-c266-4d04-bda3-4af0b165fc3d tempest-VolumeDependencyTests-442009576 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (080bf6b3-b9a6-436b-bc48-fff3c5f2c92e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:36:28 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-5087e30c-c266-4d04-bda3-4af0b165fc3d tempest-VolumeDependencyTests-442009576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a36e2726-7823-498e-b654-8e7e66449006) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:36:28 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-5087e30c-c266-4d04-bda3-4af0b165fc3d tempest-VolumeDependencyTests-442009576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a36e2726-7823-498e-b654-8e7e66449006) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ca5d8c89-9ec6-4058-8d58-5c1e42ac9371', 'volume_name': 'volume-ca5d8c89-9ec6-4058-8d58-5c1e42ac9371', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:36:28 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-5087e30c-c266-4d04-bda3-4af0b165fc3d tempest-VolumeDependencyTests-442009576 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10b4642f-e324-4cd0-abbc-475be381ed1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:36:28 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-5087e30c-c266-4d04-bda3-4af0b165fc3d tempest-VolumeDependencyTests-442009576 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10b4642f-e324-4cd0-abbc-475be381ed1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:36:28 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-5087e30c-c266-4d04-bda3-4af0b165fc3d tempest-VolumeDependencyTests-442009576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8bdbb646-9f11-4685-bf1b-76d1d586e667) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:36:28 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-5087e30c-c266-4d04-bda3-4af0b165fc3d tempest-VolumeDependencyTests-442009576 None] Volume ca5d8c89-9ec6-4058-8d58-5c1e42ac9371: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ca5d8c89-9ec6-4058-8d58-5c1e42ac9371', 'volume_size': 1} Jul 31 12:36:28 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-5087e30c-c266-4d04-bda3-4af0b165fc3d tempest-VolumeDependencyTests-442009576 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:36:28 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-5087e30c-c266-4d04-bda3-4af0b165fc3d tempest-VolumeDependencyTests-442009576 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:36:28 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-5087e30c-c266-4d04-bda3-4af0b165fc3d tempest-VolumeDependencyTests-442009576 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:36:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1721095856',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca5d8c89-9ec6-4058-8d58-5c1e42ac9371,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c622d586c4c9404ead8c06d764810df1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:36:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:36:28Z,use_quota=True,user_id='cfc528fe8ec2487bb4171d283c222b1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)}" {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 12:36:28 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-5087e30c-c266-4d04-bda3-4af0b165fc3d tempest-VolumeDependencyTests-442009576 None] Creating volume ca5d8c89-9ec6-4058-8d58-5c1e42ac9371 {{(pid=89182) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 12:36:28 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-5087e30c-c266-4d04-bda3-4af0b165fc3d tempest-VolumeDependencyTests-442009576 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:36:28 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-5087e30c-c266-4d04-bda3-4af0b165fc3d tempest-VolumeDependencyTests-442009576 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:36:28 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-5087e30c-c266-4d04-bda3-4af0b165fc3d tempest-VolumeDependencyTests-442009576 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:36:28 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-5087e30c-c266-4d04-bda3-4af0b165fc3d tempest-VolumeDependencyTests-442009576 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:36:28 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-5087e30c-c266-4d04-bda3-4af0b165fc3d tempest-VolumeDependencyTests-442009576 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:36:28 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-5087e30c-c266-4d04-bda3-4af0b165fc3d tempest-VolumeDependencyTests-442009576 None] Selected osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 as target Quobyte volume. {{(pid=89182) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 12:36:28 devstack cinder-volume[89182]: INFO cinder.volume.drivers.remotefs [None req-5087e30c-c266-4d04-bda3-4af0b165fc3d tempest-VolumeDependencyTests-442009576 None] casted to osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 Jul 31 12:36:28 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-5087e30c-c266-4d04-bda3-4af0b165fc3d tempest-VolumeDependencyTests-442009576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-ca5d8c89-9ec6-4058-8d58-5c1e42ac9371 1073741824 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:36:28 devstack sudo[111674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-ca5d8c89-9ec6-4058-8d58-5c1e42ac9371 1073741824 Jul 31 12:36:28 devstack sudo[111674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:36:28 devstack cinder-volume[89182]: DEBUG cinder.volume.flows.manager.create_volume [None req-247c5938-d4e7-40c3-996d-98adaa6058fd tempest-CreateVolumesFromImageTest-2001993980 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89182) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 12:36:28 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-247c5938-d4e7-40c3-996d-98adaa6058fd tempest-CreateVolumesFromImageTest-2001993980 None] Flow 'volume_create_manager' (860db4a7-65c8-48e1-9ba0-153f7a93c827) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:36:28 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-247c5938-d4e7-40c3-996d-98adaa6058fd tempest-CreateVolumesFromImageTest-2001993980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a93b0e39-e86b-4642-a1f4-d5c27ff56815) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:36:28 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-247c5938-d4e7-40c3-996d-98adaa6058fd tempest-CreateVolumesFromImageTest-2001993980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a93b0e39-e86b-4642-a1f4-d5c27ff56815) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:36:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-401257015',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d18571fa-46a5-4f67-b558-6d9c5df3017a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19609c58f2b041a38a753a54337fcb7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:36:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:36:29Z,use_quota=True,user_id='6388585c04b345dd91bdd892086fa59f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:36:28 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-247c5938-d4e7-40c3-996d-98adaa6058fd tempest-CreateVolumesFromImageTest-2001993980 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20f2546e-3174-46ff-a041-d4116920909c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:36:28 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-247c5938-d4e7-40c3-996d-98adaa6058fd tempest-CreateVolumesFromImageTest-2001993980 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20f2546e-3174-46ff-a041-d4116920909c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:36:28 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-247c5938-d4e7-40c3-996d-98adaa6058fd tempest-CreateVolumesFromImageTest-2001993980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48d28678-e749-44c0-b010-9712c6053058) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:36:28 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-247c5938-d4e7-40c3-996d-98adaa6058fd tempest-CreateVolumesFromImageTest-2001993980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48d28678-e749-44c0-b010-9712c6053058) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd18571fa-46a5-4f67-b558-6d9c5df3017a', 'volume_name': 'volume-d18571fa-46a5-4f67-b558-6d9c5df3017a', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:36:28 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-247c5938-d4e7-40c3-996d-98adaa6058fd tempest-CreateVolumesFromImageTest-2001993980 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1a4997e-8f61-4b80-a3cd-12db3006cf98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:36:28 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-247c5938-d4e7-40c3-996d-98adaa6058fd tempest-CreateVolumesFromImageTest-2001993980 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1a4997e-8f61-4b80-a3cd-12db3006cf98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:36:28 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-247c5938-d4e7-40c3-996d-98adaa6058fd tempest-CreateVolumesFromImageTest-2001993980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f80373ac-7e83-447e-be51-b868a95cc8b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:36:28 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-247c5938-d4e7-40c3-996d-98adaa6058fd tempest-CreateVolumesFromImageTest-2001993980 None] Volume d18571fa-46a5-4f67-b558-6d9c5df3017a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d18571fa-46a5-4f67-b558-6d9c5df3017a', 'volume_size': 1} Jul 31 12:36:28 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-247c5938-d4e7-40c3-996d-98adaa6058fd tempest-CreateVolumesFromImageTest-2001993980 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:36:29 devstack sudo[111674]: pam_unix(sudo:session): session closed for user root Jul 31 12:36:29 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-5087e30c-c266-4d04-bda3-4af0b165fc3d tempest-VolumeDependencyTests-442009576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-ca5d8c89-9ec6-4058-8d58-5c1e42ac9371 1073741824" returned: 0 in 0.639s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:36:29 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-5087e30c-c266-4d04-bda3-4af0b165fc3d tempest-VolumeDependencyTests-442009576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-ca5d8c89-9ec6-4058-8d58-5c1e42ac9371 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:36:29 devstack sudo[111680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-ca5d8c89-9ec6-4058-8d58-5c1e42ac9371 Jul 31 12:36:29 devstack sudo[111680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:36:29 devstack cinder-volume[89182]: DEBUG cinder.volume.flows.manager.create_volume [None req-6ad12b35-30f1-4546-b7cf-86876a7e8c07 tempest-CreateVolumesFromImageTest-2001993980 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89182) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 12:36:29 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-6ad12b35-30f1-4546-b7cf-86876a7e8c07 tempest-CreateVolumesFromImageTest-2001993980 None] Flow 'volume_create_manager' (e064d93f-77b8-40a6-8304-12a5a4f25279) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:36:29 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-6ad12b35-30f1-4546-b7cf-86876a7e8c07 tempest-CreateVolumesFromImageTest-2001993980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bbd84d2e-2917-482c-afd0-251c12731278) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:36:29 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-6ad12b35-30f1-4546-b7cf-86876a7e8c07 tempest-CreateVolumesFromImageTest-2001993980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bbd84d2e-2917-482c-afd0-251c12731278) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:36:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-247681190',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c001e8c-51c6-4c27-8268-0100fb438ba5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19609c58f2b041a38a753a54337fcb7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:36:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:36:29Z,use_quota=True,user_id='6388585c04b345dd91bdd892086fa59f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:36:29 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-6ad12b35-30f1-4546-b7cf-86876a7e8c07 tempest-CreateVolumesFromImageTest-2001993980 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d570d077-c4be-4083-be5b-3995df99fbb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:36:29 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-6ad12b35-30f1-4546-b7cf-86876a7e8c07 tempest-CreateVolumesFromImageTest-2001993980 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d570d077-c4be-4083-be5b-3995df99fbb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:36:29 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-6ad12b35-30f1-4546-b7cf-86876a7e8c07 tempest-CreateVolumesFromImageTest-2001993980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12cecd11-fda6-4ef7-aee8-08c6d69b4e31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:36:29 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-6ad12b35-30f1-4546-b7cf-86876a7e8c07 tempest-CreateVolumesFromImageTest-2001993980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12cecd11-fda6-4ef7-aee8-08c6d69b4e31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0c001e8c-51c6-4c27-8268-0100fb438ba5', 'volume_name': 'volume-0c001e8c-51c6-4c27-8268-0100fb438ba5', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:36:29 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-6ad12b35-30f1-4546-b7cf-86876a7e8c07 tempest-CreateVolumesFromImageTest-2001993980 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d63f723-65ee-4fff-8a64-e6ca37ca2f89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:36:29 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-6ad12b35-30f1-4546-b7cf-86876a7e8c07 tempest-CreateVolumesFromImageTest-2001993980 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d63f723-65ee-4fff-8a64-e6ca37ca2f89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:36:29 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-6ad12b35-30f1-4546-b7cf-86876a7e8c07 tempest-CreateVolumesFromImageTest-2001993980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db947b86-f5cd-43d7-bfaf-4f3d5694ce42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:36:29 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-6ad12b35-30f1-4546-b7cf-86876a7e8c07 tempest-CreateVolumesFromImageTest-2001993980 None] Volume 0c001e8c-51c6-4c27-8268-0100fb438ba5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0c001e8c-51c6-4c27-8268-0100fb438ba5', 'volume_size': 1} Jul 31 12:36:29 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-6ad12b35-30f1-4546-b7cf-86876a7e8c07 tempest-CreateVolumesFromImageTest-2001993980 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:36:29 devstack sudo[111680]: pam_unix(sudo:session): session closed for user root Jul 31 12:36:29 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-5087e30c-c266-4d04-bda3-4af0b165fc3d tempest-VolumeDependencyTests-442009576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-ca5d8c89-9ec6-4058-8d58-5c1e42ac9371" returned: 0 in 0.341s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:36:29 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-5087e30c-c266-4d04-bda3-4af0b165fc3d tempest-VolumeDependencyTests-442009576 None] <== create_volume: return (1085ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'} {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 12:36:29 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-5087e30c-c266-4d04-bda3-4af0b165fc3d tempest-VolumeDependencyTests-442009576 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.088s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:36:29 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-247c5938-d4e7-40c3-996d-98adaa6058fd tempest-CreateVolumesFromImageTest-2001993980 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.736s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:36:29 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-247c5938-d4e7-40c3-996d-98adaa6058fd tempest-CreateVolumesFromImageTest-2001993980 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:36:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-401257015',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d18571fa-46a5-4f67-b558-6d9c5df3017a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19609c58f2b041a38a753a54337fcb7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:36:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:36:29Z,use_quota=True,user_id='6388585c04b345dd91bdd892086fa59f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)}" {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 12:36:29 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-247c5938-d4e7-40c3-996d-98adaa6058fd tempest-CreateVolumesFromImageTest-2001993980 None] Creating volume d18571fa-46a5-4f67-b558-6d9c5df3017a {{(pid=89182) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 12:36:29 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-247c5938-d4e7-40c3-996d-98adaa6058fd tempest-CreateVolumesFromImageTest-2001993980 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:36:29 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-247c5938-d4e7-40c3-996d-98adaa6058fd tempest-CreateVolumesFromImageTest-2001993980 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:36:29 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-247c5938-d4e7-40c3-996d-98adaa6058fd tempest-CreateVolumesFromImageTest-2001993980 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:36:29 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-247c5938-d4e7-40c3-996d-98adaa6058fd tempest-CreateVolumesFromImageTest-2001993980 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:36:29 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-247c5938-d4e7-40c3-996d-98adaa6058fd tempest-CreateVolumesFromImageTest-2001993980 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:36:29 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-247c5938-d4e7-40c3-996d-98adaa6058fd tempest-CreateVolumesFromImageTest-2001993980 None] Selected osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 as target Quobyte volume. {{(pid=89182) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 12:36:29 devstack cinder-volume[89182]: INFO cinder.volume.drivers.remotefs [None req-247c5938-d4e7-40c3-996d-98adaa6058fd tempest-CreateVolumesFromImageTest-2001993980 None] casted to osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 Jul 31 12:36:29 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-247c5938-d4e7-40c3-996d-98adaa6058fd tempest-CreateVolumesFromImageTest-2001993980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-d18571fa-46a5-4f67-b558-6d9c5df3017a 1073741824 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:36:29 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-5087e30c-c266-4d04-bda3-4af0b165fc3d tempest-VolumeDependencyTests-442009576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8bdbb646-9f11-4685-bf1b-76d1d586e667) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ca5d8c89-9ec6-4058-8d58-5c1e42ac9371', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:36:29 devstack sudo[111683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-d18571fa-46a5-4f67-b558-6d9c5df3017a 1073741824 Jul 31 12:36:29 devstack sudo[111683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:36:29 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-5087e30c-c266-4d04-bda3-4af0b165fc3d tempest-VolumeDependencyTests-442009576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dfb058f7-d50c-4b64-9d28-42e661e92013) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:36:29 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-5087e30c-c266-4d04-bda3-4af0b165fc3d tempest-VolumeDependencyTests-442009576 None] Volume volume-ca5d8c89-9ec6-4058-8d58-5c1e42ac9371 (ca5d8c89-9ec6-4058-8d58-5c1e42ac9371): created successfully Jul 31 12:36:29 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-5087e30c-c266-4d04-bda3-4af0b165fc3d tempest-VolumeDependencyTests-442009576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dfb058f7-d50c-4b64-9d28-42e661e92013) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:36:29 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-5087e30c-c266-4d04-bda3-4af0b165fc3d tempest-VolumeDependencyTests-442009576 None] Flow 'volume_create_manager' (2d9534af-e345-4248-9723-4fa80386991c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:36:29 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-5087e30c-c266-4d04-bda3-4af0b165fc3d tempest-VolumeDependencyTests-442009576 None] Created volume successfully. Jul 31 12:36:29 devstack cinder-volume[89182]: DEBUG cinder.volume.flows.manager.create_volume [None req-38608c7e-17dd-48b1-be8f-58dfdfa29947 tempest-CreateVolumesFromImageTest-2001993980 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89182) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 12:36:29 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-38608c7e-17dd-48b1-be8f-58dfdfa29947 tempest-CreateVolumesFromImageTest-2001993980 None] Flow 'volume_create_manager' (123dcd06-e478-47ed-8b84-a722ffcd4e6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:36:29 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-38608c7e-17dd-48b1-be8f-58dfdfa29947 tempest-CreateVolumesFromImageTest-2001993980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9e2815a-03a5-42b1-b0b2-1be4b90942f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:36:29 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-38608c7e-17dd-48b1-be8f-58dfdfa29947 tempest-CreateVolumesFromImageTest-2001993980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9e2815a-03a5-42b1-b0b2-1be4b90942f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:36:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-376798362',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=846a2715-7614-4e18-aa5f-dae7ccb77220,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19609c58f2b041a38a753a54337fcb7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:36:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:36:30Z,use_quota=True,user_id='6388585c04b345dd91bdd892086fa59f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:36:29 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-38608c7e-17dd-48b1-be8f-58dfdfa29947 tempest-CreateVolumesFromImageTest-2001993980 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (682cc24d-d92e-4d82-87f8-82391579c8b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:36:29 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-38608c7e-17dd-48b1-be8f-58dfdfa29947 tempest-CreateVolumesFromImageTest-2001993980 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (682cc24d-d92e-4d82-87f8-82391579c8b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:36:29 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-38608c7e-17dd-48b1-be8f-58dfdfa29947 tempest-CreateVolumesFromImageTest-2001993980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09f2edb7-b4dd-4513-9b9c-a46cee5e6fbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:36:29 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-38608c7e-17dd-48b1-be8f-58dfdfa29947 tempest-CreateVolumesFromImageTest-2001993980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09f2edb7-b4dd-4513-9b9c-a46cee5e6fbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '846a2715-7614-4e18-aa5f-dae7ccb77220', 'volume_name': 'volume-846a2715-7614-4e18-aa5f-dae7ccb77220', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:36:29 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-38608c7e-17dd-48b1-be8f-58dfdfa29947 tempest-CreateVolumesFromImageTest-2001993980 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba317dbe-9267-4dbd-bb0b-18e45c491ce1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:36:29 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-38608c7e-17dd-48b1-be8f-58dfdfa29947 tempest-CreateVolumesFromImageTest-2001993980 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba317dbe-9267-4dbd-bb0b-18e45c491ce1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:36:29 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-38608c7e-17dd-48b1-be8f-58dfdfa29947 tempest-CreateVolumesFromImageTest-2001993980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (950f4a85-51e4-4198-ae6e-a87672c4bfc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:36:29 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-38608c7e-17dd-48b1-be8f-58dfdfa29947 tempest-CreateVolumesFromImageTest-2001993980 None] Volume 846a2715-7614-4e18-aa5f-dae7ccb77220: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-846a2715-7614-4e18-aa5f-dae7ccb77220', 'volume_size': 1} Jul 31 12:36:29 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-38608c7e-17dd-48b1-be8f-58dfdfa29947 tempest-CreateVolumesFromImageTest-2001993980 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:36:30 devstack cinder-volume[89182]: DEBUG cinder.volume.flows.manager.create_volume [None req-de5907a7-86ed-4121-b55f-c7621078a4ee tempest-CreateVolumesFromImageTest-2001993980 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89182) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 12:36:30 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-de5907a7-86ed-4121-b55f-c7621078a4ee tempest-CreateVolumesFromImageTest-2001993980 None] Flow 'volume_create_manager' (470e0626-768a-4497-a0e5-d6c127c960f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:36:30 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-de5907a7-86ed-4121-b55f-c7621078a4ee tempest-CreateVolumesFromImageTest-2001993980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72dca360-0510-4867-add7-04b1772e938b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:36:30 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-de5907a7-86ed-4121-b55f-c7621078a4ee tempest-CreateVolumesFromImageTest-2001993980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72dca360-0510-4867-add7-04b1772e938b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:36:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1651860850',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de382ded-1065-4b8a-b7f1-3a8e7359e2cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19609c58f2b041a38a753a54337fcb7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:36:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:36:30Z,use_quota=True,user_id='6388585c04b345dd91bdd892086fa59f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:36:30 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-de5907a7-86ed-4121-b55f-c7621078a4ee tempest-CreateVolumesFromImageTest-2001993980 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63acd444-f218-40fd-9f71-832d8b0d4d1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:36:30 devstack sudo[111683]: pam_unix(sudo:session): session closed for user root Jul 31 12:36:30 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-de5907a7-86ed-4121-b55f-c7621078a4ee tempest-CreateVolumesFromImageTest-2001993980 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63acd444-f218-40fd-9f71-832d8b0d4d1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:36:30 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-de5907a7-86ed-4121-b55f-c7621078a4ee tempest-CreateVolumesFromImageTest-2001993980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fbed3663-f7df-477e-90a0-e3a9c2b8bfc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:36:30 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-de5907a7-86ed-4121-b55f-c7621078a4ee tempest-CreateVolumesFromImageTest-2001993980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fbed3663-f7df-477e-90a0-e3a9c2b8bfc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'de382ded-1065-4b8a-b7f1-3a8e7359e2cb', 'volume_name': 'volume-de382ded-1065-4b8a-b7f1-3a8e7359e2cb', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:36:30 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-de5907a7-86ed-4121-b55f-c7621078a4ee tempest-CreateVolumesFromImageTest-2001993980 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (811d1c38-52af-4cca-9583-e49898c906e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:36:30 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-de5907a7-86ed-4121-b55f-c7621078a4ee tempest-CreateVolumesFromImageTest-2001993980 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (811d1c38-52af-4cca-9583-e49898c906e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:36:30 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-de5907a7-86ed-4121-b55f-c7621078a4ee tempest-CreateVolumesFromImageTest-2001993980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d70d2f4-db8c-4f85-8464-edaea829844c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:36:30 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-de5907a7-86ed-4121-b55f-c7621078a4ee tempest-CreateVolumesFromImageTest-2001993980 None] Volume de382ded-1065-4b8a-b7f1-3a8e7359e2cb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-de382ded-1065-4b8a-b7f1-3a8e7359e2cb', 'volume_size': 1} Jul 31 12:36:30 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-de5907a7-86ed-4121-b55f-c7621078a4ee tempest-CreateVolumesFromImageTest-2001993980 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:36:30 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-247c5938-d4e7-40c3-996d-98adaa6058fd tempest-CreateVolumesFromImageTest-2001993980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-d18571fa-46a5-4f67-b558-6d9c5df3017a 1073741824" returned: 0 in 0.659s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:36:30 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-247c5938-d4e7-40c3-996d-98adaa6058fd tempest-CreateVolumesFromImageTest-2001993980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-d18571fa-46a5-4f67-b558-6d9c5df3017a {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:36:30 devstack sudo[111690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-d18571fa-46a5-4f67-b558-6d9c5df3017a Jul 31 12:36:30 devstack sudo[111690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:36:30 devstack sudo[111690]: pam_unix(sudo:session): session closed for user root Jul 31 12:36:30 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-247c5938-d4e7-40c3-996d-98adaa6058fd tempest-CreateVolumesFromImageTest-2001993980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-d18571fa-46a5-4f67-b558-6d9c5df3017a" returned: 0 in 0.474s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:36:30 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-247c5938-d4e7-40c3-996d-98adaa6058fd tempest-CreateVolumesFromImageTest-2001993980 None] <== create_volume: return (1184ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'} {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 12:36:30 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-247c5938-d4e7-40c3-996d-98adaa6058fd tempest-CreateVolumesFromImageTest-2001993980 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.187s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:36:30 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-6ad12b35-30f1-4546-b7cf-86876a7e8c07 tempest-CreateVolumesFromImageTest-2001993980 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.332s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:36:30 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-6ad12b35-30f1-4546-b7cf-86876a7e8c07 tempest-CreateVolumesFromImageTest-2001993980 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:36:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-247681190',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c001e8c-51c6-4c27-8268-0100fb438ba5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19609c58f2b041a38a753a54337fcb7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:36:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:36:29Z,use_quota=True,user_id='6388585c04b345dd91bdd892086fa59f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)}" {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 12:36:30 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-6ad12b35-30f1-4546-b7cf-86876a7e8c07 tempest-CreateVolumesFromImageTest-2001993980 None] Creating volume 0c001e8c-51c6-4c27-8268-0100fb438ba5 {{(pid=89182) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 12:36:30 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-6ad12b35-30f1-4546-b7cf-86876a7e8c07 tempest-CreateVolumesFromImageTest-2001993980 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:36:30 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-6ad12b35-30f1-4546-b7cf-86876a7e8c07 tempest-CreateVolumesFromImageTest-2001993980 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:36:30 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-6ad12b35-30f1-4546-b7cf-86876a7e8c07 tempest-CreateVolumesFromImageTest-2001993980 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:36:30 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-6ad12b35-30f1-4546-b7cf-86876a7e8c07 tempest-CreateVolumesFromImageTest-2001993980 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:36:30 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-6ad12b35-30f1-4546-b7cf-86876a7e8c07 tempest-CreateVolumesFromImageTest-2001993980 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:36:30 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-6ad12b35-30f1-4546-b7cf-86876a7e8c07 tempest-CreateVolumesFromImageTest-2001993980 None] Selected osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 as target Quobyte volume. {{(pid=89182) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 12:36:30 devstack cinder-volume[89182]: INFO cinder.volume.drivers.remotefs [None req-6ad12b35-30f1-4546-b7cf-86876a7e8c07 tempest-CreateVolumesFromImageTest-2001993980 None] casted to osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 Jul 31 12:36:30 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-6ad12b35-30f1-4546-b7cf-86876a7e8c07 tempest-CreateVolumesFromImageTest-2001993980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0c001e8c-51c6-4c27-8268-0100fb438ba5 1073741824 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:36:30 devstack sudo[111693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0c001e8c-51c6-4c27-8268-0100fb438ba5 1073741824 Jul 31 12:36:30 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-247c5938-d4e7-40c3-996d-98adaa6058fd tempest-CreateVolumesFromImageTest-2001993980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f80373ac-7e83-447e-be51-b868a95cc8b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d18571fa-46a5-4f67-b558-6d9c5df3017a', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:36:30 devstack sudo[111693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:36:30 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-247c5938-d4e7-40c3-996d-98adaa6058fd tempest-CreateVolumesFromImageTest-2001993980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (044c31a8-e3c1-4dbd-b136-06dbfbf0ffdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:36:30 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-247c5938-d4e7-40c3-996d-98adaa6058fd tempest-CreateVolumesFromImageTest-2001993980 None] Volume volume-d18571fa-46a5-4f67-b558-6d9c5df3017a (d18571fa-46a5-4f67-b558-6d9c5df3017a): created successfully Jul 31 12:36:31 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-247c5938-d4e7-40c3-996d-98adaa6058fd tempest-CreateVolumesFromImageTest-2001993980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (044c31a8-e3c1-4dbd-b136-06dbfbf0ffdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:36:31 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-247c5938-d4e7-40c3-996d-98adaa6058fd tempest-CreateVolumesFromImageTest-2001993980 None] Flow 'volume_create_manager' (860db4a7-65c8-48e1-9ba0-153f7a93c827) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:36:31 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-247c5938-d4e7-40c3-996d-98adaa6058fd tempest-CreateVolumesFromImageTest-2001993980 None] Created volume successfully. Jul 31 12:36:31 devstack cinder-volume[89182]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a74b9bb-abc8-412b-822f-1b5e9705b597 tempest-CreateVolumesFromImageTest-2001993980 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89182) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 12:36:31 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-2a74b9bb-abc8-412b-822f-1b5e9705b597 tempest-CreateVolumesFromImageTest-2001993980 None] Flow 'volume_create_manager' (82ba2dde-0abf-4e77-8b29-1f4b87b11c73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:36:31 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-2a74b9bb-abc8-412b-822f-1b5e9705b597 tempest-CreateVolumesFromImageTest-2001993980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c21e1218-ccdb-4e8d-b405-978b9a49f4aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:36:31 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-9447a6fb-5622-4796-8f51-ded8b4b755b7 tempest-VolumeDependencyTests-442009576 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:36:31 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-2a74b9bb-abc8-412b-822f-1b5e9705b597 tempest-CreateVolumesFromImageTest-2001993980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c21e1218-ccdb-4e8d-b405-978b9a49f4aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:36:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2010560828',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb52be29-5e59-462c-aba5-06d5175c8f6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19609c58f2b041a38a753a54337fcb7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:36:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:36:31Z,use_quota=True,user_id='6388585c04b345dd91bdd892086fa59f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:36:31 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-2a74b9bb-abc8-412b-822f-1b5e9705b597 tempest-CreateVolumesFromImageTest-2001993980 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bdaf0954-5945-4af1-a1c0-21ffa6b47fc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:36:31 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-2a74b9bb-abc8-412b-822f-1b5e9705b597 tempest-CreateVolumesFromImageTest-2001993980 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bdaf0954-5945-4af1-a1c0-21ffa6b47fc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:36:31 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-2a74b9bb-abc8-412b-822f-1b5e9705b597 tempest-CreateVolumesFromImageTest-2001993980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (477a99d8-bb4f-4a5b-9f92-fed1ce076543) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:36:31 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-2a74b9bb-abc8-412b-822f-1b5e9705b597 tempest-CreateVolumesFromImageTest-2001993980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (477a99d8-bb4f-4a5b-9f92-fed1ce076543) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eb52be29-5e59-462c-aba5-06d5175c8f6a', 'volume_name': 'volume-eb52be29-5e59-462c-aba5-06d5175c8f6a', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:36:31 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-2a74b9bb-abc8-412b-822f-1b5e9705b597 tempest-CreateVolumesFromImageTest-2001993980 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (431533f4-ae26-4758-9c9b-96866b5ac7cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:36:31 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-2a74b9bb-abc8-412b-822f-1b5e9705b597 tempest-CreateVolumesFromImageTest-2001993980 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (431533f4-ae26-4758-9c9b-96866b5ac7cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:36:31 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-2a74b9bb-abc8-412b-822f-1b5e9705b597 tempest-CreateVolumesFromImageTest-2001993980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bacd5df7-6145-478b-bb4f-6c928bb1ef8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:36:31 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-2a74b9bb-abc8-412b-822f-1b5e9705b597 tempest-CreateVolumesFromImageTest-2001993980 None] Volume eb52be29-5e59-462c-aba5-06d5175c8f6a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eb52be29-5e59-462c-aba5-06d5175c8f6a', 'volume_size': 1} Jul 31 12:36:31 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-2a74b9bb-abc8-412b-822f-1b5e9705b597 tempest-CreateVolumesFromImageTest-2001993980 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:36:31 devstack sudo[111693]: pam_unix(sudo:session): session closed for user root Jul 31 12:36:31 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-6ad12b35-30f1-4546-b7cf-86876a7e8c07 tempest-CreateVolumesFromImageTest-2001993980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0c001e8c-51c6-4c27-8268-0100fb438ba5 1073741824" returned: 0 in 0.587s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:36:31 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-6ad12b35-30f1-4546-b7cf-86876a7e8c07 tempest-CreateVolumesFromImageTest-2001993980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0c001e8c-51c6-4c27-8268-0100fb438ba5 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:36:31 devstack sudo[111700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0c001e8c-51c6-4c27-8268-0100fb438ba5 Jul 31 12:36:31 devstack sudo[111700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:36:31 devstack sudo[111700]: pam_unix(sudo:session): session closed for user root Jul 31 12:36:31 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-6ad12b35-30f1-4546-b7cf-86876a7e8c07 tempest-CreateVolumesFromImageTest-2001993980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0c001e8c-51c6-4c27-8268-0100fb438ba5" returned: 0 in 0.290s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:36:31 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-6ad12b35-30f1-4546-b7cf-86876a7e8c07 tempest-CreateVolumesFromImageTest-2001993980 None] <== create_volume: return (929ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'} {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 12:36:31 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-6ad12b35-30f1-4546-b7cf-86876a7e8c07 tempest-CreateVolumesFromImageTest-2001993980 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.935s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:36:31 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-38608c7e-17dd-48b1-be8f-58dfdfa29947 tempest-CreateVolumesFromImageTest-2001993980 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.802s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:36:31 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-38608c7e-17dd-48b1-be8f-58dfdfa29947 tempest-CreateVolumesFromImageTest-2001993980 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:36:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-376798362',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=846a2715-7614-4e18-aa5f-dae7ccb77220,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19609c58f2b041a38a753a54337fcb7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:36:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:36:30Z,use_quota=True,user_id='6388585c04b345dd91bdd892086fa59f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)}" {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 12:36:31 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-38608c7e-17dd-48b1-be8f-58dfdfa29947 tempest-CreateVolumesFromImageTest-2001993980 None] Creating volume 846a2715-7614-4e18-aa5f-dae7ccb77220 {{(pid=89182) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 12:36:31 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-38608c7e-17dd-48b1-be8f-58dfdfa29947 tempest-CreateVolumesFromImageTest-2001993980 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:36:31 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-38608c7e-17dd-48b1-be8f-58dfdfa29947 tempest-CreateVolumesFromImageTest-2001993980 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:36:31 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-38608c7e-17dd-48b1-be8f-58dfdfa29947 tempest-CreateVolumesFromImageTest-2001993980 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:36:31 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-38608c7e-17dd-48b1-be8f-58dfdfa29947 tempest-CreateVolumesFromImageTest-2001993980 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:36:31 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-38608c7e-17dd-48b1-be8f-58dfdfa29947 tempest-CreateVolumesFromImageTest-2001993980 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:36:31 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-38608c7e-17dd-48b1-be8f-58dfdfa29947 tempest-CreateVolumesFromImageTest-2001993980 None] Selected osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 as target Quobyte volume. {{(pid=89182) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 12:36:31 devstack cinder-volume[89182]: INFO cinder.volume.drivers.remotefs [None req-38608c7e-17dd-48b1-be8f-58dfdfa29947 tempest-CreateVolumesFromImageTest-2001993980 None] casted to osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 Jul 31 12:36:31 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-38608c7e-17dd-48b1-be8f-58dfdfa29947 tempest-CreateVolumesFromImageTest-2001993980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-846a2715-7614-4e18-aa5f-dae7ccb77220 1073741824 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:36:31 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-6ad12b35-30f1-4546-b7cf-86876a7e8c07 tempest-CreateVolumesFromImageTest-2001993980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db947b86-f5cd-43d7-bfaf-4f3d5694ce42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0c001e8c-51c6-4c27-8268-0100fb438ba5', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:36:31 devstack sudo[111703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-846a2715-7614-4e18-aa5f-dae7ccb77220 1073741824 Jul 31 12:36:31 devstack sudo[111703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:36:31 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-6ad12b35-30f1-4546-b7cf-86876a7e8c07 tempest-CreateVolumesFromImageTest-2001993980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e483f493-aaea-4787-a49d-6c57657b26a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:36:31 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-6ad12b35-30f1-4546-b7cf-86876a7e8c07 tempest-CreateVolumesFromImageTest-2001993980 None] Volume volume-0c001e8c-51c6-4c27-8268-0100fb438ba5 (0c001e8c-51c6-4c27-8268-0100fb438ba5): created successfully Jul 31 12:36:31 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-6ad12b35-30f1-4546-b7cf-86876a7e8c07 tempest-CreateVolumesFromImageTest-2001993980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e483f493-aaea-4787-a49d-6c57657b26a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:36:31 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-6ad12b35-30f1-4546-b7cf-86876a7e8c07 tempest-CreateVolumesFromImageTest-2001993980 None] Flow 'volume_create_manager' (e064d93f-77b8-40a6-8304-12a5a4f25279) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:36:31 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-6ad12b35-30f1-4546-b7cf-86876a7e8c07 tempest-CreateVolumesFromImageTest-2001993980 None] Created volume successfully. Jul 31 12:36:32 devstack sudo[111703]: pam_unix(sudo:session): session closed for user root Jul 31 12:36:32 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-38608c7e-17dd-48b1-be8f-58dfdfa29947 tempest-CreateVolumesFromImageTest-2001993980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-846a2715-7614-4e18-aa5f-dae7ccb77220 1073741824" returned: 0 in 0.597s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:36:32 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-38608c7e-17dd-48b1-be8f-58dfdfa29947 tempest-CreateVolumesFromImageTest-2001993980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-846a2715-7614-4e18-aa5f-dae7ccb77220 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:36:32 devstack sudo[111709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-846a2715-7614-4e18-aa5f-dae7ccb77220 Jul 31 12:36:32 devstack sudo[111709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:36:32 devstack sudo[111709]: pam_unix(sudo:session): session closed for user root Jul 31 12:36:32 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-38608c7e-17dd-48b1-be8f-58dfdfa29947 tempest-CreateVolumesFromImageTest-2001993980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-846a2715-7614-4e18-aa5f-dae7ccb77220" returned: 0 in 0.283s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:36:32 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-38608c7e-17dd-48b1-be8f-58dfdfa29947 tempest-CreateVolumesFromImageTest-2001993980 None] <== create_volume: return (934ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'} {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 12:36:32 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-38608c7e-17dd-48b1-be8f-58dfdfa29947 tempest-CreateVolumesFromImageTest-2001993980 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.937s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:36:32 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-de5907a7-86ed-4121-b55f-c7621078a4ee tempest-CreateVolumesFromImageTest-2001993980 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.423s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:36:32 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-de5907a7-86ed-4121-b55f-c7621078a4ee tempest-CreateVolumesFromImageTest-2001993980 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:36:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1651860850',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de382ded-1065-4b8a-b7f1-3a8e7359e2cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19609c58f2b041a38a753a54337fcb7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:36:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:36:30Z,use_quota=True,user_id='6388585c04b345dd91bdd892086fa59f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)}" {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 12:36:32 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-de5907a7-86ed-4121-b55f-c7621078a4ee tempest-CreateVolumesFromImageTest-2001993980 None] Creating volume de382ded-1065-4b8a-b7f1-3a8e7359e2cb {{(pid=89182) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 12:36:32 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-de5907a7-86ed-4121-b55f-c7621078a4ee tempest-CreateVolumesFromImageTest-2001993980 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:36:32 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-de5907a7-86ed-4121-b55f-c7621078a4ee tempest-CreateVolumesFromImageTest-2001993980 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:36:32 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-de5907a7-86ed-4121-b55f-c7621078a4ee tempest-CreateVolumesFromImageTest-2001993980 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:36:32 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-de5907a7-86ed-4121-b55f-c7621078a4ee tempest-CreateVolumesFromImageTest-2001993980 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:36:32 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-de5907a7-86ed-4121-b55f-c7621078a4ee tempest-CreateVolumesFromImageTest-2001993980 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:36:32 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-de5907a7-86ed-4121-b55f-c7621078a4ee tempest-CreateVolumesFromImageTest-2001993980 None] Selected osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 as target Quobyte volume. {{(pid=89182) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 12:36:32 devstack cinder-volume[89182]: INFO cinder.volume.drivers.remotefs [None req-de5907a7-86ed-4121-b55f-c7621078a4ee tempest-CreateVolumesFromImageTest-2001993980 None] casted to osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 Jul 31 12:36:32 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-de5907a7-86ed-4121-b55f-c7621078a4ee tempest-CreateVolumesFromImageTest-2001993980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-de382ded-1065-4b8a-b7f1-3a8e7359e2cb 1073741824 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:36:32 devstack sudo[111712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-de382ded-1065-4b8a-b7f1-3a8e7359e2cb 1073741824 Jul 31 12:36:32 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-38608c7e-17dd-48b1-be8f-58dfdfa29947 tempest-CreateVolumesFromImageTest-2001993980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (950f4a85-51e4-4198-ae6e-a87672c4bfc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-846a2715-7614-4e18-aa5f-dae7ccb77220', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:36:32 devstack sudo[111712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:36:32 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-38608c7e-17dd-48b1-be8f-58dfdfa29947 tempest-CreateVolumesFromImageTest-2001993980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d543a6c2-73d6-40e2-bfc0-a126e1ed28f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:36:32 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-38608c7e-17dd-48b1-be8f-58dfdfa29947 tempest-CreateVolumesFromImageTest-2001993980 None] Volume volume-846a2715-7614-4e18-aa5f-dae7ccb77220 (846a2715-7614-4e18-aa5f-dae7ccb77220): created successfully Jul 31 12:36:32 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-38608c7e-17dd-48b1-be8f-58dfdfa29947 tempest-CreateVolumesFromImageTest-2001993980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d543a6c2-73d6-40e2-bfc0-a126e1ed28f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:36:32 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-38608c7e-17dd-48b1-be8f-58dfdfa29947 tempest-CreateVolumesFromImageTest-2001993980 None] Flow 'volume_create_manager' (123dcd06-e478-47ed-8b84-a722ffcd4e6e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:36:32 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-38608c7e-17dd-48b1-be8f-58dfdfa29947 tempest-CreateVolumesFromImageTest-2001993980 None] Created volume successfully. Jul 31 12:36:33 devstack sudo[111712]: pam_unix(sudo:session): session closed for user root Jul 31 12:36:33 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-de5907a7-86ed-4121-b55f-c7621078a4ee tempest-CreateVolumesFromImageTest-2001993980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-de382ded-1065-4b8a-b7f1-3a8e7359e2cb 1073741824" returned: 0 in 0.596s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:36:33 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-de5907a7-86ed-4121-b55f-c7621078a4ee tempest-CreateVolumesFromImageTest-2001993980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-de382ded-1065-4b8a-b7f1-3a8e7359e2cb {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:36:33 devstack sudo[111717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-de382ded-1065-4b8a-b7f1-3a8e7359e2cb Jul 31 12:36:33 devstack sudo[111717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:36:33 devstack sudo[111717]: pam_unix(sudo:session): session closed for user root Jul 31 12:36:33 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-de5907a7-86ed-4121-b55f-c7621078a4ee tempest-CreateVolumesFromImageTest-2001993980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-de382ded-1065-4b8a-b7f1-3a8e7359e2cb" returned: 0 in 0.294s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:36:33 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-de5907a7-86ed-4121-b55f-c7621078a4ee tempest-CreateVolumesFromImageTest-2001993980 None] <== create_volume: return (937ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'} {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 12:36:33 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-de5907a7-86ed-4121-b55f-c7621078a4ee tempest-CreateVolumesFromImageTest-2001993980 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.940s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:36:33 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-9447a6fb-5622-4796-8f51-ded8b4b755b7 tempest-VolumeDependencyTests-442009576 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.489s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:36:33 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-de5907a7-86ed-4121-b55f-c7621078a4ee tempest-CreateVolumesFromImageTest-2001993980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d70d2f4-db8c-4f85-8464-edaea829844c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-de382ded-1065-4b8a-b7f1-3a8e7359e2cb', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:36:33 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-de5907a7-86ed-4121-b55f-c7621078a4ee tempest-CreateVolumesFromImageTest-2001993980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee4e5b9a-cbf7-499b-a8b1-3d0065607440) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:36:33 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-9447a6fb-5622-4796-8f51-ded8b4b755b7 tempest-VolumeDependencyTests-442009576 None] Creating offline snapshot 95aca6b6-cfbc-429a-908b-24083c170e76 of volume ca5d8c89-9ec6-4058-8d58-5c1e42ac9371 {{(pid=89182) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 31 12:36:33 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-de5907a7-86ed-4121-b55f-c7621078a4ee tempest-CreateVolumesFromImageTest-2001993980 None] Volume volume-de382ded-1065-4b8a-b7f1-3a8e7359e2cb (de382ded-1065-4b8a-b7f1-3a8e7359e2cb): created successfully Jul 31 12:36:33 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-de5907a7-86ed-4121-b55f-c7621078a4ee tempest-CreateVolumesFromImageTest-2001993980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee4e5b9a-cbf7-499b-a8b1-3d0065607440) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:36:33 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-de5907a7-86ed-4121-b55f-c7621078a4ee tempest-CreateVolumesFromImageTest-2001993980 None] Flow 'volume_create_manager' (470e0626-768a-4497-a0e5-d6c127c960f1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:36:33 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[68f2a260-70c7-4fdc-95a1-3101eaa23499]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:36:33 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-9447a6fb-5622-4796-8f51-ded8b4b755b7 tempest-VolumeDependencyTests-442009576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-ca5d8c89-9ec6-4058-8d58-5c1e42ac9371 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:36:33 devstack cinder-volume[89182]: DEBUG cinder.volume.flows.manager.create_volume [None req-8140937c-52a2-47c9-89f0-b8ec56fa2a33 tempest-VolumeAndVolumeTypeFromImageTest-1209246421 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89182) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 12:36:33 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-8140937c-52a2-47c9-89f0-b8ec56fa2a33 tempest-VolumeAndVolumeTypeFromImageTest-1209246421 None] Flow 'volume_create_manager' (0402ece3-216d-4915-a5a3-a16c707d7bb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:36:33 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-8140937c-52a2-47c9-89f0-b8ec56fa2a33 tempest-VolumeAndVolumeTypeFromImageTest-1209246421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a240854-fd47-4e9c-8afb-4e6c3b58b01e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:36:33 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-de5907a7-86ed-4121-b55f-c7621078a4ee tempest-CreateVolumesFromImageTest-2001993980 None] Created volume successfully. Jul 31 12:36:33 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-8140937c-52a2-47c9-89f0-b8ec56fa2a33 tempest-VolumeAndVolumeTypeFromImageTest-1209246421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a240854-fd47-4e9c-8afb-4e6c3b58b01e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:36:33Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd46497a-805f-4af2-bfb4-f52936694c17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04abb2055d2e4eef9ad2cf3c0f1c48b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:36:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:36:34Z,use_quota=True,user_id='8be32e1fcde946c08a0d91eaa5d10ad0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9c7d848a-7000-40a0-9e60-c8df6ae7bdcc),volume_type_id=9c7d848a-7000-40a0-9e60-c8df6ae7bdcc)' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:36:33 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-8140937c-52a2-47c9-89f0-b8ec56fa2a33 tempest-VolumeAndVolumeTypeFromImageTest-1209246421 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b49c60a-eaec-4ad7-9cec-875dcc2d4613) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:36:33 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-8140937c-52a2-47c9-89f0-b8ec56fa2a33 tempest-VolumeAndVolumeTypeFromImageTest-1209246421 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b49c60a-eaec-4ad7-9cec-875dcc2d4613) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:36:33 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-8140937c-52a2-47c9-89f0-b8ec56fa2a33 tempest-VolumeAndVolumeTypeFromImageTest-1209246421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36169982-1bef-453e-96e9-78f3a6a04196) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:36:33 devstack cinder-volume[89182]: DEBUG cinder.image.glance [None req-8140937c-52a2-47c9-89f0-b8ec56fa2a33 tempest-VolumeAndVolumeTypeFromImageTest-1209246421 None] Creating Keystone auth plugin from conf {{(pid=89182) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 31 12:36:33 devstack sudo[111720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-ca5d8c89-9ec6-4058-8d58-5c1e42ac9371 Jul 31 12:36:33 devstack sudo[111720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:36:34 devstack sudo[111720]: pam_unix(sudo:session): session closed for user root Jul 31 12:36:34 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-9447a6fb-5622-4796-8f51-ded8b4b755b7 tempest-VolumeDependencyTests-442009576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-ca5d8c89-9ec6-4058-8d58-5c1e42ac9371" returned: 0 in 0.435s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:36:34 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-9447a6fb-5622-4796-8f51-ded8b4b755b7 tempest-VolumeDependencyTests-442009576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-ca5d8c89-9ec6-4058-8d58-5c1e42ac9371,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-ca5d8c89-9ec6-4058-8d58-5c1e42ac9371.95aca6b6-cfbc-429a-908b-24083c170e76 1G {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:36:34 devstack sudo[111725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-ca5d8c89-9ec6-4058-8d58-5c1e42ac9371,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-ca5d8c89-9ec6-4058-8d58-5c1e42ac9371.95aca6b6-cfbc-429a-908b-24083c170e76 1G Jul 31 12:36:34 devstack sudo[111725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:36:34 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-8140937c-52a2-47c9-89f0-b8ec56fa2a33 tempest-VolumeAndVolumeTypeFromImageTest-1209246421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36169982-1bef-453e-96e9-78f3a6a04196) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'bd46497a-805f-4af2-bfb4-f52936694c17', 'volume_name': 'volume-bd46497a-805f-4af2-bfb4-f52936694c17', 'volume_size': 1, 'image_id': 'fb5cdb98-42f3-44c8-96fc-8688dce59e8e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fb5cdb98-42f3-44c8-96fc-8688dce59e8e', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'b793bbee0479dd6d8247b8cbfaeaa94b', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '04abb2055d2e4eef9ad2cf3c0f1c48b4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '4f58f8c2966709d6277b60b1ce2da56526a2ea80ed9088d9ae50a9db0f013a3b86efeee673c53d1057a0a5beefc32f0a6f03dbe6edee40ca87bbaa026a6960af', 'id': 'fb5cdb98-42f3-44c8-96fc-8688dce59e8e', 'created_at': datetime.datetime(2026, 7, 31, 10, 36, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 31, 10, 36, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fb5cdb98-42f3-44c8-96fc-8688dce59e8e/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:36:34 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-8140937c-52a2-47c9-89f0-b8ec56fa2a33 tempest-VolumeAndVolumeTypeFromImageTest-1209246421 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b854228f-6575-4dcd-b01b-5a761fc8040f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:36:34 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-8140937c-52a2-47c9-89f0-b8ec56fa2a33 tempest-VolumeAndVolumeTypeFromImageTest-1209246421 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b854228f-6575-4dcd-b01b-5a761fc8040f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:36:34 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-8140937c-52a2-47c9-89f0-b8ec56fa2a33 tempest-VolumeAndVolumeTypeFromImageTest-1209246421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40a1f057-3a29-4f3b-97a6-054a6fac2584) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:36:34 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-8140937c-52a2-47c9-89f0-b8ec56fa2a33 tempest-VolumeAndVolumeTypeFromImageTest-1209246421 None] Volume bd46497a-805f-4af2-bfb4-f52936694c17: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-bd46497a-805f-4af2-bfb4-f52936694c17', 'volume_size': 1, 'image_id': 'fb5cdb98-42f3-44c8-96fc-8688dce59e8e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fb5cdb98-42f3-44c8-96fc-8688dce59e8e', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'b793bbee0479dd6d8247b8cbfaeaa94b', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '04abb2055d2e4eef9ad2cf3c0f1c48b4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '4f58f8c2966709d6277b60b1ce2da56526a2ea80ed9088d9ae50a9db0f013a3b86efeee673c53d1057a0a5beefc32f0a6f03dbe6edee40ca87bbaa026a6960af', 'id': 'fb5cdb98-42f3-44c8-96fc-8688dce59e8e', 'created_at': datetime.datetime(2026, 7, 31, 10, 36, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 31, 10, 36, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fb5cdb98-42f3-44c8-96fc-8688dce59e8e/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jul 31 12:36:34 devstack cinder-volume[89182]: DEBUG cinder.volume.flows.manager.create_volume [None req-8140937c-52a2-47c9-89f0-b8ec56fa2a33 tempest-VolumeAndVolumeTypeFromImageTest-1209246421 None] Trying to clone bd46497a-805f-4af2-bfb4-f52936694c17 from image fb5cdb98-42f3-44c8-96fc-8688dce59e8e at location (None, [{'url': 'file:///opt/stack/data/glance/images/fb5cdb98-42f3-44c8-96fc-8688dce59e8e', 'metadata': {}}]). {{(pid=89182) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 31 12:36:34 devstack cinder-volume[89182]: DEBUG cinder.image.image_utils [None req-8140937c-52a2-47c9-89f0-b8ec56fa2a33 tempest-VolumeAndVolumeTypeFromImageTest-1209246421 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_fb5cdb98-42f3-44c8-96fc-8688dce59e8e_0l8p8fozdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=89182) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 31 12:36:34 devstack cinder-volume[89182]: INFO cinder.image.image_utils [None req-8140937c-52a2-47c9-89f0-b8ec56fa2a33 tempest-VolumeAndVolumeTypeFromImageTest-1209246421 None] Image download 0.00 MB at 0.00 MB/s Jul 31 12:36:34 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b750d76-b514-4e08-848e-0e224124afe8]: (4, 'raw') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:36:34 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-8140937c-52a2-47c9-89f0-b8ec56fa2a33 tempest-VolumeAndVolumeTypeFromImageTest-1209246421 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fb5cdb98-42f3-44c8-96fc-8688dce59e8e_0l8p8fozdevstack@QuobyteHD {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:36:34 devstack sudo[111729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fb5cdb98-42f3-44c8-96fc-8688dce59e8e_0l8p8fozdevstack@QuobyteHD Jul 31 12:36:34 devstack sudo[111729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:36:34 devstack sudo[111725]: pam_unix(sudo:session): session closed for user root Jul 31 12:36:34 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-9447a6fb-5622-4796-8f51-ded8b4b755b7 tempest-VolumeDependencyTests-442009576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-ca5d8c89-9ec6-4058-8d58-5c1e42ac9371,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-ca5d8c89-9ec6-4058-8d58-5c1e42ac9371.95aca6b6-cfbc-429a-908b-24083c170e76 1G" returned: 0 in 0.550s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:36:34 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-9447a6fb-5622-4796-8f51-ded8b4b755b7 tempest-VolumeDependencyTests-442009576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ca5d8c89-9ec6-4058-8d58-5c1e42ac9371 -F qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-ca5d8c89-9ec6-4058-8d58-5c1e42ac9371.95aca6b6-cfbc-429a-908b-24083c170e76 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:36:34 devstack sudo[111733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ca5d8c89-9ec6-4058-8d58-5c1e42ac9371 -F qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-ca5d8c89-9ec6-4058-8d58-5c1e42ac9371.95aca6b6-cfbc-429a-908b-24083c170e76 Jul 31 12:36:34 devstack sudo[111733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:36:34 devstack sudo[111729]: pam_unix(sudo:session): session closed for user root Jul 31 12:36:34 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-8140937c-52a2-47c9-89f0-b8ec56fa2a33 tempest-VolumeAndVolumeTypeFromImageTest-1209246421 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fb5cdb98-42f3-44c8-96fc-8688dce59e8e_0l8p8fozdevstack@QuobyteHD" returned: 0 in 0.373s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:36:34 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-8140937c-52a2-47c9-89f0-b8ec56fa2a33 tempest-VolumeAndVolumeTypeFromImageTest-1209246421 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fb5cdb98-42f3-44c8-96fc-8688dce59e8e_0l8p8fozdevstack@QuobyteHD {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:36:35 devstack sudo[111737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fb5cdb98-42f3-44c8-96fc-8688dce59e8e_0l8p8fozdevstack@QuobyteHD Jul 31 12:36:35 devstack sudo[111737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:36:35 devstack sudo[111733]: pam_unix(sudo:session): session closed for user root Jul 31 12:36:35 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-9447a6fb-5622-4796-8f51-ded8b4b755b7 tempest-VolumeDependencyTests-442009576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ca5d8c89-9ec6-4058-8d58-5c1e42ac9371 -F qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-ca5d8c89-9ec6-4058-8d58-5c1e42ac9371.95aca6b6-cfbc-429a-908b-24083c170e76" returned: 0 in 0.349s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:36:35 devstack cinder-volume[89182]: WARNING cinder.volume.drivers.remotefs [None req-9447a6fb-5622-4796-8f51-ded8b4b755b7 tempest-VolumeDependencyTests-442009576 None] /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-ca5d8c89-9ec6-4058-8d58-5c1e42ac9371.95aca6b6-cfbc-429a-908b-24083c170e76 is being set with open permissions: ugo+rw Jul 31 12:36:35 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-9447a6fb-5622-4796-8f51-ded8b4b755b7 tempest-VolumeDependencyTests-442009576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-ca5d8c89-9ec6-4058-8d58-5c1e42ac9371.95aca6b6-cfbc-429a-908b-24083c170e76 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:36:35 devstack sudo[111742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-ca5d8c89-9ec6-4058-8d58-5c1e42ac9371.95aca6b6-cfbc-429a-908b-24083c170e76 Jul 31 12:36:35 devstack sudo[111742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:36:35 devstack sudo[111737]: pam_unix(sudo:session): session closed for user root Jul 31 12:36:35 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-8140937c-52a2-47c9-89f0-b8ec56fa2a33 tempest-VolumeAndVolumeTypeFromImageTest-1209246421 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fb5cdb98-42f3-44c8-96fc-8688dce59e8e_0l8p8fozdevstack@QuobyteHD" returned: 1 in 0.396s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:36:35 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-8140937c-52a2-47c9-89f0-b8ec56fa2a33 tempest-VolumeAndVolumeTypeFromImageTest-1209246421 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fb5cdb98-42f3-44c8-96fc-8688dce59e8e_0l8p8fozdevstack@QuobyteHD' failed. Not Retrying. {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 31 12:36:35 devstack cinder-volume[89182]: DEBUG cinder.image.image_utils [None req-8140937c-52a2-47c9-89f0-b8ec56fa2a33 tempest-VolumeAndVolumeTypeFromImageTest-1209246421 None] Temporary image fb5cdb98-42f3-44c8-96fc-8688dce59e8e is fetched for user 8be32e1fcde946c08a0d91eaa5d10ad0. {{(pid=89182) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 31 12:36:35 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[0161fca8-72e1-4aad-b556-138c9fbd5f2e]: (4, 'raw') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:36:35 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-8140937c-52a2-47c9-89f0-b8ec56fa2a33 tempest-VolumeAndVolumeTypeFromImageTest-1209246421 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fb5cdb98-42f3-44c8-96fc-8688dce59e8e_0l8p8fozdevstack@QuobyteHD {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:36:35 devstack sudo[111742]: pam_unix(sudo:session): session closed for user root Jul 31 12:36:35 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-9447a6fb-5622-4796-8f51-ded8b4b755b7 tempest-VolumeDependencyTests-442009576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-ca5d8c89-9ec6-4058-8d58-5c1e42ac9371.95aca6b6-cfbc-429a-908b-24083c170e76" returned: 0 in 0.321s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:36:35 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-9447a6fb-5622-4796-8f51-ded8b4b755b7 tempest-VolumeDependencyTests-442009576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-ca5d8c89-9ec6-4058-8d58-5c1e42ac9371.info {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:36:35 devstack sudo[111749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-ca5d8c89-9ec6-4058-8d58-5c1e42ac9371.info Jul 31 12:36:35 devstack sudo[111749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:36:35 devstack sudo[111748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fb5cdb98-42f3-44c8-96fc-8688dce59e8e_0l8p8fozdevstack@QuobyteHD Jul 31 12:36:35 devstack sudo[111748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:36:35 devstack sudo[111748]: pam_unix(sudo:session): session closed for user root Jul 31 12:36:35 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-8140937c-52a2-47c9-89f0-b8ec56fa2a33 tempest-VolumeAndVolumeTypeFromImageTest-1209246421 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fb5cdb98-42f3-44c8-96fc-8688dce59e8e_0l8p8fozdevstack@QuobyteHD" returned: 0 in 0.430s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:36:35 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-8140937c-52a2-47c9-89f0-b8ec56fa2a33 tempest-VolumeAndVolumeTypeFromImageTest-1209246421 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fb5cdb98-42f3-44c8-96fc-8688dce59e8e_0l8p8fozdevstack@QuobyteHD {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:36:35 devstack sudo[111749]: pam_unix(sudo:session): session closed for user root Jul 31 12:36:35 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-9447a6fb-5622-4796-8f51-ded8b4b755b7 tempest-VolumeDependencyTests-442009576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-ca5d8c89-9ec6-4058-8d58-5c1e42ac9371.info" returned: 0 in 0.319s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:36:35 devstack cinder-volume[89182]: WARNING cinder.volume.drivers.remotefs [None req-9447a6fb-5622-4796-8f51-ded8b4b755b7 tempest-VolumeDependencyTests-442009576 None] /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-ca5d8c89-9ec6-4058-8d58-5c1e42ac9371.info is being set with open permissions: ugo+rw Jul 31 12:36:35 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-9447a6fb-5622-4796-8f51-ded8b4b755b7 tempest-VolumeDependencyTests-442009576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-ca5d8c89-9ec6-4058-8d58-5c1e42ac9371.info {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:36:35 devstack sudo[111756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-ca5d8c89-9ec6-4058-8d58-5c1e42ac9371.info Jul 31 12:36:35 devstack sudo[111756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:36:35 devstack sudo[111755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fb5cdb98-42f3-44c8-96fc-8688dce59e8e_0l8p8fozdevstack@QuobyteHD Jul 31 12:36:35 devstack sudo[111755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:36:36 devstack sudo[111756]: pam_unix(sudo:session): session closed for user root Jul 31 12:36:36 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-9447a6fb-5622-4796-8f51-ded8b4b755b7 tempest-VolumeDependencyTests-442009576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-ca5d8c89-9ec6-4058-8d58-5c1e42ac9371.info" returned: 0 in 0.269s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:36:36 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-9447a6fb-5622-4796-8f51-ded8b4b755b7 tempest-VolumeDependencyTests-442009576 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.420s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:36:36 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-2a74b9bb-abc8-412b-822f-1b5e9705b597 tempest-CreateVolumesFromImageTest-2001993980 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.853s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:36:36 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-2a74b9bb-abc8-412b-822f-1b5e9705b597 tempest-CreateVolumesFromImageTest-2001993980 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:36:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2010560828',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb52be29-5e59-462c-aba5-06d5175c8f6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19609c58f2b041a38a753a54337fcb7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:36:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:36:31Z,use_quota=True,user_id='6388585c04b345dd91bdd892086fa59f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)}" {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 12:36:36 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-2a74b9bb-abc8-412b-822f-1b5e9705b597 tempest-CreateVolumesFromImageTest-2001993980 None] Creating volume eb52be29-5e59-462c-aba5-06d5175c8f6a {{(pid=89182) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 12:36:36 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-2a74b9bb-abc8-412b-822f-1b5e9705b597 tempest-CreateVolumesFromImageTest-2001993980 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:36:36 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-2a74b9bb-abc8-412b-822f-1b5e9705b597 tempest-CreateVolumesFromImageTest-2001993980 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:36:36 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-2a74b9bb-abc8-412b-822f-1b5e9705b597 tempest-CreateVolumesFromImageTest-2001993980 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:36:36 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-2a74b9bb-abc8-412b-822f-1b5e9705b597 tempest-CreateVolumesFromImageTest-2001993980 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:36:36 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-2a74b9bb-abc8-412b-822f-1b5e9705b597 tempest-CreateVolumesFromImageTest-2001993980 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:36:36 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-2a74b9bb-abc8-412b-822f-1b5e9705b597 tempest-CreateVolumesFromImageTest-2001993980 None] Selected osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 as target Quobyte volume. {{(pid=89182) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 12:36:36 devstack cinder-volume[89182]: INFO cinder.volume.drivers.remotefs [None req-2a74b9bb-abc8-412b-822f-1b5e9705b597 tempest-CreateVolumesFromImageTest-2001993980 None] casted to osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 Jul 31 12:36:36 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-2a74b9bb-abc8-412b-822f-1b5e9705b597 tempest-CreateVolumesFromImageTest-2001993980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-eb52be29-5e59-462c-aba5-06d5175c8f6a 1073741824 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:36:36 devstack sudo[111755]: pam_unix(sudo:session): session closed for user root Jul 31 12:36:36 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-8140937c-52a2-47c9-89f0-b8ec56fa2a33 tempest-VolumeAndVolumeTypeFromImageTest-1209246421 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fb5cdb98-42f3-44c8-96fc-8688dce59e8e_0l8p8fozdevstack@QuobyteHD" returned: 1 in 0.348s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:36:36 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-8140937c-52a2-47c9-89f0-b8ec56fa2a33 tempest-VolumeAndVolumeTypeFromImageTest-1209246421 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fb5cdb98-42f3-44c8-96fc-8688dce59e8e_0l8p8fozdevstack@QuobyteHD' failed. Not Retrying. {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 31 12:36:36 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-8140937c-52a2-47c9-89f0-b8ec56fa2a33 tempest-VolumeAndVolumeTypeFromImageTest-1209246421 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:36:36 devstack sudo[111763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-eb52be29-5e59-462c-aba5-06d5175c8f6a 1073741824 Jul 31 12:36:36 devstack sudo[111763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:36:36 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-9447a6fb-5622-4796-8f51-ded8b4b755b7 tempest-VolumeDependencyTests-442009576 None] Create snapshot completed successfully Jul 31 12:36:36 devstack sudo[111763]: pam_unix(sudo:session): session closed for user root Jul 31 12:36:36 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-2a74b9bb-abc8-412b-822f-1b5e9705b597 tempest-CreateVolumesFromImageTest-2001993980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-eb52be29-5e59-462c-aba5-06d5175c8f6a 1073741824" returned: 0 in 0.500s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:36:36 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-2a74b9bb-abc8-412b-822f-1b5e9705b597 tempest-CreateVolumesFromImageTest-2001993980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-eb52be29-5e59-462c-aba5-06d5175c8f6a {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:36:36 devstack sudo[111769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-eb52be29-5e59-462c-aba5-06d5175c8f6a Jul 31 12:36:36 devstack sudo[111769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:36:36 devstack sudo[111769]: pam_unix(sudo:session): session closed for user root Jul 31 12:36:36 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-2a74b9bb-abc8-412b-822f-1b5e9705b597 tempest-CreateVolumesFromImageTest-2001993980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-eb52be29-5e59-462c-aba5-06d5175c8f6a" returned: 0 in 0.259s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:36:36 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-2a74b9bb-abc8-412b-822f-1b5e9705b597 tempest-CreateVolumesFromImageTest-2001993980 None] <== create_volume: return (803ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'} {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 12:36:36 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-2a74b9bb-abc8-412b-822f-1b5e9705b597 tempest-CreateVolumesFromImageTest-2001993980 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.806s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:36:36 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-8140937c-52a2-47c9-89f0-b8ec56fa2a33 tempest-VolumeAndVolumeTypeFromImageTest-1209246421 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.773s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:36:36 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-8140937c-52a2-47c9-89f0-b8ec56fa2a33 tempest-VolumeAndVolumeTypeFromImageTest-1209246421 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:36:33Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd46497a-805f-4af2-bfb4-f52936694c17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04abb2055d2e4eef9ad2cf3c0f1c48b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:36:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:36:34Z,use_quota=True,user_id='8be32e1fcde946c08a0d91eaa5d10ad0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9c7d848a-7000-40a0-9e60-c8df6ae7bdcc),volume_type_id=9c7d848a-7000-40a0-9e60-c8df6ae7bdcc)}" {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 12:36:36 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-8140937c-52a2-47c9-89f0-b8ec56fa2a33 tempest-VolumeAndVolumeTypeFromImageTest-1209246421 None] Creating volume bd46497a-805f-4af2-bfb4-f52936694c17 {{(pid=89182) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 12:36:36 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-8140937c-52a2-47c9-89f0-b8ec56fa2a33 tempest-VolumeAndVolumeTypeFromImageTest-1209246421 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:36:36 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-8140937c-52a2-47c9-89f0-b8ec56fa2a33 tempest-VolumeAndVolumeTypeFromImageTest-1209246421 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:36:36 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-8140937c-52a2-47c9-89f0-b8ec56fa2a33 tempest-VolumeAndVolumeTypeFromImageTest-1209246421 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:36:36 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-8140937c-52a2-47c9-89f0-b8ec56fa2a33 tempest-VolumeAndVolumeTypeFromImageTest-1209246421 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:36:36 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-8140937c-52a2-47c9-89f0-b8ec56fa2a33 tempest-VolumeAndVolumeTypeFromImageTest-1209246421 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:36:36 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-8140937c-52a2-47c9-89f0-b8ec56fa2a33 tempest-VolumeAndVolumeTypeFromImageTest-1209246421 None] Selected osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 as target Quobyte volume. {{(pid=89182) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 12:36:36 devstack cinder-volume[89182]: INFO cinder.volume.drivers.remotefs [None req-8140937c-52a2-47c9-89f0-b8ec56fa2a33 tempest-VolumeAndVolumeTypeFromImageTest-1209246421 None] casted to osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 Jul 31 12:36:36 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-8140937c-52a2-47c9-89f0-b8ec56fa2a33 tempest-VolumeAndVolumeTypeFromImageTest-1209246421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-bd46497a-805f-4af2-bfb4-f52936694c17 1073741824 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:36:36 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-2a74b9bb-abc8-412b-822f-1b5e9705b597 tempest-CreateVolumesFromImageTest-2001993980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bacd5df7-6145-478b-bb4f-6c928bb1ef8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eb52be29-5e59-462c-aba5-06d5175c8f6a', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:36:36 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-2a74b9bb-abc8-412b-822f-1b5e9705b597 tempest-CreateVolumesFromImageTest-2001993980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bcd68f43-4d9e-4a2c-9e63-cd3f038bdf2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:36:36 devstack sudo[111772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-bd46497a-805f-4af2-bfb4-f52936694c17 1073741824 Jul 31 12:36:36 devstack sudo[111772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:36:36 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-2a74b9bb-abc8-412b-822f-1b5e9705b597 tempest-CreateVolumesFromImageTest-2001993980 None] Volume volume-eb52be29-5e59-462c-aba5-06d5175c8f6a (eb52be29-5e59-462c-aba5-06d5175c8f6a): created successfully Jul 31 12:36:36 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-2a74b9bb-abc8-412b-822f-1b5e9705b597 tempest-CreateVolumesFromImageTest-2001993980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bcd68f43-4d9e-4a2c-9e63-cd3f038bdf2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:36:36 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-2a74b9bb-abc8-412b-822f-1b5e9705b597 tempest-CreateVolumesFromImageTest-2001993980 None] Flow 'volume_create_manager' (82ba2dde-0abf-4e77-8b29-1f4b87b11c73) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:36:37 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-2a74b9bb-abc8-412b-822f-1b5e9705b597 tempest-CreateVolumesFromImageTest-2001993980 None] Created volume successfully. Jul 31 12:36:37 devstack sudo[111772]: pam_unix(sudo:session): session closed for user root Jul 31 12:36:37 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-8140937c-52a2-47c9-89f0-b8ec56fa2a33 tempest-VolumeAndVolumeTypeFromImageTest-1209246421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-bd46497a-805f-4af2-bfb4-f52936694c17 1073741824" returned: 0 in 0.481s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:36:37 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-8140937c-52a2-47c9-89f0-b8ec56fa2a33 tempest-VolumeAndVolumeTypeFromImageTest-1209246421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-bd46497a-805f-4af2-bfb4-f52936694c17 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:36:37 devstack sudo[111779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-bd46497a-805f-4af2-bfb4-f52936694c17 Jul 31 12:36:37 devstack sudo[111779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:36:37 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-2e9d1f76-426b-457f-ae37-c1033cb8b192 tempest-CreateVolumesFromImageTest-2001993980 None] Acquiring lock "cinder-eb52be29-5e59-462c-aba5-06d5175c8f6a-delete_volume" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:36:37 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-2e9d1f76-426b-457f-ae37-c1033cb8b192 tempest-CreateVolumesFromImageTest-2001993980 None] Lock "cinder-eb52be29-5e59-462c-aba5-06d5175c8f6a-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:36:37 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-2e9d1f76-426b-457f-ae37-c1033cb8b192 tempest-CreateVolumesFromImageTest-2001993980 None] Acquiring lock "cinder-quobyte-eb52be29-5e59-462c-aba5-06d5175c8f6a" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:36:37 devstack sudo[111779]: pam_unix(sudo:session): session closed for user root Jul 31 12:36:37 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-8140937c-52a2-47c9-89f0-b8ec56fa2a33 tempest-VolumeAndVolumeTypeFromImageTest-1209246421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-bd46497a-805f-4af2-bfb4-f52936694c17" returned: 0 in 0.430s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:36:37 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-8140937c-52a2-47c9-89f0-b8ec56fa2a33 tempest-VolumeAndVolumeTypeFromImageTest-1209246421 None] <== create_volume: return (968ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'} {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 12:36:37 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-8140937c-52a2-47c9-89f0-b8ec56fa2a33 tempest-VolumeAndVolumeTypeFromImageTest-1209246421 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.971s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:36:37 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-2e9d1f76-426b-457f-ae37-c1033cb8b192 tempest-CreateVolumesFromImageTest-2001993980 None] Lock "cinder-quobyte-eb52be29-5e59-462c-aba5-06d5175c8f6a" acquired by "delete_volume" :: waited 0.032s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:36:37 devstack cinder-volume[89182]: DEBUG cinder.volume.volume_utils [None req-8140937c-52a2-47c9-89f0-b8ec56fa2a33 tempest-VolumeAndVolumeTypeFromImageTest-1209246421 None] Attempting download of fb5cdb98-42f3-44c8-96fc-8688dce59e8e ((None, [{'url': 'file:///opt/stack/data/glance/images/fb5cdb98-42f3-44c8-96fc-8688dce59e8e', 'metadata': {}}])) to volume bd46497a-805f-4af2-bfb4-f52936694c17. {{(pid=89182) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 31 12:36:37 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[59b19b5c-0acc-4e97-a374-e71e7ef443c6]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:36:37 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-2e9d1f76-426b-457f-ae37-c1033cb8b192 tempest-CreateVolumesFromImageTest-2001993980 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-eb52be29-5e59-462c-aba5-06d5175c8f6a {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:36:38 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef618284-ac2a-47a0-95c4-c66d76adbe06]: (4, 'raw') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:36:38 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-8140937c-52a2-47c9-89f0-b8ec56fa2a33 tempest-VolumeAndVolumeTypeFromImageTest-1209246421 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fb5cdb98-42f3-44c8-96fc-8688dce59e8e_um17jdmy {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:36:38 devstack sudo[111782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-eb52be29-5e59-462c-aba5-06d5175c8f6a Jul 31 12:36:38 devstack sudo[111782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:36:38 devstack cinder-volume[89182]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d4857c6-7f2c-4347-a669-422badd56fc1 tempest-VolumeDependencyTests-442009576 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89182) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 12:36:38 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-4d4857c6-7f2c-4347-a669-422badd56fc1 tempest-VolumeDependencyTests-442009576 None] Flow 'volume_create_manager' (43f62fe0-e600-4fa6-a19d-3e6feccfca34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:36:38 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-4d4857c6-7f2c-4347-a669-422badd56fc1 tempest-VolumeDependencyTests-442009576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa8a5b26-02e0-4a25-a708-d56405b2f34f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:36:38 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-4d4857c6-7f2c-4347-a669-422badd56fc1 tempest-VolumeDependencyTests-442009576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa8a5b26-02e0-4a25-a708-d56405b2f34f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:36:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2116521916',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c784aa3-b637-4a2f-a70b-058a3b465b2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c622d586c4c9404ead8c06d764810df1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:36:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=95aca6b6-cfbc-429a-908b-24083c170e76,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:36:38Z,use_quota=True,user_id='cfc528fe8ec2487bb4171d283c222b1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:36:38 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-4d4857c6-7f2c-4347-a669-422badd56fc1 tempest-VolumeDependencyTests-442009576 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4914900-32ee-431c-b2ec-733b4d649da6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:36:38 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-4d4857c6-7f2c-4347-a669-422badd56fc1 tempest-VolumeDependencyTests-442009576 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4914900-32ee-431c-b2ec-733b4d649da6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:36:38 devstack sudo[111784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fb5cdb98-42f3-44c8-96fc-8688dce59e8e_um17jdmy Jul 31 12:36:38 devstack sudo[111784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:36:38 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-4d4857c6-7f2c-4347-a669-422badd56fc1 tempest-VolumeDependencyTests-442009576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d00459ac-bb14-498f-9f1d-39db7b5537c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:36:38 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-4d4857c6-7f2c-4347-a669-422badd56fc1 tempest-VolumeDependencyTests-442009576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d00459ac-bb14-498f-9f1d-39db7b5537c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '8c784aa3-b637-4a2f-a70b-058a3b465b2a', 'volume_name': 'volume-8c784aa3-b637-4a2f-a70b-058a3b465b2a', 'volume_size': 1, 'snapshot_id': '95aca6b6-cfbc-429a-908b-24083c170e76'}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:36:38 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-4d4857c6-7f2c-4347-a669-422badd56fc1 tempest-VolumeDependencyTests-442009576 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ffeaa27-8826-4c05-ae90-d6b57c184472) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:36:38 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-4d4857c6-7f2c-4347-a669-422badd56fc1 tempest-VolumeDependencyTests-442009576 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ffeaa27-8826-4c05-ae90-d6b57c184472) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:36:38 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-4d4857c6-7f2c-4347-a669-422badd56fc1 tempest-VolumeDependencyTests-442009576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (edd4b6c9-e468-41e2-80cc-d08d244f3acb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:36:38 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-4d4857c6-7f2c-4347-a669-422badd56fc1 tempest-VolumeDependencyTests-442009576 None] Volume 8c784aa3-b637-4a2f-a70b-058a3b465b2a: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-8c784aa3-b637-4a2f-a70b-058a3b465b2a', 'volume_size': 1, 'snapshot_id': '95aca6b6-cfbc-429a-908b-24083c170e76'} Jul 31 12:36:38 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-4d4857c6-7f2c-4347-a669-422badd56fc1 tempest-VolumeDependencyTests-442009576 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:36:38 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-4d4857c6-7f2c-4347-a669-422badd56fc1 tempest-VolumeDependencyTests-442009576 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:36:38 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-4d4857c6-7f2c-4347-a669-422badd56fc1 tempest-VolumeDependencyTests-442009576 None] Acquiring lock "cinder-quobyte-95aca6b6-cfbc-429a-908b-24083c170e76-8c784aa3-b637-4a2f-a70b-058a3b465b2a" by "_create_volume_from_snapshot" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:36:38 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-4d4857c6-7f2c-4347-a669-422badd56fc1 tempest-VolumeDependencyTests-442009576 None] Lock "cinder-quobyte-95aca6b6-cfbc-429a-908b-24083c170e76-8c784aa3-b637-4a2f-a70b-058a3b465b2a" acquired by "_create_volume_from_snapshot" :: waited 0.017s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:36:38 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-4d4857c6-7f2c-4347-a669-422badd56fc1 tempest-VolumeDependencyTests-442009576 None] Creating volume 8c784aa3-b637-4a2f-a70b-058a3b465b2a from snapshot 95aca6b6-cfbc-429a-908b-24083c170e76 {{(pid=89182) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 31 12:36:38 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-4d4857c6-7f2c-4347-a669-422badd56fc1 tempest-VolumeDependencyTests-442009576 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:36:38 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-4d4857c6-7f2c-4347-a669-422badd56fc1 tempest-VolumeDependencyTests-442009576 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:36:38 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-4d4857c6-7f2c-4347-a669-422badd56fc1 tempest-VolumeDependencyTests-442009576 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:36:38 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-4d4857c6-7f2c-4347-a669-422badd56fc1 tempest-VolumeDependencyTests-442009576 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:36:38 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-4d4857c6-7f2c-4347-a669-422badd56fc1 tempest-VolumeDependencyTests-442009576 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:36:38 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-4d4857c6-7f2c-4347-a669-422badd56fc1 tempest-VolumeDependencyTests-442009576 None] Selected osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 as target Quobyte volume. {{(pid=89182) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 12:36:38 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-4d4857c6-7f2c-4347-a669-422badd56fc1 tempest-VolumeDependencyTests-442009576 None] Acquiring lock "cinder-quobyte-8c784aa3-b637-4a2f-a70b-058a3b465b2a" by "_copy_volume_from_snapshot" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:36:38 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-4d4857c6-7f2c-4347-a669-422badd56fc1 tempest-VolumeDependencyTests-442009576 None] Lock "cinder-quobyte-8c784aa3-b637-4a2f-a70b-058a3b465b2a" acquired by "_copy_volume_from_snapshot" :: waited 0.033s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:36:38 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-4d4857c6-7f2c-4347-a669-422badd56fc1 tempest-VolumeDependencyTests-442009576 None] snapshot: 95aca6b6-cfbc-429a-908b-24083c170e76, volume: 8c784aa3-b637-4a2f-a70b-058a3b465b2a, {{(pid=89182) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Jul 31 12:36:38 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-4d4857c6-7f2c-4347-a669-422badd56fc1 tempest-VolumeDependencyTests-442009576 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:36:38 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-4d4857c6-7f2c-4347-a669-422badd56fc1 tempest-VolumeDependencyTests-442009576 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:36:38 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-4d4857c6-7f2c-4347-a669-422badd56fc1 tempest-VolumeDependencyTests-442009576 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:36:38 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-4d4857c6-7f2c-4347-a669-422badd56fc1 tempest-VolumeDependencyTests-442009576 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:36:38 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-4d4857c6-7f2c-4347-a669-422badd56fc1 tempest-VolumeDependencyTests-442009576 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:36:38 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a168b66-5db8-43cb-b2cc-6ec351a3c1ce]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:36:38 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-4d4857c6-7f2c-4347-a669-422badd56fc1 tempest-VolumeDependencyTests-442009576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-ca5d8c89-9ec6-4058-8d58-5c1e42ac9371.95aca6b6-cfbc-429a-908b-24083c170e76 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:36:38 devstack sudo[111782]: pam_unix(sudo:session): session closed for user root Jul 31 12:36:38 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-2e9d1f76-426b-457f-ae37-c1033cb8b192 tempest-CreateVolumesFromImageTest-2001993980 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-eb52be29-5e59-462c-aba5-06d5175c8f6a" returned: 0 in 0.471s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:36:38 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-2e9d1f76-426b-457f-ae37-c1033cb8b192 tempest-CreateVolumesFromImageTest-2001993980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-eb52be29-5e59-462c-aba5-06d5175c8f6a {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:36:38 devstack sudo[111791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-eb52be29-5e59-462c-aba5-06d5175c8f6a Jul 31 12:36:38 devstack sudo[111791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:36:38 devstack sudo[111784]: pam_unix(sudo:session): session closed for user root Jul 31 12:36:38 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-8140937c-52a2-47c9-89f0-b8ec56fa2a33 tempest-VolumeAndVolumeTypeFromImageTest-1209246421 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fb5cdb98-42f3-44c8-96fc-8688dce59e8e_um17jdmy" returned: 0 in 0.378s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:36:38 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-8140937c-52a2-47c9-89f0-b8ec56fa2a33 tempest-VolumeAndVolumeTypeFromImageTest-1209246421 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fb5cdb98-42f3-44c8-96fc-8688dce59e8e_um17jdmy {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:36:38 devstack sudo[111789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-ca5d8c89-9ec6-4058-8d58-5c1e42ac9371.95aca6b6-cfbc-429a-908b-24083c170e76 Jul 31 12:36:38 devstack sudo[111789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:36:38 devstack sudo[111794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fb5cdb98-42f3-44c8-96fc-8688dce59e8e_um17jdmy Jul 31 12:36:38 devstack sudo[111794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:36:38 devstack sudo[111791]: pam_unix(sudo:session): session closed for user root Jul 31 12:36:38 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-2e9d1f76-426b-457f-ae37-c1033cb8b192 tempest-CreateVolumesFromImageTest-2001993980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-eb52be29-5e59-462c-aba5-06d5175c8f6a" returned: 0 in 0.273s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:36:38 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-2e9d1f76-426b-457f-ae37-c1033cb8b192 tempest-CreateVolumesFromImageTest-2001993980 None] Lock "cinder-quobyte-eb52be29-5e59-462c-aba5-06d5175c8f6a" released by "delete_volume" :: held 0.810s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:36:38 devstack cinder-volume[89182]: DEBUG cinder.quota [None req-2e9d1f76-426b-457f-ae37-c1033cb8b192 tempest-CreateVolumesFromImageTest-2001993980 None] Created reservations ['3e6d8f54-9fed-4513-bd87-a4e0bc095b67', 'aa12a1f9-a4a3-431d-aea5-0c58063961bd', '2d95086e-fee6-485f-957d-7c6faa7704b4', '9c5666a4-1594-4ef1-8b75-fd5ba883f697'] {{(pid=89182) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 12:36:38 devstack sudo[111794]: pam_unix(sudo:session): session closed for user root Jul 31 12:36:38 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-8140937c-52a2-47c9-89f0-b8ec56fa2a33 tempest-VolumeAndVolumeTypeFromImageTest-1209246421 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fb5cdb98-42f3-44c8-96fc-8688dce59e8e_um17jdmy" returned: 1 in 0.358s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:36:38 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-8140937c-52a2-47c9-89f0-b8ec56fa2a33 tempest-VolumeAndVolumeTypeFromImageTest-1209246421 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fb5cdb98-42f3-44c8-96fc-8688dce59e8e_um17jdmy' failed. Not Retrying. {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 31 12:36:38 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc2acaf6-d6f8-46d7-840c-684588bf39f8]: (4, 'raw') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:36:38 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-8140937c-52a2-47c9-89f0-b8ec56fa2a33 tempest-VolumeAndVolumeTypeFromImageTest-1209246421 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fb5cdb98-42f3-44c8-96fc-8688dce59e8e_0l8p8fozdevstack@QuobyteHD {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:36:38 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-2e9d1f76-426b-457f-ae37-c1033cb8b192 tempest-CreateVolumesFromImageTest-2001993980 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:36:38 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-2e9d1f76-426b-457f-ae37-c1033cb8b192 tempest-CreateVolumesFromImageTest-2001993980 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:36:38 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-2e9d1f76-426b-457f-ae37-c1033cb8b192 tempest-CreateVolumesFromImageTest-2001993980 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:36:38 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-2e9d1f76-426b-457f-ae37-c1033cb8b192 tempest-CreateVolumesFromImageTest-2001993980 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:36:38 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-2e9d1f76-426b-457f-ae37-c1033cb8b192 tempest-CreateVolumesFromImageTest-2001993980 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:36:38 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-2e9d1f76-426b-457f-ae37-c1033cb8b192 tempest-CreateVolumesFromImageTest-2001993980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:36:38 devstack sudo[111789]: pam_unix(sudo:session): session closed for user root Jul 31 12:36:38 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-4d4857c6-7f2c-4347-a669-422badd56fc1 tempest-VolumeDependencyTests-442009576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-ca5d8c89-9ec6-4058-8d58-5c1e42ac9371.95aca6b6-cfbc-429a-908b-24083c170e76" returned: 0 in 0.552s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:36:38 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-4d4857c6-7f2c-4347-a669-422badd56fc1 tempest-VolumeDependencyTests-442009576 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ca5d8c89-9ec6-4058-8d58-5c1e42ac9371(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89182) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 12:36:38 devstack sudo[111804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 Jul 31 12:36:38 devstack sudo[111804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:36:38 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-5646cae9-ef4e-4c38-af5a-36cb435906e9 tempest-CreateVolumesFromImageTest-2001993980 None] Acquiring lock "cinder-de382ded-1065-4b8a-b7f1-3a8e7359e2cb-delete_volume" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:36:38 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cdd4b66-90a5-4327-bec6-fe895e143608]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:36:38 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-4d4857c6-7f2c-4347-a669-422badd56fc1 tempest-VolumeDependencyTests-442009576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-ca5d8c89-9ec6-4058-8d58-5c1e42ac9371 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:36:39 devstack sudo[111803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fb5cdb98-42f3-44c8-96fc-8688dce59e8e_0l8p8fozdevstack@QuobyteHD Jul 31 12:36:39 devstack sudo[111803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:36:39 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-5646cae9-ef4e-4c38-af5a-36cb435906e9 tempest-CreateVolumesFromImageTest-2001993980 None] Lock "cinder-de382ded-1065-4b8a-b7f1-3a8e7359e2cb-delete_volume" acquired by "delete_volume" :: waited 0.066s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:36:39 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-5646cae9-ef4e-4c38-af5a-36cb435906e9 tempest-CreateVolumesFromImageTest-2001993980 None] Acquiring lock "cinder-quobyte-de382ded-1065-4b8a-b7f1-3a8e7359e2cb" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:36:39 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-5646cae9-ef4e-4c38-af5a-36cb435906e9 tempest-CreateVolumesFromImageTest-2001993980 None] Lock "cinder-quobyte-de382ded-1065-4b8a-b7f1-3a8e7359e2cb" acquired by "delete_volume" :: waited 0.028s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:36:39 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[04c87080-fdf8-48f8-9711-df17f1381b01]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:36:39 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-5646cae9-ef4e-4c38-af5a-36cb435906e9 tempest-CreateVolumesFromImageTest-2001993980 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-de382ded-1065-4b8a-b7f1-3a8e7359e2cb {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:36:39 devstack sudo[111806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-ca5d8c89-9ec6-4058-8d58-5c1e42ac9371 Jul 31 12:36:39 devstack sudo[111806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:36:39 devstack sudo[111804]: pam_unix(sudo:session): session closed for user root Jul 31 12:36:39 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-2e9d1f76-426b-457f-ae37-c1033cb8b192 tempest-CreateVolumesFromImageTest-2001993980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2" returned: 0 in 0.374s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:36:39 devstack cinder-volume[89182]: DEBUG cinder.manager [None req-2e9d1f76-426b-457f-ae37-c1033cb8b192 tempest-CreateVolumesFromImageTest-2001993980 None] Notifying Schedulers of capabilities ... {{(pid=89182) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 12:36:39 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-2e9d1f76-426b-457f-ae37-c1033cb8b192 tempest-CreateVolumesFromImageTest-2001993980 None] Deleted volume successfully. Jul 31 12:36:39 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-2e9d1f76-426b-457f-ae37-c1033cb8b192 tempest-CreateVolumesFromImageTest-2001993980 None] Lock "cinder-eb52be29-5e59-462c-aba5-06d5175c8f6a-delete_volume" released by "delete_volume" :: held 1.583s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:36:39 devstack sudo[111803]: pam_unix(sudo:session): session closed for user root Jul 31 12:36:39 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-8140937c-52a2-47c9-89f0-b8ec56fa2a33 tempest-VolumeAndVolumeTypeFromImageTest-1209246421 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fb5cdb98-42f3-44c8-96fc-8688dce59e8e_0l8p8fozdevstack@QuobyteHD" returned: 0 in 0.613s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:36:39 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-8140937c-52a2-47c9-89f0-b8ec56fa2a33 tempest-VolumeAndVolumeTypeFromImageTest-1209246421 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fb5cdb98-42f3-44c8-96fc-8688dce59e8e_0l8p8fozdevstack@QuobyteHD {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:36:39 devstack sudo[111809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-de382ded-1065-4b8a-b7f1-3a8e7359e2cb Jul 31 12:36:39 devstack sudo[111809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:36:39 devstack sudo[111813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fb5cdb98-42f3-44c8-96fc-8688dce59e8e_0l8p8fozdevstack@QuobyteHD Jul 31 12:36:39 devstack sudo[111813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:36:39 devstack sudo[111806]: pam_unix(sudo:session): session closed for user root Jul 31 12:36:39 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-4d4857c6-7f2c-4347-a669-422badd56fc1 tempest-VolumeDependencyTests-442009576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-ca5d8c89-9ec6-4058-8d58-5c1e42ac9371" returned: 0 in 0.664s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:36:39 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-4d4857c6-7f2c-4347-a669-422badd56fc1 tempest-VolumeDependencyTests-442009576 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-ca5d8c89-9ec6-4058-8d58-5c1e42ac9371 {{(pid=89182) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Jul 31 12:36:39 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-4d4857c6-7f2c-4347-a669-422badd56fc1 tempest-VolumeDependencyTests-442009576 None] Creating direct copy from snapshot {{(pid=89182) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Jul 31 12:36:39 devstack cinder-volume[89182]: DEBUG cinder.utils [None req-4d4857c6-7f2c-4347-a669-422badd56fc1 tempest-VolumeDependencyTests-442009576 None] Path /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-8c784aa3-b637-4a2f-a70b-058a3b465b2a not found in is_blk_device check {{(pid=89182) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 31 12:36:39 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-4d4857c6-7f2c-4347-a669-422badd56fc1 tempest-VolumeDependencyTests-442009576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-ca5d8c89-9ec6-4058-8d58-5c1e42ac9371 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-8c784aa3-b637-4a2f-a70b-058a3b465b2a {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:36:39 devstack sudo[111819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-ca5d8c89-9ec6-4058-8d58-5c1e42ac9371 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-8c784aa3-b637-4a2f-a70b-058a3b465b2a Jul 31 12:36:39 devstack sudo[111819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:36:39 devstack sudo[111809]: pam_unix(sudo:session): session closed for user root Jul 31 12:36:39 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-5646cae9-ef4e-4c38-af5a-36cb435906e9 tempest-CreateVolumesFromImageTest-2001993980 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-de382ded-1065-4b8a-b7f1-3a8e7359e2cb" returned: 0 in 0.619s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:36:39 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-5646cae9-ef4e-4c38-af5a-36cb435906e9 tempest-CreateVolumesFromImageTest-2001993980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-de382ded-1065-4b8a-b7f1-3a8e7359e2cb {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:36:39 devstack sudo[111827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-de382ded-1065-4b8a-b7f1-3a8e7359e2cb Jul 31 12:36:39 devstack sudo[111827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:36:39 devstack sudo[111813]: pam_unix(sudo:session): session closed for user root Jul 31 12:36:39 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-8140937c-52a2-47c9-89f0-b8ec56fa2a33 tempest-VolumeAndVolumeTypeFromImageTest-1209246421 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fb5cdb98-42f3-44c8-96fc-8688dce59e8e_0l8p8fozdevstack@QuobyteHD" returned: 1 in 0.451s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:36:39 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-8140937c-52a2-47c9-89f0-b8ec56fa2a33 tempest-VolumeAndVolumeTypeFromImageTest-1209246421 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fb5cdb98-42f3-44c8-96fc-8688dce59e8e_0l8p8fozdevstack@QuobyteHD' failed. Not Retrying. {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 31 12:36:39 devstack cinder-volume[89182]: DEBUG cinder.image.image_utils [None req-8140937c-52a2-47c9-89f0-b8ec56fa2a33 tempest-VolumeAndVolumeTypeFromImageTest-1209246421 None] fb5cdb98-42f3-44c8-96fc-8688dce59e8e was raw, converting to qcow2 {{(pid=89182) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 31 12:36:39 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-8140937c-52a2-47c9-89f0-b8ec56fa2a33 tempest-VolumeAndVolumeTypeFromImageTest-1209246421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_fb5cdb98-42f3-44c8-96fc-8688dce59e8e_0l8p8fozdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-bd46497a-805f-4af2-bfb4-f52936694c17 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:36:39 devstack sudo[111829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_fb5cdb98-42f3-44c8-96fc-8688dce59e8e_0l8p8fozdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-bd46497a-805f-4af2-bfb4-f52936694c17 Jul 31 12:36:39 devstack sudo[111829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:36:40 devstack sudo[111827]: pam_unix(sudo:session): session closed for user root Jul 31 12:36:40 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-5646cae9-ef4e-4c38-af5a-36cb435906e9 tempest-CreateVolumesFromImageTest-2001993980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-de382ded-1065-4b8a-b7f1-3a8e7359e2cb" returned: 0 in 0.511s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:36:40 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-5646cae9-ef4e-4c38-af5a-36cb435906e9 tempest-CreateVolumesFromImageTest-2001993980 None] Lock "cinder-quobyte-de382ded-1065-4b8a-b7f1-3a8e7359e2cb" released by "delete_volume" :: held 1.228s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:36:40 devstack cinder-volume[89182]: DEBUG cinder.quota [None req-5646cae9-ef4e-4c38-af5a-36cb435906e9 tempest-CreateVolumesFromImageTest-2001993980 None] Created reservations ['d0d246ba-9de6-46d2-8514-ebb35dd0427b', '3f165d0f-0b25-42b3-a1a0-7961a2efe4f8', '618cd566-6b28-4917-b359-6d1c3378aa7e', '4ca85e71-9c44-4be4-b941-f7ad11aae7f6'] {{(pid=89182) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 12:36:40 devstack sudo[111829]: pam_unix(sudo:session): session closed for user root Jul 31 12:36:40 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-8140937c-52a2-47c9-89f0-b8ec56fa2a33 tempest-VolumeAndVolumeTypeFromImageTest-1209246421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_fb5cdb98-42f3-44c8-96fc-8688dce59e8e_0l8p8fozdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-bd46497a-805f-4af2-bfb4-f52936694c17" returned: 0 in 0.795s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:36:40 devstack cinder-volume[89182]: DEBUG cinder.image.image_utils [None req-8140937c-52a2-47c9-89f0-b8ec56fa2a33 tempest-VolumeAndVolumeTypeFromImageTest-1209246421 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_fb5cdb98-42f3-44c8-96fc-8688dce59e8e_0l8p8fozdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-bd46497a-805f-4af2-bfb4-f52936694c17 {{(pid=89182) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 31 12:36:40 devstack cinder-volume[89182]: INFO cinder.image.image_utils [None req-8140937c-52a2-47c9-89f0-b8ec56fa2a33 tempest-VolumeAndVolumeTypeFromImageTest-1209246421 None] Converted 0.00 MB image at 0.00 MB/s Jul 31 12:36:40 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-8140937c-52a2-47c9-89f0-b8ec56fa2a33 tempest-VolumeAndVolumeTypeFromImageTest-1209246421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-bd46497a-805f-4af2-bfb4-f52936694c17 1G {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:36:40 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-5646cae9-ef4e-4c38-af5a-36cb435906e9 tempest-CreateVolumesFromImageTest-2001993980 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:36:40 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-5646cae9-ef4e-4c38-af5a-36cb435906e9 tempest-CreateVolumesFromImageTest-2001993980 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:36:40 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-5646cae9-ef4e-4c38-af5a-36cb435906e9 tempest-CreateVolumesFromImageTest-2001993980 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:36:40 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-5646cae9-ef4e-4c38-af5a-36cb435906e9 tempest-CreateVolumesFromImageTest-2001993980 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:36:40 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-5646cae9-ef4e-4c38-af5a-36cb435906e9 tempest-CreateVolumesFromImageTest-2001993980 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:36:40 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-5646cae9-ef4e-4c38-af5a-36cb435906e9 tempest-CreateVolumesFromImageTest-2001993980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:36:40 devstack sudo[111845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-bd46497a-805f-4af2-bfb4-f52936694c17 1G Jul 31 12:36:40 devstack sudo[111845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:36:40 devstack sudo[111847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 Jul 31 12:36:40 devstack sudo[111847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:36:41 devstack sudo[111847]: pam_unix(sudo:session): session closed for user root Jul 31 12:36:41 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-5646cae9-ef4e-4c38-af5a-36cb435906e9 tempest-CreateVolumesFromImageTest-2001993980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2" returned: 0 in 0.528s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:36:41 devstack cinder-volume[89182]: DEBUG cinder.manager [None req-5646cae9-ef4e-4c38-af5a-36cb435906e9 tempest-CreateVolumesFromImageTest-2001993980 None] Notifying Schedulers of capabilities ... {{(pid=89182) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 12:36:41 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-5646cae9-ef4e-4c38-af5a-36cb435906e9 tempest-CreateVolumesFromImageTest-2001993980 None] Deleted volume successfully. Jul 31 12:36:41 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-5646cae9-ef4e-4c38-af5a-36cb435906e9 tempest-CreateVolumesFromImageTest-2001993980 None] Lock "cinder-de382ded-1065-4b8a-b7f1-3a8e7359e2cb-delete_volume" released by "delete_volume" :: held 2.418s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:36:41 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-8de4bb5d-2a6b-478e-a657-ad2144b314b8 tempest-CreateVolumesFromImageTest-2001993980 None] Acquiring lock "cinder-846a2715-7614-4e18-aa5f-dae7ccb77220-delete_volume" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:36:41 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-8de4bb5d-2a6b-478e-a657-ad2144b314b8 tempest-CreateVolumesFromImageTest-2001993980 None] Lock "cinder-846a2715-7614-4e18-aa5f-dae7ccb77220-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:36:41 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-8de4bb5d-2a6b-478e-a657-ad2144b314b8 tempest-CreateVolumesFromImageTest-2001993980 None] Acquiring lock "cinder-quobyte-846a2715-7614-4e18-aa5f-dae7ccb77220" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:36:41 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-8de4bb5d-2a6b-478e-a657-ad2144b314b8 tempest-CreateVolumesFromImageTest-2001993980 None] Lock "cinder-quobyte-846a2715-7614-4e18-aa5f-dae7ccb77220" acquired by "delete_volume" :: waited 0.038s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:36:41 devstack sudo[111845]: pam_unix(sudo:session): session closed for user root Jul 31 12:36:41 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-8140937c-52a2-47c9-89f0-b8ec56fa2a33 tempest-VolumeAndVolumeTypeFromImageTest-1209246421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-bd46497a-805f-4af2-bfb4-f52936694c17 1G" returned: 0 in 1.172s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:36:41 devstack cinder-volume[89182]: DEBUG cinder.volume.volume_utils [None req-8140937c-52a2-47c9-89f0-b8ec56fa2a33 tempest-VolumeAndVolumeTypeFromImageTest-1209246421 None] Downloaded image fb5cdb98-42f3-44c8-96fc-8688dce59e8e ((None, [{'url': 'file:///opt/stack/data/glance/images/fb5cdb98-42f3-44c8-96fc-8688dce59e8e', 'metadata': {}}])) to volume bd46497a-805f-4af2-bfb4-f52936694c17 successfully. {{(pid=89182) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 31 12:36:41 devstack cinder-volume[89182]: DEBUG cinder.image.image_utils [None req-8140937c-52a2-47c9-89f0-b8ec56fa2a33 tempest-VolumeAndVolumeTypeFromImageTest-1209246421 None] Temporary image fb5cdb98-42f3-44c8-96fc-8688dce59e8e for user 8be32e1fcde946c08a0d91eaa5d10ad0 is deleted. {{(pid=89182) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 31 12:36:41 devstack cinder-volume[89182]: DEBUG cinder.volume.volume_utils [None req-8140937c-52a2-47c9-89f0-b8ec56fa2a33 tempest-VolumeAndVolumeTypeFromImageTest-1209246421 None] Marking volume bd46497a-805f-4af2-bfb4-f52936694c17 as bootable. {{(pid=89182) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 31 12:36:41 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[07ff66fc-fbe3-4351-abb4-edff40f7dc2c]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:36:41 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-8de4bb5d-2a6b-478e-a657-ad2144b314b8 tempest-CreateVolumesFromImageTest-2001993980 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-846a2715-7614-4e18-aa5f-dae7ccb77220 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:36:41 devstack cinder-volume[89182]: DEBUG cinder.volume.flows.manager.create_volume [None req-8140937c-52a2-47c9-89f0-b8ec56fa2a33 tempest-VolumeAndVolumeTypeFromImageTest-1209246421 None] Copying metadata from image fb5cdb98-42f3-44c8-96fc-8688dce59e8e to bd46497a-805f-4af2-bfb4-f52936694c17. {{(pid=89182) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 31 12:36:41 devstack cinder-volume[89182]: DEBUG cinder.volume.flows.manager.create_volume [None req-8140937c-52a2-47c9-89f0-b8ec56fa2a33 tempest-VolumeAndVolumeTypeFromImageTest-1209246421 None] Creating volume glance metadata for volume bd46497a-805f-4af2-bfb4-f52936694c17 backed by image fb5cdb98-42f3-44c8-96fc-8688dce59e8e with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'fb5cdb98-42f3-44c8-96fc-8688dce59e8e', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'b793bbee0479dd6d8247b8cbfaeaa94b', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=89182) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 31 12:36:42 devstack sudo[111854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-846a2715-7614-4e18-aa5f-dae7ccb77220 Jul 31 12:36:42 devstack sudo[111854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:36:42 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-8140937c-52a2-47c9-89f0-b8ec56fa2a33 tempest-VolumeAndVolumeTypeFromImageTest-1209246421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40a1f057-3a29-4f3b-97a6-054a6fac2584) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bd46497a-805f-4af2-bfb4-f52936694c17', 'volume_size': 1, 'image_id': 'fb5cdb98-42f3-44c8-96fc-8688dce59e8e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fb5cdb98-42f3-44c8-96fc-8688dce59e8e', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'b793bbee0479dd6d8247b8cbfaeaa94b', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '04abb2055d2e4eef9ad2cf3c0f1c48b4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '4f58f8c2966709d6277b60b1ce2da56526a2ea80ed9088d9ae50a9db0f013a3b86efeee673c53d1057a0a5beefc32f0a6f03dbe6edee40ca87bbaa026a6960af', 'id': 'fb5cdb98-42f3-44c8-96fc-8688dce59e8e', 'created_at': datetime.datetime(2026, 7, 31, 10, 36, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 31, 10, 36, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fb5cdb98-42f3-44c8-96fc-8688dce59e8e/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:36:42 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-8140937c-52a2-47c9-89f0-b8ec56fa2a33 tempest-VolumeAndVolumeTypeFromImageTest-1209246421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bbbc09a3-00ea-46fc-99e2-2e5cfdb520fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:36:42 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-8140937c-52a2-47c9-89f0-b8ec56fa2a33 tempest-VolumeAndVolumeTypeFromImageTest-1209246421 None] Volume volume-bd46497a-805f-4af2-bfb4-f52936694c17 (bd46497a-805f-4af2-bfb4-f52936694c17): created successfully Jul 31 12:36:42 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-8140937c-52a2-47c9-89f0-b8ec56fa2a33 tempest-VolumeAndVolumeTypeFromImageTest-1209246421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bbbc09a3-00ea-46fc-99e2-2e5cfdb520fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:36:42 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-8140937c-52a2-47c9-89f0-b8ec56fa2a33 tempest-VolumeAndVolumeTypeFromImageTest-1209246421 None] Flow 'volume_create_manager' (0402ece3-216d-4915-a5a3-a16c707d7bb7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:36:42 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-8140937c-52a2-47c9-89f0-b8ec56fa2a33 tempest-VolumeAndVolumeTypeFromImageTest-1209246421 None] Created volume successfully. Jul 31 12:36:43 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-4af039ec-e5a3-4997-8f13-081df20ea212 tempest-VolumeAndVolumeTypeFromImageTest-1209246421 None] Acquiring lock "cinder-bd46497a-805f-4af2-bfb4-f52936694c17-delete_volume" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:36:43 devstack sudo[111854]: pam_unix(sudo:session): session closed for user root Jul 31 12:36:43 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-4af039ec-e5a3-4997-8f13-081df20ea212 tempest-VolumeAndVolumeTypeFromImageTest-1209246421 None] Lock "cinder-bd46497a-805f-4af2-bfb4-f52936694c17-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:36:43 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-8de4bb5d-2a6b-478e-a657-ad2144b314b8 tempest-CreateVolumesFromImageTest-2001993980 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-846a2715-7614-4e18-aa5f-dae7ccb77220" returned: 0 in 1.200s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:36:43 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-8de4bb5d-2a6b-478e-a657-ad2144b314b8 tempest-CreateVolumesFromImageTest-2001993980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-846a2715-7614-4e18-aa5f-dae7ccb77220 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:36:43 devstack sudo[111859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-846a2715-7614-4e18-aa5f-dae7ccb77220 Jul 31 12:36:43 devstack sudo[111859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:36:43 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-4af039ec-e5a3-4997-8f13-081df20ea212 tempest-VolumeAndVolumeTypeFromImageTest-1209246421 None] Acquiring lock "cinder-quobyte-bd46497a-805f-4af2-bfb4-f52936694c17" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:36:43 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-4af039ec-e5a3-4997-8f13-081df20ea212 tempest-VolumeAndVolumeTypeFromImageTest-1209246421 None] Lock "cinder-quobyte-bd46497a-805f-4af2-bfb4-f52936694c17" acquired by "delete_volume" :: waited 0.043s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:36:43 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[78dc63e8-e3af-4e14-b815-d52a6617a57b]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:36:43 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-4af039ec-e5a3-4997-8f13-081df20ea212 tempest-VolumeAndVolumeTypeFromImageTest-1209246421 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-bd46497a-805f-4af2-bfb4-f52936694c17 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:36:43 devstack sudo[111861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-bd46497a-805f-4af2-bfb4-f52936694c17 Jul 31 12:36:43 devstack sudo[111861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:36:44 devstack sudo[111859]: pam_unix(sudo:session): session closed for user root Jul 31 12:36:44 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-8de4bb5d-2a6b-478e-a657-ad2144b314b8 tempest-CreateVolumesFromImageTest-2001993980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-846a2715-7614-4e18-aa5f-dae7ccb77220" returned: 0 in 1.240s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:36:44 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-8de4bb5d-2a6b-478e-a657-ad2144b314b8 tempest-CreateVolumesFromImageTest-2001993980 None] Lock "cinder-quobyte-846a2715-7614-4e18-aa5f-dae7ccb77220" released by "delete_volume" :: held 2.592s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:36:44 devstack sudo[111861]: pam_unix(sudo:session): session closed for user root Jul 31 12:36:44 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-4af039ec-e5a3-4997-8f13-081df20ea212 tempest-VolumeAndVolumeTypeFromImageTest-1209246421 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-bd46497a-805f-4af2-bfb4-f52936694c17" returned: 0 in 1.093s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:36:44 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-4af039ec-e5a3-4997-8f13-081df20ea212 tempest-VolumeAndVolumeTypeFromImageTest-1209246421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-bd46497a-805f-4af2-bfb4-f52936694c17 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:36:44 devstack sudo[111901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-bd46497a-805f-4af2-bfb4-f52936694c17 Jul 31 12:36:44 devstack sudo[111901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:36:44 devstack cinder-volume[89182]: DEBUG cinder.quota [None req-8de4bb5d-2a6b-478e-a657-ad2144b314b8 tempest-CreateVolumesFromImageTest-2001993980 None] Created reservations ['ce504b08-286f-4129-9ea7-26f725ab9ab0', '82ba4ef9-d0b2-4077-bab5-fcfd507e8165', '86c45256-2db0-4377-8e54-59dba28b5b95', '1b1081e4-d50d-40d4-9eaa-36accb427eb9'] {{(pid=89182) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 12:36:44 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-8de4bb5d-2a6b-478e-a657-ad2144b314b8 tempest-CreateVolumesFromImageTest-2001993980 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:36:44 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-8de4bb5d-2a6b-478e-a657-ad2144b314b8 tempest-CreateVolumesFromImageTest-2001993980 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:36:44 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-8de4bb5d-2a6b-478e-a657-ad2144b314b8 tempest-CreateVolumesFromImageTest-2001993980 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:36:44 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-8de4bb5d-2a6b-478e-a657-ad2144b314b8 tempest-CreateVolumesFromImageTest-2001993980 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:36:44 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-8de4bb5d-2a6b-478e-a657-ad2144b314b8 tempest-CreateVolumesFromImageTest-2001993980 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:36:44 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-8de4bb5d-2a6b-478e-a657-ad2144b314b8 tempest-CreateVolumesFromImageTest-2001993980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:36:44 devstack sudo[111904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 Jul 31 12:36:44 devstack sudo[111904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:36:45 devstack sudo[111901]: pam_unix(sudo:session): session closed for user root Jul 31 12:36:45 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-4af039ec-e5a3-4997-8f13-081df20ea212 tempest-VolumeAndVolumeTypeFromImageTest-1209246421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-bd46497a-805f-4af2-bfb4-f52936694c17" returned: 0 in 0.850s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:36:45 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-4af039ec-e5a3-4997-8f13-081df20ea212 tempest-VolumeAndVolumeTypeFromImageTest-1209246421 None] Lock "cinder-quobyte-bd46497a-805f-4af2-bfb4-f52936694c17" released by "delete_volume" :: held 2.071s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:36:45 devstack sudo[111904]: pam_unix(sudo:session): session closed for user root Jul 31 12:36:45 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-8de4bb5d-2a6b-478e-a657-ad2144b314b8 tempest-CreateVolumesFromImageTest-2001993980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2" returned: 0 in 0.608s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:36:45 devstack cinder-volume[89182]: DEBUG cinder.manager [None req-8de4bb5d-2a6b-478e-a657-ad2144b314b8 tempest-CreateVolumesFromImageTest-2001993980 None] Notifying Schedulers of capabilities ... {{(pid=89182) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 12:36:45 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-8de4bb5d-2a6b-478e-a657-ad2144b314b8 tempest-CreateVolumesFromImageTest-2001993980 None] Deleted volume successfully. Jul 31 12:36:45 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-8de4bb5d-2a6b-478e-a657-ad2144b314b8 tempest-CreateVolumesFromImageTest-2001993980 None] Lock "cinder-846a2715-7614-4e18-aa5f-dae7ccb77220-delete_volume" released by "delete_volume" :: held 3.918s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:36:45 devstack cinder-volume[89182]: DEBUG cinder.quota [None req-4af039ec-e5a3-4997-8f13-081df20ea212 tempest-VolumeAndVolumeTypeFromImageTest-1209246421 None] Created reservations ['9f850e3d-ed35-4788-9180-3a307bbf6593', 'c2042f0d-36fd-41dc-af1c-0879ded7e835', '26bd549f-d248-428a-a628-21d0bcfe9837', '57f36bca-0368-462c-859a-8a7022c5fa07'] {{(pid=89182) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 12:36:45 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-2ecc22c1-def8-4833-9763-fea039226692 tempest-CreateVolumesFromImageTest-2001993980 None] Acquiring lock "cinder-0c001e8c-51c6-4c27-8268-0100fb438ba5-delete_volume" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:36:45 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-2ecc22c1-def8-4833-9763-fea039226692 tempest-CreateVolumesFromImageTest-2001993980 None] Lock "cinder-0c001e8c-51c6-4c27-8268-0100fb438ba5-delete_volume" acquired by "delete_volume" :: waited 0.117s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:36:45 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-4af039ec-e5a3-4997-8f13-081df20ea212 tempest-VolumeAndVolumeTypeFromImageTest-1209246421 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:36:45 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-4af039ec-e5a3-4997-8f13-081df20ea212 tempest-VolumeAndVolumeTypeFromImageTest-1209246421 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:36:45 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-4af039ec-e5a3-4997-8f13-081df20ea212 tempest-VolumeAndVolumeTypeFromImageTest-1209246421 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:36:45 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-4af039ec-e5a3-4997-8f13-081df20ea212 tempest-VolumeAndVolumeTypeFromImageTest-1209246421 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:36:45 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-4af039ec-e5a3-4997-8f13-081df20ea212 tempest-VolumeAndVolumeTypeFromImageTest-1209246421 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:36:45 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-4af039ec-e5a3-4997-8f13-081df20ea212 tempest-VolumeAndVolumeTypeFromImageTest-1209246421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:36:46 devstack sudo[111910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 Jul 31 12:36:46 devstack sudo[111910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:36:46 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-2ecc22c1-def8-4833-9763-fea039226692 tempest-CreateVolumesFromImageTest-2001993980 None] Acquiring lock "cinder-quobyte-0c001e8c-51c6-4c27-8268-0100fb438ba5" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:36:46 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-2ecc22c1-def8-4833-9763-fea039226692 tempest-CreateVolumesFromImageTest-2001993980 None] Lock "cinder-quobyte-0c001e8c-51c6-4c27-8268-0100fb438ba5" acquired by "delete_volume" :: waited 0.053s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:36:46 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5078279-ad7e-4e22-90b7-0bcec7b28ebb]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:36:46 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-2ecc22c1-def8-4833-9763-fea039226692 tempest-CreateVolumesFromImageTest-2001993980 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0c001e8c-51c6-4c27-8268-0100fb438ba5 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:36:46 devstack sudo[111912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0c001e8c-51c6-4c27-8268-0100fb438ba5 Jul 31 12:36:46 devstack sudo[111912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:36:46 devstack sudo[111910]: pam_unix(sudo:session): session closed for user root Jul 31 12:36:46 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-4af039ec-e5a3-4997-8f13-081df20ea212 tempest-VolumeAndVolumeTypeFromImageTest-1209246421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2" returned: 0 in 0.697s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:36:46 devstack cinder-volume[89182]: DEBUG cinder.manager [None req-4af039ec-e5a3-4997-8f13-081df20ea212 tempest-VolumeAndVolumeTypeFromImageTest-1209246421 None] Notifying Schedulers of capabilities ... {{(pid=89182) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 12:36:46 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-4af039ec-e5a3-4997-8f13-081df20ea212 tempest-VolumeAndVolumeTypeFromImageTest-1209246421 None] Deleted volume successfully. Jul 31 12:36:46 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-4af039ec-e5a3-4997-8f13-081df20ea212 tempest-VolumeAndVolumeTypeFromImageTest-1209246421 None] Lock "cinder-bd46497a-805f-4af2-bfb4-f52936694c17-delete_volume" released by "delete_volume" :: held 3.682s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:36:46 devstack sudo[111819]: pam_unix(sudo:session): session closed for user root Jul 31 12:36:46 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-4d4857c6-7f2c-4347-a669-422badd56fc1 tempest-VolumeDependencyTests-442009576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-ca5d8c89-9ec6-4058-8d58-5c1e42ac9371 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-8c784aa3-b637-4a2f-a70b-058a3b465b2a" returned: 0 in 7.217s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:36:46 devstack cinder-volume[89182]: DEBUG cinder.image.image_utils [None req-4d4857c6-7f2c-4347-a669-422badd56fc1 tempest-VolumeDependencyTests-442009576 None] Image conversion details: src /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-ca5d8c89-9ec6-4058-8d58-5c1e42ac9371, size 1024.00 MB, duration 7.22 sec, destination /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-8c784aa3-b637-4a2f-a70b-058a3b465b2a {{(pid=89182) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 31 12:36:46 devstack cinder-volume[89182]: INFO cinder.image.image_utils [None req-4d4857c6-7f2c-4347-a669-422badd56fc1 tempest-VolumeDependencyTests-442009576 None] Converted 1024.00 MB image at 141.86 MB/s Jul 31 12:36:46 devstack cinder-volume[89182]: WARNING cinder.volume.drivers.remotefs [None req-4d4857c6-7f2c-4347-a669-422badd56fc1 tempest-VolumeDependencyTests-442009576 None] /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-8c784aa3-b637-4a2f-a70b-058a3b465b2a is being set with open permissions: ugo+rw Jul 31 12:36:46 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-4d4857c6-7f2c-4347-a669-422badd56fc1 tempest-VolumeDependencyTests-442009576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-8c784aa3-b637-4a2f-a70b-058a3b465b2a {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:36:46 devstack sudo[111918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-8c784aa3-b637-4a2f-a70b-058a3b465b2a Jul 31 12:36:46 devstack sudo[111918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:36:47 devstack sudo[111912]: pam_unix(sudo:session): session closed for user root Jul 31 12:36:47 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-2ecc22c1-def8-4833-9763-fea039226692 tempest-CreateVolumesFromImageTest-2001993980 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0c001e8c-51c6-4c27-8268-0100fb438ba5" returned: 0 in 0.916s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:36:47 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-2ecc22c1-def8-4833-9763-fea039226692 tempest-CreateVolumesFromImageTest-2001993980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0c001e8c-51c6-4c27-8268-0100fb438ba5 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:36:47 devstack sudo[111924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0c001e8c-51c6-4c27-8268-0100fb438ba5 Jul 31 12:36:47 devstack sudo[111924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:36:47 devstack sudo[111918]: pam_unix(sudo:session): session closed for user root Jul 31 12:36:47 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-4d4857c6-7f2c-4347-a669-422badd56fc1 tempest-VolumeDependencyTests-442009576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-8c784aa3-b637-4a2f-a70b-058a3b465b2a" returned: 0 in 0.360s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:36:47 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-4d4857c6-7f2c-4347-a669-422badd56fc1 tempest-VolumeDependencyTests-442009576 None] Lock "cinder-quobyte-8c784aa3-b637-4a2f-a70b-058a3b465b2a" released by "_copy_volume_from_snapshot" :: held 8.936s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:36:47 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-4d4857c6-7f2c-4347-a669-422badd56fc1 tempest-VolumeDependencyTests-442009576 None] Lock "cinder-quobyte-95aca6b6-cfbc-429a-908b-24083c170e76-8c784aa3-b637-4a2f-a70b-058a3b465b2a" released by "_create_volume_from_snapshot" :: held 9.071s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:36:47 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-4d4857c6-7f2c-4347-a669-422badd56fc1 tempest-VolumeDependencyTests-442009576 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.090s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:36:47 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-4d4857c6-7f2c-4347-a669-422badd56fc1 tempest-VolumeDependencyTests-442009576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (edd4b6c9-e468-41e2-80cc-d08d244f3acb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8c784aa3-b637-4a2f-a70b-058a3b465b2a', 'volume_size': 1, 'snapshot_id': '95aca6b6-cfbc-429a-908b-24083c170e76'}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:36:47 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-4d4857c6-7f2c-4347-a669-422badd56fc1 tempest-VolumeDependencyTests-442009576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb708c82-79fe-44e2-91ae-84632d00b5d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:36:47 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-4d4857c6-7f2c-4347-a669-422badd56fc1 tempest-VolumeDependencyTests-442009576 None] Volume volume-8c784aa3-b637-4a2f-a70b-058a3b465b2a (8c784aa3-b637-4a2f-a70b-058a3b465b2a): created successfully Jul 31 12:36:47 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-4d4857c6-7f2c-4347-a669-422badd56fc1 tempest-VolumeDependencyTests-442009576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb708c82-79fe-44e2-91ae-84632d00b5d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:36:47 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-4d4857c6-7f2c-4347-a669-422badd56fc1 tempest-VolumeDependencyTests-442009576 None] Flow 'volume_create_manager' (43f62fe0-e600-4fa6-a19d-3e6feccfca34) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:36:47 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-4d4857c6-7f2c-4347-a669-422badd56fc1 tempest-VolumeDependencyTests-442009576 None] Created volume successfully. Jul 31 12:36:47 devstack sudo[111924]: pam_unix(sudo:session): session closed for user root Jul 31 12:36:47 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-2ecc22c1-def8-4833-9763-fea039226692 tempest-CreateVolumesFromImageTest-2001993980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0c001e8c-51c6-4c27-8268-0100fb438ba5" returned: 0 in 0.392s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:36:47 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-2ecc22c1-def8-4833-9763-fea039226692 tempest-CreateVolumesFromImageTest-2001993980 None] Lock "cinder-quobyte-0c001e8c-51c6-4c27-8268-0100fb438ba5" released by "delete_volume" :: held 1.426s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:36:47 devstack cinder-volume[89182]: DEBUG cinder.quota [None req-2ecc22c1-def8-4833-9763-fea039226692 tempest-CreateVolumesFromImageTest-2001993980 None] Created reservations ['d28b5b35-e01b-4bc8-aa4a-021d8eeb6e82', '4379701d-7eb8-463d-a428-b2ae59728887', 'd774afcb-1054-4adb-8e8f-f1d3d6c48a17', '6fc7c0d4-0063-47fc-acec-d4f3156554ff'] {{(pid=89182) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 12:36:47 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-2ecc22c1-def8-4833-9763-fea039226692 tempest-CreateVolumesFromImageTest-2001993980 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:36:47 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-2ecc22c1-def8-4833-9763-fea039226692 tempest-CreateVolumesFromImageTest-2001993980 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:36:47 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-2ecc22c1-def8-4833-9763-fea039226692 tempest-CreateVolumesFromImageTest-2001993980 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:36:47 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-2ecc22c1-def8-4833-9763-fea039226692 tempest-CreateVolumesFromImageTest-2001993980 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:36:47 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-2ecc22c1-def8-4833-9763-fea039226692 tempest-CreateVolumesFromImageTest-2001993980 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:36:47 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-2ecc22c1-def8-4833-9763-fea039226692 tempest-CreateVolumesFromImageTest-2001993980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:36:47 devstack sudo[111928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 Jul 31 12:36:47 devstack sudo[111928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:36:48 devstack sudo[111928]: pam_unix(sudo:session): session closed for user root Jul 31 12:36:48 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-2ecc22c1-def8-4833-9763-fea039226692 tempest-CreateVolumesFromImageTest-2001993980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2" returned: 0 in 0.421s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:36:48 devstack cinder-volume[89182]: DEBUG cinder.manager [None req-2ecc22c1-def8-4833-9763-fea039226692 tempest-CreateVolumesFromImageTest-2001993980 None] Notifying Schedulers of capabilities ... {{(pid=89182) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 12:36:48 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-2ecc22c1-def8-4833-9763-fea039226692 tempest-CreateVolumesFromImageTest-2001993980 None] Deleted volume successfully. Jul 31 12:36:48 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-2ecc22c1-def8-4833-9763-fea039226692 tempest-CreateVolumesFromImageTest-2001993980 None] Lock "cinder-0c001e8c-51c6-4c27-8268-0100fb438ba5-delete_volume" released by "delete_volume" :: held 2.323s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:36:48 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-7793ad3b-d5b8-4abf-b9d8-e9d81f3f7627 tempest-CreateVolumesFromImageTest-2001993980 None] Acquiring lock "cinder-d18571fa-46a5-4f67-b558-6d9c5df3017a-delete_volume" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:36:48 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-7793ad3b-d5b8-4abf-b9d8-e9d81f3f7627 tempest-CreateVolumesFromImageTest-2001993980 None] Lock "cinder-d18571fa-46a5-4f67-b558-6d9c5df3017a-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:36:48 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-7793ad3b-d5b8-4abf-b9d8-e9d81f3f7627 tempest-CreateVolumesFromImageTest-2001993980 None] Acquiring lock "cinder-quobyte-d18571fa-46a5-4f67-b558-6d9c5df3017a" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:36:48 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-7793ad3b-d5b8-4abf-b9d8-e9d81f3f7627 tempest-CreateVolumesFromImageTest-2001993980 None] Lock "cinder-quobyte-d18571fa-46a5-4f67-b558-6d9c5df3017a" acquired by "delete_volume" :: waited 0.029s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:36:48 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[92d78571-540d-453c-ab50-b6e92c985801]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:36:48 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-7793ad3b-d5b8-4abf-b9d8-e9d81f3f7627 tempest-CreateVolumesFromImageTest-2001993980 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-d18571fa-46a5-4f67-b558-6d9c5df3017a {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:36:48 devstack sudo[111931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-d18571fa-46a5-4f67-b558-6d9c5df3017a Jul 31 12:36:48 devstack sudo[111931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:36:48 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-a58eece6-6684-481c-a1ad-ec836179de66 tempest-VolumeDependencyTests-442009576 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:36:48 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-a58eece6-6684-481c-a1ad-ec836179de66 tempest-VolumeDependencyTests-442009576 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:36:48 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-a58eece6-6684-481c-a1ad-ec836179de66 tempest-VolumeDependencyTests-442009576 None] Creating offline snapshot 24ff7149-be4a-498c-a2d4-e93e5e951ca0 of volume 8c784aa3-b637-4a2f-a70b-058a3b465b2a {{(pid=89182) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 31 12:36:48 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c53442d-2110-455a-8a08-de1163793ab9]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:36:48 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-a58eece6-6684-481c-a1ad-ec836179de66 tempest-VolumeDependencyTests-442009576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-8c784aa3-b637-4a2f-a70b-058a3b465b2a {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:36:48 devstack sudo[111933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-8c784aa3-b637-4a2f-a70b-058a3b465b2a Jul 31 12:36:48 devstack sudo[111933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:36:49 devstack sudo[111931]: pam_unix(sudo:session): session closed for user root Jul 31 12:36:49 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-7793ad3b-d5b8-4abf-b9d8-e9d81f3f7627 tempest-CreateVolumesFromImageTest-2001993980 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-d18571fa-46a5-4f67-b558-6d9c5df3017a" returned: 0 in 0.559s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:36:49 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-7793ad3b-d5b8-4abf-b9d8-e9d81f3f7627 tempest-CreateVolumesFromImageTest-2001993980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-d18571fa-46a5-4f67-b558-6d9c5df3017a {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:36:49 devstack sudo[111938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-d18571fa-46a5-4f67-b558-6d9c5df3017a Jul 31 12:36:49 devstack sudo[111938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:36:49 devstack sudo[111933]: pam_unix(sudo:session): session closed for user root Jul 31 12:36:49 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-a58eece6-6684-481c-a1ad-ec836179de66 tempest-VolumeDependencyTests-442009576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-8c784aa3-b637-4a2f-a70b-058a3b465b2a" returned: 0 in 0.500s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:36:49 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-a58eece6-6684-481c-a1ad-ec836179de66 tempest-VolumeDependencyTests-442009576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-8c784aa3-b637-4a2f-a70b-058a3b465b2a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-8c784aa3-b637-4a2f-a70b-058a3b465b2a.24ff7149-be4a-498c-a2d4-e93e5e951ca0 1G {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:36:49 devstack sudo[111938]: pam_unix(sudo:session): session closed for user root Jul 31 12:36:49 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-7793ad3b-d5b8-4abf-b9d8-e9d81f3f7627 tempest-CreateVolumesFromImageTest-2001993980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-d18571fa-46a5-4f67-b558-6d9c5df3017a" returned: 0 in 0.318s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:36:49 devstack sudo[111944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-8c784aa3-b637-4a2f-a70b-058a3b465b2a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-8c784aa3-b637-4a2f-a70b-058a3b465b2a.24ff7149-be4a-498c-a2d4-e93e5e951ca0 1G Jul 31 12:36:49 devstack sudo[111944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:36:49 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-7793ad3b-d5b8-4abf-b9d8-e9d81f3f7627 tempest-CreateVolumesFromImageTest-2001993980 None] Lock "cinder-quobyte-d18571fa-46a5-4f67-b558-6d9c5df3017a" released by "delete_volume" :: held 0.962s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:36:49 devstack cinder-volume[89182]: DEBUG cinder.quota [None req-7793ad3b-d5b8-4abf-b9d8-e9d81f3f7627 tempest-CreateVolumesFromImageTest-2001993980 None] Created reservations ['73efecfb-570c-4e4c-9b69-f26c3d05d3fe', 'b0b4cd55-b093-4f9e-ae76-0d2bea2ee0ba', '71708672-5e1b-4ac8-ae07-e79bee0bc3e1', '4e2f544d-ee7b-4a87-8e4a-4131717fe9b6'] {{(pid=89182) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 12:36:49 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-7793ad3b-d5b8-4abf-b9d8-e9d81f3f7627 tempest-CreateVolumesFromImageTest-2001993980 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:36:49 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-7793ad3b-d5b8-4abf-b9d8-e9d81f3f7627 tempest-CreateVolumesFromImageTest-2001993980 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:36:49 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-7793ad3b-d5b8-4abf-b9d8-e9d81f3f7627 tempest-CreateVolumesFromImageTest-2001993980 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:36:49 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-7793ad3b-d5b8-4abf-b9d8-e9d81f3f7627 tempest-CreateVolumesFromImageTest-2001993980 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:36:49 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-7793ad3b-d5b8-4abf-b9d8-e9d81f3f7627 tempest-CreateVolumesFromImageTest-2001993980 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:36:49 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-7793ad3b-d5b8-4abf-b9d8-e9d81f3f7627 tempest-CreateVolumesFromImageTest-2001993980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:36:49 devstack sudo[111946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 Jul 31 12:36:49 devstack sudo[111946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:36:49 devstack sudo[111946]: pam_unix(sudo:session): session closed for user root Jul 31 12:36:49 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-7793ad3b-d5b8-4abf-b9d8-e9d81f3f7627 tempest-CreateVolumesFromImageTest-2001993980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2" returned: 0 in 0.354s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:36:49 devstack cinder-volume[89182]: DEBUG cinder.manager [None req-7793ad3b-d5b8-4abf-b9d8-e9d81f3f7627 tempest-CreateVolumesFromImageTest-2001993980 None] Notifying Schedulers of capabilities ... {{(pid=89182) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 12:36:49 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-7793ad3b-d5b8-4abf-b9d8-e9d81f3f7627 tempest-CreateVolumesFromImageTest-2001993980 None] Deleted volume successfully. Jul 31 12:36:49 devstack sudo[111944]: pam_unix(sudo:session): session closed for user root Jul 31 12:36:49 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-a58eece6-6684-481c-a1ad-ec836179de66 tempest-VolumeDependencyTests-442009576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-8c784aa3-b637-4a2f-a70b-058a3b465b2a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-8c784aa3-b637-4a2f-a70b-058a3b465b2a.24ff7149-be4a-498c-a2d4-e93e5e951ca0 1G" returned: 0 in 0.609s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:36:49 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-a58eece6-6684-481c-a1ad-ec836179de66 tempest-VolumeDependencyTests-442009576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8c784aa3-b637-4a2f-a70b-058a3b465b2a -F qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-8c784aa3-b637-4a2f-a70b-058a3b465b2a.24ff7149-be4a-498c-a2d4-e93e5e951ca0 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:36:49 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-7793ad3b-d5b8-4abf-b9d8-e9d81f3f7627 tempest-CreateVolumesFromImageTest-2001993980 None] Lock "cinder-d18571fa-46a5-4f67-b558-6d9c5df3017a-delete_volume" released by "delete_volume" :: held 1.643s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:36:49 devstack sudo[111956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8c784aa3-b637-4a2f-a70b-058a3b465b2a -F qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-8c784aa3-b637-4a2f-a70b-058a3b465b2a.24ff7149-be4a-498c-a2d4-e93e5e951ca0 Jul 31 12:36:49 devstack sudo[111956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:36:50 devstack sudo[111956]: pam_unix(sudo:session): session closed for user root Jul 31 12:36:50 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-a58eece6-6684-481c-a1ad-ec836179de66 tempest-VolumeDependencyTests-442009576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8c784aa3-b637-4a2f-a70b-058a3b465b2a -F qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-8c784aa3-b637-4a2f-a70b-058a3b465b2a.24ff7149-be4a-498c-a2d4-e93e5e951ca0" returned: 0 in 0.384s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:36:50 devstack cinder-volume[89182]: WARNING cinder.volume.drivers.remotefs [None req-a58eece6-6684-481c-a1ad-ec836179de66 tempest-VolumeDependencyTests-442009576 None] /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-8c784aa3-b637-4a2f-a70b-058a3b465b2a.24ff7149-be4a-498c-a2d4-e93e5e951ca0 is being set with open permissions: ugo+rw Jul 31 12:36:50 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-a58eece6-6684-481c-a1ad-ec836179de66 tempest-VolumeDependencyTests-442009576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-8c784aa3-b637-4a2f-a70b-058a3b465b2a.24ff7149-be4a-498c-a2d4-e93e5e951ca0 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:36:50 devstack sudo[111965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-8c784aa3-b637-4a2f-a70b-058a3b465b2a.24ff7149-be4a-498c-a2d4-e93e5e951ca0 Jul 31 12:36:50 devstack sudo[111965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:36:50 devstack sudo[111965]: pam_unix(sudo:session): session closed for user root Jul 31 12:36:50 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-a58eece6-6684-481c-a1ad-ec836179de66 tempest-VolumeDependencyTests-442009576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-8c784aa3-b637-4a2f-a70b-058a3b465b2a.24ff7149-be4a-498c-a2d4-e93e5e951ca0" returned: 0 in 0.292s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:36:50 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-a58eece6-6684-481c-a1ad-ec836179de66 tempest-VolumeDependencyTests-442009576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-8c784aa3-b637-4a2f-a70b-058a3b465b2a.info {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:36:50 devstack sudo[111968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-8c784aa3-b637-4a2f-a70b-058a3b465b2a.info Jul 31 12:36:50 devstack sudo[111968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:36:50 devstack sudo[111968]: pam_unix(sudo:session): session closed for user root Jul 31 12:36:50 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-a58eece6-6684-481c-a1ad-ec836179de66 tempest-VolumeDependencyTests-442009576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-8c784aa3-b637-4a2f-a70b-058a3b465b2a.info" returned: 0 in 0.350s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:36:50 devstack cinder-volume[89182]: WARNING cinder.volume.drivers.remotefs [None req-a58eece6-6684-481c-a1ad-ec836179de66 tempest-VolumeDependencyTests-442009576 None] /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-8c784aa3-b637-4a2f-a70b-058a3b465b2a.info is being set with open permissions: ugo+rw Jul 31 12:36:50 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-a58eece6-6684-481c-a1ad-ec836179de66 tempest-VolumeDependencyTests-442009576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-8c784aa3-b637-4a2f-a70b-058a3b465b2a.info {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:36:51 devstack sudo[111971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-8c784aa3-b637-4a2f-a70b-058a3b465b2a.info Jul 31 12:36:51 devstack sudo[111971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:36:51 devstack sudo[111971]: pam_unix(sudo:session): session closed for user root Jul 31 12:36:51 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-a58eece6-6684-481c-a1ad-ec836179de66 tempest-VolumeDependencyTests-442009576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-8c784aa3-b637-4a2f-a70b-058a3b465b2a.info" returned: 0 in 0.287s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:36:51 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-a58eece6-6684-481c-a1ad-ec836179de66 tempest-VolumeDependencyTests-442009576 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.535s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:36:51 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-a58eece6-6684-481c-a1ad-ec836179de66 tempest-VolumeDependencyTests-442009576 None] Create snapshot completed successfully Jul 31 12:36:52 devstack cinder-volume[89182]: DEBUG cinder.volume.flows.manager.create_volume [None req-79a5b460-f9af-4bb1-924c-49b3ce154548 tempest-VolumeDependencyTests-442009576 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89182) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 12:36:52 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-79a5b460-f9af-4bb1-924c-49b3ce154548 tempest-VolumeDependencyTests-442009576 None] Flow 'volume_create_manager' (95561735-bd29-46f1-8f99-4fbbc9c81135) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:36:52 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-79a5b460-f9af-4bb1-924c-49b3ce154548 tempest-VolumeDependencyTests-442009576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a769a17-3c36-44de-97fb-d07ae36ed92b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:36:52 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-79a5b460-f9af-4bb1-924c-49b3ce154548 tempest-VolumeDependencyTests-442009576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a769a17-3c36-44de-97fb-d07ae36ed92b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:36:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-89751718',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42c40d21-294a-47d6-8a4b-e3f75f09845b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c622d586c4c9404ead8c06d764810df1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:36:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=24ff7149-be4a-498c-a2d4-e93e5e951ca0,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:36:53Z,use_quota=True,user_id='cfc528fe8ec2487bb4171d283c222b1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:36:52 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-79a5b460-f9af-4bb1-924c-49b3ce154548 tempest-VolumeDependencyTests-442009576 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (385e464a-bdc2-4010-97ea-6c446d38343f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:36:52 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-79a5b460-f9af-4bb1-924c-49b3ce154548 tempest-VolumeDependencyTests-442009576 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (385e464a-bdc2-4010-97ea-6c446d38343f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:36:52 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-79a5b460-f9af-4bb1-924c-49b3ce154548 tempest-VolumeDependencyTests-442009576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5f4b36a-f95c-4b7e-bfb5-237c9bf2ca55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:36:52 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-79a5b460-f9af-4bb1-924c-49b3ce154548 tempest-VolumeDependencyTests-442009576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5f4b36a-f95c-4b7e-bfb5-237c9bf2ca55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '42c40d21-294a-47d6-8a4b-e3f75f09845b', 'volume_name': 'volume-42c40d21-294a-47d6-8a4b-e3f75f09845b', 'volume_size': 1, 'snapshot_id': '24ff7149-be4a-498c-a2d4-e93e5e951ca0'}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:36:52 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-79a5b460-f9af-4bb1-924c-49b3ce154548 tempest-VolumeDependencyTests-442009576 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a3e4e42-509b-4ca3-adf2-6d606cd57be4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:36:52 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-79a5b460-f9af-4bb1-924c-49b3ce154548 tempest-VolumeDependencyTests-442009576 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a3e4e42-509b-4ca3-adf2-6d606cd57be4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:36:52 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-79a5b460-f9af-4bb1-924c-49b3ce154548 tempest-VolumeDependencyTests-442009576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a61a4361-6811-46f1-a4e6-a7492876e0c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:36:52 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-79a5b460-f9af-4bb1-924c-49b3ce154548 tempest-VolumeDependencyTests-442009576 None] Volume 42c40d21-294a-47d6-8a4b-e3f75f09845b: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-42c40d21-294a-47d6-8a4b-e3f75f09845b', 'volume_size': 1, 'snapshot_id': '24ff7149-be4a-498c-a2d4-e93e5e951ca0'} Jul 31 12:36:52 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-79a5b460-f9af-4bb1-924c-49b3ce154548 tempest-VolumeDependencyTests-442009576 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:36:52 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-79a5b460-f9af-4bb1-924c-49b3ce154548 tempest-VolumeDependencyTests-442009576 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:36:52 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-79a5b460-f9af-4bb1-924c-49b3ce154548 tempest-VolumeDependencyTests-442009576 None] Acquiring lock "cinder-quobyte-24ff7149-be4a-498c-a2d4-e93e5e951ca0-42c40d21-294a-47d6-8a4b-e3f75f09845b" by "_create_volume_from_snapshot" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:36:52 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-79a5b460-f9af-4bb1-924c-49b3ce154548 tempest-VolumeDependencyTests-442009576 None] Lock "cinder-quobyte-24ff7149-be4a-498c-a2d4-e93e5e951ca0-42c40d21-294a-47d6-8a4b-e3f75f09845b" acquired by "_create_volume_from_snapshot" :: waited 0.055s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:36:52 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-79a5b460-f9af-4bb1-924c-49b3ce154548 tempest-VolumeDependencyTests-442009576 None] Creating volume 42c40d21-294a-47d6-8a4b-e3f75f09845b from snapshot 24ff7149-be4a-498c-a2d4-e93e5e951ca0 {{(pid=89182) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 31 12:36:52 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-79a5b460-f9af-4bb1-924c-49b3ce154548 tempest-VolumeDependencyTests-442009576 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:36:52 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-79a5b460-f9af-4bb1-924c-49b3ce154548 tempest-VolumeDependencyTests-442009576 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:36:52 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-79a5b460-f9af-4bb1-924c-49b3ce154548 tempest-VolumeDependencyTests-442009576 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:36:52 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-79a5b460-f9af-4bb1-924c-49b3ce154548 tempest-VolumeDependencyTests-442009576 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:36:52 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-79a5b460-f9af-4bb1-924c-49b3ce154548 tempest-VolumeDependencyTests-442009576 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:36:52 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-79a5b460-f9af-4bb1-924c-49b3ce154548 tempest-VolumeDependencyTests-442009576 None] Selected osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 as target Quobyte volume. {{(pid=89182) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 12:36:52 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-79a5b460-f9af-4bb1-924c-49b3ce154548 tempest-VolumeDependencyTests-442009576 None] Acquiring lock "cinder-quobyte-42c40d21-294a-47d6-8a4b-e3f75f09845b" by "_copy_volume_from_snapshot" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:36:52 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-79a5b460-f9af-4bb1-924c-49b3ce154548 tempest-VolumeDependencyTests-442009576 None] Lock "cinder-quobyte-42c40d21-294a-47d6-8a4b-e3f75f09845b" acquired by "_copy_volume_from_snapshot" :: waited 0.027s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:36:52 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-79a5b460-f9af-4bb1-924c-49b3ce154548 tempest-VolumeDependencyTests-442009576 None] snapshot: 24ff7149-be4a-498c-a2d4-e93e5e951ca0, volume: 42c40d21-294a-47d6-8a4b-e3f75f09845b, {{(pid=89182) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Jul 31 12:36:52 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-79a5b460-f9af-4bb1-924c-49b3ce154548 tempest-VolumeDependencyTests-442009576 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:36:52 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-79a5b460-f9af-4bb1-924c-49b3ce154548 tempest-VolumeDependencyTests-442009576 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:36:52 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-79a5b460-f9af-4bb1-924c-49b3ce154548 tempest-VolumeDependencyTests-442009576 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:36:52 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-79a5b460-f9af-4bb1-924c-49b3ce154548 tempest-VolumeDependencyTests-442009576 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:36:52 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-79a5b460-f9af-4bb1-924c-49b3ce154548 tempest-VolumeDependencyTests-442009576 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:36:52 devstack cinder-volume[89182]: DEBUG cinder.volume.flows.manager.create_volume [None req-8092121f-3d5a-49dc-99a6-8e2bc467f2e9 tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89182) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 12:36:53 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-8092121f-3d5a-49dc-99a6-8e2bc467f2e9 tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] Flow 'volume_create_manager' (538e6b2e-b6d9-43c3-ba83-124f4cda681a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:36:53 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-8092121f-3d5a-49dc-99a6-8e2bc467f2e9 tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b945023-e385-450d-8aff-9e811b31f814) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:36:53 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b566159-4b57-4f25-a382-ac79a3b84038]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:36:53 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-79a5b460-f9af-4bb1-924c-49b3ce154548 tempest-VolumeDependencyTests-442009576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-8c784aa3-b637-4a2f-a70b-058a3b465b2a.24ff7149-be4a-498c-a2d4-e93e5e951ca0 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:36:53 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-8092121f-3d5a-49dc-99a6-8e2bc467f2e9 tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b945023-e385-450d-8aff-9e811b31f814) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:36:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-894310804',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=326d2db4-2735-42ef-8c3d-8d3cf121a440,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bfbd0c1a82d24c2abd94708a13d08b32',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:36:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:36:53Z,use_quota=True,user_id='ded1236451fe48f2919ae0454dbed235',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:36:53 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-8092121f-3d5a-49dc-99a6-8e2bc467f2e9 tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b54b1356-f0bd-4de6-8356-a3088334a7bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:36:53 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-8092121f-3d5a-49dc-99a6-8e2bc467f2e9 tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b54b1356-f0bd-4de6-8356-a3088334a7bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:36:53 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-8092121f-3d5a-49dc-99a6-8e2bc467f2e9 tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddae0800-5fa0-4046-9923-0e23757a178b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:36:53 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-8092121f-3d5a-49dc-99a6-8e2bc467f2e9 tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddae0800-5fa0-4046-9923-0e23757a178b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '326d2db4-2735-42ef-8c3d-8d3cf121a440', 'volume_name': 'volume-326d2db4-2735-42ef-8c3d-8d3cf121a440', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:36:53 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-8092121f-3d5a-49dc-99a6-8e2bc467f2e9 tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b877926-5534-47b1-9200-1af0f6d857f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:36:53 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-8092121f-3d5a-49dc-99a6-8e2bc467f2e9 tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b877926-5534-47b1-9200-1af0f6d857f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:36:53 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-8092121f-3d5a-49dc-99a6-8e2bc467f2e9 tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ad27cc9-5b48-4836-89cf-b19f5913bef4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:36:53 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-8092121f-3d5a-49dc-99a6-8e2bc467f2e9 tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] Volume 326d2db4-2735-42ef-8c3d-8d3cf121a440: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-326d2db4-2735-42ef-8c3d-8d3cf121a440', 'volume_size': 1} Jul 31 12:36:53 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-8092121f-3d5a-49dc-99a6-8e2bc467f2e9 tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:36:53 devstack sudo[111974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-8c784aa3-b637-4a2f-a70b-058a3b465b2a.24ff7149-be4a-498c-a2d4-e93e5e951ca0 Jul 31 12:36:53 devstack sudo[111974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:36:53 devstack sudo[111974]: pam_unix(sudo:session): session closed for user root Jul 31 12:36:53 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-79a5b460-f9af-4bb1-924c-49b3ce154548 tempest-VolumeDependencyTests-442009576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-8c784aa3-b637-4a2f-a70b-058a3b465b2a.24ff7149-be4a-498c-a2d4-e93e5e951ca0" returned: 0 in 0.420s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:36:53 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-79a5b460-f9af-4bb1-924c-49b3ce154548 tempest-VolumeDependencyTests-442009576 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8c784aa3-b637-4a2f-a70b-058a3b465b2a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89182) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 12:36:53 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[50512dec-0f7d-434b-b4b7-49716199a3ba]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:36:53 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-79a5b460-f9af-4bb1-924c-49b3ce154548 tempest-VolumeDependencyTests-442009576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-8c784aa3-b637-4a2f-a70b-058a3b465b2a {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:36:53 devstack sudo[111980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-8c784aa3-b637-4a2f-a70b-058a3b465b2a Jul 31 12:36:53 devstack sudo[111980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:36:53 devstack sudo[111980]: pam_unix(sudo:session): session closed for user root Jul 31 12:36:53 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-79a5b460-f9af-4bb1-924c-49b3ce154548 tempest-VolumeDependencyTests-442009576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-8c784aa3-b637-4a2f-a70b-058a3b465b2a" returned: 0 in 0.474s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:36:53 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-79a5b460-f9af-4bb1-924c-49b3ce154548 tempest-VolumeDependencyTests-442009576 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-8c784aa3-b637-4a2f-a70b-058a3b465b2a {{(pid=89182) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Jul 31 12:36:53 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-79a5b460-f9af-4bb1-924c-49b3ce154548 tempest-VolumeDependencyTests-442009576 None] Creating direct copy from snapshot {{(pid=89182) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Jul 31 12:36:53 devstack cinder-volume[89182]: DEBUG cinder.utils [None req-79a5b460-f9af-4bb1-924c-49b3ce154548 tempest-VolumeDependencyTests-442009576 None] Path /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-42c40d21-294a-47d6-8a4b-e3f75f09845b not found in is_blk_device check {{(pid=89182) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 31 12:36:53 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-79a5b460-f9af-4bb1-924c-49b3ce154548 tempest-VolumeDependencyTests-442009576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-8c784aa3-b637-4a2f-a70b-058a3b465b2a /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-42c40d21-294a-47d6-8a4b-e3f75f09845b {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:36:53 devstack sudo[111985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-8c784aa3-b637-4a2f-a70b-058a3b465b2a /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-42c40d21-294a-47d6-8a4b-e3f75f09845b Jul 31 12:36:53 devstack sudo[111985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:36:54 devstack cinder-volume[89182]: DEBUG cinder.volume.flows.manager.create_volume [None req-f023b7bb-5aff-45bb-90a9-c2cebd325096 tempest-CreateVolumesFromSnapshotTest-1185178291 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89182) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 12:36:54 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-f023b7bb-5aff-45bb-90a9-c2cebd325096 tempest-CreateVolumesFromSnapshotTest-1185178291 None] Flow 'volume_create_manager' (49b6154f-a07c-4289-bacf-fb4ca042bae6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:36:54 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-f023b7bb-5aff-45bb-90a9-c2cebd325096 tempest-CreateVolumesFromSnapshotTest-1185178291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (380fd80d-e4d7-4d2b-a6d6-3754be2f7d28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:36:54 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-f023b7bb-5aff-45bb-90a9-c2cebd325096 tempest-CreateVolumesFromSnapshotTest-1185178291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (380fd80d-e4d7-4d2b-a6d6-3754be2f7d28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:36:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-507662959',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb17bd40-f8bd-4485-ac68-569e5a061f1d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73b25c0a73d14ed6baac1d54f3a462b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:36:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:36:54Z,use_quota=True,user_id='581f5fa15e8c451db457aa17e8682712',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:36:54 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-f023b7bb-5aff-45bb-90a9-c2cebd325096 tempest-CreateVolumesFromSnapshotTest-1185178291 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d549b46-5e88-47e3-8adf-36d7d6b0ce8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:36:54 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-f023b7bb-5aff-45bb-90a9-c2cebd325096 tempest-CreateVolumesFromSnapshotTest-1185178291 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d549b46-5e88-47e3-8adf-36d7d6b0ce8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:36:54 devstack sudo[111985]: pam_unix(sudo:session): session closed for user root Jul 31 12:36:54 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-f023b7bb-5aff-45bb-90a9-c2cebd325096 tempest-CreateVolumesFromSnapshotTest-1185178291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ceb5781-b5c0-4d93-8401-1df3ee48ac9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:36:54 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-f023b7bb-5aff-45bb-90a9-c2cebd325096 tempest-CreateVolumesFromSnapshotTest-1185178291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ceb5781-b5c0-4d93-8401-1df3ee48ac9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eb17bd40-f8bd-4485-ac68-569e5a061f1d', 'volume_name': 'volume-eb17bd40-f8bd-4485-ac68-569e5a061f1d', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:36:54 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-f023b7bb-5aff-45bb-90a9-c2cebd325096 tempest-CreateVolumesFromSnapshotTest-1185178291 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a58703f8-8215-48a4-b101-234f5dd8d5d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:36:54 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-f023b7bb-5aff-45bb-90a9-c2cebd325096 tempest-CreateVolumesFromSnapshotTest-1185178291 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a58703f8-8215-48a4-b101-234f5dd8d5d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:36:54 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-f023b7bb-5aff-45bb-90a9-c2cebd325096 tempest-CreateVolumesFromSnapshotTest-1185178291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e15bed98-14a8-4176-ab1e-87b55b0dadff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:36:54 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-f023b7bb-5aff-45bb-90a9-c2cebd325096 tempest-CreateVolumesFromSnapshotTest-1185178291 None] Volume eb17bd40-f8bd-4485-ac68-569e5a061f1d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eb17bd40-f8bd-4485-ac68-569e5a061f1d', 'volume_size': 1} Jul 31 12:36:54 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-f023b7bb-5aff-45bb-90a9-c2cebd325096 tempest-CreateVolumesFromSnapshotTest-1185178291 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:36:54 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-79a5b460-f9af-4bb1-924c-49b3ce154548 tempest-VolumeDependencyTests-442009576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-8c784aa3-b637-4a2f-a70b-058a3b465b2a /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-42c40d21-294a-47d6-8a4b-e3f75f09845b" returned: 0 in 0.567s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:36:54 devstack cinder-volume[89182]: DEBUG cinder.image.image_utils [None req-79a5b460-f9af-4bb1-924c-49b3ce154548 tempest-VolumeDependencyTests-442009576 None] Image conversion details: src /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-8c784aa3-b637-4a2f-a70b-058a3b465b2a, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-42c40d21-294a-47d6-8a4b-e3f75f09845b {{(pid=89182) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 31 12:36:54 devstack cinder-volume[89182]: INFO cinder.image.image_utils [None req-79a5b460-f9af-4bb1-924c-49b3ce154548 tempest-VolumeDependencyTests-442009576 None] Converted 1024.00 MB image at 1024.00 MB/s Jul 31 12:36:54 devstack cinder-volume[89182]: WARNING cinder.volume.drivers.remotefs [None req-79a5b460-f9af-4bb1-924c-49b3ce154548 tempest-VolumeDependencyTests-442009576 None] /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-42c40d21-294a-47d6-8a4b-e3f75f09845b is being set with open permissions: ugo+rw Jul 31 12:36:54 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-79a5b460-f9af-4bb1-924c-49b3ce154548 tempest-VolumeDependencyTests-442009576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-42c40d21-294a-47d6-8a4b-e3f75f09845b {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:36:54 devstack sudo[111991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-42c40d21-294a-47d6-8a4b-e3f75f09845b Jul 31 12:36:54 devstack sudo[111991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:36:54 devstack sudo[111991]: pam_unix(sudo:session): session closed for user root Jul 31 12:36:54 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-79a5b460-f9af-4bb1-924c-49b3ce154548 tempest-VolumeDependencyTests-442009576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-42c40d21-294a-47d6-8a4b-e3f75f09845b" returned: 0 in 0.263s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:36:54 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-79a5b460-f9af-4bb1-924c-49b3ce154548 tempest-VolumeDependencyTests-442009576 None] Lock "cinder-quobyte-42c40d21-294a-47d6-8a4b-e3f75f09845b" released by "_copy_volume_from_snapshot" :: held 1.892s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:36:54 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-79a5b460-f9af-4bb1-924c-49b3ce154548 tempest-VolumeDependencyTests-442009576 None] Lock "cinder-quobyte-24ff7149-be4a-498c-a2d4-e93e5e951ca0-42c40d21-294a-47d6-8a4b-e3f75f09845b" released by "_create_volume_from_snapshot" :: held 2.009s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:36:54 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-79a5b460-f9af-4bb1-924c-49b3ce154548 tempest-VolumeDependencyTests-442009576 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 2.066s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:36:54 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-8092121f-3d5a-49dc-99a6-8e2bc467f2e9 tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.769s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:36:54 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-8092121f-3d5a-49dc-99a6-8e2bc467f2e9 tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:36:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-894310804',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=326d2db4-2735-42ef-8c3d-8d3cf121a440,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bfbd0c1a82d24c2abd94708a13d08b32',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:36:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:36:53Z,use_quota=True,user_id='ded1236451fe48f2919ae0454dbed235',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)}" {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 12:36:54 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-8092121f-3d5a-49dc-99a6-8e2bc467f2e9 tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] Creating volume 326d2db4-2735-42ef-8c3d-8d3cf121a440 {{(pid=89182) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 12:36:54 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-8092121f-3d5a-49dc-99a6-8e2bc467f2e9 tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:36:54 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-8092121f-3d5a-49dc-99a6-8e2bc467f2e9 tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:36:54 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-8092121f-3d5a-49dc-99a6-8e2bc467f2e9 tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:36:54 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-8092121f-3d5a-49dc-99a6-8e2bc467f2e9 tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:36:54 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-8092121f-3d5a-49dc-99a6-8e2bc467f2e9 tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:36:54 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-8092121f-3d5a-49dc-99a6-8e2bc467f2e9 tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] Selected osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 as target Quobyte volume. {{(pid=89182) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 12:36:54 devstack cinder-volume[89182]: INFO cinder.volume.drivers.remotefs [None req-8092121f-3d5a-49dc-99a6-8e2bc467f2e9 tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] casted to osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 Jul 31 12:36:54 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-8092121f-3d5a-49dc-99a6-8e2bc467f2e9 tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-326d2db4-2735-42ef-8c3d-8d3cf121a440 1073741824 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:36:54 devstack sudo[111994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-326d2db4-2735-42ef-8c3d-8d3cf121a440 1073741824 Jul 31 12:36:54 devstack sudo[111994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:36:54 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-79a5b460-f9af-4bb1-924c-49b3ce154548 tempest-VolumeDependencyTests-442009576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a61a4361-6811-46f1-a4e6-a7492876e0c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-42c40d21-294a-47d6-8a4b-e3f75f09845b', 'volume_size': 1, 'snapshot_id': '24ff7149-be4a-498c-a2d4-e93e5e951ca0'}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:36:54 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-79a5b460-f9af-4bb1-924c-49b3ce154548 tempest-VolumeDependencyTests-442009576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12112b44-6ea2-49a9-bcce-5068172d7ecd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:36:55 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-79a5b460-f9af-4bb1-924c-49b3ce154548 tempest-VolumeDependencyTests-442009576 None] Volume volume-42c40d21-294a-47d6-8a4b-e3f75f09845b (42c40d21-294a-47d6-8a4b-e3f75f09845b): created successfully Jul 31 12:36:55 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-79a5b460-f9af-4bb1-924c-49b3ce154548 tempest-VolumeDependencyTests-442009576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12112b44-6ea2-49a9-bcce-5068172d7ecd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:36:55 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-79a5b460-f9af-4bb1-924c-49b3ce154548 tempest-VolumeDependencyTests-442009576 None] Flow 'volume_create_manager' (95561735-bd29-46f1-8f99-4fbbc9c81135) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:36:55 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-79a5b460-f9af-4bb1-924c-49b3ce154548 tempest-VolumeDependencyTests-442009576 None] Created volume successfully. Jul 31 12:36:55 devstack sudo[111994]: pam_unix(sudo:session): session closed for user root Jul 31 12:36:55 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-8092121f-3d5a-49dc-99a6-8e2bc467f2e9 tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-326d2db4-2735-42ef-8c3d-8d3cf121a440 1073741824" returned: 0 in 0.569s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:36:55 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-8092121f-3d5a-49dc-99a6-8e2bc467f2e9 tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-326d2db4-2735-42ef-8c3d-8d3cf121a440 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:36:55 devstack sudo[112000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-326d2db4-2735-42ef-8c3d-8d3cf121a440 Jul 31 12:36:55 devstack sudo[112000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:36:55 devstack sudo[112000]: pam_unix(sudo:session): session closed for user root Jul 31 12:36:55 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-8092121f-3d5a-49dc-99a6-8e2bc467f2e9 tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-326d2db4-2735-42ef-8c3d-8d3cf121a440" returned: 0 in 0.269s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:36:55 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-8092121f-3d5a-49dc-99a6-8e2bc467f2e9 tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] <== create_volume: return (907ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'} {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 12:36:55 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-8092121f-3d5a-49dc-99a6-8e2bc467f2e9 tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.913s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:36:55 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-f023b7bb-5aff-45bb-90a9-c2cebd325096 tempest-CreateVolumesFromSnapshotTest-1185178291 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.284s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:36:55 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-f023b7bb-5aff-45bb-90a9-c2cebd325096 tempest-CreateVolumesFromSnapshotTest-1185178291 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:36:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-507662959',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb17bd40-f8bd-4485-ac68-569e5a061f1d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73b25c0a73d14ed6baac1d54f3a462b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:36:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:36:54Z,use_quota=True,user_id='581f5fa15e8c451db457aa17e8682712',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)}" {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 12:36:55 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-f023b7bb-5aff-45bb-90a9-c2cebd325096 tempest-CreateVolumesFromSnapshotTest-1185178291 None] Creating volume eb17bd40-f8bd-4485-ac68-569e5a061f1d {{(pid=89182) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 12:36:55 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-f023b7bb-5aff-45bb-90a9-c2cebd325096 tempest-CreateVolumesFromSnapshotTest-1185178291 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:36:55 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-f023b7bb-5aff-45bb-90a9-c2cebd325096 tempest-CreateVolumesFromSnapshotTest-1185178291 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:36:55 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-f023b7bb-5aff-45bb-90a9-c2cebd325096 tempest-CreateVolumesFromSnapshotTest-1185178291 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:36:55 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-f023b7bb-5aff-45bb-90a9-c2cebd325096 tempest-CreateVolumesFromSnapshotTest-1185178291 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:36:55 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-f023b7bb-5aff-45bb-90a9-c2cebd325096 tempest-CreateVolumesFromSnapshotTest-1185178291 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:36:55 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-f023b7bb-5aff-45bb-90a9-c2cebd325096 tempest-CreateVolumesFromSnapshotTest-1185178291 None] Selected osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 as target Quobyte volume. {{(pid=89182) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 12:36:55 devstack cinder-volume[89182]: INFO cinder.volume.drivers.remotefs [None req-f023b7bb-5aff-45bb-90a9-c2cebd325096 tempest-CreateVolumesFromSnapshotTest-1185178291 None] casted to osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 Jul 31 12:36:55 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-f023b7bb-5aff-45bb-90a9-c2cebd325096 tempest-CreateVolumesFromSnapshotTest-1185178291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-eb17bd40-f8bd-4485-ac68-569e5a061f1d 1073741824 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:36:55 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-8092121f-3d5a-49dc-99a6-8e2bc467f2e9 tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ad27cc9-5b48-4836-89cf-b19f5913bef4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-326d2db4-2735-42ef-8c3d-8d3cf121a440', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:36:55 devstack sudo[112003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-eb17bd40-f8bd-4485-ac68-569e5a061f1d 1073741824 Jul 31 12:36:55 devstack sudo[112003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:36:55 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-8092121f-3d5a-49dc-99a6-8e2bc467f2e9 tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff4b9269-5344-464f-8d7c-9f5afbbf5202) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:36:55 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-8092121f-3d5a-49dc-99a6-8e2bc467f2e9 tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] Volume volume-326d2db4-2735-42ef-8c3d-8d3cf121a440 (326d2db4-2735-42ef-8c3d-8d3cf121a440): created successfully Jul 31 12:36:55 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-8092121f-3d5a-49dc-99a6-8e2bc467f2e9 tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff4b9269-5344-464f-8d7c-9f5afbbf5202) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:36:55 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-8092121f-3d5a-49dc-99a6-8e2bc467f2e9 tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] Flow 'volume_create_manager' (538e6b2e-b6d9-43c3-ba83-124f4cda681a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:36:55 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-8092121f-3d5a-49dc-99a6-8e2bc467f2e9 tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] Created volume successfully. Jul 31 12:36:56 devstack cinder-volume[89182]: DEBUG cinder.volume.flows.manager.create_volume [None req-c612cec3-0df9-45ea-a39d-3f6d468e581c tempest-VolumeDependencyTests-442009576 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89182) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 12:36:56 devstack sudo[112003]: pam_unix(sudo:session): session closed for user root Jul 31 12:36:56 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-f023b7bb-5aff-45bb-90a9-c2cebd325096 tempest-CreateVolumesFromSnapshotTest-1185178291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-eb17bd40-f8bd-4485-ac68-569e5a061f1d 1073741824" returned: 0 in 0.655s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:36:56 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-c612cec3-0df9-45ea-a39d-3f6d468e581c tempest-VolumeDependencyTests-442009576 None] Flow 'volume_create_manager' (e15778e2-9104-4f68-a1c3-bcfe9273c30a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:36:56 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-c612cec3-0df9-45ea-a39d-3f6d468e581c tempest-VolumeDependencyTests-442009576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8872307-3abf-4729-96b0-b99c006787ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:36:56 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-c612cec3-0df9-45ea-a39d-3f6d468e581c tempest-VolumeDependencyTests-442009576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8872307-3abf-4729-96b0-b99c006787ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:36:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-364838252',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c5a2f2e-5b30-4a3c-8732-6417d383faca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c622d586c4c9404ead8c06d764810df1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:36:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=42c40d21-294a-47d6-8a4b-e3f75f09845b,status='creating',terminated_at=None,updated_at=2026-07-31T10:36:56Z,use_quota=True,user_id='cfc528fe8ec2487bb4171d283c222b1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:36:56 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-c612cec3-0df9-45ea-a39d-3f6d468e581c tempest-VolumeDependencyTests-442009576 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0fa4af78-8a46-43c4-bcc9-e7d3edf36d0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:36:56 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-c612cec3-0df9-45ea-a39d-3f6d468e581c tempest-VolumeDependencyTests-442009576 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0fa4af78-8a46-43c4-bcc9-e7d3edf36d0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:36:56 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-c612cec3-0df9-45ea-a39d-3f6d468e581c tempest-VolumeDependencyTests-442009576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dcad91e6-62fe-4933-933e-9f98e23a59d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:36:56 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-c612cec3-0df9-45ea-a39d-3f6d468e581c tempest-VolumeDependencyTests-442009576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dcad91e6-62fe-4933-933e-9f98e23a59d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '9c5a2f2e-5b30-4a3c-8732-6417d383faca', 'volume_name': 'volume-9c5a2f2e-5b30-4a3c-8732-6417d383faca', 'volume_size': 1, 'source_volid': '42c40d21-294a-47d6-8a4b-e3f75f09845b', 'source_volstatus': 'available'}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:36:56 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-c612cec3-0df9-45ea-a39d-3f6d468e581c tempest-VolumeDependencyTests-442009576 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f69d9fc1-2402-4b47-aff6-0fcb7128708e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:36:56 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-c612cec3-0df9-45ea-a39d-3f6d468e581c tempest-VolumeDependencyTests-442009576 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f69d9fc1-2402-4b47-aff6-0fcb7128708e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:36:56 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-c612cec3-0df9-45ea-a39d-3f6d468e581c tempest-VolumeDependencyTests-442009576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8df5c7d2-1fb1-4159-8194-25dd76409339) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:36:56 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-c612cec3-0df9-45ea-a39d-3f6d468e581c tempest-VolumeDependencyTests-442009576 None] Volume 9c5a2f2e-5b30-4a3c-8732-6417d383faca: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-9c5a2f2e-5b30-4a3c-8732-6417d383faca', 'volume_size': 1, 'source_volid': '42c40d21-294a-47d6-8a4b-e3f75f09845b', 'source_volstatus': 'available'} Jul 31 12:36:56 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-f023b7bb-5aff-45bb-90a9-c2cebd325096 tempest-CreateVolumesFromSnapshotTest-1185178291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-eb17bd40-f8bd-4485-ac68-569e5a061f1d {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:36:56 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-c612cec3-0df9-45ea-a39d-3f6d468e581c tempest-VolumeDependencyTests-442009576 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:36:56 devstack sudo[112009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-eb17bd40-f8bd-4485-ac68-569e5a061f1d Jul 31 12:36:56 devstack sudo[112009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:36:56 devstack cinder-volume[89182]: DEBUG cinder.volume.flows.manager.create_volume [None req-02e854c3-f371-4742-9e01-2766e416bd08 tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89182) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 12:36:56 devstack sudo[112009]: pam_unix(sudo:session): session closed for user root Jul 31 12:36:56 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-02e854c3-f371-4742-9e01-2766e416bd08 tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] Flow 'volume_create_manager' (d49bd9cd-f653-4c73-808b-6d02a99d0084) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:36:56 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-02e854c3-f371-4742-9e01-2766e416bd08 tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea7a3323-abd9-47f6-a370-bf5558f4325f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:36:56 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-f023b7bb-5aff-45bb-90a9-c2cebd325096 tempest-CreateVolumesFromSnapshotTest-1185178291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-eb17bd40-f8bd-4485-ac68-569e5a061f1d" returned: 0 in 0.369s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:36:56 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-f023b7bb-5aff-45bb-90a9-c2cebd325096 tempest-CreateVolumesFromSnapshotTest-1185178291 None] <== create_volume: return (1148ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'} {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 12:36:56 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-f023b7bb-5aff-45bb-90a9-c2cebd325096 tempest-CreateVolumesFromSnapshotTest-1185178291 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.152s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:36:56 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-c612cec3-0df9-45ea-a39d-3f6d468e581c tempest-VolumeDependencyTests-442009576 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.359s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:36:56 devstack cinder-volume[89182]: INFO cinder.volume.drivers.remotefs [None req-c612cec3-0df9-45ea-a39d-3f6d468e581c tempest-VolumeDependencyTests-442009576 None] Cloning volume 42c40d21-294a-47d6-8a4b-e3f75f09845b to volume 9c5a2f2e-5b30-4a3c-8732-6417d383faca Jul 31 12:36:56 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-f023b7bb-5aff-45bb-90a9-c2cebd325096 tempest-CreateVolumesFromSnapshotTest-1185178291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e15bed98-14a8-4176-ab1e-87b55b0dadff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eb17bd40-f8bd-4485-ac68-569e5a061f1d', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:36:56 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-f023b7bb-5aff-45bb-90a9-c2cebd325096 tempest-CreateVolumesFromSnapshotTest-1185178291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3ed38cd-04f3-466c-a7de-c9da1a1d4b86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:36:56 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-02e854c3-f371-4742-9e01-2766e416bd08 tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea7a3323-abd9-47f6-a370-bf5558f4325f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:36:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1515505002',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=177969d5-f860-45ad-bad4-0d9ad47d3932,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bfbd0c1a82d24c2abd94708a13d08b32',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:36:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:36:57Z,use_quota=True,user_id='ded1236451fe48f2919ae0454dbed235',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:36:56 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-02e854c3-f371-4742-9e01-2766e416bd08 tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dbf0786f-f7f8-4e2d-bbec-cf0e1d8fc2d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:36:56 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-02e854c3-f371-4742-9e01-2766e416bd08 tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dbf0786f-f7f8-4e2d-bbec-cf0e1d8fc2d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:36:57 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-02e854c3-f371-4742-9e01-2766e416bd08 tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f557b5d3-a836-4f6d-9149-56300d67ef28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:36:57 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-02e854c3-f371-4742-9e01-2766e416bd08 tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f557b5d3-a836-4f6d-9149-56300d67ef28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '177969d5-f860-45ad-bad4-0d9ad47d3932', 'volume_name': 'volume-177969d5-f860-45ad-bad4-0d9ad47d3932', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:36:57 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-02e854c3-f371-4742-9e01-2766e416bd08 tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (648ada7e-52e0-48be-86cd-9d1652f2aff9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:36:57 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-02e854c3-f371-4742-9e01-2766e416bd08 tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (648ada7e-52e0-48be-86cd-9d1652f2aff9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:36:57 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-02e854c3-f371-4742-9e01-2766e416bd08 tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f38d6ad-9756-436f-809f-5bd87d95ecc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:36:57 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-02e854c3-f371-4742-9e01-2766e416bd08 tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] Volume 177969d5-f860-45ad-bad4-0d9ad47d3932: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-177969d5-f860-45ad-bad4-0d9ad47d3932', 'volume_size': 1} Jul 31 12:36:57 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-02e854c3-f371-4742-9e01-2766e416bd08 tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:36:57 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-f023b7bb-5aff-45bb-90a9-c2cebd325096 tempest-CreateVolumesFromSnapshotTest-1185178291 None] Volume volume-eb17bd40-f8bd-4485-ac68-569e5a061f1d (eb17bd40-f8bd-4485-ac68-569e5a061f1d): created successfully Jul 31 12:36:57 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-f023b7bb-5aff-45bb-90a9-c2cebd325096 tempest-CreateVolumesFromSnapshotTest-1185178291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3ed38cd-04f3-466c-a7de-c9da1a1d4b86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:36:57 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-f023b7bb-5aff-45bb-90a9-c2cebd325096 tempest-CreateVolumesFromSnapshotTest-1185178291 None] Flow 'volume_create_manager' (49b6154f-a07c-4289-bacf-fb4ca042bae6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:36:57 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-c612cec3-0df9-45ea-a39d-3f6d468e581c tempest-VolumeDependencyTests-442009576 None] Creating offline snapshot 11f934da-32b9-465f-bc98-241808c399c2 of volume 42c40d21-294a-47d6-8a4b-e3f75f09845b {{(pid=89182) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 31 12:36:57 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-f023b7bb-5aff-45bb-90a9-c2cebd325096 tempest-CreateVolumesFromSnapshotTest-1185178291 None] Created volume successfully. Jul 31 12:36:57 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[38179385-f351-4de5-93e5-bff2297e0af6]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:36:57 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-c612cec3-0df9-45ea-a39d-3f6d468e581c tempest-VolumeDependencyTests-442009576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-42c40d21-294a-47d6-8a4b-e3f75f09845b {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:36:57 devstack sudo[112013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-42c40d21-294a-47d6-8a4b-e3f75f09845b Jul 31 12:36:57 devstack sudo[112013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:36:57 devstack cinder-volume[89182]: DEBUG cinder.volume.flows.manager.create_volume [None req-22817f40-19cb-4729-8b5b-f41730a92adb tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89182) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 12:36:57 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-22817f40-19cb-4729-8b5b-f41730a92adb tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] Flow 'volume_create_manager' (e1f7a3cb-f534-4bef-97c3-cea402d42d36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:36:57 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-22817f40-19cb-4729-8b5b-f41730a92adb tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97ac44b2-51ac-4a50-89d2-b7d724b3077b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:36:57 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-22817f40-19cb-4729-8b5b-f41730a92adb tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97ac44b2-51ac-4a50-89d2-b7d724b3077b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:36:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-289468109',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d6e8087-f075-4acb-8a10-e30c61ccb1bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bfbd0c1a82d24c2abd94708a13d08b32',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:36:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:36:57Z,use_quota=True,user_id='ded1236451fe48f2919ae0454dbed235',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:36:57 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-22817f40-19cb-4729-8b5b-f41730a92adb tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c34391c0-ddaf-4594-874d-48cf97aae72c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:36:57 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-22817f40-19cb-4729-8b5b-f41730a92adb tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c34391c0-ddaf-4594-874d-48cf97aae72c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:36:57 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-22817f40-19cb-4729-8b5b-f41730a92adb tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11efb497-e355-4942-b807-93ca604ce9f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:36:57 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-22817f40-19cb-4729-8b5b-f41730a92adb tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11efb497-e355-4942-b807-93ca604ce9f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4d6e8087-f075-4acb-8a10-e30c61ccb1bb', 'volume_name': 'volume-4d6e8087-f075-4acb-8a10-e30c61ccb1bb', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:36:57 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-22817f40-19cb-4729-8b5b-f41730a92adb tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42416b86-f57a-4000-808f-fbe1170d5358) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:36:57 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-22817f40-19cb-4729-8b5b-f41730a92adb tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42416b86-f57a-4000-808f-fbe1170d5358) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:36:57 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-22817f40-19cb-4729-8b5b-f41730a92adb tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ec0e330-c9af-4abe-ba3c-bdeb60ccf72b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:36:57 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-22817f40-19cb-4729-8b5b-f41730a92adb tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] Volume 4d6e8087-f075-4acb-8a10-e30c61ccb1bb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4d6e8087-f075-4acb-8a10-e30c61ccb1bb', 'volume_size': 1} Jul 31 12:36:57 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-22817f40-19cb-4729-8b5b-f41730a92adb tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:36:57 devstack sudo[112013]: pam_unix(sudo:session): session closed for user root Jul 31 12:36:57 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-c612cec3-0df9-45ea-a39d-3f6d468e581c tempest-VolumeDependencyTests-442009576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-42c40d21-294a-47d6-8a4b-e3f75f09845b" returned: 0 in 0.656s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:36:57 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-c612cec3-0df9-45ea-a39d-3f6d468e581c tempest-VolumeDependencyTests-442009576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-42c40d21-294a-47d6-8a4b-e3f75f09845b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-42c40d21-294a-47d6-8a4b-e3f75f09845b.11f934da-32b9-465f-bc98-241808c399c2 1G {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:36:57 devstack sudo[112018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-42c40d21-294a-47d6-8a4b-e3f75f09845b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-42c40d21-294a-47d6-8a4b-e3f75f09845b.11f934da-32b9-465f-bc98-241808c399c2 1G Jul 31 12:36:57 devstack sudo[112018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:36:58 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-dec480c6-3064-45d6-a56b-a8f1ed1c15e9 tempest-CreateVolumesFromSnapshotTest-1185178291 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:36:58 devstack cinder-volume[89182]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b3e9ec0-8b09-4dc4-80d3-06c5fa73fd1b tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89182) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 12:36:58 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-9b3e9ec0-8b09-4dc4-80d3-06c5fa73fd1b tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] Flow 'volume_create_manager' (ccce374d-96b2-4193-90e5-6f187d109ec0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:36:58 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-9b3e9ec0-8b09-4dc4-80d3-06c5fa73fd1b tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c780cc5d-894d-42f1-b645-24970ddab456) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:36:58 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-9b3e9ec0-8b09-4dc4-80d3-06c5fa73fd1b tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c780cc5d-894d-42f1-b645-24970ddab456) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:36:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-83079991',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=734a2868-6cd5-4d71-9abb-d61fe285435f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bfbd0c1a82d24c2abd94708a13d08b32',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:36:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:36:58Z,use_quota=True,user_id='ded1236451fe48f2919ae0454dbed235',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:36:58 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-9b3e9ec0-8b09-4dc4-80d3-06c5fa73fd1b tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78af8f38-af46-4f7c-908a-23354d49b335) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:36:58 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-9b3e9ec0-8b09-4dc4-80d3-06c5fa73fd1b tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78af8f38-af46-4f7c-908a-23354d49b335) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:36:58 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-9b3e9ec0-8b09-4dc4-80d3-06c5fa73fd1b tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d7cdf2e-63b5-4d3d-97cb-7121a37db49f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:36:58 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-9b3e9ec0-8b09-4dc4-80d3-06c5fa73fd1b tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d7cdf2e-63b5-4d3d-97cb-7121a37db49f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '734a2868-6cd5-4d71-9abb-d61fe285435f', 'volume_name': 'volume-734a2868-6cd5-4d71-9abb-d61fe285435f', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:36:58 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-9b3e9ec0-8b09-4dc4-80d3-06c5fa73fd1b tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (108e75db-5661-48c7-9b95-1d9cf6fc5e8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:36:58 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-9b3e9ec0-8b09-4dc4-80d3-06c5fa73fd1b tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (108e75db-5661-48c7-9b95-1d9cf6fc5e8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:36:58 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-9b3e9ec0-8b09-4dc4-80d3-06c5fa73fd1b tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1c7c4e3-b5ed-4117-aafa-8b89ded8181e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:36:58 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-9b3e9ec0-8b09-4dc4-80d3-06c5fa73fd1b tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] Volume 734a2868-6cd5-4d71-9abb-d61fe285435f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-734a2868-6cd5-4d71-9abb-d61fe285435f', 'volume_size': 1} Jul 31 12:36:58 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-9b3e9ec0-8b09-4dc4-80d3-06c5fa73fd1b tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:36:58 devstack sudo[112018]: pam_unix(sudo:session): session closed for user root Jul 31 12:36:58 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-c612cec3-0df9-45ea-a39d-3f6d468e581c tempest-VolumeDependencyTests-442009576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-42c40d21-294a-47d6-8a4b-e3f75f09845b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-42c40d21-294a-47d6-8a4b-e3f75f09845b.11f934da-32b9-465f-bc98-241808c399c2 1G" returned: 0 in 0.519s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:36:58 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-c612cec3-0df9-45ea-a39d-3f6d468e581c tempest-VolumeDependencyTests-442009576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-42c40d21-294a-47d6-8a4b-e3f75f09845b -F qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-42c40d21-294a-47d6-8a4b-e3f75f09845b.11f934da-32b9-465f-bc98-241808c399c2 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:36:58 devstack sudo[112023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-42c40d21-294a-47d6-8a4b-e3f75f09845b -F qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-42c40d21-294a-47d6-8a4b-e3f75f09845b.11f934da-32b9-465f-bc98-241808c399c2 Jul 31 12:36:58 devstack sudo[112023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:36:58 devstack cinder-volume[89182]: DEBUG cinder.volume.flows.manager.create_volume [None req-c7839c60-2579-4067-b573-642424a272e8 tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89182) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 12:36:58 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-c7839c60-2579-4067-b573-642424a272e8 tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] Flow 'volume_create_manager' (39d68639-63b9-4c96-b09d-2671aa1c930d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:36:58 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-c7839c60-2579-4067-b573-642424a272e8 tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e08b62f4-07e5-493a-8b09-165ce3629e4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:36:58 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-c7839c60-2579-4067-b573-642424a272e8 tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e08b62f4-07e5-493a-8b09-165ce3629e4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:36:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1424721905',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9922a446-63fc-4c60-a625-6aa16bfe3440,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bfbd0c1a82d24c2abd94708a13d08b32',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:36:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:36:58Z,use_quota=True,user_id='ded1236451fe48f2919ae0454dbed235',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:36:58 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-c7839c60-2579-4067-b573-642424a272e8 tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0105cfc5-30ee-4b8d-b0cf-f476f7a57b64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:36:58 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-c7839c60-2579-4067-b573-642424a272e8 tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0105cfc5-30ee-4b8d-b0cf-f476f7a57b64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:36:58 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-c7839c60-2579-4067-b573-642424a272e8 tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b11efd3-71d5-4b4f-8b13-4c9caf926eb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:36:58 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-c7839c60-2579-4067-b573-642424a272e8 tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b11efd3-71d5-4b4f-8b13-4c9caf926eb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9922a446-63fc-4c60-a625-6aa16bfe3440', 'volume_name': 'volume-9922a446-63fc-4c60-a625-6aa16bfe3440', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:36:58 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-c7839c60-2579-4067-b573-642424a272e8 tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c07693ef-b5cd-4be1-af42-f50c55929b12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:36:58 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-c7839c60-2579-4067-b573-642424a272e8 tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c07693ef-b5cd-4be1-af42-f50c55929b12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:36:58 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-c7839c60-2579-4067-b573-642424a272e8 tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89344735-b235-4203-95db-0b605fb967cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:36:58 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-c7839c60-2579-4067-b573-642424a272e8 tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] Volume 9922a446-63fc-4c60-a625-6aa16bfe3440: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9922a446-63fc-4c60-a625-6aa16bfe3440', 'volume_size': 1} Jul 31 12:36:58 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-c7839c60-2579-4067-b573-642424a272e8 tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:36:58 devstack sudo[112023]: pam_unix(sudo:session): session closed for user root Jul 31 12:36:58 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-c612cec3-0df9-45ea-a39d-3f6d468e581c tempest-VolumeDependencyTests-442009576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-42c40d21-294a-47d6-8a4b-e3f75f09845b -F qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-42c40d21-294a-47d6-8a4b-e3f75f09845b.11f934da-32b9-465f-bc98-241808c399c2" returned: 0 in 0.411s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:36:58 devstack cinder-volume[89182]: WARNING cinder.volume.drivers.remotefs [None req-c612cec3-0df9-45ea-a39d-3f6d468e581c tempest-VolumeDependencyTests-442009576 None] /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-42c40d21-294a-47d6-8a4b-e3f75f09845b.11f934da-32b9-465f-bc98-241808c399c2 is being set with open permissions: ugo+rw Jul 31 12:36:58 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-c612cec3-0df9-45ea-a39d-3f6d468e581c tempest-VolumeDependencyTests-442009576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-42c40d21-294a-47d6-8a4b-e3f75f09845b.11f934da-32b9-465f-bc98-241808c399c2 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:36:58 devstack sudo[112029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-42c40d21-294a-47d6-8a4b-e3f75f09845b.11f934da-32b9-465f-bc98-241808c399c2 Jul 31 12:36:58 devstack sudo[112029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:36:58 devstack cinder-volume[89182]: DEBUG cinder.volume.flows.manager.create_volume [None req-061695c3-e506-4295-b701-fe94fae2b687 tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89182) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 12:36:58 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-061695c3-e506-4295-b701-fe94fae2b687 tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] Flow 'volume_create_manager' (4ac8e6e8-bd3c-4dab-a595-5ac64daa5c31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:36:58 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-061695c3-e506-4295-b701-fe94fae2b687 tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2343683c-53c8-44a7-82f9-cf4ed4ed5321) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:36:58 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-061695c3-e506-4295-b701-fe94fae2b687 tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2343683c-53c8-44a7-82f9-cf4ed4ed5321) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:36:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1295449081',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=206ec721-8ff8-4775-b6c9-d0077677f502,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bfbd0c1a82d24c2abd94708a13d08b32',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:36:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:36:59Z,use_quota=True,user_id='ded1236451fe48f2919ae0454dbed235',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:36:58 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-061695c3-e506-4295-b701-fe94fae2b687 tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d18113d0-1719-4207-aca0-1fa6a1670b69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:36:58 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-061695c3-e506-4295-b701-fe94fae2b687 tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d18113d0-1719-4207-aca0-1fa6a1670b69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:36:58 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-061695c3-e506-4295-b701-fe94fae2b687 tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a3c5aaa-1cc5-4124-8fd2-380e7f8d50fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:36:58 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-061695c3-e506-4295-b701-fe94fae2b687 tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a3c5aaa-1cc5-4124-8fd2-380e7f8d50fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '206ec721-8ff8-4775-b6c9-d0077677f502', 'volume_name': 'volume-206ec721-8ff8-4775-b6c9-d0077677f502', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:36:58 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-061695c3-e506-4295-b701-fe94fae2b687 tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99daa56a-aa52-4045-8cc3-630cd96209aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:36:58 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-061695c3-e506-4295-b701-fe94fae2b687 tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99daa56a-aa52-4045-8cc3-630cd96209aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:36:58 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-061695c3-e506-4295-b701-fe94fae2b687 tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40c7bfdb-d0e6-4c48-ab26-77b68e062036) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:36:58 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-061695c3-e506-4295-b701-fe94fae2b687 tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] Volume 206ec721-8ff8-4775-b6c9-d0077677f502: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-206ec721-8ff8-4775-b6c9-d0077677f502', 'volume_size': 1} Jul 31 12:36:58 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-061695c3-e506-4295-b701-fe94fae2b687 tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:36:59 devstack sudo[112029]: pam_unix(sudo:session): session closed for user root Jul 31 12:36:59 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-c612cec3-0df9-45ea-a39d-3f6d468e581c tempest-VolumeDependencyTests-442009576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-42c40d21-294a-47d6-8a4b-e3f75f09845b.11f934da-32b9-465f-bc98-241808c399c2" returned: 0 in 0.294s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:36:59 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-c612cec3-0df9-45ea-a39d-3f6d468e581c tempest-VolumeDependencyTests-442009576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-42c40d21-294a-47d6-8a4b-e3f75f09845b.info {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:36:59 devstack sudo[112032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-42c40d21-294a-47d6-8a4b-e3f75f09845b.info Jul 31 12:36:59 devstack sudo[112032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:36:59 devstack sudo[112032]: pam_unix(sudo:session): session closed for user root Jul 31 12:36:59 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-c612cec3-0df9-45ea-a39d-3f6d468e581c tempest-VolumeDependencyTests-442009576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-42c40d21-294a-47d6-8a4b-e3f75f09845b.info" returned: 0 in 0.260s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:36:59 devstack cinder-volume[89182]: WARNING cinder.volume.drivers.remotefs [None req-c612cec3-0df9-45ea-a39d-3f6d468e581c tempest-VolumeDependencyTests-442009576 None] /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-42c40d21-294a-47d6-8a4b-e3f75f09845b.info is being set with open permissions: ugo+rw Jul 31 12:36:59 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-c612cec3-0df9-45ea-a39d-3f6d468e581c tempest-VolumeDependencyTests-442009576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-42c40d21-294a-47d6-8a4b-e3f75f09845b.info {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:36:59 devstack sudo[112035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-42c40d21-294a-47d6-8a4b-e3f75f09845b.info Jul 31 12:36:59 devstack sudo[112035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:36:59 devstack sudo[112035]: pam_unix(sudo:session): session closed for user root Jul 31 12:36:59 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-c612cec3-0df9-45ea-a39d-3f6d468e581c tempest-VolumeDependencyTests-442009576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-42c40d21-294a-47d6-8a4b-e3f75f09845b.info" returned: 0 in 0.243s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:36:59 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-c612cec3-0df9-45ea-a39d-3f6d468e581c tempest-VolumeDependencyTests-442009576 None] Acquiring lock "cinder-quobyte-9c5a2f2e-5b30-4a3c-8732-6417d383faca" by "_copy_volume_from_snapshot" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:36:59 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-c612cec3-0df9-45ea-a39d-3f6d468e581c tempest-VolumeDependencyTests-442009576 None] Lock "cinder-quobyte-9c5a2f2e-5b30-4a3c-8732-6417d383faca" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:36:59 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-c612cec3-0df9-45ea-a39d-3f6d468e581c tempest-VolumeDependencyTests-442009576 None] snapshot: 11f934da-32b9-465f-bc98-241808c399c2, volume: 9c5a2f2e-5b30-4a3c-8732-6417d383faca, {{(pid=89182) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Jul 31 12:36:59 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-c612cec3-0df9-45ea-a39d-3f6d468e581c tempest-VolumeDependencyTests-442009576 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:36:59 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-c612cec3-0df9-45ea-a39d-3f6d468e581c tempest-VolumeDependencyTests-442009576 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:36:59 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-c612cec3-0df9-45ea-a39d-3f6d468e581c tempest-VolumeDependencyTests-442009576 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:36:59 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-c612cec3-0df9-45ea-a39d-3f6d468e581c tempest-VolumeDependencyTests-442009576 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:36:59 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-c612cec3-0df9-45ea-a39d-3f6d468e581c tempest-VolumeDependencyTests-442009576 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:36:59 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[aed6f0a5-87fa-4130-b67c-7cda9c8d134b]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:36:59 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-c612cec3-0df9-45ea-a39d-3f6d468e581c tempest-VolumeDependencyTests-442009576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-42c40d21-294a-47d6-8a4b-e3f75f09845b.11f934da-32b9-465f-bc98-241808c399c2 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:36:59 devstack sudo[112038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-42c40d21-294a-47d6-8a4b-e3f75f09845b.11f934da-32b9-465f-bc98-241808c399c2 Jul 31 12:36:59 devstack sudo[112038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:37:00 devstack sudo[112038]: pam_unix(sudo:session): session closed for user root Jul 31 12:37:00 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-c612cec3-0df9-45ea-a39d-3f6d468e581c tempest-VolumeDependencyTests-442009576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-42c40d21-294a-47d6-8a4b-e3f75f09845b.11f934da-32b9-465f-bc98-241808c399c2" returned: 0 in 0.409s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:37:00 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-c612cec3-0df9-45ea-a39d-3f6d468e581c tempest-VolumeDependencyTests-442009576 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-42c40d21-294a-47d6-8a4b-e3f75f09845b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89182) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 12:37:00 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5ca0587-77b8-41ce-ac7e-53f192eb50f3]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:37:00 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-c612cec3-0df9-45ea-a39d-3f6d468e581c tempest-VolumeDependencyTests-442009576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-42c40d21-294a-47d6-8a4b-e3f75f09845b {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:37:00 devstack sudo[112043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-42c40d21-294a-47d6-8a4b-e3f75f09845b Jul 31 12:37:00 devstack sudo[112043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:37:00 devstack sudo[112043]: pam_unix(sudo:session): session closed for user root Jul 31 12:37:00 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-c612cec3-0df9-45ea-a39d-3f6d468e581c tempest-VolumeDependencyTests-442009576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-42c40d21-294a-47d6-8a4b-e3f75f09845b" returned: 0 in 0.379s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:37:00 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-c612cec3-0df9-45ea-a39d-3f6d468e581c tempest-VolumeDependencyTests-442009576 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-42c40d21-294a-47d6-8a4b-e3f75f09845b {{(pid=89182) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Jul 31 12:37:00 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-c612cec3-0df9-45ea-a39d-3f6d468e581c tempest-VolumeDependencyTests-442009576 None] Creating direct copy from snapshot {{(pid=89182) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Jul 31 12:37:00 devstack cinder-volume[89182]: DEBUG cinder.utils [None req-c612cec3-0df9-45ea-a39d-3f6d468e581c tempest-VolumeDependencyTests-442009576 None] Path /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-9c5a2f2e-5b30-4a3c-8732-6417d383faca not found in is_blk_device check {{(pid=89182) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 31 12:37:00 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-c612cec3-0df9-45ea-a39d-3f6d468e581c tempest-VolumeDependencyTests-442009576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-42c40d21-294a-47d6-8a4b-e3f75f09845b /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-9c5a2f2e-5b30-4a3c-8732-6417d383faca {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:37:00 devstack sudo[112048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-42c40d21-294a-47d6-8a4b-e3f75f09845b /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-9c5a2f2e-5b30-4a3c-8732-6417d383faca Jul 31 12:37:00 devstack sudo[112048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:37:00 devstack sudo[112048]: pam_unix(sudo:session): session closed for user root Jul 31 12:37:00 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-c612cec3-0df9-45ea-a39d-3f6d468e581c tempest-VolumeDependencyTests-442009576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-42c40d21-294a-47d6-8a4b-e3f75f09845b /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-9c5a2f2e-5b30-4a3c-8732-6417d383faca" returned: 0 in 0.471s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:37:00 devstack cinder-volume[89182]: DEBUG cinder.image.image_utils [None req-c612cec3-0df9-45ea-a39d-3f6d468e581c tempest-VolumeDependencyTests-442009576 None] Image conversion details: src /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-42c40d21-294a-47d6-8a4b-e3f75f09845b, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-9c5a2f2e-5b30-4a3c-8732-6417d383faca {{(pid=89182) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 31 12:37:00 devstack cinder-volume[89182]: INFO cinder.image.image_utils [None req-c612cec3-0df9-45ea-a39d-3f6d468e581c tempest-VolumeDependencyTests-442009576 None] Converted 1024.00 MB image at 1024.00 MB/s Jul 31 12:37:00 devstack cinder-volume[89182]: WARNING cinder.volume.drivers.remotefs [None req-c612cec3-0df9-45ea-a39d-3f6d468e581c tempest-VolumeDependencyTests-442009576 None] /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-9c5a2f2e-5b30-4a3c-8732-6417d383faca is being set with open permissions: ugo+rw Jul 31 12:37:00 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-c612cec3-0df9-45ea-a39d-3f6d468e581c tempest-VolumeDependencyTests-442009576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-9c5a2f2e-5b30-4a3c-8732-6417d383faca {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:37:00 devstack sudo[112054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-9c5a2f2e-5b30-4a3c-8732-6417d383faca Jul 31 12:37:00 devstack sudo[112054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:37:01 devstack sudo[112054]: pam_unix(sudo:session): session closed for user root Jul 31 12:37:01 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-c612cec3-0df9-45ea-a39d-3f6d468e581c tempest-VolumeDependencyTests-442009576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-9c5a2f2e-5b30-4a3c-8732-6417d383faca" returned: 0 in 0.278s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:37:01 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-c612cec3-0df9-45ea-a39d-3f6d468e581c tempest-VolumeDependencyTests-442009576 None] Lock "cinder-quobyte-9c5a2f2e-5b30-4a3c-8732-6417d383faca" released by "_copy_volume_from_snapshot" :: held 1.612s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:37:01 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-c612cec3-0df9-45ea-a39d-3f6d468e581c tempest-VolumeDependencyTests-442009576 None] Acquiring lock "cinder-quobyte-11f934da-32b9-465f-bc98-241808c399c2" by "_delete_snapshot" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:37:01 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-c612cec3-0df9-45ea-a39d-3f6d468e581c tempest-VolumeDependencyTests-442009576 None] Lock "cinder-quobyte-11f934da-32b9-465f-bc98-241808c399c2" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:37:01 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-c612cec3-0df9-45ea-a39d-3f6d468e581c tempest-VolumeDependencyTests-442009576 None] Deleting offline snapshot 11f934da-32b9-465f-bc98-241808c399c2 of volume 42c40d21-294a-47d6-8a4b-e3f75f09845b {{(pid=89182) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 31 12:37:01 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-c612cec3-0df9-45ea-a39d-3f6d468e581c tempest-VolumeDependencyTests-442009576 None] snapshot_file for this snap is: volume-42c40d21-294a-47d6-8a4b-e3f75f09845b.11f934da-32b9-465f-bc98-241808c399c2 {{(pid=89182) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 31 12:37:01 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[b694bd80-c49e-480f-94d3-d5ba2a6b781c]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:37:01 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-c612cec3-0df9-45ea-a39d-3f6d468e581c tempest-VolumeDependencyTests-442009576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-42c40d21-294a-47d6-8a4b-e3f75f09845b.11f934da-32b9-465f-bc98-241808c399c2 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:37:01 devstack sudo[112057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-42c40d21-294a-47d6-8a4b-e3f75f09845b.11f934da-32b9-465f-bc98-241808c399c2 Jul 31 12:37:01 devstack sudo[112057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:37:01 devstack sudo[112057]: pam_unix(sudo:session): session closed for user root Jul 31 12:37:01 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-c612cec3-0df9-45ea-a39d-3f6d468e581c tempest-VolumeDependencyTests-442009576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-42c40d21-294a-47d6-8a4b-e3f75f09845b.11f934da-32b9-465f-bc98-241808c399c2" returned: 0 in 0.412s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:37:01 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-c612cec3-0df9-45ea-a39d-3f6d468e581c tempest-VolumeDependencyTests-442009576 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-42c40d21-294a-47d6-8a4b-e3f75f09845b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89182) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 12:37:01 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4fbea3f-f4a5-4624-986e-223281a5d096]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:37:01 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-c612cec3-0df9-45ea-a39d-3f6d468e581c tempest-VolumeDependencyTests-442009576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-42c40d21-294a-47d6-8a4b-e3f75f09845b {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:37:01 devstack sudo[112063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-42c40d21-294a-47d6-8a4b-e3f75f09845b Jul 31 12:37:01 devstack sudo[112063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:37:02 devstack sudo[112063]: pam_unix(sudo:session): session closed for user root Jul 31 12:37:02 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-c612cec3-0df9-45ea-a39d-3f6d468e581c tempest-VolumeDependencyTests-442009576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-42c40d21-294a-47d6-8a4b-e3f75f09845b" returned: 0 in 0.443s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:37:02 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-c612cec3-0df9-45ea-a39d-3f6d468e581c tempest-VolumeDependencyTests-442009576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-42c40d21-294a-47d6-8a4b-e3f75f09845b.11f934da-32b9-465f-bc98-241808c399c2 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:37:02 devstack sudo[112068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-42c40d21-294a-47d6-8a4b-e3f75f09845b.11f934da-32b9-465f-bc98-241808c399c2 Jul 31 12:37:02 devstack sudo[112068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:37:02 devstack sudo[112068]: pam_unix(sudo:session): session closed for user root Jul 31 12:37:02 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-c612cec3-0df9-45ea-a39d-3f6d468e581c tempest-VolumeDependencyTests-442009576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-42c40d21-294a-47d6-8a4b-e3f75f09845b.11f934da-32b9-465f-bc98-241808c399c2" returned: 0 in 0.426s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:37:02 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-c612cec3-0df9-45ea-a39d-3f6d468e581c tempest-VolumeDependencyTests-442009576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-42c40d21-294a-47d6-8a4b-e3f75f09845b.11f934da-32b9-465f-bc98-241808c399c2 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:37:02 devstack sudo[112073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-42c40d21-294a-47d6-8a4b-e3f75f09845b.11f934da-32b9-465f-bc98-241808c399c2 Jul 31 12:37:02 devstack sudo[112073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:37:02 devstack sudo[112073]: pam_unix(sudo:session): session closed for user root Jul 31 12:37:02 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-c612cec3-0df9-45ea-a39d-3f6d468e581c tempest-VolumeDependencyTests-442009576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-42c40d21-294a-47d6-8a4b-e3f75f09845b.11f934da-32b9-465f-bc98-241808c399c2" returned: 0 in 0.282s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:37:02 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-c612cec3-0df9-45ea-a39d-3f6d468e581c tempest-VolumeDependencyTests-442009576 None] Lock "cinder-quobyte-11f934da-32b9-465f-bc98-241808c399c2" released by "_delete_snapshot" :: held 1.663s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:37:02 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-c612cec3-0df9-45ea-a39d-3f6d468e581c tempest-VolumeDependencyTests-442009576 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 6.011s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:37:02 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-02e854c3-f371-4742-9e01-2766e416bd08 tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.890s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:37:02 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-02e854c3-f371-4742-9e01-2766e416bd08 tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:36:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1515505002',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=177969d5-f860-45ad-bad4-0d9ad47d3932,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bfbd0c1a82d24c2abd94708a13d08b32',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:36:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:36:57Z,use_quota=True,user_id='ded1236451fe48f2919ae0454dbed235',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)}" {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 12:37:02 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-02e854c3-f371-4742-9e01-2766e416bd08 tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] Creating volume 177969d5-f860-45ad-bad4-0d9ad47d3932 {{(pid=89182) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 12:37:02 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-02e854c3-f371-4742-9e01-2766e416bd08 tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:37:02 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-02e854c3-f371-4742-9e01-2766e416bd08 tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:37:02 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-02e854c3-f371-4742-9e01-2766e416bd08 tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:37:02 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-02e854c3-f371-4742-9e01-2766e416bd08 tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:37:02 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-02e854c3-f371-4742-9e01-2766e416bd08 tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:37:02 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-02e854c3-f371-4742-9e01-2766e416bd08 tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] Selected osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 as target Quobyte volume. {{(pid=89182) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 12:37:02 devstack cinder-volume[89182]: INFO cinder.volume.drivers.remotefs [None req-02e854c3-f371-4742-9e01-2766e416bd08 tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] casted to osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 Jul 31 12:37:02 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-02e854c3-f371-4742-9e01-2766e416bd08 tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-177969d5-f860-45ad-bad4-0d9ad47d3932 1073741824 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:37:02 devstack sudo[112076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-177969d5-f860-45ad-bad4-0d9ad47d3932 1073741824 Jul 31 12:37:02 devstack sudo[112076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:37:03 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-c612cec3-0df9-45ea-a39d-3f6d468e581c tempest-VolumeDependencyTests-442009576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8df5c7d2-1fb1-4159-8194-25dd76409339) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c5a2f2e-5b30-4a3c-8732-6417d383faca', 'volume_size': 1, 'source_volid': '42c40d21-294a-47d6-8a4b-e3f75f09845b', 'source_volstatus': 'available'}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:37:03 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-c612cec3-0df9-45ea-a39d-3f6d468e581c tempest-VolumeDependencyTests-442009576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4593842-9b68-4b7e-afb2-28412c6fe985) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:37:03 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-c612cec3-0df9-45ea-a39d-3f6d468e581c tempest-VolumeDependencyTests-442009576 None] Volume volume-9c5a2f2e-5b30-4a3c-8732-6417d383faca (9c5a2f2e-5b30-4a3c-8732-6417d383faca): created successfully Jul 31 12:37:03 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-c612cec3-0df9-45ea-a39d-3f6d468e581c tempest-VolumeDependencyTests-442009576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4593842-9b68-4b7e-afb2-28412c6fe985) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:37:03 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-c612cec3-0df9-45ea-a39d-3f6d468e581c tempest-VolumeDependencyTests-442009576 None] Flow 'volume_create_manager' (e15778e2-9104-4f68-a1c3-bcfe9273c30a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:37:03 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-c612cec3-0df9-45ea-a39d-3f6d468e581c tempest-VolumeDependencyTests-442009576 None] Created volume successfully. Jul 31 12:37:03 devstack sudo[112076]: pam_unix(sudo:session): session closed for user root Jul 31 12:37:03 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-02e854c3-f371-4742-9e01-2766e416bd08 tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-177969d5-f860-45ad-bad4-0d9ad47d3932 1073741824" returned: 0 in 0.456s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:37:03 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-02e854c3-f371-4742-9e01-2766e416bd08 tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-177969d5-f860-45ad-bad4-0d9ad47d3932 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:37:03 devstack sudo[112083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-177969d5-f860-45ad-bad4-0d9ad47d3932 Jul 31 12:37:03 devstack sudo[112083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:37:03 devstack sudo[112083]: pam_unix(sudo:session): session closed for user root Jul 31 12:37:03 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-02e854c3-f371-4742-9e01-2766e416bd08 tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-177969d5-f860-45ad-bad4-0d9ad47d3932" returned: 0 in 0.259s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:37:03 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-02e854c3-f371-4742-9e01-2766e416bd08 tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] <== create_volume: return (758ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'} {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 12:37:03 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-02e854c3-f371-4742-9e01-2766e416bd08 tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.760s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:37:03 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-22817f40-19cb-4729-8b5b-f41730a92adb tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.183s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:37:03 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-22817f40-19cb-4729-8b5b-f41730a92adb tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:36:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-289468109',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d6e8087-f075-4acb-8a10-e30c61ccb1bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bfbd0c1a82d24c2abd94708a13d08b32',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:36:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:36:57Z,use_quota=True,user_id='ded1236451fe48f2919ae0454dbed235',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)}" {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 12:37:03 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-22817f40-19cb-4729-8b5b-f41730a92adb tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] Creating volume 4d6e8087-f075-4acb-8a10-e30c61ccb1bb {{(pid=89182) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 12:37:03 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-22817f40-19cb-4729-8b5b-f41730a92adb tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:37:03 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-22817f40-19cb-4729-8b5b-f41730a92adb tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:37:03 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-22817f40-19cb-4729-8b5b-f41730a92adb tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:37:03 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-22817f40-19cb-4729-8b5b-f41730a92adb tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:37:03 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-22817f40-19cb-4729-8b5b-f41730a92adb tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:37:03 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-22817f40-19cb-4729-8b5b-f41730a92adb tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] Selected osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 as target Quobyte volume. {{(pid=89182) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 12:37:03 devstack cinder-volume[89182]: INFO cinder.volume.drivers.remotefs [None req-22817f40-19cb-4729-8b5b-f41730a92adb tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] casted to osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 Jul 31 12:37:03 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-22817f40-19cb-4729-8b5b-f41730a92adb tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-4d6e8087-f075-4acb-8a10-e30c61ccb1bb 1073741824 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:37:03 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-02e854c3-f371-4742-9e01-2766e416bd08 tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f38d6ad-9756-436f-809f-5bd87d95ecc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-177969d5-f860-45ad-bad4-0d9ad47d3932', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:37:03 devstack sudo[112086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-4d6e8087-f075-4acb-8a10-e30c61ccb1bb 1073741824 Jul 31 12:37:03 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-02e854c3-f371-4742-9e01-2766e416bd08 tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44d24e4d-4393-469c-bb42-f526ed8e6897) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:37:03 devstack sudo[112086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:37:03 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-02e854c3-f371-4742-9e01-2766e416bd08 tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] Volume volume-177969d5-f860-45ad-bad4-0d9ad47d3932 (177969d5-f860-45ad-bad4-0d9ad47d3932): created successfully Jul 31 12:37:03 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-02e854c3-f371-4742-9e01-2766e416bd08 tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44d24e4d-4393-469c-bb42-f526ed8e6897) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:37:03 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-02e854c3-f371-4742-9e01-2766e416bd08 tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] Flow 'volume_create_manager' (d49bd9cd-f653-4c73-808b-6d02a99d0084) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:37:03 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-02e854c3-f371-4742-9e01-2766e416bd08 tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] Created volume successfully. Jul 31 12:37:03 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-7cadbd37-afc7-4be1-a0a2-fa803896d844 tempest-VolumeDependencyTests-442009576 None] Acquiring lock "cinder-95aca6b6-cfbc-429a-908b-24083c170e76-delete_snapshot" by "delete_snapshot" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:37:03 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-7cadbd37-afc7-4be1-a0a2-fa803896d844 tempest-VolumeDependencyTests-442009576 None] Lock "cinder-95aca6b6-cfbc-429a-908b-24083c170e76-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:37:03 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-7cadbd37-afc7-4be1-a0a2-fa803896d844 tempest-VolumeDependencyTests-442009576 None] Acquiring lock "cinder-quobyte-ca5d8c89-9ec6-4058-8d58-5c1e42ac9371" by "delete_snapshot" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:37:03 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-7cadbd37-afc7-4be1-a0a2-fa803896d844 tempest-VolumeDependencyTests-442009576 None] Lock "cinder-quobyte-ca5d8c89-9ec6-4058-8d58-5c1e42ac9371" acquired by "delete_snapshot" :: waited 0.020s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:37:03 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-7cadbd37-afc7-4be1-a0a2-fa803896d844 tempest-VolumeDependencyTests-442009576 None] Acquiring lock "cinder-quobyte-95aca6b6-cfbc-429a-908b-24083c170e76" by "_delete_snapshot" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:37:03 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-7cadbd37-afc7-4be1-a0a2-fa803896d844 tempest-VolumeDependencyTests-442009576 None] Lock "cinder-quobyte-95aca6b6-cfbc-429a-908b-24083c170e76" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:37:03 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-7cadbd37-afc7-4be1-a0a2-fa803896d844 tempest-VolumeDependencyTests-442009576 None] Deleting offline snapshot 95aca6b6-cfbc-429a-908b-24083c170e76 of volume ca5d8c89-9ec6-4058-8d58-5c1e42ac9371 {{(pid=89182) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 31 12:37:03 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-7cadbd37-afc7-4be1-a0a2-fa803896d844 tempest-VolumeDependencyTests-442009576 None] snapshot_file for this snap is: volume-ca5d8c89-9ec6-4058-8d58-5c1e42ac9371.95aca6b6-cfbc-429a-908b-24083c170e76 {{(pid=89182) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 31 12:37:03 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0a60dea-30fd-4efb-9119-ddc79a2f54ea]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:37:03 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-7cadbd37-afc7-4be1-a0a2-fa803896d844 tempest-VolumeDependencyTests-442009576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-ca5d8c89-9ec6-4058-8d58-5c1e42ac9371.95aca6b6-cfbc-429a-908b-24083c170e76 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:37:04 devstack sudo[112088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-ca5d8c89-9ec6-4058-8d58-5c1e42ac9371.95aca6b6-cfbc-429a-908b-24083c170e76 Jul 31 12:37:04 devstack sudo[112088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:37:04 devstack sudo[112086]: pam_unix(sudo:session): session closed for user root Jul 31 12:37:04 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-22817f40-19cb-4729-8b5b-f41730a92adb tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-4d6e8087-f075-4acb-8a10-e30c61ccb1bb 1073741824" returned: 0 in 0.611s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:37:04 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-22817f40-19cb-4729-8b5b-f41730a92adb tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-4d6e8087-f075-4acb-8a10-e30c61ccb1bb {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:37:04 devstack sudo[112097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-4d6e8087-f075-4acb-8a10-e30c61ccb1bb Jul 31 12:37:04 devstack sudo[112097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:37:04 devstack sudo[112088]: pam_unix(sudo:session): session closed for user root Jul 31 12:37:04 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-7cadbd37-afc7-4be1-a0a2-fa803896d844 tempest-VolumeDependencyTests-442009576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-ca5d8c89-9ec6-4058-8d58-5c1e42ac9371.95aca6b6-cfbc-429a-908b-24083c170e76" returned: 0 in 0.444s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:37:04 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-7cadbd37-afc7-4be1-a0a2-fa803896d844 tempest-VolumeDependencyTests-442009576 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ca5d8c89-9ec6-4058-8d58-5c1e42ac9371(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89182) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 12:37:04 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[1eb571a0-a2d4-4f91-b437-1ac713b2b7c3]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:37:04 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-7cadbd37-afc7-4be1-a0a2-fa803896d844 tempest-VolumeDependencyTests-442009576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-ca5d8c89-9ec6-4058-8d58-5c1e42ac9371 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:37:04 devstack sudo[112099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-ca5d8c89-9ec6-4058-8d58-5c1e42ac9371 Jul 31 12:37:04 devstack sudo[112099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:37:04 devstack sudo[112097]: pam_unix(sudo:session): session closed for user root Jul 31 12:37:04 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-22817f40-19cb-4729-8b5b-f41730a92adb tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-4d6e8087-f075-4acb-8a10-e30c61ccb1bb" returned: 0 in 0.277s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:37:04 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-22817f40-19cb-4729-8b5b-f41730a92adb tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] <== create_volume: return (941ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'} {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 12:37:04 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-22817f40-19cb-4729-8b5b-f41730a92adb tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.945s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:37:04 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-dec480c6-3064-45d6-a56b-a8f1ed1c15e9 tempest-CreateVolumesFromSnapshotTest-1185178291 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 6.563s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:37:04 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-dec480c6-3064-45d6-a56b-a8f1ed1c15e9 tempest-CreateVolumesFromSnapshotTest-1185178291 None] Creating offline snapshot 623d7d2a-1106-43b7-a4c2-a7a3217d6894 of volume eb17bd40-f8bd-4485-ac68-569e5a061f1d {{(pid=89182) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 31 12:37:04 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-22817f40-19cb-4729-8b5b-f41730a92adb tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ec0e330-c9af-4abe-ba3c-bdeb60ccf72b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4d6e8087-f075-4acb-8a10-e30c61ccb1bb', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:37:04 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-22817f40-19cb-4729-8b5b-f41730a92adb tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd4367e1-281d-4251-8f98-c05f831d9ea8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:37:04 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[45f5c451-1538-42bc-837b-4a7216d7c534]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:37:04 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-dec480c6-3064-45d6-a56b-a8f1ed1c15e9 tempest-CreateVolumesFromSnapshotTest-1185178291 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-eb17bd40-f8bd-4485-ac68-569e5a061f1d {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:37:04 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-22817f40-19cb-4729-8b5b-f41730a92adb tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] Volume volume-4d6e8087-f075-4acb-8a10-e30c61ccb1bb (4d6e8087-f075-4acb-8a10-e30c61ccb1bb): created successfully Jul 31 12:37:04 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-22817f40-19cb-4729-8b5b-f41730a92adb tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd4367e1-281d-4251-8f98-c05f831d9ea8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:37:04 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-22817f40-19cb-4729-8b5b-f41730a92adb tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] Flow 'volume_create_manager' (e1f7a3cb-f534-4bef-97c3-cea402d42d36) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:37:04 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-22817f40-19cb-4729-8b5b-f41730a92adb tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] Created volume successfully. Jul 31 12:37:04 devstack sudo[112102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-eb17bd40-f8bd-4485-ac68-569e5a061f1d Jul 31 12:37:04 devstack sudo[112102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:37:05 devstack sudo[112099]: pam_unix(sudo:session): session closed for user root Jul 31 12:37:05 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-7cadbd37-afc7-4be1-a0a2-fa803896d844 tempest-VolumeDependencyTests-442009576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-ca5d8c89-9ec6-4058-8d58-5c1e42ac9371" returned: 0 in 0.641s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:37:05 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-7cadbd37-afc7-4be1-a0a2-fa803896d844 tempest-VolumeDependencyTests-442009576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-ca5d8c89-9ec6-4058-8d58-5c1e42ac9371.95aca6b6-cfbc-429a-908b-24083c170e76 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:37:05 devstack sudo[112110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-ca5d8c89-9ec6-4058-8d58-5c1e42ac9371.95aca6b6-cfbc-429a-908b-24083c170e76 Jul 31 12:37:05 devstack sudo[112110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:37:05 devstack sudo[112102]: pam_unix(sudo:session): session closed for user root Jul 31 12:37:05 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-dec480c6-3064-45d6-a56b-a8f1ed1c15e9 tempest-CreateVolumesFromSnapshotTest-1185178291 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-eb17bd40-f8bd-4485-ac68-569e5a061f1d" returned: 0 in 0.426s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:37:05 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-dec480c6-3064-45d6-a56b-a8f1ed1c15e9 tempest-CreateVolumesFromSnapshotTest-1185178291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-eb17bd40-f8bd-4485-ac68-569e5a061f1d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-eb17bd40-f8bd-4485-ac68-569e5a061f1d.623d7d2a-1106-43b7-a4c2-a7a3217d6894 1G {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:37:05 devstack sudo[112112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-eb17bd40-f8bd-4485-ac68-569e5a061f1d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-eb17bd40-f8bd-4485-ac68-569e5a061f1d.623d7d2a-1106-43b7-a4c2-a7a3217d6894 1G Jul 31 12:37:05 devstack sudo[112112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:37:05 devstack sudo[112110]: pam_unix(sudo:session): session closed for user root Jul 31 12:37:05 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-7cadbd37-afc7-4be1-a0a2-fa803896d844 tempest-VolumeDependencyTests-442009576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-ca5d8c89-9ec6-4058-8d58-5c1e42ac9371.95aca6b6-cfbc-429a-908b-24083c170e76" returned: 0 in 0.423s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:37:05 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-7cadbd37-afc7-4be1-a0a2-fa803896d844 tempest-VolumeDependencyTests-442009576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-ca5d8c89-9ec6-4058-8d58-5c1e42ac9371.95aca6b6-cfbc-429a-908b-24083c170e76 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:37:05 devstack sudo[112120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-ca5d8c89-9ec6-4058-8d58-5c1e42ac9371.95aca6b6-cfbc-429a-908b-24083c170e76 Jul 31 12:37:05 devstack sudo[112120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:37:05 devstack sudo[112112]: pam_unix(sudo:session): session closed for user root Jul 31 12:37:05 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-dec480c6-3064-45d6-a56b-a8f1ed1c15e9 tempest-CreateVolumesFromSnapshotTest-1185178291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-eb17bd40-f8bd-4485-ac68-569e5a061f1d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-eb17bd40-f8bd-4485-ac68-569e5a061f1d.623d7d2a-1106-43b7-a4c2-a7a3217d6894 1G" returned: 0 in 0.506s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:37:05 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-dec480c6-3064-45d6-a56b-a8f1ed1c15e9 tempest-CreateVolumesFromSnapshotTest-1185178291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eb17bd40-f8bd-4485-ac68-569e5a061f1d -F qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-eb17bd40-f8bd-4485-ac68-569e5a061f1d.623d7d2a-1106-43b7-a4c2-a7a3217d6894 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:37:05 devstack sudo[112123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eb17bd40-f8bd-4485-ac68-569e5a061f1d -F qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-eb17bd40-f8bd-4485-ac68-569e5a061f1d.623d7d2a-1106-43b7-a4c2-a7a3217d6894 Jul 31 12:37:05 devstack sudo[112123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:37:05 devstack sudo[112120]: pam_unix(sudo:session): session closed for user root Jul 31 12:37:05 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-7cadbd37-afc7-4be1-a0a2-fa803896d844 tempest-VolumeDependencyTests-442009576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-ca5d8c89-9ec6-4058-8d58-5c1e42ac9371.95aca6b6-cfbc-429a-908b-24083c170e76" returned: 0 in 0.323s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:37:05 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-7cadbd37-afc7-4be1-a0a2-fa803896d844 tempest-VolumeDependencyTests-442009576 None] Lock "cinder-quobyte-95aca6b6-cfbc-429a-908b-24083c170e76" released by "_delete_snapshot" :: held 1.970s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:37:05 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-7cadbd37-afc7-4be1-a0a2-fa803896d844 tempest-VolumeDependencyTests-442009576 None] Lock "cinder-quobyte-ca5d8c89-9ec6-4058-8d58-5c1e42ac9371" released by "delete_snapshot" :: held 1.999s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:37:06 devstack cinder-volume[89182]: DEBUG cinder.quota [None req-7cadbd37-afc7-4be1-a0a2-fa803896d844 tempest-VolumeDependencyTests-442009576 None] Created reservations ['222c7627-0ad8-4d46-b654-682a1e0f776e', '1dfc0e13-9d3f-40f0-ad8d-f915f309bcad', 'f184e6c8-0ca3-40b9-a32d-19358c3f491c', 'a4cc4840-20f9-4340-9633-cd2cf35f791b'] {{(pid=89182) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 12:37:06 devstack sudo[112123]: pam_unix(sudo:session): session closed for user root Jul 31 12:37:06 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-dec480c6-3064-45d6-a56b-a8f1ed1c15e9 tempest-CreateVolumesFromSnapshotTest-1185178291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eb17bd40-f8bd-4485-ac68-569e5a061f1d -F qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-eb17bd40-f8bd-4485-ac68-569e5a061f1d.623d7d2a-1106-43b7-a4c2-a7a3217d6894" returned: 0 in 0.368s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:37:06 devstack cinder-volume[89182]: WARNING cinder.volume.drivers.remotefs [None req-dec480c6-3064-45d6-a56b-a8f1ed1c15e9 tempest-CreateVolumesFromSnapshotTest-1185178291 None] /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-eb17bd40-f8bd-4485-ac68-569e5a061f1d.623d7d2a-1106-43b7-a4c2-a7a3217d6894 is being set with open permissions: ugo+rw Jul 31 12:37:06 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-dec480c6-3064-45d6-a56b-a8f1ed1c15e9 tempest-CreateVolumesFromSnapshotTest-1185178291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-eb17bd40-f8bd-4485-ac68-569e5a061f1d.623d7d2a-1106-43b7-a4c2-a7a3217d6894 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:37:06 devstack sudo[112131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-eb17bd40-f8bd-4485-ac68-569e5a061f1d.623d7d2a-1106-43b7-a4c2-a7a3217d6894 Jul 31 12:37:06 devstack sudo[112131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:37:06 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-7cadbd37-afc7-4be1-a0a2-fa803896d844 tempest-VolumeDependencyTests-442009576 None] Delete snapshot completed successfully. Jul 31 12:37:06 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-7cadbd37-afc7-4be1-a0a2-fa803896d844 tempest-VolumeDependencyTests-442009576 None] Lock "cinder-95aca6b6-cfbc-429a-908b-24083c170e76-delete_snapshot" released by "delete_snapshot" :: held 2.196s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:37:06 devstack sudo[112131]: pam_unix(sudo:session): session closed for user root Jul 31 12:37:06 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-dec480c6-3064-45d6-a56b-a8f1ed1c15e9 tempest-CreateVolumesFromSnapshotTest-1185178291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-eb17bd40-f8bd-4485-ac68-569e5a061f1d.623d7d2a-1106-43b7-a4c2-a7a3217d6894" returned: 0 in 0.285s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:37:06 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-dec480c6-3064-45d6-a56b-a8f1ed1c15e9 tempest-CreateVolumesFromSnapshotTest-1185178291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-eb17bd40-f8bd-4485-ac68-569e5a061f1d.info {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:37:06 devstack sudo[112134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-eb17bd40-f8bd-4485-ac68-569e5a061f1d.info Jul 31 12:37:06 devstack sudo[112134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:37:06 devstack sudo[112134]: pam_unix(sudo:session): session closed for user root Jul 31 12:37:06 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-dec480c6-3064-45d6-a56b-a8f1ed1c15e9 tempest-CreateVolumesFromSnapshotTest-1185178291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-eb17bd40-f8bd-4485-ac68-569e5a061f1d.info" returned: 0 in 0.278s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:37:06 devstack cinder-volume[89182]: WARNING cinder.volume.drivers.remotefs [None req-dec480c6-3064-45d6-a56b-a8f1ed1c15e9 tempest-CreateVolumesFromSnapshotTest-1185178291 None] /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-eb17bd40-f8bd-4485-ac68-569e5a061f1d.info is being set with open permissions: ugo+rw Jul 31 12:37:06 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-dec480c6-3064-45d6-a56b-a8f1ed1c15e9 tempest-CreateVolumesFromSnapshotTest-1185178291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-eb17bd40-f8bd-4485-ac68-569e5a061f1d.info {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:37:06 devstack sudo[112137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-eb17bd40-f8bd-4485-ac68-569e5a061f1d.info Jul 31 12:37:06 devstack sudo[112137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:37:06 devstack sudo[112137]: pam_unix(sudo:session): session closed for user root Jul 31 12:37:06 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-dec480c6-3064-45d6-a56b-a8f1ed1c15e9 tempest-CreateVolumesFromSnapshotTest-1185178291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-eb17bd40-f8bd-4485-ac68-569e5a061f1d.info" returned: 0 in 0.269s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:37:06 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-dec480c6-3064-45d6-a56b-a8f1ed1c15e9 tempest-CreateVolumesFromSnapshotTest-1185178291 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.257s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:37:06 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-9b3e9ec0-8b09-4dc4-80d3-06c5fa73fd1b tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.714s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:37:06 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-9b3e9ec0-8b09-4dc4-80d3-06c5fa73fd1b tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:36:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-83079991',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=734a2868-6cd5-4d71-9abb-d61fe285435f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bfbd0c1a82d24c2abd94708a13d08b32',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:36:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:36:58Z,use_quota=True,user_id='ded1236451fe48f2919ae0454dbed235',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)}" {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 12:37:06 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-9b3e9ec0-8b09-4dc4-80d3-06c5fa73fd1b tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] Creating volume 734a2868-6cd5-4d71-9abb-d61fe285435f {{(pid=89182) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 12:37:06 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-9b3e9ec0-8b09-4dc4-80d3-06c5fa73fd1b tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:37:06 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-9b3e9ec0-8b09-4dc4-80d3-06c5fa73fd1b tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:37:06 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-9b3e9ec0-8b09-4dc4-80d3-06c5fa73fd1b tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:37:06 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-9b3e9ec0-8b09-4dc4-80d3-06c5fa73fd1b tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:37:06 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-9b3e9ec0-8b09-4dc4-80d3-06c5fa73fd1b tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:37:06 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-9b3e9ec0-8b09-4dc4-80d3-06c5fa73fd1b tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] Selected osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 as target Quobyte volume. {{(pid=89182) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 12:37:06 devstack cinder-volume[89182]: INFO cinder.volume.drivers.remotefs [None req-9b3e9ec0-8b09-4dc4-80d3-06c5fa73fd1b tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] casted to osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 Jul 31 12:37:06 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-9b3e9ec0-8b09-4dc4-80d3-06c5fa73fd1b tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-734a2868-6cd5-4d71-9abb-d61fe285435f 1073741824 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:37:06 devstack sudo[112140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-734a2868-6cd5-4d71-9abb-d61fe285435f 1073741824 Jul 31 12:37:06 devstack sudo[112140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:37:06 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-dec480c6-3064-45d6-a56b-a8f1ed1c15e9 tempest-CreateVolumesFromSnapshotTest-1185178291 None] Create snapshot completed successfully Jul 31 12:37:07 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-4ee0a0d1-c91f-47ae-a7b2-fc8b68f4f195 tempest-VolumeDependencyTests-442009576 None] Acquiring lock "cinder-24ff7149-be4a-498c-a2d4-e93e5e951ca0-delete_snapshot" by "delete_snapshot" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:37:07 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-4ee0a0d1-c91f-47ae-a7b2-fc8b68f4f195 tempest-VolumeDependencyTests-442009576 None] Lock "cinder-24ff7149-be4a-498c-a2d4-e93e5e951ca0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:37:07 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-4ee0a0d1-c91f-47ae-a7b2-fc8b68f4f195 tempest-VolumeDependencyTests-442009576 None] Acquiring lock "cinder-quobyte-8c784aa3-b637-4a2f-a70b-058a3b465b2a" by "delete_snapshot" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:37:07 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-4ee0a0d1-c91f-47ae-a7b2-fc8b68f4f195 tempest-VolumeDependencyTests-442009576 None] Lock "cinder-quobyte-8c784aa3-b637-4a2f-a70b-058a3b465b2a" acquired by "delete_snapshot" :: waited 0.016s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:37:07 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-4ee0a0d1-c91f-47ae-a7b2-fc8b68f4f195 tempest-VolumeDependencyTests-442009576 None] Acquiring lock "cinder-quobyte-24ff7149-be4a-498c-a2d4-e93e5e951ca0" by "_delete_snapshot" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:37:07 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-4ee0a0d1-c91f-47ae-a7b2-fc8b68f4f195 tempest-VolumeDependencyTests-442009576 None] Lock "cinder-quobyte-24ff7149-be4a-498c-a2d4-e93e5e951ca0" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:37:07 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-4ee0a0d1-c91f-47ae-a7b2-fc8b68f4f195 tempest-VolumeDependencyTests-442009576 None] Deleting offline snapshot 24ff7149-be4a-498c-a2d4-e93e5e951ca0 of volume 8c784aa3-b637-4a2f-a70b-058a3b465b2a {{(pid=89182) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 31 12:37:07 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-4ee0a0d1-c91f-47ae-a7b2-fc8b68f4f195 tempest-VolumeDependencyTests-442009576 None] snapshot_file for this snap is: volume-8c784aa3-b637-4a2f-a70b-058a3b465b2a.24ff7149-be4a-498c-a2d4-e93e5e951ca0 {{(pid=89182) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 31 12:37:07 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7b7855d-a40f-4e56-9e43-36990c0b9249]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:37:07 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-4ee0a0d1-c91f-47ae-a7b2-fc8b68f4f195 tempest-VolumeDependencyTests-442009576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-8c784aa3-b637-4a2f-a70b-058a3b465b2a.24ff7149-be4a-498c-a2d4-e93e5e951ca0 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:37:07 devstack sudo[112145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-8c784aa3-b637-4a2f-a70b-058a3b465b2a.24ff7149-be4a-498c-a2d4-e93e5e951ca0 Jul 31 12:37:07 devstack sudo[112145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:37:07 devstack sudo[112140]: pam_unix(sudo:session): session closed for user root Jul 31 12:37:07 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-9b3e9ec0-8b09-4dc4-80d3-06c5fa73fd1b tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-734a2868-6cd5-4d71-9abb-d61fe285435f 1073741824" returned: 0 in 0.544s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:37:07 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-9b3e9ec0-8b09-4dc4-80d3-06c5fa73fd1b tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-734a2868-6cd5-4d71-9abb-d61fe285435f {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:37:07 devstack sudo[112152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-734a2868-6cd5-4d71-9abb-d61fe285435f Jul 31 12:37:07 devstack sudo[112152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:37:07 devstack sudo[112145]: pam_unix(sudo:session): session closed for user root Jul 31 12:37:07 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-4ee0a0d1-c91f-47ae-a7b2-fc8b68f4f195 tempest-VolumeDependencyTests-442009576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-8c784aa3-b637-4a2f-a70b-058a3b465b2a.24ff7149-be4a-498c-a2d4-e93e5e951ca0" returned: 0 in 0.427s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:37:07 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-4ee0a0d1-c91f-47ae-a7b2-fc8b68f4f195 tempest-VolumeDependencyTests-442009576 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8c784aa3-b637-4a2f-a70b-058a3b465b2a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89182) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 12:37:07 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[a77940c2-cf55-448d-be73-6ab5d1ce23e6]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:37:07 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-4ee0a0d1-c91f-47ae-a7b2-fc8b68f4f195 tempest-VolumeDependencyTests-442009576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-8c784aa3-b637-4a2f-a70b-058a3b465b2a {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:37:07 devstack sudo[112158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-8c784aa3-b637-4a2f-a70b-058a3b465b2a Jul 31 12:37:07 devstack sudo[112158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:37:07 devstack cinder-volume[89182]: DEBUG cinder.volume.flows.manager.create_volume [None req-68be7faa-d58b-4efa-86ed-1d782c90ff3d tempest-CreateVolumesFromSnapshotTest-1185178291 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89182) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 12:37:07 devstack sudo[112152]: pam_unix(sudo:session): session closed for user root Jul 31 12:37:07 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-68be7faa-d58b-4efa-86ed-1d782c90ff3d tempest-CreateVolumesFromSnapshotTest-1185178291 None] Flow 'volume_create_manager' (f5ddafd2-478f-4edc-8ac5-4c9792d37d6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:37:07 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-68be7faa-d58b-4efa-86ed-1d782c90ff3d tempest-CreateVolumesFromSnapshotTest-1185178291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (609e8ea3-809c-4eee-8502-1579c3976078) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:37:08 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-9b3e9ec0-8b09-4dc4-80d3-06c5fa73fd1b tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-734a2868-6cd5-4d71-9abb-d61fe285435f" returned: 0 in 0.466s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:37:08 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-9b3e9ec0-8b09-4dc4-80d3-06c5fa73fd1b tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] <== create_volume: return (1074ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'} {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 12:37:08 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-9b3e9ec0-8b09-4dc4-80d3-06c5fa73fd1b tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.079s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:37:08 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-c7839c60-2579-4067-b573-642424a272e8 tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.499s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:37:08 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-c7839c60-2579-4067-b573-642424a272e8 tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:36:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1424721905',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9922a446-63fc-4c60-a625-6aa16bfe3440,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bfbd0c1a82d24c2abd94708a13d08b32',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:36:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:36:58Z,use_quota=True,user_id='ded1236451fe48f2919ae0454dbed235',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)}" {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 12:37:08 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-c7839c60-2579-4067-b573-642424a272e8 tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] Creating volume 9922a446-63fc-4c60-a625-6aa16bfe3440 {{(pid=89182) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 12:37:08 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-c7839c60-2579-4067-b573-642424a272e8 tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:37:08 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-c7839c60-2579-4067-b573-642424a272e8 tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:37:08 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-c7839c60-2579-4067-b573-642424a272e8 tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:37:08 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-c7839c60-2579-4067-b573-642424a272e8 tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:37:08 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-c7839c60-2579-4067-b573-642424a272e8 tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:37:08 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-c7839c60-2579-4067-b573-642424a272e8 tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] Selected osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 as target Quobyte volume. {{(pid=89182) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 12:37:08 devstack cinder-volume[89182]: INFO cinder.volume.drivers.remotefs [None req-c7839c60-2579-4067-b573-642424a272e8 tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] casted to osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 Jul 31 12:37:08 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-c7839c60-2579-4067-b573-642424a272e8 tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-9922a446-63fc-4c60-a625-6aa16bfe3440 1073741824 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:37:08 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-68be7faa-d58b-4efa-86ed-1d782c90ff3d tempest-CreateVolumesFromSnapshotTest-1185178291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (609e8ea3-809c-4eee-8502-1579c3976078) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:37:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1866664659',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76d99f77-9ddb-4568-9cd5-e0c478330306,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73b25c0a73d14ed6baac1d54f3a462b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:37:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:37:08Z,use_quota=True,user_id='581f5fa15e8c451db457aa17e8682712',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:37:08 devstack sudo[112161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-9922a446-63fc-4c60-a625-6aa16bfe3440 1073741824 Jul 31 12:37:08 devstack sudo[112161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:37:08 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-68be7faa-d58b-4efa-86ed-1d782c90ff3d tempest-CreateVolumesFromSnapshotTest-1185178291 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ada892d-b8e8-4c53-940d-0f2f885db9f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:37:08 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-68be7faa-d58b-4efa-86ed-1d782c90ff3d tempest-CreateVolumesFromSnapshotTest-1185178291 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ada892d-b8e8-4c53-940d-0f2f885db9f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:37:08 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-68be7faa-d58b-4efa-86ed-1d782c90ff3d tempest-CreateVolumesFromSnapshotTest-1185178291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5bedbb6-24ee-41e5-b955-fe8502de26bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:37:08 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-68be7faa-d58b-4efa-86ed-1d782c90ff3d tempest-CreateVolumesFromSnapshotTest-1185178291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5bedbb6-24ee-41e5-b955-fe8502de26bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '76d99f77-9ddb-4568-9cd5-e0c478330306', 'volume_name': 'volume-76d99f77-9ddb-4568-9cd5-e0c478330306', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:37:08 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-68be7faa-d58b-4efa-86ed-1d782c90ff3d tempest-CreateVolumesFromSnapshotTest-1185178291 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0747aa1d-b9f9-4311-ade4-261010ba71de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:37:08 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-68be7faa-d58b-4efa-86ed-1d782c90ff3d tempest-CreateVolumesFromSnapshotTest-1185178291 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0747aa1d-b9f9-4311-ade4-261010ba71de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:37:08 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-68be7faa-d58b-4efa-86ed-1d782c90ff3d tempest-CreateVolumesFromSnapshotTest-1185178291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef596e49-5c6f-4180-baf8-7f324facaf88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:37:08 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-68be7faa-d58b-4efa-86ed-1d782c90ff3d tempest-CreateVolumesFromSnapshotTest-1185178291 None] Volume 76d99f77-9ddb-4568-9cd5-e0c478330306: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-76d99f77-9ddb-4568-9cd5-e0c478330306', 'volume_size': 1} Jul 31 12:37:08 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-68be7faa-d58b-4efa-86ed-1d782c90ff3d tempest-CreateVolumesFromSnapshotTest-1185178291 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:37:08 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-9b3e9ec0-8b09-4dc4-80d3-06c5fa73fd1b tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1c7c4e3-b5ed-4117-aafa-8b89ded8181e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-734a2868-6cd5-4d71-9abb-d61fe285435f', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:37:08 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-9b3e9ec0-8b09-4dc4-80d3-06c5fa73fd1b tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e489f8e7-443e-4ed7-93cd-91388f6a56a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:37:08 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-9b3e9ec0-8b09-4dc4-80d3-06c5fa73fd1b tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] Volume volume-734a2868-6cd5-4d71-9abb-d61fe285435f (734a2868-6cd5-4d71-9abb-d61fe285435f): created successfully Jul 31 12:37:08 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-9b3e9ec0-8b09-4dc4-80d3-06c5fa73fd1b tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e489f8e7-443e-4ed7-93cd-91388f6a56a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:37:08 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-9b3e9ec0-8b09-4dc4-80d3-06c5fa73fd1b tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] Flow 'volume_create_manager' (ccce374d-96b2-4193-90e5-6f187d109ec0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:37:08 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-9b3e9ec0-8b09-4dc4-80d3-06c5fa73fd1b tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] Created volume successfully. Jul 31 12:37:08 devstack sudo[112158]: pam_unix(sudo:session): session closed for user root Jul 31 12:37:08 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-4ee0a0d1-c91f-47ae-a7b2-fc8b68f4f195 tempest-VolumeDependencyTests-442009576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-8c784aa3-b637-4a2f-a70b-058a3b465b2a" returned: 0 in 0.608s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:37:08 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-4ee0a0d1-c91f-47ae-a7b2-fc8b68f4f195 tempest-VolumeDependencyTests-442009576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-8c784aa3-b637-4a2f-a70b-058a3b465b2a.24ff7149-be4a-498c-a2d4-e93e5e951ca0 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:37:08 devstack sudo[112166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-8c784aa3-b637-4a2f-a70b-058a3b465b2a.24ff7149-be4a-498c-a2d4-e93e5e951ca0 Jul 31 12:37:08 devstack sudo[112166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:37:08 devstack cinder-volume[89182]: DEBUG cinder.volume.flows.manager.create_volume [None req-c011695f-c8f7-4f48-8e42-f9b7e120a7c9 tempest-CreateVolumesFromSnapshotTest-1185178291 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89182) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 12:37:08 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-c011695f-c8f7-4f48-8e42-f9b7e120a7c9 tempest-CreateVolumesFromSnapshotTest-1185178291 None] Flow 'volume_create_manager' (d750130b-c5f7-46e7-b75b-4bae3b66ba76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:37:08 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-c011695f-c8f7-4f48-8e42-f9b7e120a7c9 tempest-CreateVolumesFromSnapshotTest-1185178291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59b434d3-8ca0-4ef2-8dc8-6169ef9ea1ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:37:08 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-c011695f-c8f7-4f48-8e42-f9b7e120a7c9 tempest-CreateVolumesFromSnapshotTest-1185178291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59b434d3-8ca0-4ef2-8dc8-6169ef9ea1ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:37:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1648370795',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df6f55b0-321b-41bb-8bd2-5725e0bf0e63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73b25c0a73d14ed6baac1d54f3a462b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:37:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:37:08Z,use_quota=True,user_id='581f5fa15e8c451db457aa17e8682712',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:37:08 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-c011695f-c8f7-4f48-8e42-f9b7e120a7c9 tempest-CreateVolumesFromSnapshotTest-1185178291 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3a7a190-97a1-436e-b8e7-05fe31b2a725) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:37:08 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-c011695f-c8f7-4f48-8e42-f9b7e120a7c9 tempest-CreateVolumesFromSnapshotTest-1185178291 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3a7a190-97a1-436e-b8e7-05fe31b2a725) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:37:08 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-c011695f-c8f7-4f48-8e42-f9b7e120a7c9 tempest-CreateVolumesFromSnapshotTest-1185178291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c9333b0-5795-447b-9d61-512127dc642c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:37:08 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-c011695f-c8f7-4f48-8e42-f9b7e120a7c9 tempest-CreateVolumesFromSnapshotTest-1185178291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c9333b0-5795-447b-9d61-512127dc642c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'df6f55b0-321b-41bb-8bd2-5725e0bf0e63', 'volume_name': 'volume-df6f55b0-321b-41bb-8bd2-5725e0bf0e63', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:37:08 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-c011695f-c8f7-4f48-8e42-f9b7e120a7c9 tempest-CreateVolumesFromSnapshotTest-1185178291 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e23dfe46-979a-4ee2-9fc7-8d903ffc9f32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:37:08 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-c011695f-c8f7-4f48-8e42-f9b7e120a7c9 tempest-CreateVolumesFromSnapshotTest-1185178291 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e23dfe46-979a-4ee2-9fc7-8d903ffc9f32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:37:08 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-c011695f-c8f7-4f48-8e42-f9b7e120a7c9 tempest-CreateVolumesFromSnapshotTest-1185178291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8a7510b-d9a3-4de2-b8d9-e7a79d6224bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:37:08 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-c011695f-c8f7-4f48-8e42-f9b7e120a7c9 tempest-CreateVolumesFromSnapshotTest-1185178291 None] Volume df6f55b0-321b-41bb-8bd2-5725e0bf0e63: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-df6f55b0-321b-41bb-8bd2-5725e0bf0e63', 'volume_size': 1} Jul 31 12:37:08 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-c011695f-c8f7-4f48-8e42-f9b7e120a7c9 tempest-CreateVolumesFromSnapshotTest-1185178291 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:37:08 devstack sudo[112161]: pam_unix(sudo:session): session closed for user root Jul 31 12:37:08 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-c7839c60-2579-4067-b573-642424a272e8 tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-9922a446-63fc-4c60-a625-6aa16bfe3440 1073741824" returned: 0 in 0.724s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:37:08 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-c7839c60-2579-4067-b573-642424a272e8 tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-9922a446-63fc-4c60-a625-6aa16bfe3440 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:37:08 devstack sudo[112176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-9922a446-63fc-4c60-a625-6aa16bfe3440 Jul 31 12:37:08 devstack sudo[112176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:37:08 devstack sudo[112166]: pam_unix(sudo:session): session closed for user root Jul 31 12:37:08 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-4ee0a0d1-c91f-47ae-a7b2-fc8b68f4f195 tempest-VolumeDependencyTests-442009576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-8c784aa3-b637-4a2f-a70b-058a3b465b2a.24ff7149-be4a-498c-a2d4-e93e5e951ca0" returned: 0 in 0.620s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:37:08 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-4ee0a0d1-c91f-47ae-a7b2-fc8b68f4f195 tempest-VolumeDependencyTests-442009576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-8c784aa3-b637-4a2f-a70b-058a3b465b2a.24ff7149-be4a-498c-a2d4-e93e5e951ca0 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:37:08 devstack sudo[112178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-8c784aa3-b637-4a2f-a70b-058a3b465b2a.24ff7149-be4a-498c-a2d4-e93e5e951ca0 Jul 31 12:37:08 devstack sudo[112178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:37:09 devstack cinder-volume[89182]: DEBUG cinder.volume.flows.manager.create_volume [None req-83ec1e68-e88e-4e59-8752-20d25868b1b6 tempest-CreateVolumesFromSnapshotTest-1185178291 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89182) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 12:37:09 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-83ec1e68-e88e-4e59-8752-20d25868b1b6 tempest-CreateVolumesFromSnapshotTest-1185178291 None] Flow 'volume_create_manager' (f4450bff-3fcb-4a80-9cf1-dbd1a878f57d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:37:09 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-83ec1e68-e88e-4e59-8752-20d25868b1b6 tempest-CreateVolumesFromSnapshotTest-1185178291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b663e694-d088-493f-8477-b84b8fd9c027) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:37:09 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-83ec1e68-e88e-4e59-8752-20d25868b1b6 tempest-CreateVolumesFromSnapshotTest-1185178291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b663e694-d088-493f-8477-b84b8fd9c027) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:37:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1666209440',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=869991fe-8fd6-45a5-bd40-64c19dad1b57,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73b25c0a73d14ed6baac1d54f3a462b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:37:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:37:09Z,use_quota=True,user_id='581f5fa15e8c451db457aa17e8682712',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:37:09 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-83ec1e68-e88e-4e59-8752-20d25868b1b6 tempest-CreateVolumesFromSnapshotTest-1185178291 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b69b72a3-9167-44a5-b21b-d67d593c3b6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:37:09 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-83ec1e68-e88e-4e59-8752-20d25868b1b6 tempest-CreateVolumesFromSnapshotTest-1185178291 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b69b72a3-9167-44a5-b21b-d67d593c3b6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:37:09 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-83ec1e68-e88e-4e59-8752-20d25868b1b6 tempest-CreateVolumesFromSnapshotTest-1185178291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea3949e7-5900-407d-9159-be548521d3cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:37:09 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-83ec1e68-e88e-4e59-8752-20d25868b1b6 tempest-CreateVolumesFromSnapshotTest-1185178291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea3949e7-5900-407d-9159-be548521d3cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '869991fe-8fd6-45a5-bd40-64c19dad1b57', 'volume_name': 'volume-869991fe-8fd6-45a5-bd40-64c19dad1b57', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:37:09 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-83ec1e68-e88e-4e59-8752-20d25868b1b6 tempest-CreateVolumesFromSnapshotTest-1185178291 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (320eaeaf-4838-40ab-93af-102836f0120d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:37:09 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-83ec1e68-e88e-4e59-8752-20d25868b1b6 tempest-CreateVolumesFromSnapshotTest-1185178291 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (320eaeaf-4838-40ab-93af-102836f0120d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:37:09 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-83ec1e68-e88e-4e59-8752-20d25868b1b6 tempest-CreateVolumesFromSnapshotTest-1185178291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0132c401-e711-4365-b8e2-2ef1fc90f738) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:37:09 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-83ec1e68-e88e-4e59-8752-20d25868b1b6 tempest-CreateVolumesFromSnapshotTest-1185178291 None] Volume 869991fe-8fd6-45a5-bd40-64c19dad1b57: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-869991fe-8fd6-45a5-bd40-64c19dad1b57', 'volume_size': 1} Jul 31 12:37:09 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-83ec1e68-e88e-4e59-8752-20d25868b1b6 tempest-CreateVolumesFromSnapshotTest-1185178291 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:37:09 devstack sudo[112176]: pam_unix(sudo:session): session closed for user root Jul 31 12:37:09 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-c7839c60-2579-4067-b573-642424a272e8 tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-9922a446-63fc-4c60-a625-6aa16bfe3440" returned: 0 in 0.345s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:37:09 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-c7839c60-2579-4067-b573-642424a272e8 tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] <== create_volume: return (1160ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'} {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 12:37:09 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-c7839c60-2579-4067-b573-642424a272e8 tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.162s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:37:09 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-061695c3-e506-4295-b701-fe94fae2b687 tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.222s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:37:09 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-061695c3-e506-4295-b701-fe94fae2b687 tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:36:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1295449081',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=206ec721-8ff8-4775-b6c9-d0077677f502,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bfbd0c1a82d24c2abd94708a13d08b32',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:36:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:36:59Z,use_quota=True,user_id='ded1236451fe48f2919ae0454dbed235',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)}" {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 12:37:09 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-061695c3-e506-4295-b701-fe94fae2b687 tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] Creating volume 206ec721-8ff8-4775-b6c9-d0077677f502 {{(pid=89182) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 12:37:09 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-061695c3-e506-4295-b701-fe94fae2b687 tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:37:09 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-061695c3-e506-4295-b701-fe94fae2b687 tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:37:09 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-061695c3-e506-4295-b701-fe94fae2b687 tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:37:09 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-061695c3-e506-4295-b701-fe94fae2b687 tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:37:09 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-061695c3-e506-4295-b701-fe94fae2b687 tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:37:09 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-061695c3-e506-4295-b701-fe94fae2b687 tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] Selected osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 as target Quobyte volume. {{(pid=89182) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 12:37:09 devstack cinder-volume[89182]: INFO cinder.volume.drivers.remotefs [None req-061695c3-e506-4295-b701-fe94fae2b687 tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] casted to osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 Jul 31 12:37:09 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-061695c3-e506-4295-b701-fe94fae2b687 tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-206ec721-8ff8-4775-b6c9-d0077677f502 1073741824 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:37:09 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-c7839c60-2579-4067-b573-642424a272e8 tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89344735-b235-4203-95db-0b605fb967cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9922a446-63fc-4c60-a625-6aa16bfe3440', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:37:09 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-c7839c60-2579-4067-b573-642424a272e8 tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3262af80-05a8-4359-98ff-4026f9378273) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:37:09 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-c7839c60-2579-4067-b573-642424a272e8 tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] Volume volume-9922a446-63fc-4c60-a625-6aa16bfe3440 (9922a446-63fc-4c60-a625-6aa16bfe3440): created successfully Jul 31 12:37:09 devstack sudo[112181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-206ec721-8ff8-4775-b6c9-d0077677f502 1073741824 Jul 31 12:37:09 devstack sudo[112181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:37:09 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-c7839c60-2579-4067-b573-642424a272e8 tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3262af80-05a8-4359-98ff-4026f9378273) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:37:09 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-c7839c60-2579-4067-b573-642424a272e8 tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] Flow 'volume_create_manager' (39d68639-63b9-4c96-b09d-2671aa1c930d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:37:09 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-c7839c60-2579-4067-b573-642424a272e8 tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] Created volume successfully. Jul 31 12:37:09 devstack sudo[112178]: pam_unix(sudo:session): session closed for user root Jul 31 12:37:09 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-4ee0a0d1-c91f-47ae-a7b2-fc8b68f4f195 tempest-VolumeDependencyTests-442009576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-8c784aa3-b637-4a2f-a70b-058a3b465b2a.24ff7149-be4a-498c-a2d4-e93e5e951ca0" returned: 0 in 0.420s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:37:09 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-4ee0a0d1-c91f-47ae-a7b2-fc8b68f4f195 tempest-VolumeDependencyTests-442009576 None] Lock "cinder-quobyte-24ff7149-be4a-498c-a2d4-e93e5e951ca0" released by "_delete_snapshot" :: held 2.227s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:37:09 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-4ee0a0d1-c91f-47ae-a7b2-fc8b68f4f195 tempest-VolumeDependencyTests-442009576 None] Lock "cinder-quobyte-8c784aa3-b637-4a2f-a70b-058a3b465b2a" released by "delete_snapshot" :: held 2.259s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:37:09 devstack cinder-volume[89182]: DEBUG cinder.quota [None req-4ee0a0d1-c91f-47ae-a7b2-fc8b68f4f195 tempest-VolumeDependencyTests-442009576 None] Created reservations ['1632f8b7-74ee-4375-bdf6-16ddb9eda56f', '0d5b1815-8383-460d-a2ae-7a69afb61aa3', '11fd7ada-7b5c-4abb-9966-dad1a1d99540', '0c51d832-d30a-4b21-a3f7-b13dba97c38d'] {{(pid=89182) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 12:37:09 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-4ee0a0d1-c91f-47ae-a7b2-fc8b68f4f195 tempest-VolumeDependencyTests-442009576 None] Delete snapshot completed successfully. Jul 31 12:37:09 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-4ee0a0d1-c91f-47ae-a7b2-fc8b68f4f195 tempest-VolumeDependencyTests-442009576 None] Lock "cinder-24ff7149-be4a-498c-a2d4-e93e5e951ca0-delete_snapshot" released by "delete_snapshot" :: held 2.428s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:37:09 devstack cinder-volume[89182]: DEBUG cinder.volume.flows.manager.create_volume [None req-5507048c-a70f-4eb9-bbc4-238adeecd463 tempest-CreateVolumesFromSnapshotTest-1185178291 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89182) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 12:37:09 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-5507048c-a70f-4eb9-bbc4-238adeecd463 tempest-CreateVolumesFromSnapshotTest-1185178291 None] Flow 'volume_create_manager' (87ce8322-616f-4548-8a55-bd673d5d729e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:37:09 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-5507048c-a70f-4eb9-bbc4-238adeecd463 tempest-CreateVolumesFromSnapshotTest-1185178291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b731f297-9859-429b-acfd-b74f609ab5be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:37:09 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-5507048c-a70f-4eb9-bbc4-238adeecd463 tempest-CreateVolumesFromSnapshotTest-1185178291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b731f297-9859-429b-acfd-b74f609ab5be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:37:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1710594918',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bad2034c-99d1-468d-b53d-d9075556becf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73b25c0a73d14ed6baac1d54f3a462b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:37:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:37:10Z,use_quota=True,user_id='581f5fa15e8c451db457aa17e8682712',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:37:09 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-5507048c-a70f-4eb9-bbc4-238adeecd463 tempest-CreateVolumesFromSnapshotTest-1185178291 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff895a9f-737e-44e6-a40f-9f022bf2e802) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:37:09 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-5507048c-a70f-4eb9-bbc4-238adeecd463 tempest-CreateVolumesFromSnapshotTest-1185178291 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff895a9f-737e-44e6-a40f-9f022bf2e802) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:37:09 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-5507048c-a70f-4eb9-bbc4-238adeecd463 tempest-CreateVolumesFromSnapshotTest-1185178291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3baab07-81a9-4ead-9946-594bfe4087e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:37:09 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-5507048c-a70f-4eb9-bbc4-238adeecd463 tempest-CreateVolumesFromSnapshotTest-1185178291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3baab07-81a9-4ead-9946-594bfe4087e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bad2034c-99d1-468d-b53d-d9075556becf', 'volume_name': 'volume-bad2034c-99d1-468d-b53d-d9075556becf', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:37:09 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-5507048c-a70f-4eb9-bbc4-238adeecd463 tempest-CreateVolumesFromSnapshotTest-1185178291 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e111fd19-216c-4288-bf90-24d440dd9548) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:37:09 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-5507048c-a70f-4eb9-bbc4-238adeecd463 tempest-CreateVolumesFromSnapshotTest-1185178291 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e111fd19-216c-4288-bf90-24d440dd9548) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:37:09 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-5507048c-a70f-4eb9-bbc4-238adeecd463 tempest-CreateVolumesFromSnapshotTest-1185178291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1fc4ee59-86f0-4de4-a3c4-f11e7a4b8ae6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:37:09 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-5507048c-a70f-4eb9-bbc4-238adeecd463 tempest-CreateVolumesFromSnapshotTest-1185178291 None] Volume bad2034c-99d1-468d-b53d-d9075556becf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bad2034c-99d1-468d-b53d-d9075556becf', 'volume_size': 1} Jul 31 12:37:09 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-5507048c-a70f-4eb9-bbc4-238adeecd463 tempest-CreateVolumesFromSnapshotTest-1185178291 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:37:10 devstack sudo[112181]: pam_unix(sudo:session): session closed for user root Jul 31 12:37:10 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-061695c3-e506-4295-b701-fe94fae2b687 tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-206ec721-8ff8-4775-b6c9-d0077677f502 1073741824" returned: 0 in 0.889s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:37:10 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-061695c3-e506-4295-b701-fe94fae2b687 tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-206ec721-8ff8-4775-b6c9-d0077677f502 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:37:10 devstack cinder-volume[89182]: DEBUG cinder.volume.flows.manager.create_volume [None req-6832ba54-20e1-48d8-8bb4-c87389edf97b tempest-CreateVolumesFromSnapshotTest-1185178291 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89182) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 12:37:10 devstack sudo[112189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-206ec721-8ff8-4775-b6c9-d0077677f502 Jul 31 12:37:10 devstack sudo[112189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:37:10 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-6832ba54-20e1-48d8-8bb4-c87389edf97b tempest-CreateVolumesFromSnapshotTest-1185178291 None] Flow 'volume_create_manager' (6e3f2f16-e7a5-43e3-b03e-ffd0d123903d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:37:10 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-6832ba54-20e1-48d8-8bb4-c87389edf97b tempest-CreateVolumesFromSnapshotTest-1185178291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2cd3a032-633b-4cd5-99b1-1773829960d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:37:10 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-6832ba54-20e1-48d8-8bb4-c87389edf97b tempest-CreateVolumesFromSnapshotTest-1185178291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2cd3a032-633b-4cd5-99b1-1773829960d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:37:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1306787177',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f55281ac-9e11-4efc-92ae-b34ae4b96d2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73b25c0a73d14ed6baac1d54f3a462b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:37:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:37:10Z,use_quota=True,user_id='581f5fa15e8c451db457aa17e8682712',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:37:10 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-6832ba54-20e1-48d8-8bb4-c87389edf97b tempest-CreateVolumesFromSnapshotTest-1185178291 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a121fe30-5091-4ebb-b79b-925b70dc48e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:37:10 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-6832ba54-20e1-48d8-8bb4-c87389edf97b tempest-CreateVolumesFromSnapshotTest-1185178291 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a121fe30-5091-4ebb-b79b-925b70dc48e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:37:10 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-6832ba54-20e1-48d8-8bb4-c87389edf97b tempest-CreateVolumesFromSnapshotTest-1185178291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0cc024c-1537-4f2e-b774-b15f23f03e40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:37:10 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-6832ba54-20e1-48d8-8bb4-c87389edf97b tempest-CreateVolumesFromSnapshotTest-1185178291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0cc024c-1537-4f2e-b774-b15f23f03e40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f55281ac-9e11-4efc-92ae-b34ae4b96d2d', 'volume_name': 'volume-f55281ac-9e11-4efc-92ae-b34ae4b96d2d', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:37:10 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-6832ba54-20e1-48d8-8bb4-c87389edf97b tempest-CreateVolumesFromSnapshotTest-1185178291 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09c54d72-2818-44cc-af92-e9799a3d4a19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:37:10 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-6832ba54-20e1-48d8-8bb4-c87389edf97b tempest-CreateVolumesFromSnapshotTest-1185178291 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09c54d72-2818-44cc-af92-e9799a3d4a19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:37:10 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-6832ba54-20e1-48d8-8bb4-c87389edf97b tempest-CreateVolumesFromSnapshotTest-1185178291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f066e28-6e43-4a84-8101-1cca3a82bfab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:37:10 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-6832ba54-20e1-48d8-8bb4-c87389edf97b tempest-CreateVolumesFromSnapshotTest-1185178291 None] Volume f55281ac-9e11-4efc-92ae-b34ae4b96d2d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f55281ac-9e11-4efc-92ae-b34ae4b96d2d', 'volume_size': 1} Jul 31 12:37:10 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-6832ba54-20e1-48d8-8bb4-c87389edf97b tempest-CreateVolumesFromSnapshotTest-1185178291 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:37:10 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-459d3781-33f2-4474-823f-096b5ea176fd tempest-VolumeDependencyTests-442009576 None] Acquiring lock "cinder-42c40d21-294a-47d6-8a4b-e3f75f09845b-delete_volume" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:37:10 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-459d3781-33f2-4474-823f-096b5ea176fd tempest-VolumeDependencyTests-442009576 None] Lock "cinder-42c40d21-294a-47d6-8a4b-e3f75f09845b-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:37:10 devstack sudo[112189]: pam_unix(sudo:session): session closed for user root Jul 31 12:37:10 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-459d3781-33f2-4474-823f-096b5ea176fd tempest-VolumeDependencyTests-442009576 None] Acquiring lock "cinder-quobyte-42c40d21-294a-47d6-8a4b-e3f75f09845b" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:37:10 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-061695c3-e506-4295-b701-fe94fae2b687 tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-206ec721-8ff8-4775-b6c9-d0077677f502" returned: 0 in 0.358s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:37:10 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-061695c3-e506-4295-b701-fe94fae2b687 tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] <== create_volume: return (1330ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'} {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 12:37:10 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-061695c3-e506-4295-b701-fe94fae2b687 tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.335s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:37:10 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-68be7faa-d58b-4efa-86ed-1d782c90ff3d tempest-CreateVolumesFromSnapshotTest-1185178291 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.408s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:37:10 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-68be7faa-d58b-4efa-86ed-1d782c90ff3d tempest-CreateVolumesFromSnapshotTest-1185178291 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:37:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1866664659',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76d99f77-9ddb-4568-9cd5-e0c478330306,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73b25c0a73d14ed6baac1d54f3a462b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:37:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:37:08Z,use_quota=True,user_id='581f5fa15e8c451db457aa17e8682712',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)}" {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 12:37:10 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-68be7faa-d58b-4efa-86ed-1d782c90ff3d tempest-CreateVolumesFromSnapshotTest-1185178291 None] Creating volume 76d99f77-9ddb-4568-9cd5-e0c478330306 {{(pid=89182) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 12:37:10 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-68be7faa-d58b-4efa-86ed-1d782c90ff3d tempest-CreateVolumesFromSnapshotTest-1185178291 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:37:10 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-68be7faa-d58b-4efa-86ed-1d782c90ff3d tempest-CreateVolumesFromSnapshotTest-1185178291 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:37:10 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-68be7faa-d58b-4efa-86ed-1d782c90ff3d tempest-CreateVolumesFromSnapshotTest-1185178291 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:37:10 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-68be7faa-d58b-4efa-86ed-1d782c90ff3d tempest-CreateVolumesFromSnapshotTest-1185178291 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:37:10 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-68be7faa-d58b-4efa-86ed-1d782c90ff3d tempest-CreateVolumesFromSnapshotTest-1185178291 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:37:10 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-68be7faa-d58b-4efa-86ed-1d782c90ff3d tempest-CreateVolumesFromSnapshotTest-1185178291 None] Selected osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 as target Quobyte volume. {{(pid=89182) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 12:37:10 devstack cinder-volume[89182]: INFO cinder.volume.drivers.remotefs [None req-68be7faa-d58b-4efa-86ed-1d782c90ff3d tempest-CreateVolumesFromSnapshotTest-1185178291 None] casted to osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 Jul 31 12:37:10 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-68be7faa-d58b-4efa-86ed-1d782c90ff3d tempest-CreateVolumesFromSnapshotTest-1185178291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-76d99f77-9ddb-4568-9cd5-e0c478330306 1073741824 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:37:10 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-459d3781-33f2-4474-823f-096b5ea176fd tempest-VolumeDependencyTests-442009576 None] Lock "cinder-quobyte-42c40d21-294a-47d6-8a4b-e3f75f09845b" acquired by "delete_volume" :: waited 0.047s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:37:10 devstack sudo[112201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-76d99f77-9ddb-4568-9cd5-e0c478330306 1073741824 Jul 31 12:37:10 devstack sudo[112201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:37:10 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-061695c3-e506-4295-b701-fe94fae2b687 tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40c7bfdb-d0e6-4c48-ab26-77b68e062036) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-206ec721-8ff8-4775-b6c9-d0077677f502', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:37:10 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-061695c3-e506-4295-b701-fe94fae2b687 tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5544d63-06d5-4a9f-a2f9-1a846474ea1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:37:10 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e7285d3-1c83-4d7f-8d3a-1ad98626e968]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:37:10 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-459d3781-33f2-4474-823f-096b5ea176fd tempest-VolumeDependencyTests-442009576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-42c40d21-294a-47d6-8a4b-e3f75f09845b {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:37:10 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-061695c3-e506-4295-b701-fe94fae2b687 tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] Volume volume-206ec721-8ff8-4775-b6c9-d0077677f502 (206ec721-8ff8-4775-b6c9-d0077677f502): created successfully Jul 31 12:37:10 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-061695c3-e506-4295-b701-fe94fae2b687 tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5544d63-06d5-4a9f-a2f9-1a846474ea1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:37:10 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-061695c3-e506-4295-b701-fe94fae2b687 tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] Flow 'volume_create_manager' (4ac8e6e8-bd3c-4dab-a595-5ac64daa5c31) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:37:10 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-061695c3-e506-4295-b701-fe94fae2b687 tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] Created volume successfully. Jul 31 12:37:10 devstack sudo[112205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-42c40d21-294a-47d6-8a4b-e3f75f09845b Jul 31 12:37:10 devstack sudo[112205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:37:11 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-6c6bca1f-44a3-4951-adaf-82b04d0ff3a5 tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] Acquiring lock "cinder-206ec721-8ff8-4775-b6c9-d0077677f502-delete_volume" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:37:11 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-6c6bca1f-44a3-4951-adaf-82b04d0ff3a5 tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] Lock "cinder-206ec721-8ff8-4775-b6c9-d0077677f502-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:37:11 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-6c6bca1f-44a3-4951-adaf-82b04d0ff3a5 tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] Acquiring lock "cinder-quobyte-206ec721-8ff8-4775-b6c9-d0077677f502" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:37:11 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-6c6bca1f-44a3-4951-adaf-82b04d0ff3a5 tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] Lock "cinder-quobyte-206ec721-8ff8-4775-b6c9-d0077677f502" acquired by "delete_volume" :: waited 0.013s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:37:11 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6275a53-6a38-434c-97c0-60e29fca16c2]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:37:11 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-6c6bca1f-44a3-4951-adaf-82b04d0ff3a5 tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-206ec721-8ff8-4775-b6c9-d0077677f502 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:37:11 devstack sudo[112205]: pam_unix(sudo:session): session closed for user root Jul 31 12:37:11 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-459d3781-33f2-4474-823f-096b5ea176fd tempest-VolumeDependencyTests-442009576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-42c40d21-294a-47d6-8a4b-e3f75f09845b" returned: 0 in 0.595s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:37:11 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-459d3781-33f2-4474-823f-096b5ea176fd tempest-VolumeDependencyTests-442009576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-42c40d21-294a-47d6-8a4b-e3f75f09845b {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:37:11 devstack sudo[112220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-42c40d21-294a-47d6-8a4b-e3f75f09845b Jul 31 12:37:11 devstack sudo[112220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:37:11 devstack sudo[112201]: pam_unix(sudo:session): session closed for user root Jul 31 12:37:11 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-68be7faa-d58b-4efa-86ed-1d782c90ff3d tempest-CreateVolumesFromSnapshotTest-1185178291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-76d99f77-9ddb-4568-9cd5-e0c478330306 1073741824" returned: 0 in 0.751s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:37:11 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-68be7faa-d58b-4efa-86ed-1d782c90ff3d tempest-CreateVolumesFromSnapshotTest-1185178291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-76d99f77-9ddb-4568-9cd5-e0c478330306 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:37:11 devstack sudo[112222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-76d99f77-9ddb-4568-9cd5-e0c478330306 Jul 31 12:37:11 devstack sudo[112222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:37:11 devstack sudo[112219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-206ec721-8ff8-4775-b6c9-d0077677f502 Jul 31 12:37:11 devstack sudo[112219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:37:11 devstack sudo[112220]: pam_unix(sudo:session): session closed for user root Jul 31 12:37:11 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-459d3781-33f2-4474-823f-096b5ea176fd tempest-VolumeDependencyTests-442009576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-42c40d21-294a-47d6-8a4b-e3f75f09845b" returned: 0 in 0.400s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:37:11 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-459d3781-33f2-4474-823f-096b5ea176fd tempest-VolumeDependencyTests-442009576 None] Lock "cinder-quobyte-42c40d21-294a-47d6-8a4b-e3f75f09845b" released by "delete_volume" :: held 1.103s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:37:11 devstack sudo[112222]: pam_unix(sudo:session): session closed for user root Jul 31 12:37:11 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-68be7faa-d58b-4efa-86ed-1d782c90ff3d tempest-CreateVolumesFromSnapshotTest-1185178291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-76d99f77-9ddb-4568-9cd5-e0c478330306" returned: 0 in 0.367s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:37:11 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-68be7faa-d58b-4efa-86ed-1d782c90ff3d tempest-CreateVolumesFromSnapshotTest-1185178291 None] <== create_volume: return (1169ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'} {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 12:37:11 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-68be7faa-d58b-4efa-86ed-1d782c90ff3d tempest-CreateVolumesFromSnapshotTest-1185178291 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.172s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:37:11 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-c011695f-c8f7-4f48-8e42-f9b7e120a7c9 tempest-CreateVolumesFromSnapshotTest-1185178291 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.053s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:37:11 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-c011695f-c8f7-4f48-8e42-f9b7e120a7c9 tempest-CreateVolumesFromSnapshotTest-1185178291 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:37:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1648370795',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df6f55b0-321b-41bb-8bd2-5725e0bf0e63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73b25c0a73d14ed6baac1d54f3a462b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:37:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:37:08Z,use_quota=True,user_id='581f5fa15e8c451db457aa17e8682712',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)}" {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 12:37:11 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-c011695f-c8f7-4f48-8e42-f9b7e120a7c9 tempest-CreateVolumesFromSnapshotTest-1185178291 None] Creating volume df6f55b0-321b-41bb-8bd2-5725e0bf0e63 {{(pid=89182) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 12:37:11 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-c011695f-c8f7-4f48-8e42-f9b7e120a7c9 tempest-CreateVolumesFromSnapshotTest-1185178291 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:37:11 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-c011695f-c8f7-4f48-8e42-f9b7e120a7c9 tempest-CreateVolumesFromSnapshotTest-1185178291 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:37:11 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-c011695f-c8f7-4f48-8e42-f9b7e120a7c9 tempest-CreateVolumesFromSnapshotTest-1185178291 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:37:11 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-c011695f-c8f7-4f48-8e42-f9b7e120a7c9 tempest-CreateVolumesFromSnapshotTest-1185178291 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:37:11 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-c011695f-c8f7-4f48-8e42-f9b7e120a7c9 tempest-CreateVolumesFromSnapshotTest-1185178291 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:37:11 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-c011695f-c8f7-4f48-8e42-f9b7e120a7c9 tempest-CreateVolumesFromSnapshotTest-1185178291 None] Selected osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 as target Quobyte volume. {{(pid=89182) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 12:37:11 devstack cinder-volume[89182]: INFO cinder.volume.drivers.remotefs [None req-c011695f-c8f7-4f48-8e42-f9b7e120a7c9 tempest-CreateVolumesFromSnapshotTest-1185178291 None] casted to osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 Jul 31 12:37:11 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-c011695f-c8f7-4f48-8e42-f9b7e120a7c9 tempest-CreateVolumesFromSnapshotTest-1185178291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-df6f55b0-321b-41bb-8bd2-5725e0bf0e63 1073741824 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:37:11 devstack sudo[112230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-df6f55b0-321b-41bb-8bd2-5725e0bf0e63 1073741824 Jul 31 12:37:11 devstack sudo[112230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:37:11 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-68be7faa-d58b-4efa-86ed-1d782c90ff3d tempest-CreateVolumesFromSnapshotTest-1185178291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef596e49-5c6f-4180-baf8-7f324facaf88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-76d99f77-9ddb-4568-9cd5-e0c478330306', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:37:11 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-68be7faa-d58b-4efa-86ed-1d782c90ff3d tempest-CreateVolumesFromSnapshotTest-1185178291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (375385d1-d633-4dd3-98d5-38cc3a57ba86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:37:11 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-68be7faa-d58b-4efa-86ed-1d782c90ff3d tempest-CreateVolumesFromSnapshotTest-1185178291 None] Volume volume-76d99f77-9ddb-4568-9cd5-e0c478330306 (76d99f77-9ddb-4568-9cd5-e0c478330306): created successfully Jul 31 12:37:11 devstack sudo[112219]: pam_unix(sudo:session): session closed for user root Jul 31 12:37:11 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-68be7faa-d58b-4efa-86ed-1d782c90ff3d tempest-CreateVolumesFromSnapshotTest-1185178291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (375385d1-d633-4dd3-98d5-38cc3a57ba86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:37:11 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-68be7faa-d58b-4efa-86ed-1d782c90ff3d tempest-CreateVolumesFromSnapshotTest-1185178291 None] Flow 'volume_create_manager' (f5ddafd2-478f-4edc-8ac5-4c9792d37d6a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:37:11 devstack cinder-volume[89182]: DEBUG cinder.quota [None req-459d3781-33f2-4474-823f-096b5ea176fd tempest-VolumeDependencyTests-442009576 None] Created reservations ['5c5c7450-033a-4d9b-aec6-0f976846a74a', '9c583d73-aadc-4104-8ccf-e409d51b17cb', '5d0a1ae2-9e97-46ce-80b7-03d6650267e7', '00e5e783-d046-4994-a9fd-fca268a33606'] {{(pid=89182) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 12:37:11 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-6c6bca1f-44a3-4951-adaf-82b04d0ff3a5 tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-206ec721-8ff8-4775-b6c9-d0077677f502" returned: 0 in 0.577s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:37:11 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-6c6bca1f-44a3-4951-adaf-82b04d0ff3a5 tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-206ec721-8ff8-4775-b6c9-d0077677f502 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:37:11 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-68be7faa-d58b-4efa-86ed-1d782c90ff3d tempest-CreateVolumesFromSnapshotTest-1185178291 None] Created volume successfully. Jul 31 12:37:11 devstack sudo[112233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-206ec721-8ff8-4775-b6c9-d0077677f502 Jul 31 12:37:11 devstack sudo[112233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:37:11 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-459d3781-33f2-4474-823f-096b5ea176fd tempest-VolumeDependencyTests-442009576 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:37:11 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-459d3781-33f2-4474-823f-096b5ea176fd tempest-VolumeDependencyTests-442009576 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:37:11 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-459d3781-33f2-4474-823f-096b5ea176fd tempest-VolumeDependencyTests-442009576 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:37:11 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-459d3781-33f2-4474-823f-096b5ea176fd tempest-VolumeDependencyTests-442009576 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:37:11 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-459d3781-33f2-4474-823f-096b5ea176fd tempest-VolumeDependencyTests-442009576 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:37:11 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-459d3781-33f2-4474-823f-096b5ea176fd tempest-VolumeDependencyTests-442009576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:37:11 devstack sudo[112235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 Jul 31 12:37:11 devstack sudo[112235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:37:12 devstack sudo[112233]: pam_unix(sudo:session): session closed for user root Jul 31 12:37:12 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-6c6bca1f-44a3-4951-adaf-82b04d0ff3a5 tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-206ec721-8ff8-4775-b6c9-d0077677f502" returned: 0 in 0.326s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:37:12 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-6c6bca1f-44a3-4951-adaf-82b04d0ff3a5 tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] Lock "cinder-quobyte-206ec721-8ff8-4775-b6c9-d0077677f502" released by "delete_volume" :: held 0.958s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:37:12 devstack cinder-volume[89182]: DEBUG cinder.quota [None req-6c6bca1f-44a3-4951-adaf-82b04d0ff3a5 tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] Created reservations ['5cde33ee-1794-4a21-acd1-8c10a2f1c8bb', '8e8645e3-324b-41f9-963f-f09cf1655d59', '4da78b4b-2831-4890-a8ca-d3dfc6db4138', '12acd7ff-a21e-4b1b-9090-0a03fe22aeb7'] {{(pid=89182) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 12:37:12 devstack sudo[112235]: pam_unix(sudo:session): session closed for user root Jul 31 12:37:12 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-459d3781-33f2-4474-823f-096b5ea176fd tempest-VolumeDependencyTests-442009576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2" returned: 0 in 0.349s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:37:12 devstack cinder-volume[89182]: DEBUG cinder.manager [None req-459d3781-33f2-4474-823f-096b5ea176fd tempest-VolumeDependencyTests-442009576 None] Notifying Schedulers of capabilities ... {{(pid=89182) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 12:37:12 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-459d3781-33f2-4474-823f-096b5ea176fd tempest-VolumeDependencyTests-442009576 None] Deleted volume successfully. Jul 31 12:37:12 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-459d3781-33f2-4474-823f-096b5ea176fd tempest-VolumeDependencyTests-442009576 None] Lock "cinder-42c40d21-294a-47d6-8a4b-e3f75f09845b-delete_volume" released by "delete_volume" :: held 1.861s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:37:12 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-6c6bca1f-44a3-4951-adaf-82b04d0ff3a5 tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:37:12 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-6c6bca1f-44a3-4951-adaf-82b04d0ff3a5 tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:37:12 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-6c6bca1f-44a3-4951-adaf-82b04d0ff3a5 tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:37:12 devstack sudo[112230]: pam_unix(sudo:session): session closed for user root Jul 31 12:37:12 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-6c6bca1f-44a3-4951-adaf-82b04d0ff3a5 tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:37:12 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-6c6bca1f-44a3-4951-adaf-82b04d0ff3a5 tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:37:12 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-6c6bca1f-44a3-4951-adaf-82b04d0ff3a5 tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:37:12 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-c011695f-c8f7-4f48-8e42-f9b7e120a7c9 tempest-CreateVolumesFromSnapshotTest-1185178291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-df6f55b0-321b-41bb-8bd2-5725e0bf0e63 1073741824" returned: 0 in 0.654s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:37:12 devstack sudo[112243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 Jul 31 12:37:12 devstack sudo[112243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:37:12 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-c011695f-c8f7-4f48-8e42-f9b7e120a7c9 tempest-CreateVolumesFromSnapshotTest-1185178291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-df6f55b0-321b-41bb-8bd2-5725e0bf0e63 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:37:12 devstack sudo[112245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-df6f55b0-321b-41bb-8bd2-5725e0bf0e63 Jul 31 12:37:12 devstack sudo[112245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:37:12 devstack sudo[112243]: pam_unix(sudo:session): session closed for user root Jul 31 12:37:12 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-6c6bca1f-44a3-4951-adaf-82b04d0ff3a5 tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2" returned: 0 in 0.266s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:37:12 devstack cinder-volume[89182]: DEBUG cinder.manager [None req-6c6bca1f-44a3-4951-adaf-82b04d0ff3a5 tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] Notifying Schedulers of capabilities ... {{(pid=89182) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 12:37:12 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-6c6bca1f-44a3-4951-adaf-82b04d0ff3a5 tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] Deleted volume successfully. Jul 31 12:37:12 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-6c6bca1f-44a3-4951-adaf-82b04d0ff3a5 tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] Lock "cinder-206ec721-8ff8-4775-b6c9-d0077677f502-delete_volume" released by "delete_volume" :: held 1.545s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:37:12 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-c199fb66-ae0f-4ae0-8efc-2620b99ce9d2 tempest-VolumeDependencyTests-442009576 None] Acquiring lock "cinder-ca5d8c89-9ec6-4058-8d58-5c1e42ac9371-delete_volume" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:37:12 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-c199fb66-ae0f-4ae0-8efc-2620b99ce9d2 tempest-VolumeDependencyTests-442009576 None] Lock "cinder-ca5d8c89-9ec6-4058-8d58-5c1e42ac9371-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:37:12 devstack sudo[112245]: pam_unix(sudo:session): session closed for user root Jul 31 12:37:12 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-c011695f-c8f7-4f48-8e42-f9b7e120a7c9 tempest-CreateVolumesFromSnapshotTest-1185178291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-df6f55b0-321b-41bb-8bd2-5725e0bf0e63" returned: 0 in 0.439s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:37:12 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-c011695f-c8f7-4f48-8e42-f9b7e120a7c9 tempest-CreateVolumesFromSnapshotTest-1185178291 None] <== create_volume: return (1144ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'} {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 12:37:12 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-c011695f-c8f7-4f48-8e42-f9b7e120a7c9 tempest-CreateVolumesFromSnapshotTest-1185178291 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.147s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:37:12 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-83ec1e68-e88e-4e59-8752-20d25868b1b6 tempest-CreateVolumesFromSnapshotTest-1185178291 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.741s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:37:12 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-83ec1e68-e88e-4e59-8752-20d25868b1b6 tempest-CreateVolumesFromSnapshotTest-1185178291 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:37:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1666209440',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=869991fe-8fd6-45a5-bd40-64c19dad1b57,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73b25c0a73d14ed6baac1d54f3a462b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:37:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:37:09Z,use_quota=True,user_id='581f5fa15e8c451db457aa17e8682712',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)}" {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 12:37:12 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-83ec1e68-e88e-4e59-8752-20d25868b1b6 tempest-CreateVolumesFromSnapshotTest-1185178291 None] Creating volume 869991fe-8fd6-45a5-bd40-64c19dad1b57 {{(pid=89182) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 12:37:12 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-83ec1e68-e88e-4e59-8752-20d25868b1b6 tempest-CreateVolumesFromSnapshotTest-1185178291 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:37:12 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-83ec1e68-e88e-4e59-8752-20d25868b1b6 tempest-CreateVolumesFromSnapshotTest-1185178291 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:37:12 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-83ec1e68-e88e-4e59-8752-20d25868b1b6 tempest-CreateVolumesFromSnapshotTest-1185178291 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:37:12 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-83ec1e68-e88e-4e59-8752-20d25868b1b6 tempest-CreateVolumesFromSnapshotTest-1185178291 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:37:12 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-83ec1e68-e88e-4e59-8752-20d25868b1b6 tempest-CreateVolumesFromSnapshotTest-1185178291 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:37:12 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-83ec1e68-e88e-4e59-8752-20d25868b1b6 tempest-CreateVolumesFromSnapshotTest-1185178291 None] Selected osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 as target Quobyte volume. {{(pid=89182) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 12:37:12 devstack cinder-volume[89182]: INFO cinder.volume.drivers.remotefs [None req-83ec1e68-e88e-4e59-8752-20d25868b1b6 tempest-CreateVolumesFromSnapshotTest-1185178291 None] casted to osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 Jul 31 12:37:12 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-83ec1e68-e88e-4e59-8752-20d25868b1b6 tempest-CreateVolumesFromSnapshotTest-1185178291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-869991fe-8fd6-45a5-bd40-64c19dad1b57 1073741824 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:37:12 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-c199fb66-ae0f-4ae0-8efc-2620b99ce9d2 tempest-VolumeDependencyTests-442009576 None] Acquiring lock "cinder-quobyte-ca5d8c89-9ec6-4058-8d58-5c1e42ac9371" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:37:12 devstack sudo[112250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-869991fe-8fd6-45a5-bd40-64c19dad1b57 1073741824 Jul 31 12:37:12 devstack sudo[112250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:37:12 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-c011695f-c8f7-4f48-8e42-f9b7e120a7c9 tempest-CreateVolumesFromSnapshotTest-1185178291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8a7510b-d9a3-4de2-b8d9-e7a79d6224bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-df6f55b0-321b-41bb-8bd2-5725e0bf0e63', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:37:12 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-c011695f-c8f7-4f48-8e42-f9b7e120a7c9 tempest-CreateVolumesFromSnapshotTest-1185178291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23631e3b-2294-4d08-8461-8bc8a801698b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:37:12 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-c199fb66-ae0f-4ae0-8efc-2620b99ce9d2 tempest-VolumeDependencyTests-442009576 None] Lock "cinder-quobyte-ca5d8c89-9ec6-4058-8d58-5c1e42ac9371" acquired by "delete_volume" :: waited 0.045s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:37:12 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ef1d262-b14d-439b-8780-556e2f62abb4]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:37:12 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-c199fb66-ae0f-4ae0-8efc-2620b99ce9d2 tempest-VolumeDependencyTests-442009576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-ca5d8c89-9ec6-4058-8d58-5c1e42ac9371 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:37:12 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-c011695f-c8f7-4f48-8e42-f9b7e120a7c9 tempest-CreateVolumesFromSnapshotTest-1185178291 None] Volume volume-df6f55b0-321b-41bb-8bd2-5725e0bf0e63 (df6f55b0-321b-41bb-8bd2-5725e0bf0e63): created successfully Jul 31 12:37:12 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-c011695f-c8f7-4f48-8e42-f9b7e120a7c9 tempest-CreateVolumesFromSnapshotTest-1185178291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23631e3b-2294-4d08-8461-8bc8a801698b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:37:13 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-c011695f-c8f7-4f48-8e42-f9b7e120a7c9 tempest-CreateVolumesFromSnapshotTest-1185178291 None] Flow 'volume_create_manager' (d750130b-c5f7-46e7-b75b-4bae3b66ba76) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:37:13 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-c011695f-c8f7-4f48-8e42-f9b7e120a7c9 tempest-CreateVolumesFromSnapshotTest-1185178291 None] Created volume successfully. Jul 31 12:37:13 devstack sudo[112252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-ca5d8c89-9ec6-4058-8d58-5c1e42ac9371 Jul 31 12:37:13 devstack sudo[112252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:37:13 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-523c705e-e394-48dd-8649-9bdbcdc9786d tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] Acquiring lock "cinder-9922a446-63fc-4c60-a625-6aa16bfe3440-delete_volume" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:37:13 devstack sudo[112250]: pam_unix(sudo:session): session closed for user root Jul 31 12:37:13 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-83ec1e68-e88e-4e59-8752-20d25868b1b6 tempest-CreateVolumesFromSnapshotTest-1185178291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-869991fe-8fd6-45a5-bd40-64c19dad1b57 1073741824" returned: 0 in 0.757s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:37:13 devstack sudo[112252]: pam_unix(sudo:session): session closed for user root Jul 31 12:37:13 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-523c705e-e394-48dd-8649-9bdbcdc9786d tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] Lock "cinder-9922a446-63fc-4c60-a625-6aa16bfe3440-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:37:13 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-c199fb66-ae0f-4ae0-8efc-2620b99ce9d2 tempest-VolumeDependencyTests-442009576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-ca5d8c89-9ec6-4058-8d58-5c1e42ac9371" returned: 0 in 0.681s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:37:13 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-c199fb66-ae0f-4ae0-8efc-2620b99ce9d2 tempest-VolumeDependencyTests-442009576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-ca5d8c89-9ec6-4058-8d58-5c1e42ac9371 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:37:13 devstack sudo[112290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-ca5d8c89-9ec6-4058-8d58-5c1e42ac9371 Jul 31 12:37:13 devstack sudo[112290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:37:13 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-83ec1e68-e88e-4e59-8752-20d25868b1b6 tempest-CreateVolumesFromSnapshotTest-1185178291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-869991fe-8fd6-45a5-bd40-64c19dad1b57 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:37:13 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-523c705e-e394-48dd-8649-9bdbcdc9786d tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] Acquiring lock "cinder-quobyte-9922a446-63fc-4c60-a625-6aa16bfe3440" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:37:13 devstack sudo[112294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-869991fe-8fd6-45a5-bd40-64c19dad1b57 Jul 31 12:37:13 devstack sudo[112294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:37:13 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-523c705e-e394-48dd-8649-9bdbcdc9786d tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] Lock "cinder-quobyte-9922a446-63fc-4c60-a625-6aa16bfe3440" acquired by "delete_volume" :: waited 0.053s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:37:13 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[29e96704-e3b5-4195-9495-d000cd8bc909]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:37:13 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-523c705e-e394-48dd-8649-9bdbcdc9786d tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-9922a446-63fc-4c60-a625-6aa16bfe3440 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:37:14 devstack sudo[112298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-9922a446-63fc-4c60-a625-6aa16bfe3440 Jul 31 12:37:14 devstack sudo[112298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:37:14 devstack sudo[112290]: pam_unix(sudo:session): session closed for user root Jul 31 12:37:14 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-c199fb66-ae0f-4ae0-8efc-2620b99ce9d2 tempest-VolumeDependencyTests-442009576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-ca5d8c89-9ec6-4058-8d58-5c1e42ac9371" returned: 0 in 0.529s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:37:14 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-c199fb66-ae0f-4ae0-8efc-2620b99ce9d2 tempest-VolumeDependencyTests-442009576 None] Lock "cinder-quobyte-ca5d8c89-9ec6-4058-8d58-5c1e42ac9371" released by "delete_volume" :: held 1.323s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:37:14 devstack sudo[112294]: pam_unix(sudo:session): session closed for user root Jul 31 12:37:14 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-83ec1e68-e88e-4e59-8752-20d25868b1b6 tempest-CreateVolumesFromSnapshotTest-1185178291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-869991fe-8fd6-45a5-bd40-64c19dad1b57" returned: 0 in 0.573s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:37:14 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-83ec1e68-e88e-4e59-8752-20d25868b1b6 tempest-CreateVolumesFromSnapshotTest-1185178291 None] <== create_volume: return (1484ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'} {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 12:37:14 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-83ec1e68-e88e-4e59-8752-20d25868b1b6 tempest-CreateVolumesFromSnapshotTest-1185178291 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.494s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:37:14 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-5507048c-a70f-4eb9-bbc4-238adeecd463 tempest-CreateVolumesFromSnapshotTest-1185178291 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.411s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:37:14 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-5507048c-a70f-4eb9-bbc4-238adeecd463 tempest-CreateVolumesFromSnapshotTest-1185178291 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:37:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1710594918',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bad2034c-99d1-468d-b53d-d9075556becf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73b25c0a73d14ed6baac1d54f3a462b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:37:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:37:10Z,use_quota=True,user_id='581f5fa15e8c451db457aa17e8682712',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)}" {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 12:37:14 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-5507048c-a70f-4eb9-bbc4-238adeecd463 tempest-CreateVolumesFromSnapshotTest-1185178291 None] Creating volume bad2034c-99d1-468d-b53d-d9075556becf {{(pid=89182) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 12:37:14 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-5507048c-a70f-4eb9-bbc4-238adeecd463 tempest-CreateVolumesFromSnapshotTest-1185178291 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:37:14 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-5507048c-a70f-4eb9-bbc4-238adeecd463 tempest-CreateVolumesFromSnapshotTest-1185178291 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:37:14 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-5507048c-a70f-4eb9-bbc4-238adeecd463 tempest-CreateVolumesFromSnapshotTest-1185178291 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:37:14 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-5507048c-a70f-4eb9-bbc4-238adeecd463 tempest-CreateVolumesFromSnapshotTest-1185178291 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:37:14 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-5507048c-a70f-4eb9-bbc4-238adeecd463 tempest-CreateVolumesFromSnapshotTest-1185178291 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:37:14 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-5507048c-a70f-4eb9-bbc4-238adeecd463 tempest-CreateVolumesFromSnapshotTest-1185178291 None] Selected osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 as target Quobyte volume. {{(pid=89182) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 12:37:14 devstack cinder-volume[89182]: INFO cinder.volume.drivers.remotefs [None req-5507048c-a70f-4eb9-bbc4-238adeecd463 tempest-CreateVolumesFromSnapshotTest-1185178291 None] casted to osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 Jul 31 12:37:14 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-5507048c-a70f-4eb9-bbc4-238adeecd463 tempest-CreateVolumesFromSnapshotTest-1185178291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-bad2034c-99d1-468d-b53d-d9075556becf 1073741824 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:37:14 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-83ec1e68-e88e-4e59-8752-20d25868b1b6 tempest-CreateVolumesFromSnapshotTest-1185178291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0132c401-e711-4365-b8e2-2ef1fc90f738) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-869991fe-8fd6-45a5-bd40-64c19dad1b57', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:37:14 devstack sudo[112320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-bad2034c-99d1-468d-b53d-d9075556becf 1073741824 Jul 31 12:37:14 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-83ec1e68-e88e-4e59-8752-20d25868b1b6 tempest-CreateVolumesFromSnapshotTest-1185178291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c138f186-5534-4262-9f24-844343aeb776) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:37:14 devstack sudo[112320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:37:14 devstack cinder-volume[89182]: DEBUG cinder.quota [None req-c199fb66-ae0f-4ae0-8efc-2620b99ce9d2 tempest-VolumeDependencyTests-442009576 None] Created reservations ['82338fb7-06d5-4af0-a161-7ee3d8adeb02', '4e4a8e28-ed4f-4cb9-9770-ab41bc1b935a', '76f40028-5697-489f-98bf-bb663fcacbb0', '65b087cf-3878-4638-9c59-baa45a2b2297'] {{(pid=89182) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 12:37:14 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-83ec1e68-e88e-4e59-8752-20d25868b1b6 tempest-CreateVolumesFromSnapshotTest-1185178291 None] Volume volume-869991fe-8fd6-45a5-bd40-64c19dad1b57 (869991fe-8fd6-45a5-bd40-64c19dad1b57): created successfully Jul 31 12:37:14 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-83ec1e68-e88e-4e59-8752-20d25868b1b6 tempest-CreateVolumesFromSnapshotTest-1185178291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c138f186-5534-4262-9f24-844343aeb776) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:37:14 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-83ec1e68-e88e-4e59-8752-20d25868b1b6 tempest-CreateVolumesFromSnapshotTest-1185178291 None] Flow 'volume_create_manager' (f4450bff-3fcb-4a80-9cf1-dbd1a878f57d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:37:14 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-83ec1e68-e88e-4e59-8752-20d25868b1b6 tempest-CreateVolumesFromSnapshotTest-1185178291 None] Created volume successfully. Jul 31 12:37:14 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-c199fb66-ae0f-4ae0-8efc-2620b99ce9d2 tempest-VolumeDependencyTests-442009576 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:37:14 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-c199fb66-ae0f-4ae0-8efc-2620b99ce9d2 tempest-VolumeDependencyTests-442009576 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:37:14 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-c199fb66-ae0f-4ae0-8efc-2620b99ce9d2 tempest-VolumeDependencyTests-442009576 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:37:14 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-c199fb66-ae0f-4ae0-8efc-2620b99ce9d2 tempest-VolumeDependencyTests-442009576 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:37:14 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-c199fb66-ae0f-4ae0-8efc-2620b99ce9d2 tempest-VolumeDependencyTests-442009576 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:37:14 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-c199fb66-ae0f-4ae0-8efc-2620b99ce9d2 tempest-VolumeDependencyTests-442009576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:37:14 devstack sudo[112325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 Jul 31 12:37:14 devstack sudo[112325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:37:14 devstack sudo[112298]: pam_unix(sudo:session): session closed for user root Jul 31 12:37:14 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-523c705e-e394-48dd-8649-9bdbcdc9786d tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-9922a446-63fc-4c60-a625-6aa16bfe3440" returned: 0 in 1.002s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:37:14 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-523c705e-e394-48dd-8649-9bdbcdc9786d tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-9922a446-63fc-4c60-a625-6aa16bfe3440 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:37:14 devstack sudo[112339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-9922a446-63fc-4c60-a625-6aa16bfe3440 Jul 31 12:37:14 devstack sudo[112339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:37:15 devstack sudo[112325]: pam_unix(sudo:session): session closed for user root Jul 31 12:37:15 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-eb6c4149-01ff-43c0-8c9a-5519b2b6e909 tempest-VolumeDependencyTests-442009576 None] Acquiring lock "cinder-8c784aa3-b637-4a2f-a70b-058a3b465b2a-delete_volume" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:37:15 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-c199fb66-ae0f-4ae0-8efc-2620b99ce9d2 tempest-VolumeDependencyTests-442009576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2" returned: 0 in 0.517s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:37:15 devstack cinder-volume[89182]: DEBUG cinder.manager [None req-c199fb66-ae0f-4ae0-8efc-2620b99ce9d2 tempest-VolumeDependencyTests-442009576 None] Notifying Schedulers of capabilities ... {{(pid=89182) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 12:37:15 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-c199fb66-ae0f-4ae0-8efc-2620b99ce9d2 tempest-VolumeDependencyTests-442009576 None] Deleted volume successfully. Jul 31 12:37:15 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-eb6c4149-01ff-43c0-8c9a-5519b2b6e909 tempest-VolumeDependencyTests-442009576 None] Lock "cinder-8c784aa3-b637-4a2f-a70b-058a3b465b2a-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:37:15 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-c199fb66-ae0f-4ae0-8efc-2620b99ce9d2 tempest-VolumeDependencyTests-442009576 None] Lock "cinder-ca5d8c89-9ec6-4058-8d58-5c1e42ac9371-delete_volume" released by "delete_volume" :: held 2.437s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:37:15 devstack sudo[112320]: pam_unix(sudo:session): session closed for user root Jul 31 12:37:15 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-5507048c-a70f-4eb9-bbc4-238adeecd463 tempest-CreateVolumesFromSnapshotTest-1185178291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-bad2034c-99d1-468d-b53d-d9075556becf 1073741824" returned: 0 in 0.870s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:37:15 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-eb6c4149-01ff-43c0-8c9a-5519b2b6e909 tempest-VolumeDependencyTests-442009576 None] Acquiring lock "cinder-quobyte-8c784aa3-b637-4a2f-a70b-058a3b465b2a" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:37:15 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-eb6c4149-01ff-43c0-8c9a-5519b2b6e909 tempest-VolumeDependencyTests-442009576 None] Lock "cinder-quobyte-8c784aa3-b637-4a2f-a70b-058a3b465b2a" acquired by "delete_volume" :: waited 0.023s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:37:15 devstack sudo[112339]: pam_unix(sudo:session): session closed for user root Jul 31 12:37:15 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-523c705e-e394-48dd-8649-9bdbcdc9786d tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-9922a446-63fc-4c60-a625-6aa16bfe3440" returned: 0 in 0.407s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:37:15 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[766ea41c-9f77-4569-9d5d-cc4dca340062]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:37:15 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-eb6c4149-01ff-43c0-8c9a-5519b2b6e909 tempest-VolumeDependencyTests-442009576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-8c784aa3-b637-4a2f-a70b-058a3b465b2a {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:37:15 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-523c705e-e394-48dd-8649-9bdbcdc9786d tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] Lock "cinder-quobyte-9922a446-63fc-4c60-a625-6aa16bfe3440" released by "delete_volume" :: held 1.500s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:37:15 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-5507048c-a70f-4eb9-bbc4-238adeecd463 tempest-CreateVolumesFromSnapshotTest-1185178291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-bad2034c-99d1-468d-b53d-d9075556becf {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:37:15 devstack sudo[112360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-bad2034c-99d1-468d-b53d-d9075556becf Jul 31 12:37:15 devstack sudo[112360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:37:15 devstack cinder-volume[89182]: DEBUG cinder.quota [None req-523c705e-e394-48dd-8649-9bdbcdc9786d tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] Created reservations ['c856e341-a115-4d58-b1a3-315fab10095b', '44f1c483-0eb1-4a14-a515-2b9ac88d335c', 'a7af9b18-c753-44b4-988f-e9e2752ddf88', 'a5c14f5d-1030-4365-86c7-9f371f912418'] {{(pid=89182) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 12:37:15 devstack sudo[112357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-8c784aa3-b637-4a2f-a70b-058a3b465b2a Jul 31 12:37:15 devstack sudo[112357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:37:15 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-523c705e-e394-48dd-8649-9bdbcdc9786d tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:37:15 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-523c705e-e394-48dd-8649-9bdbcdc9786d tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:37:15 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-523c705e-e394-48dd-8649-9bdbcdc9786d tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:37:15 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-523c705e-e394-48dd-8649-9bdbcdc9786d tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:37:15 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-523c705e-e394-48dd-8649-9bdbcdc9786d tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:37:15 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-523c705e-e394-48dd-8649-9bdbcdc9786d tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:37:15 devstack sudo[112368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 Jul 31 12:37:15 devstack sudo[112368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:37:15 devstack sudo[112360]: pam_unix(sudo:session): session closed for user root Jul 31 12:37:15 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-5507048c-a70f-4eb9-bbc4-238adeecd463 tempest-CreateVolumesFromSnapshotTest-1185178291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-bad2034c-99d1-468d-b53d-d9075556becf" returned: 0 in 0.338s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:37:15 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-5507048c-a70f-4eb9-bbc4-238adeecd463 tempest-CreateVolumesFromSnapshotTest-1185178291 None] <== create_volume: return (1320ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'} {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 12:37:15 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-5507048c-a70f-4eb9-bbc4-238adeecd463 tempest-CreateVolumesFromSnapshotTest-1185178291 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.326s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:37:15 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-6832ba54-20e1-48d8-8bb4-c87389edf97b tempest-CreateVolumesFromSnapshotTest-1185178291 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.393s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:37:15 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-6832ba54-20e1-48d8-8bb4-c87389edf97b tempest-CreateVolumesFromSnapshotTest-1185178291 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:37:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1306787177',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f55281ac-9e11-4efc-92ae-b34ae4b96d2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73b25c0a73d14ed6baac1d54f3a462b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:37:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:37:10Z,use_quota=True,user_id='581f5fa15e8c451db457aa17e8682712',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)}" {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 12:37:15 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-6832ba54-20e1-48d8-8bb4-c87389edf97b tempest-CreateVolumesFromSnapshotTest-1185178291 None] Creating volume f55281ac-9e11-4efc-92ae-b34ae4b96d2d {{(pid=89182) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 12:37:15 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-6832ba54-20e1-48d8-8bb4-c87389edf97b tempest-CreateVolumesFromSnapshotTest-1185178291 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:37:15 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-6832ba54-20e1-48d8-8bb4-c87389edf97b tempest-CreateVolumesFromSnapshotTest-1185178291 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:37:15 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-6832ba54-20e1-48d8-8bb4-c87389edf97b tempest-CreateVolumesFromSnapshotTest-1185178291 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:37:15 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-6832ba54-20e1-48d8-8bb4-c87389edf97b tempest-CreateVolumesFromSnapshotTest-1185178291 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:37:15 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-6832ba54-20e1-48d8-8bb4-c87389edf97b tempest-CreateVolumesFromSnapshotTest-1185178291 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:37:15 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-6832ba54-20e1-48d8-8bb4-c87389edf97b tempest-CreateVolumesFromSnapshotTest-1185178291 None] Selected osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 as target Quobyte volume. {{(pid=89182) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 12:37:15 devstack cinder-volume[89182]: INFO cinder.volume.drivers.remotefs [None req-6832ba54-20e1-48d8-8bb4-c87389edf97b tempest-CreateVolumesFromSnapshotTest-1185178291 None] casted to osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 Jul 31 12:37:15 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-6832ba54-20e1-48d8-8bb4-c87389edf97b tempest-CreateVolumesFromSnapshotTest-1185178291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-f55281ac-9e11-4efc-92ae-b34ae4b96d2d 1073741824 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:37:15 devstack sudo[112373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-f55281ac-9e11-4efc-92ae-b34ae4b96d2d 1073741824 Jul 31 12:37:15 devstack sudo[112373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:37:15 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-5507048c-a70f-4eb9-bbc4-238adeecd463 tempest-CreateVolumesFromSnapshotTest-1185178291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1fc4ee59-86f0-4de4-a3c4-f11e7a4b8ae6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bad2034c-99d1-468d-b53d-d9075556becf', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:37:15 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-5507048c-a70f-4eb9-bbc4-238adeecd463 tempest-CreateVolumesFromSnapshotTest-1185178291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2bcba31c-2555-4d91-8b54-a78eb3f816a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:37:15 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-5507048c-a70f-4eb9-bbc4-238adeecd463 tempest-CreateVolumesFromSnapshotTest-1185178291 None] Volume volume-bad2034c-99d1-468d-b53d-d9075556becf (bad2034c-99d1-468d-b53d-d9075556becf): created successfully Jul 31 12:37:15 devstack sudo[112368]: pam_unix(sudo:session): session closed for user root Jul 31 12:37:15 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-5507048c-a70f-4eb9-bbc4-238adeecd463 tempest-CreateVolumesFromSnapshotTest-1185178291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2bcba31c-2555-4d91-8b54-a78eb3f816a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:37:15 devstack sudo[112357]: pam_unix(sudo:session): session closed for user root Jul 31 12:37:15 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-5507048c-a70f-4eb9-bbc4-238adeecd463 tempest-CreateVolumesFromSnapshotTest-1185178291 None] Flow 'volume_create_manager' (87ce8322-616f-4548-8a55-bd673d5d729e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:37:15 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-523c705e-e394-48dd-8649-9bdbcdc9786d tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2" returned: 0 in 0.377s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:37:15 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-eb6c4149-01ff-43c0-8c9a-5519b2b6e909 tempest-VolumeDependencyTests-442009576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-8c784aa3-b637-4a2f-a70b-058a3b465b2a" returned: 0 in 0.566s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:37:15 devstack cinder-volume[89182]: DEBUG cinder.manager [None req-523c705e-e394-48dd-8649-9bdbcdc9786d tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] Notifying Schedulers of capabilities ... {{(pid=89182) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 12:37:15 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-eb6c4149-01ff-43c0-8c9a-5519b2b6e909 tempest-VolumeDependencyTests-442009576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-8c784aa3-b637-4a2f-a70b-058a3b465b2a {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:37:15 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-523c705e-e394-48dd-8649-9bdbcdc9786d tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] Deleted volume successfully. Jul 31 12:37:15 devstack sudo[112377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-8c784aa3-b637-4a2f-a70b-058a3b465b2a Jul 31 12:37:15 devstack sudo[112377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:37:15 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-5507048c-a70f-4eb9-bbc4-238adeecd463 tempest-CreateVolumesFromSnapshotTest-1185178291 None] Created volume successfully. Jul 31 12:37:15 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-aa04c623-0469-4966-b2a2-3753991b5877 tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] Acquiring lock "cinder-734a2868-6cd5-4d71-9abb-d61fe285435f-delete_volume" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:37:16 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-523c705e-e394-48dd-8649-9bdbcdc9786d tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] Lock "cinder-9922a446-63fc-4c60-a625-6aa16bfe3440-delete_volume" released by "delete_volume" :: held 2.390s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:37:16 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-aa04c623-0469-4966-b2a2-3753991b5877 tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] Lock "cinder-734a2868-6cd5-4d71-9abb-d61fe285435f-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:37:16 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-aa04c623-0469-4966-b2a2-3753991b5877 tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] Acquiring lock "cinder-quobyte-734a2868-6cd5-4d71-9abb-d61fe285435f" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:37:16 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-aa04c623-0469-4966-b2a2-3753991b5877 tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] Lock "cinder-quobyte-734a2868-6cd5-4d71-9abb-d61fe285435f" acquired by "delete_volume" :: waited 0.024s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:37:16 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[b42e24bb-f84d-464d-9f6b-f8b98b9e2044]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:37:16 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-aa04c623-0469-4966-b2a2-3753991b5877 tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-734a2868-6cd5-4d71-9abb-d61fe285435f {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:37:16 devstack sudo[112377]: pam_unix(sudo:session): session closed for user root Jul 31 12:37:16 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-eb6c4149-01ff-43c0-8c9a-5519b2b6e909 tempest-VolumeDependencyTests-442009576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-8c784aa3-b637-4a2f-a70b-058a3b465b2a" returned: 0 in 0.388s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:37:16 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-eb6c4149-01ff-43c0-8c9a-5519b2b6e909 tempest-VolumeDependencyTests-442009576 None] Lock "cinder-quobyte-8c784aa3-b637-4a2f-a70b-058a3b465b2a" released by "delete_volume" :: held 1.039s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:37:16 devstack sudo[112380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-734a2868-6cd5-4d71-9abb-d61fe285435f Jul 31 12:37:16 devstack sudo[112380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:37:16 devstack cinder-volume[89182]: DEBUG cinder.quota [None req-eb6c4149-01ff-43c0-8c9a-5519b2b6e909 tempest-VolumeDependencyTests-442009576 None] Created reservations ['e864182f-07ce-4ee1-a70b-ce6e1cc0fc83', '26334666-eeee-4908-9f06-26c49368a092', 'c7975336-80a3-42a3-9479-d430d0ee505e', '73a6e1da-27c1-4687-81ea-b2356ca6fbed'] {{(pid=89182) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 12:37:16 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-eb6c4149-01ff-43c0-8c9a-5519b2b6e909 tempest-VolumeDependencyTests-442009576 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:37:16 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-eb6c4149-01ff-43c0-8c9a-5519b2b6e909 tempest-VolumeDependencyTests-442009576 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:37:16 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-eb6c4149-01ff-43c0-8c9a-5519b2b6e909 tempest-VolumeDependencyTests-442009576 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:37:16 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-eb6c4149-01ff-43c0-8c9a-5519b2b6e909 tempest-VolumeDependencyTests-442009576 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:37:16 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-eb6c4149-01ff-43c0-8c9a-5519b2b6e909 tempest-VolumeDependencyTests-442009576 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:37:16 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-eb6c4149-01ff-43c0-8c9a-5519b2b6e909 tempest-VolumeDependencyTests-442009576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:37:16 devstack sudo[112388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 Jul 31 12:37:16 devstack sudo[112388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:37:16 devstack sudo[112373]: pam_unix(sudo:session): session closed for user root Jul 31 12:37:16 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-6832ba54-20e1-48d8-8bb4-c87389edf97b tempest-CreateVolumesFromSnapshotTest-1185178291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-f55281ac-9e11-4efc-92ae-b34ae4b96d2d 1073741824" returned: 0 in 0.875s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:37:16 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-6832ba54-20e1-48d8-8bb4-c87389edf97b tempest-CreateVolumesFromSnapshotTest-1185178291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-f55281ac-9e11-4efc-92ae-b34ae4b96d2d {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:37:16 devstack sudo[112392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-f55281ac-9e11-4efc-92ae-b34ae4b96d2d Jul 31 12:37:16 devstack sudo[112392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:37:16 devstack sudo[112380]: pam_unix(sudo:session): session closed for user root Jul 31 12:37:16 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-aa04c623-0469-4966-b2a2-3753991b5877 tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-734a2868-6cd5-4d71-9abb-d61fe285435f" returned: 0 in 0.606s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:37:16 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-aa04c623-0469-4966-b2a2-3753991b5877 tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-734a2868-6cd5-4d71-9abb-d61fe285435f {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:37:16 devstack sudo[112396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-734a2868-6cd5-4d71-9abb-d61fe285435f Jul 31 12:37:16 devstack sudo[112396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:37:16 devstack sudo[112388]: pam_unix(sudo:session): session closed for user root Jul 31 12:37:16 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-eb6c4149-01ff-43c0-8c9a-5519b2b6e909 tempest-VolumeDependencyTests-442009576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2" returned: 0 in 0.433s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:37:16 devstack cinder-volume[89182]: DEBUG cinder.manager [None req-eb6c4149-01ff-43c0-8c9a-5519b2b6e909 tempest-VolumeDependencyTests-442009576 None] Notifying Schedulers of capabilities ... {{(pid=89182) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 12:37:16 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-eb6c4149-01ff-43c0-8c9a-5519b2b6e909 tempest-VolumeDependencyTests-442009576 None] Deleted volume successfully. Jul 31 12:37:16 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-eb6c4149-01ff-43c0-8c9a-5519b2b6e909 tempest-VolumeDependencyTests-442009576 None] Lock "cinder-8c784aa3-b637-4a2f-a70b-058a3b465b2a-delete_volume" released by "delete_volume" :: held 1.819s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:37:17 devstack sudo[112392]: pam_unix(sudo:session): session closed for user root Jul 31 12:37:17 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-6832ba54-20e1-48d8-8bb4-c87389edf97b tempest-CreateVolumesFromSnapshotTest-1185178291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-f55281ac-9e11-4efc-92ae-b34ae4b96d2d" returned: 0 in 0.517s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:37:17 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-6832ba54-20e1-48d8-8bb4-c87389edf97b tempest-CreateVolumesFromSnapshotTest-1185178291 None] <== create_volume: return (1468ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'} {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 12:37:17 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-6832ba54-20e1-48d8-8bb4-c87389edf97b tempest-CreateVolumesFromSnapshotTest-1185178291 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.471s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:37:17 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-6832ba54-20e1-48d8-8bb4-c87389edf97b tempest-CreateVolumesFromSnapshotTest-1185178291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f066e28-6e43-4a84-8101-1cca3a82bfab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f55281ac-9e11-4efc-92ae-b34ae4b96d2d', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:37:17 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-6832ba54-20e1-48d8-8bb4-c87389edf97b tempest-CreateVolumesFromSnapshotTest-1185178291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (907f84cf-1e9e-4c1a-9770-381f197df9b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:37:17 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-6832ba54-20e1-48d8-8bb4-c87389edf97b tempest-CreateVolumesFromSnapshotTest-1185178291 None] Volume volume-f55281ac-9e11-4efc-92ae-b34ae4b96d2d (f55281ac-9e11-4efc-92ae-b34ae4b96d2d): created successfully Jul 31 12:37:17 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-6832ba54-20e1-48d8-8bb4-c87389edf97b tempest-CreateVolumesFromSnapshotTest-1185178291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (907f84cf-1e9e-4c1a-9770-381f197df9b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:37:17 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-6832ba54-20e1-48d8-8bb4-c87389edf97b tempest-CreateVolumesFromSnapshotTest-1185178291 None] Flow 'volume_create_manager' (6e3f2f16-e7a5-43e3-b03e-ffd0d123903d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:37:17 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-6832ba54-20e1-48d8-8bb4-c87389edf97b tempest-CreateVolumesFromSnapshotTest-1185178291 None] Created volume successfully. Jul 31 12:37:17 devstack sudo[112396]: pam_unix(sudo:session): session closed for user root Jul 31 12:37:17 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-aa04c623-0469-4966-b2a2-3753991b5877 tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-734a2868-6cd5-4d71-9abb-d61fe285435f" returned: 0 in 0.479s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:37:17 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-aa04c623-0469-4966-b2a2-3753991b5877 tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] Lock "cinder-quobyte-734a2868-6cd5-4d71-9abb-d61fe285435f" released by "delete_volume" :: held 1.150s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:37:17 devstack cinder-volume[89182]: DEBUG cinder.quota [None req-aa04c623-0469-4966-b2a2-3753991b5877 tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] Created reservations ['35b1b0d0-9f3c-463e-bcf2-13b8d98f5321', '13a08721-47e7-4032-bc76-7093efafa4b4', '3bd2eacc-d1f0-40ef-b125-6044c7de7000', '42981f4b-725b-4be6-b453-657075f96d2e'] {{(pid=89182) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 12:37:17 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-11668177-70a1-45ca-a2ec-8a8549cd43e8 tempest-VolumeDependencyTests-442009576 None] Acquiring lock "cinder-9c5a2f2e-5b30-4a3c-8732-6417d383faca-delete_volume" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:37:17 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-11668177-70a1-45ca-a2ec-8a8549cd43e8 tempest-VolumeDependencyTests-442009576 None] Lock "cinder-9c5a2f2e-5b30-4a3c-8732-6417d383faca-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:37:17 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-aa04c623-0469-4966-b2a2-3753991b5877 tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:37:17 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-aa04c623-0469-4966-b2a2-3753991b5877 tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:37:17 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-aa04c623-0469-4966-b2a2-3753991b5877 tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:37:17 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-aa04c623-0469-4966-b2a2-3753991b5877 tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:37:17 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-aa04c623-0469-4966-b2a2-3753991b5877 tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:37:17 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-aa04c623-0469-4966-b2a2-3753991b5877 tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:37:17 devstack sudo[112401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 Jul 31 12:37:17 devstack sudo[112401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:37:17 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-11668177-70a1-45ca-a2ec-8a8549cd43e8 tempest-VolumeDependencyTests-442009576 None] Acquiring lock "cinder-quobyte-9c5a2f2e-5b30-4a3c-8732-6417d383faca" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:37:17 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-11668177-70a1-45ca-a2ec-8a8549cd43e8 tempest-VolumeDependencyTests-442009576 None] Lock "cinder-quobyte-9c5a2f2e-5b30-4a3c-8732-6417d383faca" acquired by "delete_volume" :: waited 0.032s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:37:17 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[03d30552-716c-46d2-997c-a9e58b8718c5]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:37:17 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-11668177-70a1-45ca-a2ec-8a8549cd43e8 tempest-VolumeDependencyTests-442009576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-9c5a2f2e-5b30-4a3c-8732-6417d383faca {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:37:17 devstack sudo[112403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-9c5a2f2e-5b30-4a3c-8732-6417d383faca Jul 31 12:37:17 devstack sudo[112403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:37:17 devstack sudo[112401]: pam_unix(sudo:session): session closed for user root Jul 31 12:37:17 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-aa04c623-0469-4966-b2a2-3753991b5877 tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2" returned: 0 in 0.358s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:37:17 devstack cinder-volume[89182]: DEBUG cinder.manager [None req-aa04c623-0469-4966-b2a2-3753991b5877 tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] Notifying Schedulers of capabilities ... {{(pid=89182) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 12:37:17 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-aa04c623-0469-4966-b2a2-3753991b5877 tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] Deleted volume successfully. Jul 31 12:37:17 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-aa04c623-0469-4966-b2a2-3753991b5877 tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] Lock "cinder-734a2868-6cd5-4d71-9abb-d61fe285435f-delete_volume" released by "delete_volume" :: held 1.825s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:37:18 devstack sudo[112403]: pam_unix(sudo:session): session closed for user root Jul 31 12:37:18 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-11668177-70a1-45ca-a2ec-8a8549cd43e8 tempest-VolumeDependencyTests-442009576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-9c5a2f2e-5b30-4a3c-8732-6417d383faca" returned: 0 in 0.446s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:37:18 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-11668177-70a1-45ca-a2ec-8a8549cd43e8 tempest-VolumeDependencyTests-442009576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-9c5a2f2e-5b30-4a3c-8732-6417d383faca {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:37:18 devstack sudo[112409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-9c5a2f2e-5b30-4a3c-8732-6417d383faca Jul 31 12:37:18 devstack sudo[112409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:37:18 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-85b171ce-1423-4e45-831b-5fc6fdc5941f tempest-CreateVolumesFromSnapshotTest-1185178291 None] Acquiring lock "cinder-f55281ac-9e11-4efc-92ae-b34ae4b96d2d-delete_volume" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:37:18 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-95a85f5c-30c4-4327-9de5-b853331301b3 tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] Acquiring lock "cinder-4d6e8087-f075-4acb-8a10-e30c61ccb1bb-delete_volume" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:37:18 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-85b171ce-1423-4e45-831b-5fc6fdc5941f tempest-CreateVolumesFromSnapshotTest-1185178291 None] Lock "cinder-f55281ac-9e11-4efc-92ae-b34ae4b96d2d-delete_volume" acquired by "delete_volume" :: waited 0.064s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:37:18 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-95a85f5c-30c4-4327-9de5-b853331301b3 tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] Lock "cinder-4d6e8087-f075-4acb-8a10-e30c61ccb1bb-delete_volume" acquired by "delete_volume" :: waited 0.070s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:37:18 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-85b171ce-1423-4e45-831b-5fc6fdc5941f tempest-CreateVolumesFromSnapshotTest-1185178291 None] Acquiring lock "cinder-quobyte-f55281ac-9e11-4efc-92ae-b34ae4b96d2d" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:37:18 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-95a85f5c-30c4-4327-9de5-b853331301b3 tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] Acquiring lock "cinder-quobyte-4d6e8087-f075-4acb-8a10-e30c61ccb1bb" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:37:18 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-85b171ce-1423-4e45-831b-5fc6fdc5941f tempest-CreateVolumesFromSnapshotTest-1185178291 None] Lock "cinder-quobyte-f55281ac-9e11-4efc-92ae-b34ae4b96d2d" acquired by "delete_volume" :: waited 0.031s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:37:18 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-95a85f5c-30c4-4327-9de5-b853331301b3 tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] Lock "cinder-quobyte-4d6e8087-f075-4acb-8a10-e30c61ccb1bb" acquired by "delete_volume" :: waited 0.048s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:37:18 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca12754e-0503-4315-82b7-9383714cd951]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:37:18 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-85b171ce-1423-4e45-831b-5fc6fdc5941f tempest-CreateVolumesFromSnapshotTest-1185178291 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-f55281ac-9e11-4efc-92ae-b34ae4b96d2d {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:37:18 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3b17f2e-580d-4cd7-83b8-a94a18c0e9e8]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:37:18 devstack sudo[112409]: pam_unix(sudo:session): session closed for user root Jul 31 12:37:18 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-95a85f5c-30c4-4327-9de5-b853331301b3 tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-4d6e8087-f075-4acb-8a10-e30c61ccb1bb {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:37:18 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-11668177-70a1-45ca-a2ec-8a8549cd43e8 tempest-VolumeDependencyTests-442009576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-9c5a2f2e-5b30-4a3c-8732-6417d383faca" returned: 0 in 0.505s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:37:18 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-11668177-70a1-45ca-a2ec-8a8549cd43e8 tempest-VolumeDependencyTests-442009576 None] Lock "cinder-quobyte-9c5a2f2e-5b30-4a3c-8732-6417d383faca" released by "delete_volume" :: held 1.035s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:37:18 devstack sudo[112412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-f55281ac-9e11-4efc-92ae-b34ae4b96d2d Jul 31 12:37:18 devstack sudo[112412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:37:18 devstack cinder-volume[89182]: DEBUG cinder.quota [None req-11668177-70a1-45ca-a2ec-8a8549cd43e8 tempest-VolumeDependencyTests-442009576 None] Created reservations ['512c1657-a8b5-4ed6-a5e1-6d6e292903b1', 'bf799e30-d3d2-4327-92e9-886a4ea0b334', '6cd45a7d-ee6b-4b92-8ce3-57de5066db1e', '509e0918-578e-404d-9926-c9aaf2976524'] {{(pid=89182) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 12:37:18 devstack sudo[112413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-4d6e8087-f075-4acb-8a10-e30c61ccb1bb Jul 31 12:37:18 devstack sudo[112413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:37:18 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-11668177-70a1-45ca-a2ec-8a8549cd43e8 tempest-VolumeDependencyTests-442009576 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:37:18 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-11668177-70a1-45ca-a2ec-8a8549cd43e8 tempest-VolumeDependencyTests-442009576 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:37:18 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-11668177-70a1-45ca-a2ec-8a8549cd43e8 tempest-VolumeDependencyTests-442009576 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:37:18 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-11668177-70a1-45ca-a2ec-8a8549cd43e8 tempest-VolumeDependencyTests-442009576 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:37:18 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-11668177-70a1-45ca-a2ec-8a8549cd43e8 tempest-VolumeDependencyTests-442009576 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:37:18 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-11668177-70a1-45ca-a2ec-8a8549cd43e8 tempest-VolumeDependencyTests-442009576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:37:19 devstack sudo[112418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 Jul 31 12:37:19 devstack sudo[112418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:37:19 devstack sudo[112412]: pam_unix(sudo:session): session closed for user root Jul 31 12:37:19 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-85b171ce-1423-4e45-831b-5fc6fdc5941f tempest-CreateVolumesFromSnapshotTest-1185178291 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-f55281ac-9e11-4efc-92ae-b34ae4b96d2d" returned: 0 in 0.628s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:37:19 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-85b171ce-1423-4e45-831b-5fc6fdc5941f tempest-CreateVolumesFromSnapshotTest-1185178291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-f55281ac-9e11-4efc-92ae-b34ae4b96d2d {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:37:19 devstack sudo[112422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-f55281ac-9e11-4efc-92ae-b34ae4b96d2d Jul 31 12:37:19 devstack sudo[112422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:37:19 devstack sudo[112413]: pam_unix(sudo:session): session closed for user root Jul 31 12:37:19 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-95a85f5c-30c4-4327-9de5-b853331301b3 tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-4d6e8087-f075-4acb-8a10-e30c61ccb1bb" returned: 0 in 0.829s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:37:19 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-95a85f5c-30c4-4327-9de5-b853331301b3 tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-4d6e8087-f075-4acb-8a10-e30c61ccb1bb {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:37:19 devstack sudo[112428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-4d6e8087-f075-4acb-8a10-e30c61ccb1bb Jul 31 12:37:19 devstack sudo[112428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:37:19 devstack sudo[112418]: pam_unix(sudo:session): session closed for user root Jul 31 12:37:19 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-11668177-70a1-45ca-a2ec-8a8549cd43e8 tempest-VolumeDependencyTests-442009576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2" returned: 0 in 0.519s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:37:19 devstack cinder-volume[89182]: DEBUG cinder.manager [None req-11668177-70a1-45ca-a2ec-8a8549cd43e8 tempest-VolumeDependencyTests-442009576 None] Notifying Schedulers of capabilities ... {{(pid=89182) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 12:37:19 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-11668177-70a1-45ca-a2ec-8a8549cd43e8 tempest-VolumeDependencyTests-442009576 None] Deleted volume successfully. Jul 31 12:37:19 devstack cinder-volume[89182]: DEBUG dbcounter [-] [89182] Writing DB stats cinder:SELECT=130,cinder:UPDATE=203,cinder:INSERT=46,cinder:DELETE=21 {{(pid=89182) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 12:37:19 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-11668177-70a1-45ca-a2ec-8a8549cd43e8 tempest-VolumeDependencyTests-442009576 None] Lock "cinder-9c5a2f2e-5b30-4a3c-8732-6417d383faca-delete_volume" released by "delete_volume" :: held 2.129s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:37:19 devstack sudo[112422]: pam_unix(sudo:session): session closed for user root Jul 31 12:37:19 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-85b171ce-1423-4e45-831b-5fc6fdc5941f tempest-CreateVolumesFromSnapshotTest-1185178291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-f55281ac-9e11-4efc-92ae-b34ae4b96d2d" returned: 0 in 0.486s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:37:19 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-85b171ce-1423-4e45-831b-5fc6fdc5941f tempest-CreateVolumesFromSnapshotTest-1185178291 None] Lock "cinder-quobyte-f55281ac-9e11-4efc-92ae-b34ae4b96d2d" released by "delete_volume" :: held 1.192s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:37:19 devstack cinder-volume[89182]: DEBUG dbcounter [-] [89182] Writing DB stats cinder:UPDATE=176,cinder:SELECT=160,cinder:DELETE=17,cinder:INSERT=51 {{(pid=89182) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 12:37:19 devstack cinder-volume[89182]: DEBUG cinder.quota [None req-85b171ce-1423-4e45-831b-5fc6fdc5941f tempest-CreateVolumesFromSnapshotTest-1185178291 None] Created reservations ['6af39d03-37ac-4290-94d4-2aad04e51247', '7bc9a0e2-61ba-4474-a103-2d20a74e4257', 'f62dcc7a-abb1-4767-8575-0f63d2b55e42', 'c3d88465-6304-4177-b6c0-e59d2a1f902c'] {{(pid=89182) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 12:37:19 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-85b171ce-1423-4e45-831b-5fc6fdc5941f tempest-CreateVolumesFromSnapshotTest-1185178291 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:37:19 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-85b171ce-1423-4e45-831b-5fc6fdc5941f tempest-CreateVolumesFromSnapshotTest-1185178291 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:37:19 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-85b171ce-1423-4e45-831b-5fc6fdc5941f tempest-CreateVolumesFromSnapshotTest-1185178291 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:37:19 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-85b171ce-1423-4e45-831b-5fc6fdc5941f tempest-CreateVolumesFromSnapshotTest-1185178291 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:37:19 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-85b171ce-1423-4e45-831b-5fc6fdc5941f tempest-CreateVolumesFromSnapshotTest-1185178291 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:37:19 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-85b171ce-1423-4e45-831b-5fc6fdc5941f tempest-CreateVolumesFromSnapshotTest-1185178291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:37:19 devstack sudo[112428]: pam_unix(sudo:session): session closed for user root Jul 31 12:37:19 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-95a85f5c-30c4-4327-9de5-b853331301b3 tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-4d6e8087-f075-4acb-8a10-e30c61ccb1bb" returned: 0 in 0.541s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:37:19 devstack sudo[112433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 Jul 31 12:37:19 devstack sudo[112433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:37:19 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-95a85f5c-30c4-4327-9de5-b853331301b3 tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] Lock "cinder-quobyte-4d6e8087-f075-4acb-8a10-e30c61ccb1bb" released by "delete_volume" :: held 1.455s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:37:20 devstack cinder-volume[89182]: DEBUG cinder.quota [None req-95a85f5c-30c4-4327-9de5-b853331301b3 tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] Created reservations ['2c466e92-a11e-402d-9e08-8cc846c0f691', 'ba556155-bbb0-45fb-a347-e4ef23eb14bb', 'b1e4e615-a9ff-4eda-b493-bbaf63367d6d', 'c8881658-0f9b-40d8-a20b-e0b7aea8dd02'] {{(pid=89182) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 12:37:20 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-95a85f5c-30c4-4327-9de5-b853331301b3 tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:37:20 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-95a85f5c-30c4-4327-9de5-b853331301b3 tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:37:20 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-95a85f5c-30c4-4327-9de5-b853331301b3 tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:37:20 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-95a85f5c-30c4-4327-9de5-b853331301b3 tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:37:20 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-95a85f5c-30c4-4327-9de5-b853331301b3 tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:37:20 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-95a85f5c-30c4-4327-9de5-b853331301b3 tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:37:20 devstack sudo[112435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 Jul 31 12:37:20 devstack sudo[112435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:37:20 devstack sudo[112433]: pam_unix(sudo:session): session closed for user root Jul 31 12:37:20 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-85b171ce-1423-4e45-831b-5fc6fdc5941f tempest-CreateVolumesFromSnapshotTest-1185178291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2" returned: 0 in 0.534s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:37:20 devstack cinder-volume[89182]: DEBUG cinder.manager [None req-85b171ce-1423-4e45-831b-5fc6fdc5941f tempest-CreateVolumesFromSnapshotTest-1185178291 None] Notifying Schedulers of capabilities ... {{(pid=89182) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 12:37:20 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-85b171ce-1423-4e45-831b-5fc6fdc5941f tempest-CreateVolumesFromSnapshotTest-1185178291 None] Deleted volume successfully. Jul 31 12:37:20 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-85b171ce-1423-4e45-831b-5fc6fdc5941f tempest-CreateVolumesFromSnapshotTest-1185178291 None] Lock "cinder-f55281ac-9e11-4efc-92ae-b34ae4b96d2d-delete_volume" released by "delete_volume" :: held 2.147s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:37:20 devstack sudo[112435]: pam_unix(sudo:session): session closed for user root Jul 31 12:37:20 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-95a85f5c-30c4-4327-9de5-b853331301b3 tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2" returned: 0 in 0.371s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:37:20 devstack cinder-volume[89182]: DEBUG cinder.manager [None req-95a85f5c-30c4-4327-9de5-b853331301b3 tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] Notifying Schedulers of capabilities ... {{(pid=89182) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 12:37:20 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-95a85f5c-30c4-4327-9de5-b853331301b3 tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] Deleted volume successfully. Jul 31 12:37:20 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-95a85f5c-30c4-4327-9de5-b853331301b3 tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] Lock "cinder-4d6e8087-f075-4acb-8a10-e30c61ccb1bb-delete_volume" released by "delete_volume" :: held 2.190s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:37:20 devstack cinder-volume[89182]: DEBUG cinder.volume.flows.manager.create_volume [None req-426542e6-954c-43a1-bfa5-a0dabbe38724 tempest-VolumeDependencyTests-442009576 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89182) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 12:37:20 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-426542e6-954c-43a1-bfa5-a0dabbe38724 tempest-VolumeDependencyTests-442009576 None] Flow 'volume_create_manager' (dc4f853a-97bc-4c93-b136-f44f8196fae0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:37:20 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-426542e6-954c-43a1-bfa5-a0dabbe38724 tempest-VolumeDependencyTests-442009576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a094d9bf-c3f3-4e92-86a3-8c170cb2040e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:37:20 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-c3111aeb-827b-47e1-b157-f6148954c8d6 tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] Acquiring lock "cinder-177969d5-f860-45ad-bad4-0d9ad47d3932-delete_volume" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:37:20 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-426542e6-954c-43a1-bfa5-a0dabbe38724 tempest-VolumeDependencyTests-442009576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a094d9bf-c3f3-4e92-86a3-8c170cb2040e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:37:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1708232933',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70102b3e-c9c8-455a-8df8-bbdf3afdeaee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c622d586c4c9404ead8c06d764810df1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:37:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:37:21Z,use_quota=True,user_id='cfc528fe8ec2487bb4171d283c222b1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:37:20 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-426542e6-954c-43a1-bfa5-a0dabbe38724 tempest-VolumeDependencyTests-442009576 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd1fa8a1-3388-478c-ad19-7a46a647de3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:37:20 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-426542e6-954c-43a1-bfa5-a0dabbe38724 tempest-VolumeDependencyTests-442009576 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd1fa8a1-3388-478c-ad19-7a46a647de3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:37:20 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-426542e6-954c-43a1-bfa5-a0dabbe38724 tempest-VolumeDependencyTests-442009576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ea7fd8a-8976-4ae9-8534-7abbc696f9b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:37:20 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-426542e6-954c-43a1-bfa5-a0dabbe38724 tempest-VolumeDependencyTests-442009576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ea7fd8a-8976-4ae9-8534-7abbc696f9b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '70102b3e-c9c8-455a-8df8-bbdf3afdeaee', 'volume_name': 'volume-70102b3e-c9c8-455a-8df8-bbdf3afdeaee', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:37:20 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-426542e6-954c-43a1-bfa5-a0dabbe38724 tempest-VolumeDependencyTests-442009576 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (566750b0-6931-44fd-b956-f1773fb110fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:37:20 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-426542e6-954c-43a1-bfa5-a0dabbe38724 tempest-VolumeDependencyTests-442009576 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (566750b0-6931-44fd-b956-f1773fb110fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:37:20 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-426542e6-954c-43a1-bfa5-a0dabbe38724 tempest-VolumeDependencyTests-442009576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9a22306-0726-47f1-9987-19e61d9aea36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:37:20 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-426542e6-954c-43a1-bfa5-a0dabbe38724 tempest-VolumeDependencyTests-442009576 None] Volume 70102b3e-c9c8-455a-8df8-bbdf3afdeaee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-70102b3e-c9c8-455a-8df8-bbdf3afdeaee', 'volume_size': 1} Jul 31 12:37:20 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-426542e6-954c-43a1-bfa5-a0dabbe38724 tempest-VolumeDependencyTests-442009576 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:37:20 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-426542e6-954c-43a1-bfa5-a0dabbe38724 tempest-VolumeDependencyTests-442009576 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:37:20 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-426542e6-954c-43a1-bfa5-a0dabbe38724 tempest-VolumeDependencyTests-442009576 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:37:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1708232933',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70102b3e-c9c8-455a-8df8-bbdf3afdeaee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c622d586c4c9404ead8c06d764810df1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:37:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:37:21Z,use_quota=True,user_id='cfc528fe8ec2487bb4171d283c222b1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)}" {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 12:37:20 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-426542e6-954c-43a1-bfa5-a0dabbe38724 tempest-VolumeDependencyTests-442009576 None] Creating volume 70102b3e-c9c8-455a-8df8-bbdf3afdeaee {{(pid=89182) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 12:37:20 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-426542e6-954c-43a1-bfa5-a0dabbe38724 tempest-VolumeDependencyTests-442009576 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:37:20 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-426542e6-954c-43a1-bfa5-a0dabbe38724 tempest-VolumeDependencyTests-442009576 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:37:20 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-426542e6-954c-43a1-bfa5-a0dabbe38724 tempest-VolumeDependencyTests-442009576 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:37:20 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-426542e6-954c-43a1-bfa5-a0dabbe38724 tempest-VolumeDependencyTests-442009576 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:37:20 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-426542e6-954c-43a1-bfa5-a0dabbe38724 tempest-VolumeDependencyTests-442009576 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:37:20 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-426542e6-954c-43a1-bfa5-a0dabbe38724 tempest-VolumeDependencyTests-442009576 None] Selected osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 as target Quobyte volume. {{(pid=89182) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 12:37:20 devstack cinder-volume[89182]: INFO cinder.volume.drivers.remotefs [None req-426542e6-954c-43a1-bfa5-a0dabbe38724 tempest-VolumeDependencyTests-442009576 None] casted to osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 Jul 31 12:37:20 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-426542e6-954c-43a1-bfa5-a0dabbe38724 tempest-VolumeDependencyTests-442009576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-70102b3e-c9c8-455a-8df8-bbdf3afdeaee 1073741824 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:37:20 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-c3111aeb-827b-47e1-b157-f6148954c8d6 tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] Lock "cinder-177969d5-f860-45ad-bad4-0d9ad47d3932-delete_volume" acquired by "delete_volume" :: waited 0.113s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:37:20 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-d5c2426b-bc38-4eec-b768-1c67e999513e tempest-CreateVolumesFromSnapshotTest-1185178291 None] Acquiring lock "cinder-bad2034c-99d1-468d-b53d-d9075556becf-delete_volume" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:37:20 devstack sudo[112439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-70102b3e-c9c8-455a-8df8-bbdf3afdeaee 1073741824 Jul 31 12:37:20 devstack sudo[112439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:37:20 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-d5c2426b-bc38-4eec-b768-1c67e999513e tempest-CreateVolumesFromSnapshotTest-1185178291 None] Lock "cinder-bad2034c-99d1-468d-b53d-d9075556becf-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:37:20 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-c3111aeb-827b-47e1-b157-f6148954c8d6 tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] Acquiring lock "cinder-quobyte-177969d5-f860-45ad-bad4-0d9ad47d3932" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:37:20 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-c3111aeb-827b-47e1-b157-f6148954c8d6 tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] Lock "cinder-quobyte-177969d5-f860-45ad-bad4-0d9ad47d3932" acquired by "delete_volume" :: waited 0.025s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:37:20 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-d5c2426b-bc38-4eec-b768-1c67e999513e tempest-CreateVolumesFromSnapshotTest-1185178291 None] Acquiring lock "cinder-quobyte-bad2034c-99d1-468d-b53d-d9075556becf" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:37:20 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-d5c2426b-bc38-4eec-b768-1c67e999513e tempest-CreateVolumesFromSnapshotTest-1185178291 None] Lock "cinder-quobyte-bad2034c-99d1-468d-b53d-d9075556becf" acquired by "delete_volume" :: waited 0.016s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:37:20 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1d0fd04-cbfe-4839-959d-f8d7a4e17082]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:37:20 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-c3111aeb-827b-47e1-b157-f6148954c8d6 tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-177969d5-f860-45ad-bad4-0d9ad47d3932 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:37:20 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc965b02-fb92-4343-9d12-4dddaa2ef31a]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:37:20 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-d5c2426b-bc38-4eec-b768-1c67e999513e tempest-CreateVolumesFromSnapshotTest-1185178291 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-bad2034c-99d1-468d-b53d-d9075556becf {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:37:21 devstack sudo[112441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-177969d5-f860-45ad-bad4-0d9ad47d3932 Jul 31 12:37:21 devstack sudo[112441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:37:21 devstack sudo[112442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-bad2034c-99d1-468d-b53d-d9075556becf Jul 31 12:37:21 devstack sudo[112442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:37:21 devstack sudo[112439]: pam_unix(sudo:session): session closed for user root Jul 31 12:37:21 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-426542e6-954c-43a1-bfa5-a0dabbe38724 tempest-VolumeDependencyTests-442009576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-70102b3e-c9c8-455a-8df8-bbdf3afdeaee 1073741824" returned: 0 in 0.560s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:37:21 devstack sudo[112442]: pam_unix(sudo:session): session closed for user root Jul 31 12:37:21 devstack sudo[112441]: pam_unix(sudo:session): session closed for user root Jul 31 12:37:21 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-d5c2426b-bc38-4eec-b768-1c67e999513e tempest-CreateVolumesFromSnapshotTest-1185178291 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-bad2034c-99d1-468d-b53d-d9075556becf" returned: 0 in 0.415s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:37:21 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-c3111aeb-827b-47e1-b157-f6148954c8d6 tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-177969d5-f860-45ad-bad4-0d9ad47d3932" returned: 0 in 0.437s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:37:21 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-d5c2426b-bc38-4eec-b768-1c67e999513e tempest-CreateVolumesFromSnapshotTest-1185178291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-bad2034c-99d1-468d-b53d-d9075556becf {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:37:21 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-c3111aeb-827b-47e1-b157-f6148954c8d6 tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-177969d5-f860-45ad-bad4-0d9ad47d3932 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:37:21 devstack sudo[112455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-bad2034c-99d1-468d-b53d-d9075556becf Jul 31 12:37:21 devstack sudo[112455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:37:21 devstack sudo[112456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-177969d5-f860-45ad-bad4-0d9ad47d3932 Jul 31 12:37:21 devstack sudo[112456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:37:21 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-426542e6-954c-43a1-bfa5-a0dabbe38724 tempest-VolumeDependencyTests-442009576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-70102b3e-c9c8-455a-8df8-bbdf3afdeaee {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:37:21 devstack sudo[112459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-70102b3e-c9c8-455a-8df8-bbdf3afdeaee Jul 31 12:37:21 devstack sudo[112459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:37:21 devstack sudo[112455]: pam_unix(sudo:session): session closed for user root Jul 31 12:37:21 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-d5c2426b-bc38-4eec-b768-1c67e999513e tempest-CreateVolumesFromSnapshotTest-1185178291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-bad2034c-99d1-468d-b53d-d9075556becf" returned: 0 in 0.268s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:37:21 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-d5c2426b-bc38-4eec-b768-1c67e999513e tempest-CreateVolumesFromSnapshotTest-1185178291 None] Lock "cinder-quobyte-bad2034c-99d1-468d-b53d-d9075556becf" released by "delete_volume" :: held 0.739s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:37:21 devstack cinder-volume[89182]: DEBUG cinder.quota [None req-d5c2426b-bc38-4eec-b768-1c67e999513e tempest-CreateVolumesFromSnapshotTest-1185178291 None] Created reservations ['ab8cce9b-550f-4b61-bb18-d690d5dee334', '8f95f485-53a5-4303-b135-561fa9ea8dbb', '59bed395-00fb-4b1f-b86f-2f22707e03f3', '45b8e41a-42f4-4808-82b1-b1b3f97e4f16'] {{(pid=89182) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 12:37:21 devstack sudo[112456]: pam_unix(sudo:session): session closed for user root Jul 31 12:37:21 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-c3111aeb-827b-47e1-b157-f6148954c8d6 tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-177969d5-f860-45ad-bad4-0d9ad47d3932" returned: 0 in 0.347s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:37:21 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-c3111aeb-827b-47e1-b157-f6148954c8d6 tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] Lock "cinder-quobyte-177969d5-f860-45ad-bad4-0d9ad47d3932" released by "delete_volume" :: held 0.858s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:37:21 devstack sudo[112459]: pam_unix(sudo:session): session closed for user root Jul 31 12:37:21 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-426542e6-954c-43a1-bfa5-a0dabbe38724 tempest-VolumeDependencyTests-442009576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-70102b3e-c9c8-455a-8df8-bbdf3afdeaee" returned: 0 in 0.382s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:37:21 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-426542e6-954c-43a1-bfa5-a0dabbe38724 tempest-VolumeDependencyTests-442009576 None] <== create_volume: return (1047ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'} {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 12:37:21 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-426542e6-954c-43a1-bfa5-a0dabbe38724 tempest-VolumeDependencyTests-442009576 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.052s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:37:21 devstack cinder-volume[89182]: DEBUG cinder.quota [None req-c3111aeb-827b-47e1-b157-f6148954c8d6 tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] Created reservations ['6de83202-199c-41cc-92d5-8dd3672ed6d2', 'e2f265c1-6f76-4a6e-b88e-ed2c498666c4', '04c51de3-5e57-4bf9-8c24-d632df3046d0', '882d8fcf-65e6-4d1c-8223-f7cdbd6ad926'] {{(pid=89182) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 12:37:21 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-426542e6-954c-43a1-bfa5-a0dabbe38724 tempest-VolumeDependencyTests-442009576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9a22306-0726-47f1-9987-19e61d9aea36) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-70102b3e-c9c8-455a-8df8-bbdf3afdeaee', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:37:21 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-426542e6-954c-43a1-bfa5-a0dabbe38724 tempest-VolumeDependencyTests-442009576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e73ac3b-cf9b-4650-ad7f-3e2bfb9de29d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:37:21 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-d5c2426b-bc38-4eec-b768-1c67e999513e tempest-CreateVolumesFromSnapshotTest-1185178291 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:37:21 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-d5c2426b-bc38-4eec-b768-1c67e999513e tempest-CreateVolumesFromSnapshotTest-1185178291 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:37:21 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-d5c2426b-bc38-4eec-b768-1c67e999513e tempest-CreateVolumesFromSnapshotTest-1185178291 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:37:21 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-d5c2426b-bc38-4eec-b768-1c67e999513e tempest-CreateVolumesFromSnapshotTest-1185178291 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:37:21 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-d5c2426b-bc38-4eec-b768-1c67e999513e tempest-CreateVolumesFromSnapshotTest-1185178291 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:37:21 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-d5c2426b-bc38-4eec-b768-1c67e999513e tempest-CreateVolumesFromSnapshotTest-1185178291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:37:21 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-426542e6-954c-43a1-bfa5-a0dabbe38724 tempest-VolumeDependencyTests-442009576 None] Volume volume-70102b3e-c9c8-455a-8df8-bbdf3afdeaee (70102b3e-c9c8-455a-8df8-bbdf3afdeaee): created successfully Jul 31 12:37:21 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-426542e6-954c-43a1-bfa5-a0dabbe38724 tempest-VolumeDependencyTests-442009576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e73ac3b-cf9b-4650-ad7f-3e2bfb9de29d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:37:21 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-426542e6-954c-43a1-bfa5-a0dabbe38724 tempest-VolumeDependencyTests-442009576 None] Flow 'volume_create_manager' (dc4f853a-97bc-4c93-b136-f44f8196fae0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:37:21 devstack sudo[112464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 Jul 31 12:37:21 devstack sudo[112464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:37:21 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-1447a960-ac38-4265-aea6-98749f14df73 tempest-CreateVolumesFromSnapshotTest-1185178291 None] Acquiring lock "cinder-869991fe-8fd6-45a5-bd40-64c19dad1b57-delete_volume" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:37:21 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-426542e6-954c-43a1-bfa5-a0dabbe38724 tempest-VolumeDependencyTests-442009576 None] Created volume successfully. Jul 31 12:37:21 devstack cinder-volume[89182]: DEBUG oslo_service.periodic_task [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89182) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 31 12:37:21 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:37:21 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:37:21 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:37:21 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:37:21 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:37:21 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:37:22 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-1447a960-ac38-4265-aea6-98749f14df73 tempest-CreateVolumesFromSnapshotTest-1185178291 None] Lock "cinder-869991fe-8fd6-45a5-bd40-64c19dad1b57-delete_volume" acquired by "delete_volume" :: waited 0.065s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:37:22 devstack sudo[112466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 Jul 31 12:37:22 devstack sudo[112466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:37:22 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-c3111aeb-827b-47e1-b157-f6148954c8d6 tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:37:22 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-c3111aeb-827b-47e1-b157-f6148954c8d6 tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:37:22 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-c3111aeb-827b-47e1-b157-f6148954c8d6 tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:37:22 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-c3111aeb-827b-47e1-b157-f6148954c8d6 tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:37:22 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-c3111aeb-827b-47e1-b157-f6148954c8d6 tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:37:22 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-c3111aeb-827b-47e1-b157-f6148954c8d6 tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:37:22 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-1447a960-ac38-4265-aea6-98749f14df73 tempest-CreateVolumesFromSnapshotTest-1185178291 None] Acquiring lock "cinder-quobyte-869991fe-8fd6-45a5-bd40-64c19dad1b57" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:37:22 devstack sudo[112468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 Jul 31 12:37:22 devstack sudo[112468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:37:22 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-1447a960-ac38-4265-aea6-98749f14df73 tempest-CreateVolumesFromSnapshotTest-1185178291 None] Lock "cinder-quobyte-869991fe-8fd6-45a5-bd40-64c19dad1b57" acquired by "delete_volume" :: waited 0.024s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:37:22 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b86fba6-972d-425b-bdad-bb1b718e7d8a]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:37:22 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-1447a960-ac38-4265-aea6-98749f14df73 tempest-CreateVolumesFromSnapshotTest-1185178291 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-869991fe-8fd6-45a5-bd40-64c19dad1b57 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:37:22 devstack sudo[112464]: pam_unix(sudo:session): session closed for user root Jul 31 12:37:22 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-d5c2426b-bc38-4eec-b768-1c67e999513e tempest-CreateVolumesFromSnapshotTest-1185178291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2" returned: 0 in 0.431s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:37:22 devstack cinder-volume[89182]: DEBUG cinder.manager [None req-d5c2426b-bc38-4eec-b768-1c67e999513e tempest-CreateVolumesFromSnapshotTest-1185178291 None] Notifying Schedulers of capabilities ... {{(pid=89182) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 12:37:22 devstack sudo[112466]: pam_unix(sudo:session): session closed for user root Jul 31 12:37:22 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-d5c2426b-bc38-4eec-b768-1c67e999513e tempest-CreateVolumesFromSnapshotTest-1185178291 None] Deleted volume successfully. Jul 31 12:37:22 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2" returned: 0 in 0.373s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:37:22 devstack cinder-volume[89182]: DEBUG cinder.manager [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] Notifying Schedulers of capabilities ... {{(pid=89182) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 12:37:22 devstack cinder-volume[89182]: DEBUG oslo_service.periodic_task [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] Running periodic task VolumeManager._thread_info {{(pid=89182) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 31 12:37:22 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] thread count: 28 {{(pid=89182) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 31 12:37:22 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] thread info: [<_MainThread(MainThread, started 136154603720832)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=89182) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 31 12:37:22 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-d5c2426b-bc38-4eec-b768-1c67e999513e tempest-CreateVolumesFromSnapshotTest-1185178291 None] Lock "cinder-bad2034c-99d1-468d-b53d-d9075556becf-delete_volume" released by "delete_volume" :: held 1.556s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:37:22 devstack sudo[112470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-869991fe-8fd6-45a5-bd40-64c19dad1b57 Jul 31 12:37:22 devstack sudo[112470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:37:22 devstack sudo[112468]: pam_unix(sudo:session): session closed for user root Jul 31 12:37:22 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-c3111aeb-827b-47e1-b157-f6148954c8d6 tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2" returned: 0 in 0.366s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:37:22 devstack cinder-volume[89182]: DEBUG cinder.manager [None req-c3111aeb-827b-47e1-b157-f6148954c8d6 tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] Notifying Schedulers of capabilities ... {{(pid=89182) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 12:37:22 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-c3111aeb-827b-47e1-b157-f6148954c8d6 tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] Deleted volume successfully. Jul 31 12:37:22 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-c3111aeb-827b-47e1-b157-f6148954c8d6 tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] Lock "cinder-177969d5-f860-45ad-bad4-0d9ad47d3932-delete_volume" released by "delete_volume" :: held 1.693s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:37:22 devstack sudo[112470]: pam_unix(sudo:session): session closed for user root Jul 31 12:37:22 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-1447a960-ac38-4265-aea6-98749f14df73 tempest-CreateVolumesFromSnapshotTest-1185178291 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-869991fe-8fd6-45a5-bd40-64c19dad1b57" returned: 0 in 0.495s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:37:22 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-1447a960-ac38-4265-aea6-98749f14df73 tempest-CreateVolumesFromSnapshotTest-1185178291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-869991fe-8fd6-45a5-bd40-64c19dad1b57 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:37:22 devstack sudo[112479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-869991fe-8fd6-45a5-bd40-64c19dad1b57 Jul 31 12:37:22 devstack sudo[112479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:37:22 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-6faa3c35-3cbd-4af0-b4ea-1afa8106937e tempest-VolumeDependencyTests-442009576 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:37:22 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-6faa3c35-3cbd-4af0-b4ea-1afa8106937e tempest-VolumeDependencyTests-442009576 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:37:22 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-7ebe9404-b407-4597-8bbe-c8137639c41d tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] Acquiring lock "cinder-326d2db4-2735-42ef-8c3d-8d3cf121a440-delete_volume" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:37:22 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-6faa3c35-3cbd-4af0-b4ea-1afa8106937e tempest-VolumeDependencyTests-442009576 None] Creating offline snapshot 982a5875-ef30-4b3f-9788-25d99ba142c2 of volume 70102b3e-c9c8-455a-8df8-bbdf3afdeaee {{(pid=89182) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 31 12:37:22 devstack sudo[112479]: pam_unix(sudo:session): session closed for user root Jul 31 12:37:22 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-1447a960-ac38-4265-aea6-98749f14df73 tempest-CreateVolumesFromSnapshotTest-1185178291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-869991fe-8fd6-45a5-bd40-64c19dad1b57" returned: 0 in 0.318s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:37:23 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-1447a960-ac38-4265-aea6-98749f14df73 tempest-CreateVolumesFromSnapshotTest-1185178291 None] Lock "cinder-quobyte-869991fe-8fd6-45a5-bd40-64c19dad1b57" released by "delete_volume" :: held 0.881s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:37:23 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[7677bf28-f81d-431c-b130-ea3cc2c7d5a0]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:37:23 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-6faa3c35-3cbd-4af0-b4ea-1afa8106937e tempest-VolumeDependencyTests-442009576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-70102b3e-c9c8-455a-8df8-bbdf3afdeaee {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:37:23 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-7ebe9404-b407-4597-8bbe-c8137639c41d tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] Lock "cinder-326d2db4-2735-42ef-8c3d-8d3cf121a440-delete_volume" acquired by "delete_volume" :: waited 0.072s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:37:23 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-7ebe9404-b407-4597-8bbe-c8137639c41d tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] Acquiring lock "cinder-quobyte-326d2db4-2735-42ef-8c3d-8d3cf121a440" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:37:23 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-7ebe9404-b407-4597-8bbe-c8137639c41d tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] Lock "cinder-quobyte-326d2db4-2735-42ef-8c3d-8d3cf121a440" acquired by "delete_volume" :: waited 0.028s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:37:23 devstack cinder-volume[89182]: DEBUG cinder.quota [None req-1447a960-ac38-4265-aea6-98749f14df73 tempest-CreateVolumesFromSnapshotTest-1185178291 None] Created reservations ['a011f169-40f4-4201-976c-8c5f5372c93b', '1b89a470-48db-42c7-882e-dacb96f8ff7a', '27e05e88-8d6f-4930-916b-5d7e15aef6cf', '9a6094cd-19ae-41f2-8098-1f45c78e1d73'] {{(pid=89182) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 12:37:23 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4d5dee5-3406-4813-882a-f92a1ebc4a90]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:37:23 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-7ebe9404-b407-4597-8bbe-c8137639c41d tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-326d2db4-2735-42ef-8c3d-8d3cf121a440 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:37:23 devstack sudo[112482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-70102b3e-c9c8-455a-8df8-bbdf3afdeaee Jul 31 12:37:23 devstack sudo[112482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:37:23 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-1447a960-ac38-4265-aea6-98749f14df73 tempest-CreateVolumesFromSnapshotTest-1185178291 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:37:23 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-1447a960-ac38-4265-aea6-98749f14df73 tempest-CreateVolumesFromSnapshotTest-1185178291 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:37:23 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-1447a960-ac38-4265-aea6-98749f14df73 tempest-CreateVolumesFromSnapshotTest-1185178291 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:37:23 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-1447a960-ac38-4265-aea6-98749f14df73 tempest-CreateVolumesFromSnapshotTest-1185178291 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:37:23 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-1447a960-ac38-4265-aea6-98749f14df73 tempest-CreateVolumesFromSnapshotTest-1185178291 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:37:23 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-1447a960-ac38-4265-aea6-98749f14df73 tempest-CreateVolumesFromSnapshotTest-1185178291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:37:23 devstack sudo[112483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-326d2db4-2735-42ef-8c3d-8d3cf121a440 Jul 31 12:37:23 devstack sudo[112483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:37:23 devstack sudo[112486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 Jul 31 12:37:23 devstack sudo[112486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:37:23 devstack sudo[112482]: pam_unix(sudo:session): session closed for user root Jul 31 12:37:23 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-6faa3c35-3cbd-4af0-b4ea-1afa8106937e tempest-VolumeDependencyTests-442009576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-70102b3e-c9c8-455a-8df8-bbdf3afdeaee" returned: 0 in 0.475s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:37:23 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-6faa3c35-3cbd-4af0-b4ea-1afa8106937e tempest-VolumeDependencyTests-442009576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-70102b3e-c9c8-455a-8df8-bbdf3afdeaee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-70102b3e-c9c8-455a-8df8-bbdf3afdeaee.982a5875-ef30-4b3f-9788-25d99ba142c2 1G {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:37:23 devstack sudo[112491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-70102b3e-c9c8-455a-8df8-bbdf3afdeaee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-70102b3e-c9c8-455a-8df8-bbdf3afdeaee.982a5875-ef30-4b3f-9788-25d99ba142c2 1G Jul 31 12:37:23 devstack sudo[112491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:37:23 devstack sudo[112486]: pam_unix(sudo:session): session closed for user root Jul 31 12:37:23 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-1447a960-ac38-4265-aea6-98749f14df73 tempest-CreateVolumesFromSnapshotTest-1185178291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2" returned: 0 in 0.299s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:37:23 devstack cinder-volume[89182]: DEBUG cinder.manager [None req-1447a960-ac38-4265-aea6-98749f14df73 tempest-CreateVolumesFromSnapshotTest-1185178291 None] Notifying Schedulers of capabilities ... {{(pid=89182) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 12:37:23 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-1447a960-ac38-4265-aea6-98749f14df73 tempest-CreateVolumesFromSnapshotTest-1185178291 None] Deleted volume successfully. Jul 31 12:37:23 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-1447a960-ac38-4265-aea6-98749f14df73 tempest-CreateVolumesFromSnapshotTest-1185178291 None] Lock "cinder-869991fe-8fd6-45a5-bd40-64c19dad1b57-delete_volume" released by "delete_volume" :: held 1.651s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:37:23 devstack sudo[112483]: pam_unix(sudo:session): session closed for user root Jul 31 12:37:23 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-7ebe9404-b407-4597-8bbe-c8137639c41d tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-326d2db4-2735-42ef-8c3d-8d3cf121a440" returned: 0 in 0.514s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:37:23 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-7ebe9404-b407-4597-8bbe-c8137639c41d tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-326d2db4-2735-42ef-8c3d-8d3cf121a440 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:37:23 devstack sudo[112497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-326d2db4-2735-42ef-8c3d-8d3cf121a440 Jul 31 12:37:23 devstack sudo[112497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:37:23 devstack sudo[112497]: pam_unix(sudo:session): session closed for user root Jul 31 12:37:23 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-7ebe9404-b407-4597-8bbe-c8137639c41d tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-326d2db4-2735-42ef-8c3d-8d3cf121a440" returned: 0 in 0.299s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:37:23 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-7ebe9404-b407-4597-8bbe-c8137639c41d tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] Lock "cinder-quobyte-326d2db4-2735-42ef-8c3d-8d3cf121a440" released by "delete_volume" :: held 0.869s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:37:24 devstack sudo[112491]: pam_unix(sudo:session): session closed for user root Jul 31 12:37:24 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-6faa3c35-3cbd-4af0-b4ea-1afa8106937e tempest-VolumeDependencyTests-442009576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-70102b3e-c9c8-455a-8df8-bbdf3afdeaee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-70102b3e-c9c8-455a-8df8-bbdf3afdeaee.982a5875-ef30-4b3f-9788-25d99ba142c2 1G" returned: 0 in 0.507s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:37:24 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-6faa3c35-3cbd-4af0-b4ea-1afa8106937e tempest-VolumeDependencyTests-442009576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-70102b3e-c9c8-455a-8df8-bbdf3afdeaee -F qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-70102b3e-c9c8-455a-8df8-bbdf3afdeaee.982a5875-ef30-4b3f-9788-25d99ba142c2 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:37:24 devstack sudo[112504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-70102b3e-c9c8-455a-8df8-bbdf3afdeaee -F qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-70102b3e-c9c8-455a-8df8-bbdf3afdeaee.982a5875-ef30-4b3f-9788-25d99ba142c2 Jul 31 12:37:24 devstack sudo[112504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:37:24 devstack cinder-volume[89182]: DEBUG cinder.quota [None req-7ebe9404-b407-4597-8bbe-c8137639c41d tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] Created reservations ['4a060d3d-1dc7-4528-b092-31521e5079be', '2c04483a-8bfb-4255-863d-260547cb5182', '14cebe9d-8c70-4fb0-9b29-d4c9e2468f23', '2c23b189-a382-4648-83e0-78f0bb935bcd'] {{(pid=89182) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 12:37:24 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-7ebe9404-b407-4597-8bbe-c8137639c41d tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:37:24 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-7ebe9404-b407-4597-8bbe-c8137639c41d tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:37:24 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-7ebe9404-b407-4597-8bbe-c8137639c41d tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:37:24 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-7ebe9404-b407-4597-8bbe-c8137639c41d tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:37:24 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-7ebe9404-b407-4597-8bbe-c8137639c41d tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:37:24 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-7ebe9404-b407-4597-8bbe-c8137639c41d tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:37:24 devstack sudo[112506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 Jul 31 12:37:24 devstack sudo[112506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:37:24 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-030a811f-a95d-482c-b139-9272f8224ada tempest-CreateVolumesFromSnapshotTest-1185178291 None] Acquiring lock "cinder-df6f55b0-321b-41bb-8bd2-5725e0bf0e63-delete_volume" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:37:24 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-030a811f-a95d-482c-b139-9272f8224ada tempest-CreateVolumesFromSnapshotTest-1185178291 None] Lock "cinder-df6f55b0-321b-41bb-8bd2-5725e0bf0e63-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:37:24 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-030a811f-a95d-482c-b139-9272f8224ada tempest-CreateVolumesFromSnapshotTest-1185178291 None] Acquiring lock "cinder-quobyte-df6f55b0-321b-41bb-8bd2-5725e0bf0e63" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:37:24 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-030a811f-a95d-482c-b139-9272f8224ada tempest-CreateVolumesFromSnapshotTest-1185178291 None] Lock "cinder-quobyte-df6f55b0-321b-41bb-8bd2-5725e0bf0e63" acquired by "delete_volume" :: waited 0.021s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:37:24 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb682a8d-8adb-4cd0-995c-204662d69eb1]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:37:24 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-030a811f-a95d-482c-b139-9272f8224ada tempest-CreateVolumesFromSnapshotTest-1185178291 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-df6f55b0-321b-41bb-8bd2-5725e0bf0e63 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:37:24 devstack sudo[112504]: pam_unix(sudo:session): session closed for user root Jul 31 12:37:24 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-6faa3c35-3cbd-4af0-b4ea-1afa8106937e tempest-VolumeDependencyTests-442009576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-70102b3e-c9c8-455a-8df8-bbdf3afdeaee -F qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-70102b3e-c9c8-455a-8df8-bbdf3afdeaee.982a5875-ef30-4b3f-9788-25d99ba142c2" returned: 0 in 0.443s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:37:24 devstack cinder-volume[89182]: WARNING cinder.volume.drivers.remotefs [None req-6faa3c35-3cbd-4af0-b4ea-1afa8106937e tempest-VolumeDependencyTests-442009576 None] /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-70102b3e-c9c8-455a-8df8-bbdf3afdeaee.982a5875-ef30-4b3f-9788-25d99ba142c2 is being set with open permissions: ugo+rw Jul 31 12:37:24 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-6faa3c35-3cbd-4af0-b4ea-1afa8106937e tempest-VolumeDependencyTests-442009576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-70102b3e-c9c8-455a-8df8-bbdf3afdeaee.982a5875-ef30-4b3f-9788-25d99ba142c2 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:37:24 devstack sudo[112513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-70102b3e-c9c8-455a-8df8-bbdf3afdeaee.982a5875-ef30-4b3f-9788-25d99ba142c2 Jul 31 12:37:24 devstack sudo[112513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:37:24 devstack sudo[112506]: pam_unix(sudo:session): session closed for user root Jul 31 12:37:24 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-7ebe9404-b407-4597-8bbe-c8137639c41d tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2" returned: 0 in 0.332s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:37:24 devstack cinder-volume[89182]: DEBUG cinder.manager [None req-7ebe9404-b407-4597-8bbe-c8137639c41d tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] Notifying Schedulers of capabilities ... {{(pid=89182) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 12:37:24 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-7ebe9404-b407-4597-8bbe-c8137639c41d tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] Deleted volume successfully. Jul 31 12:37:24 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-7ebe9404-b407-4597-8bbe-c8137639c41d tempest-CreateVolumesFromSourceVolumeTest-1911865854 None] Lock "cinder-326d2db4-2735-42ef-8c3d-8d3cf121a440-delete_volume" released by "delete_volume" :: held 1.509s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:37:24 devstack sudo[112511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-df6f55b0-321b-41bb-8bd2-5725e0bf0e63 Jul 31 12:37:24 devstack sudo[112511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:37:24 devstack sudo[112513]: pam_unix(sudo:session): session closed for user root Jul 31 12:37:24 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-6faa3c35-3cbd-4af0-b4ea-1afa8106937e tempest-VolumeDependencyTests-442009576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-70102b3e-c9c8-455a-8df8-bbdf3afdeaee.982a5875-ef30-4b3f-9788-25d99ba142c2" returned: 0 in 0.300s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:37:24 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-6faa3c35-3cbd-4af0-b4ea-1afa8106937e tempest-VolumeDependencyTests-442009576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-70102b3e-c9c8-455a-8df8-bbdf3afdeaee.info {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:37:24 devstack sudo[112521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-70102b3e-c9c8-455a-8df8-bbdf3afdeaee.info Jul 31 12:37:24 devstack sudo[112521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:37:24 devstack sudo[112511]: pam_unix(sudo:session): session closed for user root Jul 31 12:37:24 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-030a811f-a95d-482c-b139-9272f8224ada tempest-CreateVolumesFromSnapshotTest-1185178291 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-df6f55b0-321b-41bb-8bd2-5725e0bf0e63" returned: 0 in 0.431s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:37:24 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-030a811f-a95d-482c-b139-9272f8224ada tempest-CreateVolumesFromSnapshotTest-1185178291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-df6f55b0-321b-41bb-8bd2-5725e0bf0e63 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:37:24 devstack sudo[112523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-df6f55b0-321b-41bb-8bd2-5725e0bf0e63 Jul 31 12:37:24 devstack sudo[112523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:37:25 devstack sudo[112521]: pam_unix(sudo:session): session closed for user root Jul 31 12:37:25 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-6faa3c35-3cbd-4af0-b4ea-1afa8106937e tempest-VolumeDependencyTests-442009576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-70102b3e-c9c8-455a-8df8-bbdf3afdeaee.info" returned: 0 in 0.278s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:37:25 devstack cinder-volume[89182]: WARNING cinder.volume.drivers.remotefs [None req-6faa3c35-3cbd-4af0-b4ea-1afa8106937e tempest-VolumeDependencyTests-442009576 None] /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-70102b3e-c9c8-455a-8df8-bbdf3afdeaee.info is being set with open permissions: ugo+rw Jul 31 12:37:25 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-6faa3c35-3cbd-4af0-b4ea-1afa8106937e tempest-VolumeDependencyTests-442009576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-70102b3e-c9c8-455a-8df8-bbdf3afdeaee.info {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:37:25 devstack sudo[112526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-70102b3e-c9c8-455a-8df8-bbdf3afdeaee.info Jul 31 12:37:25 devstack sudo[112526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:37:25 devstack sudo[112523]: pam_unix(sudo:session): session closed for user root Jul 31 12:37:25 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-030a811f-a95d-482c-b139-9272f8224ada tempest-CreateVolumesFromSnapshotTest-1185178291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-df6f55b0-321b-41bb-8bd2-5725e0bf0e63" returned: 0 in 0.270s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:37:25 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-030a811f-a95d-482c-b139-9272f8224ada tempest-CreateVolumesFromSnapshotTest-1185178291 None] Lock "cinder-quobyte-df6f55b0-321b-41bb-8bd2-5725e0bf0e63" released by "delete_volume" :: held 0.763s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:37:25 devstack cinder-volume[89182]: DEBUG cinder.quota [None req-030a811f-a95d-482c-b139-9272f8224ada tempest-CreateVolumesFromSnapshotTest-1185178291 None] Created reservations ['7b7e6170-b84c-4f20-ab64-26c2d8e91a70', 'a331a401-01da-4914-9d2d-ff6615305063', '094c66e6-e323-4385-8824-900d3c56c6d4', '6c96185b-12c3-404f-884c-ccae4e880760'] {{(pid=89182) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 12:37:25 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-030a811f-a95d-482c-b139-9272f8224ada tempest-CreateVolumesFromSnapshotTest-1185178291 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:37:25 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-030a811f-a95d-482c-b139-9272f8224ada tempest-CreateVolumesFromSnapshotTest-1185178291 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:37:25 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-030a811f-a95d-482c-b139-9272f8224ada tempest-CreateVolumesFromSnapshotTest-1185178291 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:37:25 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-030a811f-a95d-482c-b139-9272f8224ada tempest-CreateVolumesFromSnapshotTest-1185178291 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:37:25 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-030a811f-a95d-482c-b139-9272f8224ada tempest-CreateVolumesFromSnapshotTest-1185178291 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:37:25 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-030a811f-a95d-482c-b139-9272f8224ada tempest-CreateVolumesFromSnapshotTest-1185178291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:37:25 devstack sudo[112529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 Jul 31 12:37:25 devstack sudo[112529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:37:25 devstack sudo[112526]: pam_unix(sudo:session): session closed for user root Jul 31 12:37:25 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-6faa3c35-3cbd-4af0-b4ea-1afa8106937e tempest-VolumeDependencyTests-442009576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-70102b3e-c9c8-455a-8df8-bbdf3afdeaee.info" returned: 0 in 0.315s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:37:25 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-6faa3c35-3cbd-4af0-b4ea-1afa8106937e tempest-VolumeDependencyTests-442009576 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.469s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:37:25 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-6faa3c35-3cbd-4af0-b4ea-1afa8106937e tempest-VolumeDependencyTests-442009576 None] Create snapshot completed successfully Jul 31 12:37:25 devstack sudo[112529]: pam_unix(sudo:session): session closed for user root Jul 31 12:37:25 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-d4bede59-70a7-4799-aa57-ea9f63b1de46 tempest-CreateVolumesFromSnapshotTest-1185178291 None] Acquiring lock "cinder-76d99f77-9ddb-4568-9cd5-e0c478330306-delete_volume" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:37:25 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-030a811f-a95d-482c-b139-9272f8224ada tempest-CreateVolumesFromSnapshotTest-1185178291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2" returned: 0 in 0.304s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:37:25 devstack cinder-volume[89182]: DEBUG cinder.manager [None req-030a811f-a95d-482c-b139-9272f8224ada tempest-CreateVolumesFromSnapshotTest-1185178291 None] Notifying Schedulers of capabilities ... {{(pid=89182) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 12:37:25 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-d4bede59-70a7-4799-aa57-ea9f63b1de46 tempest-CreateVolumesFromSnapshotTest-1185178291 None] Lock "cinder-76d99f77-9ddb-4568-9cd5-e0c478330306-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:37:25 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-030a811f-a95d-482c-b139-9272f8224ada tempest-CreateVolumesFromSnapshotTest-1185178291 None] Deleted volume successfully. Jul 31 12:37:25 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-030a811f-a95d-482c-b139-9272f8224ada tempest-CreateVolumesFromSnapshotTest-1185178291 None] Lock "cinder-df6f55b0-321b-41bb-8bd2-5725e0bf0e63-delete_volume" released by "delete_volume" :: held 1.349s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:37:25 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-d4bede59-70a7-4799-aa57-ea9f63b1de46 tempest-CreateVolumesFromSnapshotTest-1185178291 None] Acquiring lock "cinder-quobyte-76d99f77-9ddb-4568-9cd5-e0c478330306" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:37:25 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-d4bede59-70a7-4799-aa57-ea9f63b1de46 tempest-CreateVolumesFromSnapshotTest-1185178291 None] Lock "cinder-quobyte-76d99f77-9ddb-4568-9cd5-e0c478330306" acquired by "delete_volume" :: waited 0.026s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:37:25 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab145974-b8fe-4171-b64f-977510427ac7]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:37:25 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-d4bede59-70a7-4799-aa57-ea9f63b1de46 tempest-CreateVolumesFromSnapshotTest-1185178291 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-76d99f77-9ddb-4568-9cd5-e0c478330306 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:37:25 devstack sudo[112533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-76d99f77-9ddb-4568-9cd5-e0c478330306 Jul 31 12:37:25 devstack sudo[112533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:37:26 devstack sudo[112533]: pam_unix(sudo:session): session closed for user root Jul 31 12:37:26 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-d4bede59-70a7-4799-aa57-ea9f63b1de46 tempest-CreateVolumesFromSnapshotTest-1185178291 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-76d99f77-9ddb-4568-9cd5-e0c478330306" returned: 0 in 0.460s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:37:26 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-d4bede59-70a7-4799-aa57-ea9f63b1de46 tempest-CreateVolumesFromSnapshotTest-1185178291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-76d99f77-9ddb-4568-9cd5-e0c478330306 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:37:26 devstack sudo[112538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-76d99f77-9ddb-4568-9cd5-e0c478330306 Jul 31 12:37:26 devstack sudo[112538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:37:26 devstack sudo[112538]: pam_unix(sudo:session): session closed for user root Jul 31 12:37:26 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-d4bede59-70a7-4799-aa57-ea9f63b1de46 tempest-CreateVolumesFromSnapshotTest-1185178291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-76d99f77-9ddb-4568-9cd5-e0c478330306" returned: 0 in 0.313s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:37:26 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-d4bede59-70a7-4799-aa57-ea9f63b1de46 tempest-CreateVolumesFromSnapshotTest-1185178291 None] Lock "cinder-quobyte-76d99f77-9ddb-4568-9cd5-e0c478330306" released by "delete_volume" :: held 0.827s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:37:26 devstack cinder-volume[89182]: DEBUG cinder.quota [None req-d4bede59-70a7-4799-aa57-ea9f63b1de46 tempest-CreateVolumesFromSnapshotTest-1185178291 None] Created reservations ['cbba1072-3196-4656-8039-18244c7a5cf6', 'fdd436af-e5fa-430b-a997-341d704c9280', 'c0c03063-211e-4d8d-9697-f2184fce493c', '82ddf153-ec35-4c79-9328-d887a08f48fd'] {{(pid=89182) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 12:37:26 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-d4bede59-70a7-4799-aa57-ea9f63b1de46 tempest-CreateVolumesFromSnapshotTest-1185178291 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:37:26 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-d4bede59-70a7-4799-aa57-ea9f63b1de46 tempest-CreateVolumesFromSnapshotTest-1185178291 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:37:26 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-d4bede59-70a7-4799-aa57-ea9f63b1de46 tempest-CreateVolumesFromSnapshotTest-1185178291 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:37:26 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-d4bede59-70a7-4799-aa57-ea9f63b1de46 tempest-CreateVolumesFromSnapshotTest-1185178291 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:37:26 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-d4bede59-70a7-4799-aa57-ea9f63b1de46 tempest-CreateVolumesFromSnapshotTest-1185178291 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:37:26 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-d4bede59-70a7-4799-aa57-ea9f63b1de46 tempest-CreateVolumesFromSnapshotTest-1185178291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:37:26 devstack sudo[112541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 Jul 31 12:37:26 devstack sudo[112541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:37:26 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-81333365-a12e-4cfa-b03d-e62b07fb9ab4 tempest-CreateVolumesFromSnapshotTest-1185178291 None] Acquiring lock "cinder-623d7d2a-1106-43b7-a4c2-a7a3217d6894-delete_snapshot" by "delete_snapshot" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:37:26 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-81333365-a12e-4cfa-b03d-e62b07fb9ab4 tempest-CreateVolumesFromSnapshotTest-1185178291 None] Lock "cinder-623d7d2a-1106-43b7-a4c2-a7a3217d6894-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:37:26 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-81333365-a12e-4cfa-b03d-e62b07fb9ab4 tempest-CreateVolumesFromSnapshotTest-1185178291 None] Acquiring lock "cinder-quobyte-eb17bd40-f8bd-4485-ac68-569e5a061f1d" by "delete_snapshot" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:37:27 devstack cinder-volume[89182]: DEBUG cinder.volume.flows.manager.create_volume [None req-425954ce-b3fb-42fd-bea0-7440f67acace tempest-VolumeDependencyTests-442009576 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89182) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 12:37:27 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-81333365-a12e-4cfa-b03d-e62b07fb9ab4 tempest-CreateVolumesFromSnapshotTest-1185178291 None] Lock "cinder-quobyte-eb17bd40-f8bd-4485-ac68-569e5a061f1d" acquired by "delete_snapshot" :: waited 0.073s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:37:27 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-81333365-a12e-4cfa-b03d-e62b07fb9ab4 tempest-CreateVolumesFromSnapshotTest-1185178291 None] Acquiring lock "cinder-quobyte-623d7d2a-1106-43b7-a4c2-a7a3217d6894" by "_delete_snapshot" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:37:27 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-425954ce-b3fb-42fd-bea0-7440f67acace tempest-VolumeDependencyTests-442009576 None] Flow 'volume_create_manager' (d3db7aba-9f59-4980-b982-aace1b26a067) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:37:27 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-425954ce-b3fb-42fd-bea0-7440f67acace tempest-VolumeDependencyTests-442009576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (956445fb-92d0-408c-a55d-0c73824841e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:37:27 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-81333365-a12e-4cfa-b03d-e62b07fb9ab4 tempest-CreateVolumesFromSnapshotTest-1185178291 None] Lock "cinder-quobyte-623d7d2a-1106-43b7-a4c2-a7a3217d6894" acquired by "_delete_snapshot" :: waited 0.063s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:37:27 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-81333365-a12e-4cfa-b03d-e62b07fb9ab4 tempest-CreateVolumesFromSnapshotTest-1185178291 None] Deleting offline snapshot 623d7d2a-1106-43b7-a4c2-a7a3217d6894 of volume eb17bd40-f8bd-4485-ac68-569e5a061f1d {{(pid=89182) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 31 12:37:27 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-81333365-a12e-4cfa-b03d-e62b07fb9ab4 tempest-CreateVolumesFromSnapshotTest-1185178291 None] snapshot_file for this snap is: volume-eb17bd40-f8bd-4485-ac68-569e5a061f1d.623d7d2a-1106-43b7-a4c2-a7a3217d6894 {{(pid=89182) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 31 12:37:27 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[60e78064-183b-47df-aa20-37cd39db80c6]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:37:27 devstack sudo[112541]: pam_unix(sudo:session): session closed for user root Jul 31 12:37:27 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-81333365-a12e-4cfa-b03d-e62b07fb9ab4 tempest-CreateVolumesFromSnapshotTest-1185178291 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-eb17bd40-f8bd-4485-ac68-569e5a061f1d.623d7d2a-1106-43b7-a4c2-a7a3217d6894 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:37:27 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-d4bede59-70a7-4799-aa57-ea9f63b1de46 tempest-CreateVolumesFromSnapshotTest-1185178291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2" returned: 0 in 0.357s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:37:27 devstack cinder-volume[89182]: DEBUG cinder.manager [None req-d4bede59-70a7-4799-aa57-ea9f63b1de46 tempest-CreateVolumesFromSnapshotTest-1185178291 None] Notifying Schedulers of capabilities ... {{(pid=89182) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 12:37:27 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-425954ce-b3fb-42fd-bea0-7440f67acace tempest-VolumeDependencyTests-442009576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (956445fb-92d0-408c-a55d-0c73824841e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:37:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1998130848',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ce7c091-c8b0-432c-a840-fa5ce161abbf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c622d586c4c9404ead8c06d764810df1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:37:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=982a5875-ef30-4b3f-9788-25d99ba142c2,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:37:27Z,use_quota=True,user_id='cfc528fe8ec2487bb4171d283c222b1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:37:27 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-425954ce-b3fb-42fd-bea0-7440f67acace tempest-VolumeDependencyTests-442009576 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (003451ed-3d8b-4168-bc6b-fca4a375781a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:37:27 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-425954ce-b3fb-42fd-bea0-7440f67acace tempest-VolumeDependencyTests-442009576 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (003451ed-3d8b-4168-bc6b-fca4a375781a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:37:27 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-425954ce-b3fb-42fd-bea0-7440f67acace tempest-VolumeDependencyTests-442009576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f422d2f-2914-4b0f-9d8e-5c989150f33d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:37:27 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-425954ce-b3fb-42fd-bea0-7440f67acace tempest-VolumeDependencyTests-442009576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f422d2f-2914-4b0f-9d8e-5c989150f33d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '4ce7c091-c8b0-432c-a840-fa5ce161abbf', 'volume_name': 'volume-4ce7c091-c8b0-432c-a840-fa5ce161abbf', 'volume_size': 1, 'snapshot_id': '982a5875-ef30-4b3f-9788-25d99ba142c2'}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:37:27 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-425954ce-b3fb-42fd-bea0-7440f67acace tempest-VolumeDependencyTests-442009576 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7949463c-86ea-42ad-a6ec-f628fe890e1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:37:27 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-425954ce-b3fb-42fd-bea0-7440f67acace tempest-VolumeDependencyTests-442009576 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7949463c-86ea-42ad-a6ec-f628fe890e1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:37:27 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-425954ce-b3fb-42fd-bea0-7440f67acace tempest-VolumeDependencyTests-442009576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc7b8b60-9947-46ac-943e-a8b547b8e6b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:37:27 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-425954ce-b3fb-42fd-bea0-7440f67acace tempest-VolumeDependencyTests-442009576 None] Volume 4ce7c091-c8b0-432c-a840-fa5ce161abbf: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-4ce7c091-c8b0-432c-a840-fa5ce161abbf', 'volume_size': 1, 'snapshot_id': '982a5875-ef30-4b3f-9788-25d99ba142c2'} Jul 31 12:37:27 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-d4bede59-70a7-4799-aa57-ea9f63b1de46 tempest-CreateVolumesFromSnapshotTest-1185178291 None] Deleted volume successfully. Jul 31 12:37:27 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-425954ce-b3fb-42fd-bea0-7440f67acace tempest-VolumeDependencyTests-442009576 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:37:27 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-425954ce-b3fb-42fd-bea0-7440f67acace tempest-VolumeDependencyTests-442009576 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:37:27 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-425954ce-b3fb-42fd-bea0-7440f67acace tempest-VolumeDependencyTests-442009576 None] Acquiring lock "cinder-quobyte-982a5875-ef30-4b3f-9788-25d99ba142c2-4ce7c091-c8b0-432c-a840-fa5ce161abbf" by "_create_volume_from_snapshot" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:37:27 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-d4bede59-70a7-4799-aa57-ea9f63b1de46 tempest-CreateVolumesFromSnapshotTest-1185178291 None] Lock "cinder-76d99f77-9ddb-4568-9cd5-e0c478330306-delete_volume" released by "delete_volume" :: held 1.632s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:37:27 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-425954ce-b3fb-42fd-bea0-7440f67acace tempest-VolumeDependencyTests-442009576 None] Lock "cinder-quobyte-982a5875-ef30-4b3f-9788-25d99ba142c2-4ce7c091-c8b0-432c-a840-fa5ce161abbf" acquired by "_create_volume_from_snapshot" :: waited 0.037s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:37:27 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-425954ce-b3fb-42fd-bea0-7440f67acace tempest-VolumeDependencyTests-442009576 None] Creating volume 4ce7c091-c8b0-432c-a840-fa5ce161abbf from snapshot 982a5875-ef30-4b3f-9788-25d99ba142c2 {{(pid=89182) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 31 12:37:27 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-425954ce-b3fb-42fd-bea0-7440f67acace tempest-VolumeDependencyTests-442009576 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:37:27 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-425954ce-b3fb-42fd-bea0-7440f67acace tempest-VolumeDependencyTests-442009576 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:37:27 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-425954ce-b3fb-42fd-bea0-7440f67acace tempest-VolumeDependencyTests-442009576 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:37:27 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-425954ce-b3fb-42fd-bea0-7440f67acace tempest-VolumeDependencyTests-442009576 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:37:27 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-425954ce-b3fb-42fd-bea0-7440f67acace tempest-VolumeDependencyTests-442009576 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:37:27 devstack sudo[112545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-eb17bd40-f8bd-4485-ac68-569e5a061f1d.623d7d2a-1106-43b7-a4c2-a7a3217d6894 Jul 31 12:37:27 devstack sudo[112545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:37:27 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-425954ce-b3fb-42fd-bea0-7440f67acace tempest-VolumeDependencyTests-442009576 None] Selected osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 as target Quobyte volume. {{(pid=89182) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 12:37:27 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-425954ce-b3fb-42fd-bea0-7440f67acace tempest-VolumeDependencyTests-442009576 None] Acquiring lock "cinder-quobyte-4ce7c091-c8b0-432c-a840-fa5ce161abbf" by "_copy_volume_from_snapshot" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:37:27 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-425954ce-b3fb-42fd-bea0-7440f67acace tempest-VolumeDependencyTests-442009576 None] Lock "cinder-quobyte-4ce7c091-c8b0-432c-a840-fa5ce161abbf" acquired by "_copy_volume_from_snapshot" :: waited 0.024s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:37:27 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-425954ce-b3fb-42fd-bea0-7440f67acace tempest-VolumeDependencyTests-442009576 None] snapshot: 982a5875-ef30-4b3f-9788-25d99ba142c2, volume: 4ce7c091-c8b0-432c-a840-fa5ce161abbf, {{(pid=89182) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Jul 31 12:37:27 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-425954ce-b3fb-42fd-bea0-7440f67acace tempest-VolumeDependencyTests-442009576 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:37:27 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-425954ce-b3fb-42fd-bea0-7440f67acace tempest-VolumeDependencyTests-442009576 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:37:27 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-425954ce-b3fb-42fd-bea0-7440f67acace tempest-VolumeDependencyTests-442009576 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:37:27 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-425954ce-b3fb-42fd-bea0-7440f67acace tempest-VolumeDependencyTests-442009576 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:37:27 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-425954ce-b3fb-42fd-bea0-7440f67acace tempest-VolumeDependencyTests-442009576 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:37:27 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b53d825-2885-4181-973b-9924e6173647]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:37:27 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-425954ce-b3fb-42fd-bea0-7440f67acace tempest-VolumeDependencyTests-442009576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-70102b3e-c9c8-455a-8df8-bbdf3afdeaee.982a5875-ef30-4b3f-9788-25d99ba142c2 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:37:27 devstack sudo[112547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-70102b3e-c9c8-455a-8df8-bbdf3afdeaee.982a5875-ef30-4b3f-9788-25d99ba142c2 Jul 31 12:37:27 devstack sudo[112547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:37:27 devstack sudo[112545]: pam_unix(sudo:session): session closed for user root Jul 31 12:37:27 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-81333365-a12e-4cfa-b03d-e62b07fb9ab4 tempest-CreateVolumesFromSnapshotTest-1185178291 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-eb17bd40-f8bd-4485-ac68-569e5a061f1d.623d7d2a-1106-43b7-a4c2-a7a3217d6894" returned: 0 in 0.444s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:37:27 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-81333365-a12e-4cfa-b03d-e62b07fb9ab4 tempest-CreateVolumesFromSnapshotTest-1185178291 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-eb17bd40-f8bd-4485-ac68-569e5a061f1d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89182) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 12:37:27 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[46e5326e-c50c-4bdf-bc88-66f0cabeb57f]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:37:27 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-81333365-a12e-4cfa-b03d-e62b07fb9ab4 tempest-CreateVolumesFromSnapshotTest-1185178291 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-eb17bd40-f8bd-4485-ac68-569e5a061f1d {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:37:27 devstack sudo[112552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-eb17bd40-f8bd-4485-ac68-569e5a061f1d Jul 31 12:37:27 devstack sudo[112552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:37:27 devstack sudo[112547]: pam_unix(sudo:session): session closed for user root Jul 31 12:37:27 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-425954ce-b3fb-42fd-bea0-7440f67acace tempest-VolumeDependencyTests-442009576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-70102b3e-c9c8-455a-8df8-bbdf3afdeaee.982a5875-ef30-4b3f-9788-25d99ba142c2" returned: 0 in 0.564s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:37:27 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-425954ce-b3fb-42fd-bea0-7440f67acace tempest-VolumeDependencyTests-442009576 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-70102b3e-c9c8-455a-8df8-bbdf3afdeaee(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89182) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 12:37:27 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb0ceb1f-1255-49a1-b190-e4173c18a64a]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:37:27 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-425954ce-b3fb-42fd-bea0-7440f67acace tempest-VolumeDependencyTests-442009576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-70102b3e-c9c8-455a-8df8-bbdf3afdeaee {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:37:28 devstack sudo[112552]: pam_unix(sudo:session): session closed for user root Jul 31 12:37:28 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-81333365-a12e-4cfa-b03d-e62b07fb9ab4 tempest-CreateVolumesFromSnapshotTest-1185178291 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-eb17bd40-f8bd-4485-ac68-569e5a061f1d" returned: 0 in 0.507s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:37:28 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-81333365-a12e-4cfa-b03d-e62b07fb9ab4 tempest-CreateVolumesFromSnapshotTest-1185178291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-eb17bd40-f8bd-4485-ac68-569e5a061f1d.623d7d2a-1106-43b7-a4c2-a7a3217d6894 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:37:28 devstack sudo[112562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-eb17bd40-f8bd-4485-ac68-569e5a061f1d.623d7d2a-1106-43b7-a4c2-a7a3217d6894 Jul 31 12:37:28 devstack sudo[112562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:37:28 devstack sudo[112558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-70102b3e-c9c8-455a-8df8-bbdf3afdeaee Jul 31 12:37:28 devstack sudo[112558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:37:28 devstack sudo[112558]: pam_unix(sudo:session): session closed for user root Jul 31 12:37:28 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-425954ce-b3fb-42fd-bea0-7440f67acace tempest-VolumeDependencyTests-442009576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-70102b3e-c9c8-455a-8df8-bbdf3afdeaee" returned: 0 in 0.473s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:37:28 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-425954ce-b3fb-42fd-bea0-7440f67acace tempest-VolumeDependencyTests-442009576 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-70102b3e-c9c8-455a-8df8-bbdf3afdeaee {{(pid=89182) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Jul 31 12:37:28 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-425954ce-b3fb-42fd-bea0-7440f67acace tempest-VolumeDependencyTests-442009576 None] Creating direct copy from snapshot {{(pid=89182) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Jul 31 12:37:28 devstack cinder-volume[89182]: DEBUG cinder.utils [None req-425954ce-b3fb-42fd-bea0-7440f67acace tempest-VolumeDependencyTests-442009576 None] Path /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-4ce7c091-c8b0-432c-a840-fa5ce161abbf not found in is_blk_device check {{(pid=89182) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 31 12:37:28 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-425954ce-b3fb-42fd-bea0-7440f67acace tempest-VolumeDependencyTests-442009576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-70102b3e-c9c8-455a-8df8-bbdf3afdeaee /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-4ce7c091-c8b0-432c-a840-fa5ce161abbf {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:37:28 devstack sudo[112572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-70102b3e-c9c8-455a-8df8-bbdf3afdeaee /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-4ce7c091-c8b0-432c-a840-fa5ce161abbf Jul 31 12:37:28 devstack sudo[112572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:37:28 devstack sudo[112562]: pam_unix(sudo:session): session closed for user root Jul 31 12:37:28 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-81333365-a12e-4cfa-b03d-e62b07fb9ab4 tempest-CreateVolumesFromSnapshotTest-1185178291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-eb17bd40-f8bd-4485-ac68-569e5a061f1d.623d7d2a-1106-43b7-a4c2-a7a3217d6894" returned: 0 in 0.418s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:37:28 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-81333365-a12e-4cfa-b03d-e62b07fb9ab4 tempest-CreateVolumesFromSnapshotTest-1185178291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-eb17bd40-f8bd-4485-ac68-569e5a061f1d.623d7d2a-1106-43b7-a4c2-a7a3217d6894 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:37:28 devstack sudo[112575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-eb17bd40-f8bd-4485-ac68-569e5a061f1d.623d7d2a-1106-43b7-a4c2-a7a3217d6894 Jul 31 12:37:28 devstack sudo[112575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:37:28 devstack sudo[112575]: pam_unix(sudo:session): session closed for user root Jul 31 12:37:28 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-81333365-a12e-4cfa-b03d-e62b07fb9ab4 tempest-CreateVolumesFromSnapshotTest-1185178291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-eb17bd40-f8bd-4485-ac68-569e5a061f1d.623d7d2a-1106-43b7-a4c2-a7a3217d6894" returned: 0 in 0.292s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:37:28 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-81333365-a12e-4cfa-b03d-e62b07fb9ab4 tempest-CreateVolumesFromSnapshotTest-1185178291 None] Lock "cinder-quobyte-623d7d2a-1106-43b7-a4c2-a7a3217d6894" released by "_delete_snapshot" :: held 1.832s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:37:28 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-81333365-a12e-4cfa-b03d-e62b07fb9ab4 tempest-CreateVolumesFromSnapshotTest-1185178291 None] Lock "cinder-quobyte-eb17bd40-f8bd-4485-ac68-569e5a061f1d" released by "delete_snapshot" :: held 1.909s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:37:29 devstack cinder-volume[89182]: DEBUG cinder.quota [None req-81333365-a12e-4cfa-b03d-e62b07fb9ab4 tempest-CreateVolumesFromSnapshotTest-1185178291 None] Created reservations ['91afdda6-9310-4cb5-8cb6-42f809edd8c6', '781ab354-8a42-4da8-a21b-188fc0bde54d', '6a1d9abf-af1c-48a2-91c0-1784a8c086e1', '7ce2522b-6ce7-45ff-ac7d-ffef78288945'] {{(pid=89182) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 12:37:29 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-81333365-a12e-4cfa-b03d-e62b07fb9ab4 tempest-CreateVolumesFromSnapshotTest-1185178291 None] Delete snapshot completed successfully. Jul 31 12:37:29 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-81333365-a12e-4cfa-b03d-e62b07fb9ab4 tempest-CreateVolumesFromSnapshotTest-1185178291 None] Lock "cinder-623d7d2a-1106-43b7-a4c2-a7a3217d6894-delete_snapshot" released by "delete_snapshot" :: held 2.287s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:37:29 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-39076944-31d5-48b4-9566-4e691622d624 tempest-CreateVolumesFromSnapshotTest-1185178291 None] Acquiring lock "cinder-eb17bd40-f8bd-4485-ac68-569e5a061f1d-delete_volume" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:37:29 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-39076944-31d5-48b4-9566-4e691622d624 tempest-CreateVolumesFromSnapshotTest-1185178291 None] Lock "cinder-eb17bd40-f8bd-4485-ac68-569e5a061f1d-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:37:29 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-39076944-31d5-48b4-9566-4e691622d624 tempest-CreateVolumesFromSnapshotTest-1185178291 None] Acquiring lock "cinder-quobyte-eb17bd40-f8bd-4485-ac68-569e5a061f1d" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:37:29 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-39076944-31d5-48b4-9566-4e691622d624 tempest-CreateVolumesFromSnapshotTest-1185178291 None] Lock "cinder-quobyte-eb17bd40-f8bd-4485-ac68-569e5a061f1d" acquired by "delete_volume" :: waited 0.052s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:37:29 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[e890c4f6-e0c8-4ef8-ba3f-8d3211fa3e85]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:37:29 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-39076944-31d5-48b4-9566-4e691622d624 tempest-CreateVolumesFromSnapshotTest-1185178291 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-eb17bd40-f8bd-4485-ac68-569e5a061f1d {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:37:29 devstack sudo[112617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-eb17bd40-f8bd-4485-ac68-569e5a061f1d Jul 31 12:37:29 devstack sudo[112617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:37:30 devstack sudo[112617]: pam_unix(sudo:session): session closed for user root Jul 31 12:37:30 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-39076944-31d5-48b4-9566-4e691622d624 tempest-CreateVolumesFromSnapshotTest-1185178291 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-eb17bd40-f8bd-4485-ac68-569e5a061f1d" returned: 0 in 1.062s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:37:30 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-39076944-31d5-48b4-9566-4e691622d624 tempest-CreateVolumesFromSnapshotTest-1185178291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-eb17bd40-f8bd-4485-ac68-569e5a061f1d {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:37:30 devstack sudo[112623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-eb17bd40-f8bd-4485-ac68-569e5a061f1d Jul 31 12:37:30 devstack sudo[112623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:37:31 devstack sudo[112623]: pam_unix(sudo:session): session closed for user root Jul 31 12:37:31 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-39076944-31d5-48b4-9566-4e691622d624 tempest-CreateVolumesFromSnapshotTest-1185178291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-eb17bd40-f8bd-4485-ac68-569e5a061f1d" returned: 0 in 0.602s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:37:31 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-39076944-31d5-48b4-9566-4e691622d624 tempest-CreateVolumesFromSnapshotTest-1185178291 None] Lock "cinder-quobyte-eb17bd40-f8bd-4485-ac68-569e5a061f1d" released by "delete_volume" :: held 1.818s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:37:31 devstack cinder-volume[89182]: DEBUG cinder.quota [None req-39076944-31d5-48b4-9566-4e691622d624 tempest-CreateVolumesFromSnapshotTest-1185178291 None] Created reservations ['0abec1ca-b6f7-4aaf-8e06-a1b9d06fc205', 'a7c6fee6-37a0-4709-948d-258791899114', '3513236b-566a-47b9-9a15-4a893e9e90e9', 'cd058d5c-9baa-49ca-b4c1-dc074a937cda'] {{(pid=89182) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 12:37:31 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-39076944-31d5-48b4-9566-4e691622d624 tempest-CreateVolumesFromSnapshotTest-1185178291 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:37:31 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-39076944-31d5-48b4-9566-4e691622d624 tempest-CreateVolumesFromSnapshotTest-1185178291 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:37:31 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-39076944-31d5-48b4-9566-4e691622d624 tempest-CreateVolumesFromSnapshotTest-1185178291 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:37:31 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-39076944-31d5-48b4-9566-4e691622d624 tempest-CreateVolumesFromSnapshotTest-1185178291 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:37:31 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-39076944-31d5-48b4-9566-4e691622d624 tempest-CreateVolumesFromSnapshotTest-1185178291 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:37:31 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-39076944-31d5-48b4-9566-4e691622d624 tempest-CreateVolumesFromSnapshotTest-1185178291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:37:31 devstack sudo[112626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 Jul 31 12:37:31 devstack sudo[112626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:37:32 devstack sudo[112626]: pam_unix(sudo:session): session closed for user root Jul 31 12:37:32 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-39076944-31d5-48b4-9566-4e691622d624 tempest-CreateVolumesFromSnapshotTest-1185178291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2" returned: 0 in 0.423s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:37:32 devstack cinder-volume[89182]: DEBUG cinder.manager [None req-39076944-31d5-48b4-9566-4e691622d624 tempest-CreateVolumesFromSnapshotTest-1185178291 None] Notifying Schedulers of capabilities ... {{(pid=89182) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 12:37:32 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-39076944-31d5-48b4-9566-4e691622d624 tempest-CreateVolumesFromSnapshotTest-1185178291 None] Deleted volume successfully. Jul 31 12:37:32 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-39076944-31d5-48b4-9566-4e691622d624 tempest-CreateVolumesFromSnapshotTest-1185178291 None] Lock "cinder-eb17bd40-f8bd-4485-ac68-569e5a061f1d-delete_volume" released by "delete_volume" :: held 2.729s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:37:34 devstack sudo[112572]: pam_unix(sudo:session): session closed for user root Jul 31 12:37:34 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-425954ce-b3fb-42fd-bea0-7440f67acace tempest-VolumeDependencyTests-442009576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-70102b3e-c9c8-455a-8df8-bbdf3afdeaee /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-4ce7c091-c8b0-432c-a840-fa5ce161abbf" returned: 0 in 5.767s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:37:34 devstack cinder-volume[89182]: DEBUG cinder.image.image_utils [None req-425954ce-b3fb-42fd-bea0-7440f67acace tempest-VolumeDependencyTests-442009576 None] Image conversion details: src /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-70102b3e-c9c8-455a-8df8-bbdf3afdeaee, size 1024.00 MB, duration 5.77 sec, destination /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-4ce7c091-c8b0-432c-a840-fa5ce161abbf {{(pid=89182) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 31 12:37:34 devstack cinder-volume[89182]: INFO cinder.image.image_utils [None req-425954ce-b3fb-42fd-bea0-7440f67acace tempest-VolumeDependencyTests-442009576 None] Converted 1024.00 MB image at 177.54 MB/s Jul 31 12:37:34 devstack cinder-volume[89182]: WARNING cinder.volume.drivers.remotefs [None req-425954ce-b3fb-42fd-bea0-7440f67acace tempest-VolumeDependencyTests-442009576 None] /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-4ce7c091-c8b0-432c-a840-fa5ce161abbf is being set with open permissions: ugo+rw Jul 31 12:37:34 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-425954ce-b3fb-42fd-bea0-7440f67acace tempest-VolumeDependencyTests-442009576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-4ce7c091-c8b0-432c-a840-fa5ce161abbf {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:37:34 devstack sudo[112629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-4ce7c091-c8b0-432c-a840-fa5ce161abbf Jul 31 12:37:34 devstack sudo[112629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:37:34 devstack sudo[112629]: pam_unix(sudo:session): session closed for user root Jul 31 12:37:34 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-425954ce-b3fb-42fd-bea0-7440f67acace tempest-VolumeDependencyTests-442009576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-4ce7c091-c8b0-432c-a840-fa5ce161abbf" returned: 0 in 0.254s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:37:34 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-425954ce-b3fb-42fd-bea0-7440f67acace tempest-VolumeDependencyTests-442009576 None] Lock "cinder-quobyte-4ce7c091-c8b0-432c-a840-fa5ce161abbf" released by "_copy_volume_from_snapshot" :: held 7.183s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:37:34 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-425954ce-b3fb-42fd-bea0-7440f67acace tempest-VolumeDependencyTests-442009576 None] Lock "cinder-quobyte-982a5875-ef30-4b3f-9788-25d99ba142c2-4ce7c091-c8b0-432c-a840-fa5ce161abbf" released by "_create_volume_from_snapshot" :: held 7.280s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:37:34 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-425954ce-b3fb-42fd-bea0-7440f67acace tempest-VolumeDependencyTests-442009576 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.318s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:37:34 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-425954ce-b3fb-42fd-bea0-7440f67acace tempest-VolumeDependencyTests-442009576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc7b8b60-9947-46ac-943e-a8b547b8e6b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4ce7c091-c8b0-432c-a840-fa5ce161abbf', 'volume_size': 1, 'snapshot_id': '982a5875-ef30-4b3f-9788-25d99ba142c2'}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:37:34 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-425954ce-b3fb-42fd-bea0-7440f67acace tempest-VolumeDependencyTests-442009576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be2db8bc-a436-4f58-b467-7abf9cfc7840) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:37:34 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-425954ce-b3fb-42fd-bea0-7440f67acace tempest-VolumeDependencyTests-442009576 None] Volume volume-4ce7c091-c8b0-432c-a840-fa5ce161abbf (4ce7c091-c8b0-432c-a840-fa5ce161abbf): created successfully Jul 31 12:37:34 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-425954ce-b3fb-42fd-bea0-7440f67acace tempest-VolumeDependencyTests-442009576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be2db8bc-a436-4f58-b467-7abf9cfc7840) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:37:34 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-425954ce-b3fb-42fd-bea0-7440f67acace tempest-VolumeDependencyTests-442009576 None] Flow 'volume_create_manager' (d3db7aba-9f59-4980-b982-aace1b26a067) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:37:34 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-425954ce-b3fb-42fd-bea0-7440f67acace tempest-VolumeDependencyTests-442009576 None] Created volume successfully. Jul 31 12:37:34 devstack cinder-volume[89182]: DEBUG cinder.volume.flows.manager.create_volume [None req-159d14ac-c120-4bef-95e0-23d2e9908d18 tempest-VolumeImageDependencyTests-1366750687 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89182) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 12:37:34 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-159d14ac-c120-4bef-95e0-23d2e9908d18 tempest-VolumeImageDependencyTests-1366750687 None] Flow 'volume_create_manager' (426a4c93-9691-46dc-8723-27b10b479e26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:37:34 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-159d14ac-c120-4bef-95e0-23d2e9908d18 tempest-VolumeImageDependencyTests-1366750687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea9f8f95-0768-4c32-9f24-35c3369e3630) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:37:34 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-159d14ac-c120-4bef-95e0-23d2e9908d18 tempest-VolumeImageDependencyTests-1366750687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea9f8f95-0768-4c32-9f24-35c3369e3630) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:37:34Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec85cdb1-7689-440b-afbd-5dd65139a0af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d0755f1e2ea4124a760580edccedbe3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:37:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:37:35Z,use_quota=True,user_id='b44e6e9d7b9542c6aea2ca270c251a89',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:37:34 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-159d14ac-c120-4bef-95e0-23d2e9908d18 tempest-VolumeImageDependencyTests-1366750687 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bba9a793-c215-4038-9a32-0efdc0750eb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:37:34 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-159d14ac-c120-4bef-95e0-23d2e9908d18 tempest-VolumeImageDependencyTests-1366750687 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bba9a793-c215-4038-9a32-0efdc0750eb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:37:34 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-159d14ac-c120-4bef-95e0-23d2e9908d18 tempest-VolumeImageDependencyTests-1366750687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64d1964b-8a0f-4fb9-85ba-7d0a4bef987c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:37:34 devstack cinder-volume[89182]: DEBUG cinder.image.glance [None req-159d14ac-c120-4bef-95e0-23d2e9908d18 tempest-VolumeImageDependencyTests-1366750687 None] Creating Keystone auth plugin from conf {{(pid=89182) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 31 12:37:35 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-159d14ac-c120-4bef-95e0-23d2e9908d18 tempest-VolumeImageDependencyTests-1366750687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64d1964b-8a0f-4fb9-85ba-7d0a4bef987c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'ec85cdb1-7689-440b-afbd-5dd65139a0af', 'volume_name': 'volume-ec85cdb1-7689-440b-afbd-5dd65139a0af', 'volume_size': 1, 'image_id': '7d692865-546c-4efb-b5b0-835056092f6f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7d692865-546c-4efb-b5b0-835056092f6f', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '0f944d0462506ab32b5f1bb8608d0b2f', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '2d0755f1e2ea4124a760580edccedbe3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '375bd2ec5f64e1d48e350ea788020a2ce0c28289ca4da531b67438f23537f00a05264aa9c497e4c4a3425e145b6d2b7da302aa0d5461ccda7fab2217779f45f1', 'id': '7d692865-546c-4efb-b5b0-835056092f6f', 'created_at': datetime.datetime(2026, 7, 31, 10, 37, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 31, 10, 37, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7d692865-546c-4efb-b5b0-835056092f6f/file', 'properties': {}}, 'image_service': }' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:37:35 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-159d14ac-c120-4bef-95e0-23d2e9908d18 tempest-VolumeImageDependencyTests-1366750687 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db5944f8-5df6-4d37-95ca-e330e7a66715) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:37:35 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-159d14ac-c120-4bef-95e0-23d2e9908d18 tempest-VolumeImageDependencyTests-1366750687 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db5944f8-5df6-4d37-95ca-e330e7a66715) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:37:35 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-159d14ac-c120-4bef-95e0-23d2e9908d18 tempest-VolumeImageDependencyTests-1366750687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12d455ea-0d19-4766-9d47-aafbf7a64600) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:37:35 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-159d14ac-c120-4bef-95e0-23d2e9908d18 tempest-VolumeImageDependencyTests-1366750687 None] Volume ec85cdb1-7689-440b-afbd-5dd65139a0af: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-ec85cdb1-7689-440b-afbd-5dd65139a0af', 'volume_size': 1, 'image_id': '7d692865-546c-4efb-b5b0-835056092f6f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7d692865-546c-4efb-b5b0-835056092f6f', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '0f944d0462506ab32b5f1bb8608d0b2f', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '2d0755f1e2ea4124a760580edccedbe3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '375bd2ec5f64e1d48e350ea788020a2ce0c28289ca4da531b67438f23537f00a05264aa9c497e4c4a3425e145b6d2b7da302aa0d5461ccda7fab2217779f45f1', 'id': '7d692865-546c-4efb-b5b0-835056092f6f', 'created_at': datetime.datetime(2026, 7, 31, 10, 37, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 31, 10, 37, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7d692865-546c-4efb-b5b0-835056092f6f/file', 'properties': {}}, 'image_service': } Jul 31 12:37:35 devstack cinder-volume[89182]: DEBUG cinder.volume.flows.manager.create_volume [None req-159d14ac-c120-4bef-95e0-23d2e9908d18 tempest-VolumeImageDependencyTests-1366750687 None] Trying to clone ec85cdb1-7689-440b-afbd-5dd65139a0af from image 7d692865-546c-4efb-b5b0-835056092f6f at location (None, [{'url': 'file:///opt/stack/data/glance/images/7d692865-546c-4efb-b5b0-835056092f6f', 'metadata': {}}]). {{(pid=89182) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 31 12:37:35 devstack cinder-volume[89182]: DEBUG cinder.image.image_utils [None req-159d14ac-c120-4bef-95e0-23d2e9908d18 tempest-VolumeImageDependencyTests-1366750687 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_7d692865-546c-4efb-b5b0-835056092f6f_fn1hxwy9devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=89182) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 31 12:37:35 devstack cinder-volume[89182]: INFO cinder.image.image_utils [None req-159d14ac-c120-4bef-95e0-23d2e9908d18 tempest-VolumeImageDependencyTests-1366750687 None] Image download 0.00 MB at 0.00 MB/s Jul 31 12:37:35 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9818a23-c15e-4f7b-90c9-ca239a0cf892]: (4, 'raw') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:37:35 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-159d14ac-c120-4bef-95e0-23d2e9908d18 tempest-VolumeImageDependencyTests-1366750687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7d692865-546c-4efb-b5b0-835056092f6f_fn1hxwy9devstack@QuobyteHD {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:37:35 devstack sudo[112632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7d692865-546c-4efb-b5b0-835056092f6f_fn1hxwy9devstack@QuobyteHD Jul 31 12:37:35 devstack sudo[112632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:37:35 devstack sudo[112632]: pam_unix(sudo:session): session closed for user root Jul 31 12:37:35 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-159d14ac-c120-4bef-95e0-23d2e9908d18 tempest-VolumeImageDependencyTests-1366750687 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7d692865-546c-4efb-b5b0-835056092f6f_fn1hxwy9devstack@QuobyteHD" returned: 0 in 0.371s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:37:35 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-159d14ac-c120-4bef-95e0-23d2e9908d18 tempest-VolumeImageDependencyTests-1366750687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7d692865-546c-4efb-b5b0-835056092f6f_fn1hxwy9devstack@QuobyteHD {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:37:35 devstack sudo[112636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7d692865-546c-4efb-b5b0-835056092f6f_fn1hxwy9devstack@QuobyteHD Jul 31 12:37:35 devstack sudo[112636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:37:35 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-d84e8732-3e05-49e9-95f7-5c5de2871231 tempest-VolumeDependencyTests-442009576 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:37:35 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-d84e8732-3e05-49e9-95f7-5c5de2871231 tempest-VolumeDependencyTests-442009576 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:37:36 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-d84e8732-3e05-49e9-95f7-5c5de2871231 tempest-VolumeDependencyTests-442009576 None] Creating offline snapshot d9823284-8e6b-48fc-bbbb-dfd45bc614d5 of volume 4ce7c091-c8b0-432c-a840-fa5ce161abbf {{(pid=89182) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 31 12:37:36 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8e3d416-2b34-410f-aeea-e0615f1b1b63]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:37:36 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-d84e8732-3e05-49e9-95f7-5c5de2871231 tempest-VolumeDependencyTests-442009576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-4ce7c091-c8b0-432c-a840-fa5ce161abbf {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:37:36 devstack sudo[112636]: pam_unix(sudo:session): session closed for user root Jul 31 12:37:36 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-159d14ac-c120-4bef-95e0-23d2e9908d18 tempest-VolumeImageDependencyTests-1366750687 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7d692865-546c-4efb-b5b0-835056092f6f_fn1hxwy9devstack@QuobyteHD" returned: 1 in 0.401s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:37:36 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-159d14ac-c120-4bef-95e0-23d2e9908d18 tempest-VolumeImageDependencyTests-1366750687 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7d692865-546c-4efb-b5b0-835056092f6f_fn1hxwy9devstack@QuobyteHD' failed. Not Retrying. {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 31 12:37:36 devstack cinder-volume[89182]: DEBUG cinder.image.image_utils [None req-159d14ac-c120-4bef-95e0-23d2e9908d18 tempest-VolumeImageDependencyTests-1366750687 None] Temporary image 7d692865-546c-4efb-b5b0-835056092f6f is fetched for user b44e6e9d7b9542c6aea2ca270c251a89. {{(pid=89182) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 31 12:37:36 devstack sudo[112638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-4ce7c091-c8b0-432c-a840-fa5ce161abbf Jul 31 12:37:36 devstack sudo[112638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:37:36 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e0cc1dd-a38b-4dce-9ff1-0c4744393549]: (4, 'raw') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:37:36 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-159d14ac-c120-4bef-95e0-23d2e9908d18 tempest-VolumeImageDependencyTests-1366750687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7d692865-546c-4efb-b5b0-835056092f6f_fn1hxwy9devstack@QuobyteHD {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:37:36 devstack sudo[112643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7d692865-546c-4efb-b5b0-835056092f6f_fn1hxwy9devstack@QuobyteHD Jul 31 12:37:36 devstack sudo[112643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:37:36 devstack sudo[112638]: pam_unix(sudo:session): session closed for user root Jul 31 12:37:36 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-d84e8732-3e05-49e9-95f7-5c5de2871231 tempest-VolumeDependencyTests-442009576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-4ce7c091-c8b0-432c-a840-fa5ce161abbf" returned: 0 in 0.527s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:37:36 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-d84e8732-3e05-49e9-95f7-5c5de2871231 tempest-VolumeDependencyTests-442009576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-4ce7c091-c8b0-432c-a840-fa5ce161abbf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-4ce7c091-c8b0-432c-a840-fa5ce161abbf.d9823284-8e6b-48fc-bbbb-dfd45bc614d5 1G {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:37:36 devstack sudo[112648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-4ce7c091-c8b0-432c-a840-fa5ce161abbf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-4ce7c091-c8b0-432c-a840-fa5ce161abbf.d9823284-8e6b-48fc-bbbb-dfd45bc614d5 1G Jul 31 12:37:36 devstack sudo[112648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:37:36 devstack sudo[112643]: pam_unix(sudo:session): session closed for user root Jul 31 12:37:36 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-159d14ac-c120-4bef-95e0-23d2e9908d18 tempest-VolumeImageDependencyTests-1366750687 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7d692865-546c-4efb-b5b0-835056092f6f_fn1hxwy9devstack@QuobyteHD" returned: 0 in 0.389s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:37:36 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-159d14ac-c120-4bef-95e0-23d2e9908d18 tempest-VolumeImageDependencyTests-1366750687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7d692865-546c-4efb-b5b0-835056092f6f_fn1hxwy9devstack@QuobyteHD {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:37:36 devstack cinder-volume[89182]: DEBUG cinder.volume.flows.manager.create_volume [None req-22ea9941-b65b-43f1-8cc1-ff59f135df35 tempest-CinderUnicodeTest-1855596390 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89182) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 12:37:36 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-22ea9941-b65b-43f1-8cc1-ff59f135df35 tempest-CinderUnicodeTest-1855596390 None] Flow 'volume_create_manager' (22d7af62-d1cd-4ab1-8f37-601f85db436d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:37:36 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-22ea9941-b65b-43f1-8cc1-ff59f135df35 tempest-CinderUnicodeTest-1855596390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ff2986c-8d78-4cf9-887a-ccaf5c4d79d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:37:36 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-22ea9941-b65b-43f1-8cc1-ff59f135df35 tempest-CinderUnicodeTest-1855596390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ff2986c-8d78-4cf9-887a-ccaf5c4d79d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:37:36Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f00ccd36-d9cf-4015-82ed-6352d569b09a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e804ed9b1a70469085ddbdb350696a23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:37:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:37:37Z,use_quota=True,user_id='8608c82041ff45229afe6164278597dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:37:36 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-22ea9941-b65b-43f1-8cc1-ff59f135df35 tempest-CinderUnicodeTest-1855596390 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c27629d-fbb9-43cf-b373-62d4d5a30579) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:37:36 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-22ea9941-b65b-43f1-8cc1-ff59f135df35 tempest-CinderUnicodeTest-1855596390 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c27629d-fbb9-43cf-b373-62d4d5a30579) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:37:36 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-22ea9941-b65b-43f1-8cc1-ff59f135df35 tempest-CinderUnicodeTest-1855596390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75826847-60b4-4fe2-8393-3aa44fc961f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:37:36 devstack sudo[112652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7d692865-546c-4efb-b5b0-835056092f6f_fn1hxwy9devstack@QuobyteHD Jul 31 12:37:36 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-22ea9941-b65b-43f1-8cc1-ff59f135df35 tempest-CinderUnicodeTest-1855596390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75826847-60b4-4fe2-8393-3aa44fc961f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f00ccd36-d9cf-4015-82ed-6352d569b09a', 'volume_name': 'volume-f00ccd36-d9cf-4015-82ed-6352d569b09a', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:37:36 devstack sudo[112652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:37:36 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-22ea9941-b65b-43f1-8cc1-ff59f135df35 tempest-CinderUnicodeTest-1855596390 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48f10071-74d1-48f8-bfdd-2bc6d34f2e98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:37:36 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-22ea9941-b65b-43f1-8cc1-ff59f135df35 tempest-CinderUnicodeTest-1855596390 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48f10071-74d1-48f8-bfdd-2bc6d34f2e98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:37:36 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-22ea9941-b65b-43f1-8cc1-ff59f135df35 tempest-CinderUnicodeTest-1855596390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f2f35b1-c60d-48f7-8be2-643021e2534a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:37:36 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-22ea9941-b65b-43f1-8cc1-ff59f135df35 tempest-CinderUnicodeTest-1855596390 None] Volume f00ccd36-d9cf-4015-82ed-6352d569b09a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f00ccd36-d9cf-4015-82ed-6352d569b09a', 'volume_size': 1} Jul 31 12:37:36 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-22ea9941-b65b-43f1-8cc1-ff59f135df35 tempest-CinderUnicodeTest-1855596390 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:37:37 devstack sudo[112652]: pam_unix(sudo:session): session closed for user root Jul 31 12:37:37 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-159d14ac-c120-4bef-95e0-23d2e9908d18 tempest-VolumeImageDependencyTests-1366750687 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7d692865-546c-4efb-b5b0-835056092f6f_fn1hxwy9devstack@QuobyteHD" returned: 1 in 0.462s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:37:37 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-159d14ac-c120-4bef-95e0-23d2e9908d18 tempest-VolumeImageDependencyTests-1366750687 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7d692865-546c-4efb-b5b0-835056092f6f_fn1hxwy9devstack@QuobyteHD' failed. Not Retrying. {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 31 12:37:37 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-159d14ac-c120-4bef-95e0-23d2e9908d18 tempest-VolumeImageDependencyTests-1366750687 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:37:37 devstack sudo[112648]: pam_unix(sudo:session): session closed for user root Jul 31 12:37:37 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-d84e8732-3e05-49e9-95f7-5c5de2871231 tempest-VolumeDependencyTests-442009576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-4ce7c091-c8b0-432c-a840-fa5ce161abbf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-4ce7c091-c8b0-432c-a840-fa5ce161abbf.d9823284-8e6b-48fc-bbbb-dfd45bc614d5 1G" returned: 0 in 0.559s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:37:37 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-d84e8732-3e05-49e9-95f7-5c5de2871231 tempest-VolumeDependencyTests-442009576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4ce7c091-c8b0-432c-a840-fa5ce161abbf -F qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-4ce7c091-c8b0-432c-a840-fa5ce161abbf.d9823284-8e6b-48fc-bbbb-dfd45bc614d5 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:37:37 devstack sudo[112661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4ce7c091-c8b0-432c-a840-fa5ce161abbf -F qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-4ce7c091-c8b0-432c-a840-fa5ce161abbf.d9823284-8e6b-48fc-bbbb-dfd45bc614d5 Jul 31 12:37:37 devstack sudo[112661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:37:37 devstack sudo[112661]: pam_unix(sudo:session): session closed for user root Jul 31 12:37:37 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-d84e8732-3e05-49e9-95f7-5c5de2871231 tempest-VolumeDependencyTests-442009576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4ce7c091-c8b0-432c-a840-fa5ce161abbf -F qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-4ce7c091-c8b0-432c-a840-fa5ce161abbf.d9823284-8e6b-48fc-bbbb-dfd45bc614d5" returned: 0 in 0.291s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:37:37 devstack cinder-volume[89182]: WARNING cinder.volume.drivers.remotefs [None req-d84e8732-3e05-49e9-95f7-5c5de2871231 tempest-VolumeDependencyTests-442009576 None] /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-4ce7c091-c8b0-432c-a840-fa5ce161abbf.d9823284-8e6b-48fc-bbbb-dfd45bc614d5 is being set with open permissions: ugo+rw Jul 31 12:37:37 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-d84e8732-3e05-49e9-95f7-5c5de2871231 tempest-VolumeDependencyTests-442009576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-4ce7c091-c8b0-432c-a840-fa5ce161abbf.d9823284-8e6b-48fc-bbbb-dfd45bc614d5 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:37:37 devstack sudo[112666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-4ce7c091-c8b0-432c-a840-fa5ce161abbf.d9823284-8e6b-48fc-bbbb-dfd45bc614d5 Jul 31 12:37:37 devstack sudo[112666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:37:37 devstack sudo[112666]: pam_unix(sudo:session): session closed for user root Jul 31 12:37:37 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-d84e8732-3e05-49e9-95f7-5c5de2871231 tempest-VolumeDependencyTests-442009576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-4ce7c091-c8b0-432c-a840-fa5ce161abbf.d9823284-8e6b-48fc-bbbb-dfd45bc614d5" returned: 0 in 0.266s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:37:37 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-d84e8732-3e05-49e9-95f7-5c5de2871231 tempest-VolumeDependencyTests-442009576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-4ce7c091-c8b0-432c-a840-fa5ce161abbf.info {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:37:37 devstack sudo[112669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-4ce7c091-c8b0-432c-a840-fa5ce161abbf.info Jul 31 12:37:37 devstack sudo[112669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:37:38 devstack sudo[112669]: pam_unix(sudo:session): session closed for user root Jul 31 12:37:38 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-d84e8732-3e05-49e9-95f7-5c5de2871231 tempest-VolumeDependencyTests-442009576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-4ce7c091-c8b0-432c-a840-fa5ce161abbf.info" returned: 0 in 0.269s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:37:38 devstack cinder-volume[89182]: WARNING cinder.volume.drivers.remotefs [None req-d84e8732-3e05-49e9-95f7-5c5de2871231 tempest-VolumeDependencyTests-442009576 None] /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-4ce7c091-c8b0-432c-a840-fa5ce161abbf.info is being set with open permissions: ugo+rw Jul 31 12:37:38 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-d84e8732-3e05-49e9-95f7-5c5de2871231 tempest-VolumeDependencyTests-442009576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-4ce7c091-c8b0-432c-a840-fa5ce161abbf.info {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:37:38 devstack sudo[112672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-4ce7c091-c8b0-432c-a840-fa5ce161abbf.info Jul 31 12:37:38 devstack sudo[112672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:37:38 devstack sudo[112672]: pam_unix(sudo:session): session closed for user root Jul 31 12:37:38 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-d84e8732-3e05-49e9-95f7-5c5de2871231 tempest-VolumeDependencyTests-442009576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-4ce7c091-c8b0-432c-a840-fa5ce161abbf.info" returned: 0 in 0.260s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:37:38 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-d84e8732-3e05-49e9-95f7-5c5de2871231 tempest-VolumeDependencyTests-442009576 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.356s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:37:38 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-22ea9941-b65b-43f1-8cc1-ff59f135df35 tempest-CinderUnicodeTest-1855596390 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.443s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:37:38 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-22ea9941-b65b-43f1-8cc1-ff59f135df35 tempest-CinderUnicodeTest-1855596390 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:37:36Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f00ccd36-d9cf-4015-82ed-6352d569b09a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e804ed9b1a70469085ddbdb350696a23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:37:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:37:37Z,use_quota=True,user_id='8608c82041ff45229afe6164278597dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)}" {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 12:37:38 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-22ea9941-b65b-43f1-8cc1-ff59f135df35 tempest-CinderUnicodeTest-1855596390 None] Creating volume f00ccd36-d9cf-4015-82ed-6352d569b09a {{(pid=89182) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 12:37:38 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-22ea9941-b65b-43f1-8cc1-ff59f135df35 tempest-CinderUnicodeTest-1855596390 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:37:38 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-22ea9941-b65b-43f1-8cc1-ff59f135df35 tempest-CinderUnicodeTest-1855596390 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:37:38 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-22ea9941-b65b-43f1-8cc1-ff59f135df35 tempest-CinderUnicodeTest-1855596390 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:37:38 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-22ea9941-b65b-43f1-8cc1-ff59f135df35 tempest-CinderUnicodeTest-1855596390 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:37:38 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-22ea9941-b65b-43f1-8cc1-ff59f135df35 tempest-CinderUnicodeTest-1855596390 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:37:38 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-22ea9941-b65b-43f1-8cc1-ff59f135df35 tempest-CinderUnicodeTest-1855596390 None] Selected osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 as target Quobyte volume. {{(pid=89182) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 12:37:38 devstack cinder-volume[89182]: INFO cinder.volume.drivers.remotefs [None req-22ea9941-b65b-43f1-8cc1-ff59f135df35 tempest-CinderUnicodeTest-1855596390 None] casted to osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 Jul 31 12:37:38 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-22ea9941-b65b-43f1-8cc1-ff59f135df35 tempest-CinderUnicodeTest-1855596390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-f00ccd36-d9cf-4015-82ed-6352d569b09a 1073741824 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:37:38 devstack sudo[112675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-f00ccd36-d9cf-4015-82ed-6352d569b09a 1073741824 Jul 31 12:37:38 devstack sudo[112675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:37:38 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-d84e8732-3e05-49e9-95f7-5c5de2871231 tempest-VolumeDependencyTests-442009576 None] Create snapshot completed successfully Jul 31 12:37:38 devstack sudo[112675]: pam_unix(sudo:session): session closed for user root Jul 31 12:37:38 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-22ea9941-b65b-43f1-8cc1-ff59f135df35 tempest-CinderUnicodeTest-1855596390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-f00ccd36-d9cf-4015-82ed-6352d569b09a 1073741824" returned: 0 in 0.482s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:37:38 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-22ea9941-b65b-43f1-8cc1-ff59f135df35 tempest-CinderUnicodeTest-1855596390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-f00ccd36-d9cf-4015-82ed-6352d569b09a {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:37:38 devstack sudo[112683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-f00ccd36-d9cf-4015-82ed-6352d569b09a Jul 31 12:37:38 devstack sudo[112683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:37:39 devstack sudo[112683]: pam_unix(sudo:session): session closed for user root Jul 31 12:37:39 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-22ea9941-b65b-43f1-8cc1-ff59f135df35 tempest-CinderUnicodeTest-1855596390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-f00ccd36-d9cf-4015-82ed-6352d569b09a" returned: 0 in 0.280s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:37:39 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-22ea9941-b65b-43f1-8cc1-ff59f135df35 tempest-CinderUnicodeTest-1855596390 None] <== create_volume: return (806ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'} {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 12:37:39 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-22ea9941-b65b-43f1-8cc1-ff59f135df35 tempest-CinderUnicodeTest-1855596390 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.810s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:37:39 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-159d14ac-c120-4bef-95e0-23d2e9908d18 tempest-VolumeImageDependencyTests-1366750687 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.000s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:37:39 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-159d14ac-c120-4bef-95e0-23d2e9908d18 tempest-VolumeImageDependencyTests-1366750687 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:37:34Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec85cdb1-7689-440b-afbd-5dd65139a0af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d0755f1e2ea4124a760580edccedbe3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:37:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:37:35Z,use_quota=True,user_id='b44e6e9d7b9542c6aea2ca270c251a89',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)}" {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 12:37:39 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-159d14ac-c120-4bef-95e0-23d2e9908d18 tempest-VolumeImageDependencyTests-1366750687 None] Creating volume ec85cdb1-7689-440b-afbd-5dd65139a0af {{(pid=89182) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 12:37:39 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-159d14ac-c120-4bef-95e0-23d2e9908d18 tempest-VolumeImageDependencyTests-1366750687 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:37:39 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-159d14ac-c120-4bef-95e0-23d2e9908d18 tempest-VolumeImageDependencyTests-1366750687 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:37:39 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-159d14ac-c120-4bef-95e0-23d2e9908d18 tempest-VolumeImageDependencyTests-1366750687 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:37:39 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-159d14ac-c120-4bef-95e0-23d2e9908d18 tempest-VolumeImageDependencyTests-1366750687 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:37:39 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-159d14ac-c120-4bef-95e0-23d2e9908d18 tempest-VolumeImageDependencyTests-1366750687 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:37:39 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-159d14ac-c120-4bef-95e0-23d2e9908d18 tempest-VolumeImageDependencyTests-1366750687 None] Selected osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 as target Quobyte volume. {{(pid=89182) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 12:37:39 devstack cinder-volume[89182]: INFO cinder.volume.drivers.remotefs [None req-159d14ac-c120-4bef-95e0-23d2e9908d18 tempest-VolumeImageDependencyTests-1366750687 None] casted to osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 Jul 31 12:37:39 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-159d14ac-c120-4bef-95e0-23d2e9908d18 tempest-VolumeImageDependencyTests-1366750687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-ec85cdb1-7689-440b-afbd-5dd65139a0af 1073741824 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:37:39 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-22ea9941-b65b-43f1-8cc1-ff59f135df35 tempest-CinderUnicodeTest-1855596390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f2f35b1-c60d-48f7-8be2-643021e2534a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f00ccd36-d9cf-4015-82ed-6352d569b09a', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:37:39 devstack sudo[112686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-ec85cdb1-7689-440b-afbd-5dd65139a0af 1073741824 Jul 31 12:37:39 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-22ea9941-b65b-43f1-8cc1-ff59f135df35 tempest-CinderUnicodeTest-1855596390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81fc159a-a092-47cd-957d-d6763deb5810) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:37:39 devstack sudo[112686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:37:39 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-22ea9941-b65b-43f1-8cc1-ff59f135df35 tempest-CinderUnicodeTest-1855596390 None] Volume volume-f00ccd36-d9cf-4015-82ed-6352d569b09a (f00ccd36-d9cf-4015-82ed-6352d569b09a): created successfully Jul 31 12:37:39 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-22ea9941-b65b-43f1-8cc1-ff59f135df35 tempest-CinderUnicodeTest-1855596390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81fc159a-a092-47cd-957d-d6763deb5810) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:37:39 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-22ea9941-b65b-43f1-8cc1-ff59f135df35 tempest-CinderUnicodeTest-1855596390 None] Flow 'volume_create_manager' (22d7af62-d1cd-4ab1-8f37-601f85db436d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:37:39 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-22ea9941-b65b-43f1-8cc1-ff59f135df35 tempest-CinderUnicodeTest-1855596390 None] Created volume successfully. Jul 31 12:37:39 devstack sudo[112686]: pam_unix(sudo:session): session closed for user root Jul 31 12:37:39 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-159d14ac-c120-4bef-95e0-23d2e9908d18 tempest-VolumeImageDependencyTests-1366750687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-ec85cdb1-7689-440b-afbd-5dd65139a0af 1073741824" returned: 0 in 0.567s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:37:39 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-159d14ac-c120-4bef-95e0-23d2e9908d18 tempest-VolumeImageDependencyTests-1366750687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-ec85cdb1-7689-440b-afbd-5dd65139a0af {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:37:39 devstack sudo[112692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-ec85cdb1-7689-440b-afbd-5dd65139a0af Jul 31 12:37:39 devstack sudo[112692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:37:39 devstack cinder-volume[89182]: DEBUG cinder.volume.flows.manager.create_volume [None req-ba5bd8fb-f727-452d-a548-7a8b87fda096 tempest-VolumeDependencyTests-442009576 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89182) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 12:37:39 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-ba5bd8fb-f727-452d-a548-7a8b87fda096 tempest-VolumeDependencyTests-442009576 None] Flow 'volume_create_manager' (607181ca-1d96-4d22-8e04-8d1dcaccd121) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:37:40 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-ba5bd8fb-f727-452d-a548-7a8b87fda096 tempest-VolumeDependencyTests-442009576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1afa880-e998-40f1-b7a6-df66bf62874d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:37:40 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-ba5bd8fb-f727-452d-a548-7a8b87fda096 tempest-VolumeDependencyTests-442009576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1afa880-e998-40f1-b7a6-df66bf62874d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:37:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1840099782',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62e947b3-0c3c-48ec-8f5f-d92cd882e684,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c622d586c4c9404ead8c06d764810df1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:37:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=d9823284-8e6b-48fc-bbbb-dfd45bc614d5,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:37:40Z,use_quota=True,user_id='cfc528fe8ec2487bb4171d283c222b1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:37:40 devstack sudo[112692]: pam_unix(sudo:session): session closed for user root Jul 31 12:37:40 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-ba5bd8fb-f727-452d-a548-7a8b87fda096 tempest-VolumeDependencyTests-442009576 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7575d0f2-4c9b-4068-9777-acabc52195cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:37:40 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-ba5bd8fb-f727-452d-a548-7a8b87fda096 tempest-VolumeDependencyTests-442009576 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7575d0f2-4c9b-4068-9777-acabc52195cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:37:40 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-ba5bd8fb-f727-452d-a548-7a8b87fda096 tempest-VolumeDependencyTests-442009576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c43ec22-7043-4d6a-8ec3-2cdc1b06957e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:37:40 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-ba5bd8fb-f727-452d-a548-7a8b87fda096 tempest-VolumeDependencyTests-442009576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c43ec22-7043-4d6a-8ec3-2cdc1b06957e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '62e947b3-0c3c-48ec-8f5f-d92cd882e684', 'volume_name': 'volume-62e947b3-0c3c-48ec-8f5f-d92cd882e684', 'volume_size': 1, 'snapshot_id': 'd9823284-8e6b-48fc-bbbb-dfd45bc614d5'}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:37:40 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-ba5bd8fb-f727-452d-a548-7a8b87fda096 tempest-VolumeDependencyTests-442009576 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb8c7294-d8d4-4991-bc82-89ec773e87b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:37:40 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-ba5bd8fb-f727-452d-a548-7a8b87fda096 tempest-VolumeDependencyTests-442009576 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb8c7294-d8d4-4991-bc82-89ec773e87b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:37:40 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-ba5bd8fb-f727-452d-a548-7a8b87fda096 tempest-VolumeDependencyTests-442009576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3106bd1d-4744-4fc6-b574-f77532d98f36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:37:40 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-ba5bd8fb-f727-452d-a548-7a8b87fda096 tempest-VolumeDependencyTests-442009576 None] Volume 62e947b3-0c3c-48ec-8f5f-d92cd882e684: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-62e947b3-0c3c-48ec-8f5f-d92cd882e684', 'volume_size': 1, 'snapshot_id': 'd9823284-8e6b-48fc-bbbb-dfd45bc614d5'} Jul 31 12:37:40 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-159d14ac-c120-4bef-95e0-23d2e9908d18 tempest-VolumeImageDependencyTests-1366750687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-ec85cdb1-7689-440b-afbd-5dd65139a0af" returned: 0 in 0.361s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:37:40 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-159d14ac-c120-4bef-95e0-23d2e9908d18 tempest-VolumeImageDependencyTests-1366750687 None] <== create_volume: return (980ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'} {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 12:37:40 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-159d14ac-c120-4bef-95e0-23d2e9908d18 tempest-VolumeImageDependencyTests-1366750687 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.983s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:37:40 devstack cinder-volume[89182]: DEBUG cinder.volume.flows.manager.create_volume [None req-cee554a5-88e7-430c-b3d2-64a025a2ea99 tempest-SnapshotDataIntegrityTests-898447071 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89182) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 12:37:40 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-cee554a5-88e7-430c-b3d2-64a025a2ea99 tempest-SnapshotDataIntegrityTests-898447071 None] Flow 'volume_create_manager' (37931973-a286-40a8-b295-9adb21ba2d53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:37:40 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-cee554a5-88e7-430c-b3d2-64a025a2ea99 tempest-SnapshotDataIntegrityTests-898447071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4834ff0-4c23-47ee-a856-af954c585dde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:37:40 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-ba5bd8fb-f727-452d-a548-7a8b87fda096 tempest-VolumeDependencyTests-442009576 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:37:40 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-ba5bd8fb-f727-452d-a548-7a8b87fda096 tempest-VolumeDependencyTests-442009576 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:37:40 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-ba5bd8fb-f727-452d-a548-7a8b87fda096 tempest-VolumeDependencyTests-442009576 None] Acquiring lock "cinder-quobyte-d9823284-8e6b-48fc-bbbb-dfd45bc614d5-62e947b3-0c3c-48ec-8f5f-d92cd882e684" by "_create_volume_from_snapshot" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:37:40 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-cee554a5-88e7-430c-b3d2-64a025a2ea99 tempest-SnapshotDataIntegrityTests-898447071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4834ff0-4c23-47ee-a856-af954c585dde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:37:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDataIntegrityTests-volume-2128903635',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6acfb11-941d-450b-8d93-0e32240df94a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e47adc7d32b64078850d9d94d5cb10bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:37:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:37:40Z,use_quota=True,user_id='6344cc57ebdb4e02aae72e7a719cd916',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:37:40 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-cee554a5-88e7-430c-b3d2-64a025a2ea99 tempest-SnapshotDataIntegrityTests-898447071 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (183cb227-f449-4e5f-9fe4-754791469cfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:37:40 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-cee554a5-88e7-430c-b3d2-64a025a2ea99 tempest-SnapshotDataIntegrityTests-898447071 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (183cb227-f449-4e5f-9fe4-754791469cfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:37:40 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-cee554a5-88e7-430c-b3d2-64a025a2ea99 tempest-SnapshotDataIntegrityTests-898447071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7c3e7a2-96b9-4851-8957-4a781dc40b35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:37:40 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-cee554a5-88e7-430c-b3d2-64a025a2ea99 tempest-SnapshotDataIntegrityTests-898447071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7c3e7a2-96b9-4851-8957-4a781dc40b35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e6acfb11-941d-450b-8d93-0e32240df94a', 'volume_name': 'volume-e6acfb11-941d-450b-8d93-0e32240df94a', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:37:40 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-cee554a5-88e7-430c-b3d2-64a025a2ea99 tempest-SnapshotDataIntegrityTests-898447071 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e634acaa-8e8b-4cd9-8de4-c33aa847ca84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:37:40 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-cee554a5-88e7-430c-b3d2-64a025a2ea99 tempest-SnapshotDataIntegrityTests-898447071 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e634acaa-8e8b-4cd9-8de4-c33aa847ca84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:37:40 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-cee554a5-88e7-430c-b3d2-64a025a2ea99 tempest-SnapshotDataIntegrityTests-898447071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (186faeae-864a-4bc1-a841-40a2585a6540) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:37:40 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-cee554a5-88e7-430c-b3d2-64a025a2ea99 tempest-SnapshotDataIntegrityTests-898447071 None] Volume e6acfb11-941d-450b-8d93-0e32240df94a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e6acfb11-941d-450b-8d93-0e32240df94a', 'volume_size': 1} Jul 31 12:37:40 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-cee554a5-88e7-430c-b3d2-64a025a2ea99 tempest-SnapshotDataIntegrityTests-898447071 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:37:40 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-ba5bd8fb-f727-452d-a548-7a8b87fda096 tempest-VolumeDependencyTests-442009576 None] Lock "cinder-quobyte-d9823284-8e6b-48fc-bbbb-dfd45bc614d5-62e947b3-0c3c-48ec-8f5f-d92cd882e684" acquired by "_create_volume_from_snapshot" :: waited 0.065s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:37:40 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-ba5bd8fb-f727-452d-a548-7a8b87fda096 tempest-VolumeDependencyTests-442009576 None] Creating volume 62e947b3-0c3c-48ec-8f5f-d92cd882e684 from snapshot d9823284-8e6b-48fc-bbbb-dfd45bc614d5 {{(pid=89182) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 31 12:37:40 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-ba5bd8fb-f727-452d-a548-7a8b87fda096 tempest-VolumeDependencyTests-442009576 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:37:40 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-ba5bd8fb-f727-452d-a548-7a8b87fda096 tempest-VolumeDependencyTests-442009576 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:37:40 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-ba5bd8fb-f727-452d-a548-7a8b87fda096 tempest-VolumeDependencyTests-442009576 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:37:40 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-ba5bd8fb-f727-452d-a548-7a8b87fda096 tempest-VolumeDependencyTests-442009576 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:37:40 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-ba5bd8fb-f727-452d-a548-7a8b87fda096 tempest-VolumeDependencyTests-442009576 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:37:40 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-ba5bd8fb-f727-452d-a548-7a8b87fda096 tempest-VolumeDependencyTests-442009576 None] Selected osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 as target Quobyte volume. {{(pid=89182) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 12:37:40 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-ba5bd8fb-f727-452d-a548-7a8b87fda096 tempest-VolumeDependencyTests-442009576 None] Acquiring lock "cinder-quobyte-62e947b3-0c3c-48ec-8f5f-d92cd882e684" by "_copy_volume_from_snapshot" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:37:40 devstack cinder-volume[89182]: DEBUG cinder.volume.volume_utils [None req-159d14ac-c120-4bef-95e0-23d2e9908d18 tempest-VolumeImageDependencyTests-1366750687 None] Attempting download of 7d692865-546c-4efb-b5b0-835056092f6f ((None, [{'url': 'file:///opt/stack/data/glance/images/7d692865-546c-4efb-b5b0-835056092f6f', 'metadata': {}}])) to volume ec85cdb1-7689-440b-afbd-5dd65139a0af. {{(pid=89182) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 31 12:37:40 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-ba5bd8fb-f727-452d-a548-7a8b87fda096 tempest-VolumeDependencyTests-442009576 None] Lock "cinder-quobyte-62e947b3-0c3c-48ec-8f5f-d92cd882e684" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:37:40 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-ba5bd8fb-f727-452d-a548-7a8b87fda096 tempest-VolumeDependencyTests-442009576 None] snapshot: d9823284-8e6b-48fc-bbbb-dfd45bc614d5, volume: 62e947b3-0c3c-48ec-8f5f-d92cd882e684, {{(pid=89182) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Jul 31 12:37:40 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-ba5bd8fb-f727-452d-a548-7a8b87fda096 tempest-VolumeDependencyTests-442009576 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:37:40 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-ba5bd8fb-f727-452d-a548-7a8b87fda096 tempest-VolumeDependencyTests-442009576 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:37:40 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-ba5bd8fb-f727-452d-a548-7a8b87fda096 tempest-VolumeDependencyTests-442009576 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:37:40 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-ba5bd8fb-f727-452d-a548-7a8b87fda096 tempest-VolumeDependencyTests-442009576 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:37:40 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-ba5bd8fb-f727-452d-a548-7a8b87fda096 tempest-VolumeDependencyTests-442009576 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:37:40 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[e459ea83-aeea-4236-aafc-0619a36f30ed]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:37:40 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-ba5bd8fb-f727-452d-a548-7a8b87fda096 tempest-VolumeDependencyTests-442009576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-4ce7c091-c8b0-432c-a840-fa5ce161abbf.d9823284-8e6b-48fc-bbbb-dfd45bc614d5 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:37:40 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[73a014d7-c454-4cee-bac1-c98ff42344cf]: (4, 'raw') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:37:40 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-159d14ac-c120-4bef-95e0-23d2e9908d18 tempest-VolumeImageDependencyTests-1366750687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7d692865-546c-4efb-b5b0-835056092f6f_zvwqz3ld {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:37:40 devstack sudo[112695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-4ce7c091-c8b0-432c-a840-fa5ce161abbf.d9823284-8e6b-48fc-bbbb-dfd45bc614d5 Jul 31 12:37:40 devstack sudo[112695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:37:40 devstack sudo[112696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7d692865-546c-4efb-b5b0-835056092f6f_zvwqz3ld Jul 31 12:37:40 devstack sudo[112696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:37:40 devstack cinder-volume[89182]: DEBUG cinder.volume.flows.manager.create_volume [None req-a08d0492-5326-4611-a790-62cb71b36dbe tempest-CinderUnicodeTest-1855596390 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89182) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 12:37:40 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-a08d0492-5326-4611-a790-62cb71b36dbe tempest-CinderUnicodeTest-1855596390 None] Flow 'volume_create_manager' (7cd22397-a562-4cde-a8c7-4fb118cf32b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:37:40 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-a08d0492-5326-4611-a790-62cb71b36dbe tempest-CinderUnicodeTest-1855596390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a1328d7-66c6-4158-80cf-5836c00db3aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:37:40 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-a08d0492-5326-4611-a790-62cb71b36dbe tempest-CinderUnicodeTest-1855596390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a1328d7-66c6-4158-80cf-5836c00db3aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:37:40Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1483328752',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e9fccdc-d42f-41c2-b0cb-37818fa463c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e804ed9b1a70469085ddbdb350696a23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:37:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:37:40Z,use_quota=True,user_id='8608c82041ff45229afe6164278597dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:37:40 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-a08d0492-5326-4611-a790-62cb71b36dbe tempest-CinderUnicodeTest-1855596390 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e13a9d45-ae09-4e48-b289-92bcf0b9d99c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:37:40 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-a08d0492-5326-4611-a790-62cb71b36dbe tempest-CinderUnicodeTest-1855596390 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e13a9d45-ae09-4e48-b289-92bcf0b9d99c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:37:40 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-a08d0492-5326-4611-a790-62cb71b36dbe tempest-CinderUnicodeTest-1855596390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eaa5dc3e-dcda-4f2a-b3e2-69429d369dd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:37:40 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-a08d0492-5326-4611-a790-62cb71b36dbe tempest-CinderUnicodeTest-1855596390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eaa5dc3e-dcda-4f2a-b3e2-69429d369dd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5e9fccdc-d42f-41c2-b0cb-37818fa463c2', 'volume_name': 'volume-5e9fccdc-d42f-41c2-b0cb-37818fa463c2', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:37:40 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-a08d0492-5326-4611-a790-62cb71b36dbe tempest-CinderUnicodeTest-1855596390 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f8653d9-f773-4112-a71b-a0b0f4743a0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:37:40 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-a08d0492-5326-4611-a790-62cb71b36dbe tempest-CinderUnicodeTest-1855596390 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f8653d9-f773-4112-a71b-a0b0f4743a0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:37:40 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-a08d0492-5326-4611-a790-62cb71b36dbe tempest-CinderUnicodeTest-1855596390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d1208f9-b632-4faf-ac4c-826671d56e43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:37:40 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-a08d0492-5326-4611-a790-62cb71b36dbe tempest-CinderUnicodeTest-1855596390 None] Volume 5e9fccdc-d42f-41c2-b0cb-37818fa463c2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5e9fccdc-d42f-41c2-b0cb-37818fa463c2', 'volume_size': 1} Jul 31 12:37:40 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-a08d0492-5326-4611-a790-62cb71b36dbe tempest-CinderUnicodeTest-1855596390 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:37:40 devstack sudo[112696]: pam_unix(sudo:session): session closed for user root Jul 31 12:37:40 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-159d14ac-c120-4bef-95e0-23d2e9908d18 tempest-VolumeImageDependencyTests-1366750687 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7d692865-546c-4efb-b5b0-835056092f6f_zvwqz3ld" returned: 0 in 0.374s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:37:40 devstack sudo[112695]: pam_unix(sudo:session): session closed for user root Jul 31 12:37:40 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-159d14ac-c120-4bef-95e0-23d2e9908d18 tempest-VolumeImageDependencyTests-1366750687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7d692865-546c-4efb-b5b0-835056092f6f_zvwqz3ld {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:37:40 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-ba5bd8fb-f727-452d-a548-7a8b87fda096 tempest-VolumeDependencyTests-442009576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-4ce7c091-c8b0-432c-a840-fa5ce161abbf.d9823284-8e6b-48fc-bbbb-dfd45bc614d5" returned: 0 in 0.399s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:37:40 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-ba5bd8fb-f727-452d-a548-7a8b87fda096 tempest-VolumeDependencyTests-442009576 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4ce7c091-c8b0-432c-a840-fa5ce161abbf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89182) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 12:37:40 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[145da357-e827-47c5-81c0-1392a86abcfe]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:37:40 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-ba5bd8fb-f727-452d-a548-7a8b87fda096 tempest-VolumeDependencyTests-442009576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-4ce7c091-c8b0-432c-a840-fa5ce161abbf {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:37:40 devstack sudo[112704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7d692865-546c-4efb-b5b0-835056092f6f_zvwqz3ld Jul 31 12:37:40 devstack sudo[112704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:37:40 devstack sudo[112705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-4ce7c091-c8b0-432c-a840-fa5ce161abbf Jul 31 12:37:40 devstack sudo[112705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:37:41 devstack sudo[112704]: pam_unix(sudo:session): session closed for user root Jul 31 12:37:41 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-159d14ac-c120-4bef-95e0-23d2e9908d18 tempest-VolumeImageDependencyTests-1366750687 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7d692865-546c-4efb-b5b0-835056092f6f_zvwqz3ld" returned: 1 in 0.347s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:37:41 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-159d14ac-c120-4bef-95e0-23d2e9908d18 tempest-VolumeImageDependencyTests-1366750687 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7d692865-546c-4efb-b5b0-835056092f6f_zvwqz3ld' failed. Not Retrying. {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 31 12:37:41 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce29112c-5b67-4c82-b0a8-48a1155bfec8]: (4, 'raw') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:37:41 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-159d14ac-c120-4bef-95e0-23d2e9908d18 tempest-VolumeImageDependencyTests-1366750687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7d692865-546c-4efb-b5b0-835056092f6f_fn1hxwy9devstack@QuobyteHD {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:37:41 devstack sudo[112705]: pam_unix(sudo:session): session closed for user root Jul 31 12:37:41 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-ba5bd8fb-f727-452d-a548-7a8b87fda096 tempest-VolumeDependencyTests-442009576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-4ce7c091-c8b0-432c-a840-fa5ce161abbf" returned: 0 in 0.386s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:37:41 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-ba5bd8fb-f727-452d-a548-7a8b87fda096 tempest-VolumeDependencyTests-442009576 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-4ce7c091-c8b0-432c-a840-fa5ce161abbf {{(pid=89182) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Jul 31 12:37:41 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-ba5bd8fb-f727-452d-a548-7a8b87fda096 tempest-VolumeDependencyTests-442009576 None] Creating direct copy from snapshot {{(pid=89182) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Jul 31 12:37:41 devstack cinder-volume[89182]: DEBUG cinder.utils [None req-ba5bd8fb-f727-452d-a548-7a8b87fda096 tempest-VolumeDependencyTests-442009576 None] Path /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-62e947b3-0c3c-48ec-8f5f-d92cd882e684 not found in is_blk_device check {{(pid=89182) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 31 12:37:41 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-ba5bd8fb-f727-452d-a548-7a8b87fda096 tempest-VolumeDependencyTests-442009576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-4ce7c091-c8b0-432c-a840-fa5ce161abbf /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-62e947b3-0c3c-48ec-8f5f-d92cd882e684 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:37:41 devstack sudo[112714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-4ce7c091-c8b0-432c-a840-fa5ce161abbf /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-62e947b3-0c3c-48ec-8f5f-d92cd882e684 Jul 31 12:37:41 devstack sudo[112714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:37:41 devstack sudo[112712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7d692865-546c-4efb-b5b0-835056092f6f_fn1hxwy9devstack@QuobyteHD Jul 31 12:37:41 devstack sudo[112712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:37:41 devstack sudo[112712]: pam_unix(sudo:session): session closed for user root Jul 31 12:37:41 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-159d14ac-c120-4bef-95e0-23d2e9908d18 tempest-VolumeImageDependencyTests-1366750687 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7d692865-546c-4efb-b5b0-835056092f6f_fn1hxwy9devstack@QuobyteHD" returned: 0 in 0.341s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:37:41 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-159d14ac-c120-4bef-95e0-23d2e9908d18 tempest-VolumeImageDependencyTests-1366750687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7d692865-546c-4efb-b5b0-835056092f6f_fn1hxwy9devstack@QuobyteHD {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:37:41 devstack sudo[112722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7d692865-546c-4efb-b5b0-835056092f6f_fn1hxwy9devstack@QuobyteHD Jul 31 12:37:41 devstack sudo[112722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:37:41 devstack sudo[112714]: pam_unix(sudo:session): session closed for user root Jul 31 12:37:41 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-ba5bd8fb-f727-452d-a548-7a8b87fda096 tempest-VolumeDependencyTests-442009576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-4ce7c091-c8b0-432c-a840-fa5ce161abbf /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-62e947b3-0c3c-48ec-8f5f-d92cd882e684" returned: 0 in 0.449s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:37:41 devstack cinder-volume[89182]: DEBUG cinder.image.image_utils [None req-ba5bd8fb-f727-452d-a548-7a8b87fda096 tempest-VolumeDependencyTests-442009576 None] Image conversion details: src /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-4ce7c091-c8b0-432c-a840-fa5ce161abbf, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-62e947b3-0c3c-48ec-8f5f-d92cd882e684 {{(pid=89182) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 31 12:37:41 devstack cinder-volume[89182]: INFO cinder.image.image_utils [None req-ba5bd8fb-f727-452d-a548-7a8b87fda096 tempest-VolumeDependencyTests-442009576 None] Converted 1024.00 MB image at 1024.00 MB/s Jul 31 12:37:41 devstack cinder-volume[89182]: WARNING cinder.volume.drivers.remotefs [None req-ba5bd8fb-f727-452d-a548-7a8b87fda096 tempest-VolumeDependencyTests-442009576 None] /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-62e947b3-0c3c-48ec-8f5f-d92cd882e684 is being set with open permissions: ugo+rw Jul 31 12:37:41 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-ba5bd8fb-f727-452d-a548-7a8b87fda096 tempest-VolumeDependencyTests-442009576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-62e947b3-0c3c-48ec-8f5f-d92cd882e684 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:37:41 devstack sudo[112725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-62e947b3-0c3c-48ec-8f5f-d92cd882e684 Jul 31 12:37:41 devstack sudo[112725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:37:41 devstack sudo[112722]: pam_unix(sudo:session): session closed for user root Jul 31 12:37:41 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-159d14ac-c120-4bef-95e0-23d2e9908d18 tempest-VolumeImageDependencyTests-1366750687 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7d692865-546c-4efb-b5b0-835056092f6f_fn1hxwy9devstack@QuobyteHD" returned: 1 in 0.356s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:37:41 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-159d14ac-c120-4bef-95e0-23d2e9908d18 tempest-VolumeImageDependencyTests-1366750687 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7d692865-546c-4efb-b5b0-835056092f6f_fn1hxwy9devstack@QuobyteHD' failed. Not Retrying. {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 31 12:37:41 devstack cinder-volume[89182]: DEBUG cinder.image.image_utils [None req-159d14ac-c120-4bef-95e0-23d2e9908d18 tempest-VolumeImageDependencyTests-1366750687 None] 7d692865-546c-4efb-b5b0-835056092f6f was raw, converting to qcow2 {{(pid=89182) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 31 12:37:41 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-159d14ac-c120-4bef-95e0-23d2e9908d18 tempest-VolumeImageDependencyTests-1366750687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_7d692865-546c-4efb-b5b0-835056092f6f_fn1hxwy9devstack@QuobyteHD /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-ec85cdb1-7689-440b-afbd-5dd65139a0af {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:37:41 devstack sudo[112730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_7d692865-546c-4efb-b5b0-835056092f6f_fn1hxwy9devstack@QuobyteHD /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-ec85cdb1-7689-440b-afbd-5dd65139a0af Jul 31 12:37:41 devstack sudo[112730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:37:41 devstack sudo[112725]: pam_unix(sudo:session): session closed for user root Jul 31 12:37:41 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-ba5bd8fb-f727-452d-a548-7a8b87fda096 tempest-VolumeDependencyTests-442009576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-62e947b3-0c3c-48ec-8f5f-d92cd882e684" returned: 0 in 0.271s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:37:41 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-ba5bd8fb-f727-452d-a548-7a8b87fda096 tempest-VolumeDependencyTests-442009576 None] Lock "cinder-quobyte-62e947b3-0c3c-48ec-8f5f-d92cd882e684" released by "_copy_volume_from_snapshot" :: held 1.612s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:37:41 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-ba5bd8fb-f727-452d-a548-7a8b87fda096 tempest-VolumeDependencyTests-442009576 None] Lock "cinder-quobyte-d9823284-8e6b-48fc-bbbb-dfd45bc614d5-62e947b3-0c3c-48ec-8f5f-d92cd882e684" released by "_create_volume_from_snapshot" :: held 1.686s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:37:41 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-ba5bd8fb-f727-452d-a548-7a8b87fda096 tempest-VolumeDependencyTests-442009576 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 1.753s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:37:41 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-cee554a5-88e7-430c-b3d2-64a025a2ea99 tempest-SnapshotDataIntegrityTests-898447071 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.691s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:37:41 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-cee554a5-88e7-430c-b3d2-64a025a2ea99 tempest-SnapshotDataIntegrityTests-898447071 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:37:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDataIntegrityTests-volume-2128903635',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6acfb11-941d-450b-8d93-0e32240df94a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e47adc7d32b64078850d9d94d5cb10bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:37:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:37:40Z,use_quota=True,user_id='6344cc57ebdb4e02aae72e7a719cd916',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)}" {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 12:37:41 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-cee554a5-88e7-430c-b3d2-64a025a2ea99 tempest-SnapshotDataIntegrityTests-898447071 None] Creating volume e6acfb11-941d-450b-8d93-0e32240df94a {{(pid=89182) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 12:37:41 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-cee554a5-88e7-430c-b3d2-64a025a2ea99 tempest-SnapshotDataIntegrityTests-898447071 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:37:41 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-cee554a5-88e7-430c-b3d2-64a025a2ea99 tempest-SnapshotDataIntegrityTests-898447071 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:37:41 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-cee554a5-88e7-430c-b3d2-64a025a2ea99 tempest-SnapshotDataIntegrityTests-898447071 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:37:41 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-cee554a5-88e7-430c-b3d2-64a025a2ea99 tempest-SnapshotDataIntegrityTests-898447071 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:37:41 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-cee554a5-88e7-430c-b3d2-64a025a2ea99 tempest-SnapshotDataIntegrityTests-898447071 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:37:41 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-cee554a5-88e7-430c-b3d2-64a025a2ea99 tempest-SnapshotDataIntegrityTests-898447071 None] Selected osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 as target Quobyte volume. {{(pid=89182) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 12:37:41 devstack cinder-volume[89182]: INFO cinder.volume.drivers.remotefs [None req-cee554a5-88e7-430c-b3d2-64a025a2ea99 tempest-SnapshotDataIntegrityTests-898447071 None] casted to osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 Jul 31 12:37:41 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-cee554a5-88e7-430c-b3d2-64a025a2ea99 tempest-SnapshotDataIntegrityTests-898447071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e6acfb11-941d-450b-8d93-0e32240df94a 1073741824 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:37:41 devstack sudo[112733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e6acfb11-941d-450b-8d93-0e32240df94a 1073741824 Jul 31 12:37:41 devstack sudo[112733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:37:41 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-ba5bd8fb-f727-452d-a548-7a8b87fda096 tempest-VolumeDependencyTests-442009576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3106bd1d-4744-4fc6-b574-f77532d98f36) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-62e947b3-0c3c-48ec-8f5f-d92cd882e684', 'volume_size': 1, 'snapshot_id': 'd9823284-8e6b-48fc-bbbb-dfd45bc614d5'}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:37:41 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-ba5bd8fb-f727-452d-a548-7a8b87fda096 tempest-VolumeDependencyTests-442009576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13f85ac4-14fa-43c0-836d-a30517dd0938) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:37:41 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-ba5bd8fb-f727-452d-a548-7a8b87fda096 tempest-VolumeDependencyTests-442009576 None] Volume volume-62e947b3-0c3c-48ec-8f5f-d92cd882e684 (62e947b3-0c3c-48ec-8f5f-d92cd882e684): created successfully Jul 31 12:37:41 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-ba5bd8fb-f727-452d-a548-7a8b87fda096 tempest-VolumeDependencyTests-442009576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13f85ac4-14fa-43c0-836d-a30517dd0938) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:37:41 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-ba5bd8fb-f727-452d-a548-7a8b87fda096 tempest-VolumeDependencyTests-442009576 None] Flow 'volume_create_manager' (607181ca-1d96-4d22-8e04-8d1dcaccd121) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:37:42 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-ba5bd8fb-f727-452d-a548-7a8b87fda096 tempest-VolumeDependencyTests-442009576 None] Created volume successfully. Jul 31 12:37:42 devstack sudo[112730]: pam_unix(sudo:session): session closed for user root Jul 31 12:37:42 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-159d14ac-c120-4bef-95e0-23d2e9908d18 tempest-VolumeImageDependencyTests-1366750687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_7d692865-546c-4efb-b5b0-835056092f6f_fn1hxwy9devstack@QuobyteHD /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-ec85cdb1-7689-440b-afbd-5dd65139a0af" returned: 0 in 0.493s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:37:42 devstack cinder-volume[89182]: DEBUG cinder.image.image_utils [None req-159d14ac-c120-4bef-95e0-23d2e9908d18 tempest-VolumeImageDependencyTests-1366750687 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_7d692865-546c-4efb-b5b0-835056092f6f_fn1hxwy9devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-ec85cdb1-7689-440b-afbd-5dd65139a0af {{(pid=89182) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 31 12:37:42 devstack cinder-volume[89182]: INFO cinder.image.image_utils [None req-159d14ac-c120-4bef-95e0-23d2e9908d18 tempest-VolumeImageDependencyTests-1366750687 None] Converted 0.00 MB image at 0.00 MB/s Jul 31 12:37:42 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-159d14ac-c120-4bef-95e0-23d2e9908d18 tempest-VolumeImageDependencyTests-1366750687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-ec85cdb1-7689-440b-afbd-5dd65139a0af 1G {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:37:42 devstack sudo[112742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-ec85cdb1-7689-440b-afbd-5dd65139a0af 1G Jul 31 12:37:42 devstack sudo[112742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:37:42 devstack sudo[112733]: pam_unix(sudo:session): session closed for user root Jul 31 12:37:42 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-cee554a5-88e7-430c-b3d2-64a025a2ea99 tempest-SnapshotDataIntegrityTests-898447071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e6acfb11-941d-450b-8d93-0e32240df94a 1073741824" returned: 0 in 0.483s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:37:42 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-cee554a5-88e7-430c-b3d2-64a025a2ea99 tempest-SnapshotDataIntegrityTests-898447071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e6acfb11-941d-450b-8d93-0e32240df94a {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:37:42 devstack sudo[112744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e6acfb11-941d-450b-8d93-0e32240df94a Jul 31 12:37:42 devstack sudo[112744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:37:42 devstack sudo[112742]: pam_unix(sudo:session): session closed for user root Jul 31 12:37:42 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-159d14ac-c120-4bef-95e0-23d2e9908d18 tempest-VolumeImageDependencyTests-1366750687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-ec85cdb1-7689-440b-afbd-5dd65139a0af 1G" returned: 0 in 0.315s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:37:42 devstack cinder-volume[89182]: DEBUG cinder.volume.volume_utils [None req-159d14ac-c120-4bef-95e0-23d2e9908d18 tempest-VolumeImageDependencyTests-1366750687 None] Downloaded image 7d692865-546c-4efb-b5b0-835056092f6f ((None, [{'url': 'file:///opt/stack/data/glance/images/7d692865-546c-4efb-b5b0-835056092f6f', 'metadata': {}}])) to volume ec85cdb1-7689-440b-afbd-5dd65139a0af successfully. {{(pid=89182) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 31 12:37:42 devstack cinder-volume[89182]: DEBUG cinder.image.image_utils [None req-159d14ac-c120-4bef-95e0-23d2e9908d18 tempest-VolumeImageDependencyTests-1366750687 None] Temporary image 7d692865-546c-4efb-b5b0-835056092f6f for user b44e6e9d7b9542c6aea2ca270c251a89 is deleted. {{(pid=89182) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 31 12:37:42 devstack cinder-volume[89182]: DEBUG cinder.volume.volume_utils [None req-159d14ac-c120-4bef-95e0-23d2e9908d18 tempest-VolumeImageDependencyTests-1366750687 None] Marking volume ec85cdb1-7689-440b-afbd-5dd65139a0af as bootable. {{(pid=89182) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 31 12:37:42 devstack cinder-volume[89182]: DEBUG cinder.volume.flows.manager.create_volume [None req-159d14ac-c120-4bef-95e0-23d2e9908d18 tempest-VolumeImageDependencyTests-1366750687 None] Copying metadata from image 7d692865-546c-4efb-b5b0-835056092f6f to ec85cdb1-7689-440b-afbd-5dd65139a0af. {{(pid=89182) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 31 12:37:42 devstack cinder-volume[89182]: DEBUG cinder.volume.flows.manager.create_volume [None req-159d14ac-c120-4bef-95e0-23d2e9908d18 tempest-VolumeImageDependencyTests-1366750687 None] Creating volume glance metadata for volume ec85cdb1-7689-440b-afbd-5dd65139a0af backed by image 7d692865-546c-4efb-b5b0-835056092f6f with: {'image_id': '7d692865-546c-4efb-b5b0-835056092f6f', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '0f944d0462506ab32b5f1bb8608d0b2f', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=89182) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 31 12:37:42 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-159d14ac-c120-4bef-95e0-23d2e9908d18 tempest-VolumeImageDependencyTests-1366750687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12d455ea-0d19-4766-9d47-aafbf7a64600) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ec85cdb1-7689-440b-afbd-5dd65139a0af', 'volume_size': 1, 'image_id': '7d692865-546c-4efb-b5b0-835056092f6f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7d692865-546c-4efb-b5b0-835056092f6f', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '0f944d0462506ab32b5f1bb8608d0b2f', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '2d0755f1e2ea4124a760580edccedbe3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '375bd2ec5f64e1d48e350ea788020a2ce0c28289ca4da531b67438f23537f00a05264aa9c497e4c4a3425e145b6d2b7da302aa0d5461ccda7fab2217779f45f1', 'id': '7d692865-546c-4efb-b5b0-835056092f6f', 'created_at': datetime.datetime(2026, 7, 31, 10, 37, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 31, 10, 37, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7d692865-546c-4efb-b5b0-835056092f6f/file', 'properties': {}}, 'image_service': }' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:37:42 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-159d14ac-c120-4bef-95e0-23d2e9908d18 tempest-VolumeImageDependencyTests-1366750687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff5bcbff-c305-411c-b9c3-e93d47c6d36d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:37:42 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-159d14ac-c120-4bef-95e0-23d2e9908d18 tempest-VolumeImageDependencyTests-1366750687 None] Volume volume-ec85cdb1-7689-440b-afbd-5dd65139a0af (ec85cdb1-7689-440b-afbd-5dd65139a0af): created successfully Jul 31 12:37:42 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-159d14ac-c120-4bef-95e0-23d2e9908d18 tempest-VolumeImageDependencyTests-1366750687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff5bcbff-c305-411c-b9c3-e93d47c6d36d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:37:42 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-159d14ac-c120-4bef-95e0-23d2e9908d18 tempest-VolumeImageDependencyTests-1366750687 None] Flow 'volume_create_manager' (426a4c93-9691-46dc-8723-27b10b479e26) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:37:42 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-159d14ac-c120-4bef-95e0-23d2e9908d18 tempest-VolumeImageDependencyTests-1366750687 None] Created volume successfully. Jul 31 12:37:42 devstack sudo[112744]: pam_unix(sudo:session): session closed for user root Jul 31 12:37:42 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-cee554a5-88e7-430c-b3d2-64a025a2ea99 tempest-SnapshotDataIntegrityTests-898447071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e6acfb11-941d-450b-8d93-0e32240df94a" returned: 0 in 0.277s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:37:42 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-cee554a5-88e7-430c-b3d2-64a025a2ea99 tempest-SnapshotDataIntegrityTests-898447071 None] <== create_volume: return (802ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'} {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 12:37:42 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-cee554a5-88e7-430c-b3d2-64a025a2ea99 tempest-SnapshotDataIntegrityTests-898447071 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.806s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:37:42 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-a08d0492-5326-4611-a790-62cb71b36dbe tempest-CinderUnicodeTest-1855596390 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.154s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:37:42 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-a08d0492-5326-4611-a790-62cb71b36dbe tempest-CinderUnicodeTest-1855596390 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:37:40Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1483328752',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e9fccdc-d42f-41c2-b0cb-37818fa463c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e804ed9b1a70469085ddbdb350696a23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:37:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:37:40Z,use_quota=True,user_id='8608c82041ff45229afe6164278597dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)}" {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 12:37:42 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-a08d0492-5326-4611-a790-62cb71b36dbe tempest-CinderUnicodeTest-1855596390 None] Creating volume 5e9fccdc-d42f-41c2-b0cb-37818fa463c2 {{(pid=89182) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 12:37:42 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-a08d0492-5326-4611-a790-62cb71b36dbe tempest-CinderUnicodeTest-1855596390 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:37:42 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-a08d0492-5326-4611-a790-62cb71b36dbe tempest-CinderUnicodeTest-1855596390 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:37:42 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-a08d0492-5326-4611-a790-62cb71b36dbe tempest-CinderUnicodeTest-1855596390 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:37:42 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-a08d0492-5326-4611-a790-62cb71b36dbe tempest-CinderUnicodeTest-1855596390 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:37:42 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-a08d0492-5326-4611-a790-62cb71b36dbe tempest-CinderUnicodeTest-1855596390 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:37:42 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-a08d0492-5326-4611-a790-62cb71b36dbe tempest-CinderUnicodeTest-1855596390 None] Selected osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 as target Quobyte volume. {{(pid=89182) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 12:37:42 devstack cinder-volume[89182]: INFO cinder.volume.drivers.remotefs [None req-a08d0492-5326-4611-a790-62cb71b36dbe tempest-CinderUnicodeTest-1855596390 None] casted to osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 Jul 31 12:37:42 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-a08d0492-5326-4611-a790-62cb71b36dbe tempest-CinderUnicodeTest-1855596390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-5e9fccdc-d42f-41c2-b0cb-37818fa463c2 1073741824 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:37:42 devstack sudo[112750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-5e9fccdc-d42f-41c2-b0cb-37818fa463c2 1073741824 Jul 31 12:37:42 devstack sudo[112750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:37:42 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-cee554a5-88e7-430c-b3d2-64a025a2ea99 tempest-SnapshotDataIntegrityTests-898447071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (186faeae-864a-4bc1-a841-40a2585a6540) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e6acfb11-941d-450b-8d93-0e32240df94a', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:37:42 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-cee554a5-88e7-430c-b3d2-64a025a2ea99 tempest-SnapshotDataIntegrityTests-898447071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3088085-33ea-428c-9810-fdb094b5f05a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:37:42 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-cee554a5-88e7-430c-b3d2-64a025a2ea99 tempest-SnapshotDataIntegrityTests-898447071 None] Volume volume-e6acfb11-941d-450b-8d93-0e32240df94a (e6acfb11-941d-450b-8d93-0e32240df94a): created successfully Jul 31 12:37:42 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-cee554a5-88e7-430c-b3d2-64a025a2ea99 tempest-SnapshotDataIntegrityTests-898447071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3088085-33ea-428c-9810-fdb094b5f05a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:37:42 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-cee554a5-88e7-430c-b3d2-64a025a2ea99 tempest-SnapshotDataIntegrityTests-898447071 None] Flow 'volume_create_manager' (37931973-a286-40a8-b295-9adb21ba2d53) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:37:42 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-cee554a5-88e7-430c-b3d2-64a025a2ea99 tempest-SnapshotDataIntegrityTests-898447071 None] Created volume successfully. Jul 31 12:37:42 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-f76068b0-18d4-4e85-9d5d-43fee5e99957 tempest-VolumeDependencyTests-442009576 None] Acquiring lock "cinder-982a5875-ef30-4b3f-9788-25d99ba142c2-delete_snapshot" by "delete_snapshot" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:37:42 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-f76068b0-18d4-4e85-9d5d-43fee5e99957 tempest-VolumeDependencyTests-442009576 None] Lock "cinder-982a5875-ef30-4b3f-9788-25d99ba142c2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:37:42 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-f76068b0-18d4-4e85-9d5d-43fee5e99957 tempest-VolumeDependencyTests-442009576 None] Acquiring lock "cinder-quobyte-70102b3e-c9c8-455a-8df8-bbdf3afdeaee" by "delete_snapshot" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:37:42 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-f76068b0-18d4-4e85-9d5d-43fee5e99957 tempest-VolumeDependencyTests-442009576 None] Lock "cinder-quobyte-70102b3e-c9c8-455a-8df8-bbdf3afdeaee" acquired by "delete_snapshot" :: waited 0.016s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:37:42 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-f76068b0-18d4-4e85-9d5d-43fee5e99957 tempest-VolumeDependencyTests-442009576 None] Acquiring lock "cinder-quobyte-982a5875-ef30-4b3f-9788-25d99ba142c2" by "_delete_snapshot" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:37:42 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-f76068b0-18d4-4e85-9d5d-43fee5e99957 tempest-VolumeDependencyTests-442009576 None] Lock "cinder-quobyte-982a5875-ef30-4b3f-9788-25d99ba142c2" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:37:42 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-f76068b0-18d4-4e85-9d5d-43fee5e99957 tempest-VolumeDependencyTests-442009576 None] Deleting offline snapshot 982a5875-ef30-4b3f-9788-25d99ba142c2 of volume 70102b3e-c9c8-455a-8df8-bbdf3afdeaee {{(pid=89182) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 31 12:37:42 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-f76068b0-18d4-4e85-9d5d-43fee5e99957 tempest-VolumeDependencyTests-442009576 None] snapshot_file for this snap is: volume-70102b3e-c9c8-455a-8df8-bbdf3afdeaee.982a5875-ef30-4b3f-9788-25d99ba142c2 {{(pid=89182) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 31 12:37:42 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d9d5bbc-539e-402e-94c8-71a2f4bac86b]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:37:42 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-f76068b0-18d4-4e85-9d5d-43fee5e99957 tempest-VolumeDependencyTests-442009576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-70102b3e-c9c8-455a-8df8-bbdf3afdeaee.982a5875-ef30-4b3f-9788-25d99ba142c2 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:37:43 devstack sudo[112752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-70102b3e-c9c8-455a-8df8-bbdf3afdeaee.982a5875-ef30-4b3f-9788-25d99ba142c2 Jul 31 12:37:43 devstack sudo[112752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:37:43 devstack sudo[112750]: pam_unix(sudo:session): session closed for user root Jul 31 12:37:43 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-a08d0492-5326-4611-a790-62cb71b36dbe tempest-CinderUnicodeTest-1855596390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-5e9fccdc-d42f-41c2-b0cb-37818fa463c2 1073741824" returned: 0 in 0.545s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:37:43 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-a08d0492-5326-4611-a790-62cb71b36dbe tempest-CinderUnicodeTest-1855596390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-5e9fccdc-d42f-41c2-b0cb-37818fa463c2 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:37:43 devstack sudo[112760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-5e9fccdc-d42f-41c2-b0cb-37818fa463c2 Jul 31 12:37:43 devstack sudo[112760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:37:43 devstack sudo[112752]: pam_unix(sudo:session): session closed for user root Jul 31 12:37:43 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-f76068b0-18d4-4e85-9d5d-43fee5e99957 tempest-VolumeDependencyTests-442009576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-70102b3e-c9c8-455a-8df8-bbdf3afdeaee.982a5875-ef30-4b3f-9788-25d99ba142c2" returned: 0 in 0.434s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:37:43 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-f76068b0-18d4-4e85-9d5d-43fee5e99957 tempest-VolumeDependencyTests-442009576 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-70102b3e-c9c8-455a-8df8-bbdf3afdeaee(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89182) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 12:37:43 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[103ec924-15f0-4916-9b27-b6a4f68d88cc]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:37:43 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-f76068b0-18d4-4e85-9d5d-43fee5e99957 tempest-VolumeDependencyTests-442009576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-70102b3e-c9c8-455a-8df8-bbdf3afdeaee {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:37:43 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-bc10a43b-0f7e-4bbf-9d11-77561d79a271 tempest-VolumeImageDependencyTests-1366750687 None] Acquiring lock "cinder-ec85cdb1-7689-440b-afbd-5dd65139a0af-delete_volume" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:37:43 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-bc10a43b-0f7e-4bbf-9d11-77561d79a271 tempest-VolumeImageDependencyTests-1366750687 None] Lock "cinder-ec85cdb1-7689-440b-afbd-5dd65139a0af-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:37:43 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-bc10a43b-0f7e-4bbf-9d11-77561d79a271 tempest-VolumeImageDependencyTests-1366750687 None] Acquiring lock "cinder-quobyte-ec85cdb1-7689-440b-afbd-5dd65139a0af" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:37:43 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-bc10a43b-0f7e-4bbf-9d11-77561d79a271 tempest-VolumeImageDependencyTests-1366750687 None] Lock "cinder-quobyte-ec85cdb1-7689-440b-afbd-5dd65139a0af" acquired by "delete_volume" :: waited 0.025s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:37:43 devstack sudo[112767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-70102b3e-c9c8-455a-8df8-bbdf3afdeaee Jul 31 12:37:43 devstack sudo[112767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:37:43 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[10856221-608e-4384-880b-4d82adb00763]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:37:43 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-bc10a43b-0f7e-4bbf-9d11-77561d79a271 tempest-VolumeImageDependencyTests-1366750687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-ec85cdb1-7689-440b-afbd-5dd65139a0af {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:37:43 devstack sudo[112760]: pam_unix(sudo:session): session closed for user root Jul 31 12:37:43 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-a08d0492-5326-4611-a790-62cb71b36dbe tempest-CinderUnicodeTest-1855596390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-5e9fccdc-d42f-41c2-b0cb-37818fa463c2" returned: 0 in 0.370s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:37:43 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-a08d0492-5326-4611-a790-62cb71b36dbe tempest-CinderUnicodeTest-1855596390 None] <== create_volume: return (973ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'} {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 12:37:43 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-a08d0492-5326-4611-a790-62cb71b36dbe tempest-CinderUnicodeTest-1855596390 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.979s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:37:43 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-a08d0492-5326-4611-a790-62cb71b36dbe tempest-CinderUnicodeTest-1855596390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d1208f9-b632-4faf-ac4c-826671d56e43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5e9fccdc-d42f-41c2-b0cb-37818fa463c2', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:37:43 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-a08d0492-5326-4611-a790-62cb71b36dbe tempest-CinderUnicodeTest-1855596390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c7161eb-1690-4bfc-a29d-2faa9a3fe1c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:37:43 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-a08d0492-5326-4611-a790-62cb71b36dbe tempest-CinderUnicodeTest-1855596390 None] Volume volume-5e9fccdc-d42f-41c2-b0cb-37818fa463c2 (5e9fccdc-d42f-41c2-b0cb-37818fa463c2): created successfully Jul 31 12:37:43 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-a08d0492-5326-4611-a790-62cb71b36dbe tempest-CinderUnicodeTest-1855596390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c7161eb-1690-4bfc-a29d-2faa9a3fe1c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:37:43 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-a08d0492-5326-4611-a790-62cb71b36dbe tempest-CinderUnicodeTest-1855596390 None] Flow 'volume_create_manager' (7cd22397-a562-4cde-a8c7-4fb118cf32b3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:37:43 devstack sudo[112769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-ec85cdb1-7689-440b-afbd-5dd65139a0af Jul 31 12:37:43 devstack sudo[112769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:37:43 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-a08d0492-5326-4611-a790-62cb71b36dbe tempest-CinderUnicodeTest-1855596390 None] Created volume successfully. Jul 31 12:37:44 devstack sudo[112769]: pam_unix(sudo:session): session closed for user root Jul 31 12:37:44 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-bc10a43b-0f7e-4bbf-9d11-77561d79a271 tempest-VolumeImageDependencyTests-1366750687 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-ec85cdb1-7689-440b-afbd-5dd65139a0af" returned: 0 in 0.453s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:37:44 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-bc10a43b-0f7e-4bbf-9d11-77561d79a271 tempest-VolumeImageDependencyTests-1366750687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-ec85cdb1-7689-440b-afbd-5dd65139a0af {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:37:44 devstack sudo[112780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-ec85cdb1-7689-440b-afbd-5dd65139a0af Jul 31 12:37:44 devstack sudo[112780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:37:44 devstack sudo[112767]: pam_unix(sudo:session): session closed for user root Jul 31 12:37:44 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-f76068b0-18d4-4e85-9d5d-43fee5e99957 tempest-VolumeDependencyTests-442009576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-70102b3e-c9c8-455a-8df8-bbdf3afdeaee" returned: 0 in 0.735s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:37:44 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-f76068b0-18d4-4e85-9d5d-43fee5e99957 tempest-VolumeDependencyTests-442009576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-70102b3e-c9c8-455a-8df8-bbdf3afdeaee.982a5875-ef30-4b3f-9788-25d99ba142c2 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:37:44 devstack sudo[112783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-70102b3e-c9c8-455a-8df8-bbdf3afdeaee.982a5875-ef30-4b3f-9788-25d99ba142c2 Jul 31 12:37:44 devstack sudo[112783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:37:44 devstack sudo[112780]: pam_unix(sudo:session): session closed for user root Jul 31 12:37:44 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-bc10a43b-0f7e-4bbf-9d11-77561d79a271 tempest-VolumeImageDependencyTests-1366750687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-ec85cdb1-7689-440b-afbd-5dd65139a0af" returned: 0 in 0.293s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:37:44 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-bc10a43b-0f7e-4bbf-9d11-77561d79a271 tempest-VolumeImageDependencyTests-1366750687 None] Lock "cinder-quobyte-ec85cdb1-7689-440b-afbd-5dd65139a0af" released by "delete_volume" :: held 0.815s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:37:44 devstack cinder-volume[89182]: DEBUG cinder.quota [None req-bc10a43b-0f7e-4bbf-9d11-77561d79a271 tempest-VolumeImageDependencyTests-1366750687 None] Created reservations ['aa969f38-883e-4ab9-a9e4-e8b574249928', 'c68719cd-d65a-458b-bfe3-8baae0afcabc', '9e0b9a94-205e-4091-9f91-bc970a1929f7', '360c8567-351e-4ba2-85d8-b4c256a00d31'] {{(pid=89182) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 12:37:44 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [req-bc2eae8c-a5c4-491c-a7af-283c36efafca req-b0ef4464-382b-4d25-bde8-3011c7515b8c tempest-SnapshotDataIntegrityTests-898447071 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:37:44 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [req-bc2eae8c-a5c4-491c-a7af-283c36efafca req-b0ef4464-382b-4d25-bde8-3011c7515b8c tempest-SnapshotDataIntegrityTests-898447071 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:37:44 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [req-bc2eae8c-a5c4-491c-a7af-283c36efafca req-b0ef4464-382b-4d25-bde8-3011c7515b8c tempest-SnapshotDataIntegrityTests-898447071 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:37:44 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [req-bc2eae8c-a5c4-491c-a7af-283c36efafca req-b0ef4464-382b-4d25-bde8-3011c7515b8c tempest-SnapshotDataIntegrityTests-898447071 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88', 'name': 'volume-e6acfb11-941d-450b-8d93-0e32240df94a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '06625027-6497-4634-90ec-02195b5dad3d', 'enforce_multipath': True} {{(pid=89182) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 31 12:37:44 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-bc10a43b-0f7e-4bbf-9d11-77561d79a271 tempest-VolumeImageDependencyTests-1366750687 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:37:44 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-bc10a43b-0f7e-4bbf-9d11-77561d79a271 tempest-VolumeImageDependencyTests-1366750687 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:37:44 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-bc10a43b-0f7e-4bbf-9d11-77561d79a271 tempest-VolumeImageDependencyTests-1366750687 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:37:44 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-bc10a43b-0f7e-4bbf-9d11-77561d79a271 tempest-VolumeImageDependencyTests-1366750687 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:37:44 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-bc10a43b-0f7e-4bbf-9d11-77561d79a271 tempest-VolumeImageDependencyTests-1366750687 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:37:44 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-bc10a43b-0f7e-4bbf-9d11-77561d79a271 tempest-VolumeImageDependencyTests-1366750687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:37:44 devstack sudo[112798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 Jul 31 12:37:44 devstack sudo[112798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:37:44 devstack sudo[112783]: pam_unix(sudo:session): session closed for user root Jul 31 12:37:44 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-f76068b0-18d4-4e85-9d5d-43fee5e99957 tempest-VolumeDependencyTests-442009576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-70102b3e-c9c8-455a-8df8-bbdf3afdeaee.982a5875-ef30-4b3f-9788-25d99ba142c2" returned: 0 in 0.422s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:37:44 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-f76068b0-18d4-4e85-9d5d-43fee5e99957 tempest-VolumeDependencyTests-442009576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-70102b3e-c9c8-455a-8df8-bbdf3afdeaee.982a5875-ef30-4b3f-9788-25d99ba142c2 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:37:44 devstack sudo[112800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-70102b3e-c9c8-455a-8df8-bbdf3afdeaee.982a5875-ef30-4b3f-9788-25d99ba142c2 Jul 31 12:37:44 devstack sudo[112800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:37:44 devstack cinder-volume[89182]: INFO cinder.volume.manager [req-bc2eae8c-a5c4-491c-a7af-283c36efafca req-b0ef4464-382b-4d25-bde8-3011c7515b8c tempest-SnapshotDataIntegrityTests-898447071 None] attachment_update completed successfully. Jul 31 12:37:45 devstack sudo[112798]: pam_unix(sudo:session): session closed for user root Jul 31 12:37:45 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-bc10a43b-0f7e-4bbf-9d11-77561d79a271 tempest-VolumeImageDependencyTests-1366750687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2" returned: 0 in 0.468s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:37:45 devstack cinder-volume[89182]: DEBUG cinder.manager [None req-bc10a43b-0f7e-4bbf-9d11-77561d79a271 tempest-VolumeImageDependencyTests-1366750687 None] Notifying Schedulers of capabilities ... {{(pid=89182) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 12:37:45 devstack sudo[112800]: pam_unix(sudo:session): session closed for user root Jul 31 12:37:45 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-f76068b0-18d4-4e85-9d5d-43fee5e99957 tempest-VolumeDependencyTests-442009576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-70102b3e-c9c8-455a-8df8-bbdf3afdeaee.982a5875-ef30-4b3f-9788-25d99ba142c2" returned: 0 in 0.430s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:37:45 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-bc10a43b-0f7e-4bbf-9d11-77561d79a271 tempest-VolumeImageDependencyTests-1366750687 None] Deleted volume successfully. Jul 31 12:37:45 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-f76068b0-18d4-4e85-9d5d-43fee5e99957 tempest-VolumeDependencyTests-442009576 None] Lock "cinder-quobyte-982a5875-ef30-4b3f-9788-25d99ba142c2" released by "_delete_snapshot" :: held 2.189s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:37:45 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-bc10a43b-0f7e-4bbf-9d11-77561d79a271 tempest-VolumeImageDependencyTests-1366750687 None] Lock "cinder-ec85cdb1-7689-440b-afbd-5dd65139a0af-delete_volume" released by "delete_volume" :: held 1.622s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:37:45 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-f76068b0-18d4-4e85-9d5d-43fee5e99957 tempest-VolumeDependencyTests-442009576 None] Lock "cinder-quobyte-70102b3e-c9c8-455a-8df8-bbdf3afdeaee" released by "delete_snapshot" :: held 2.223s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:37:45 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-315f98e8-ddfc-4191-9856-2c9d06c04694 tempest-CinderUnicodeTest-1855596390 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:37:45 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-315f98e8-ddfc-4191-9856-2c9d06c04694 tempest-CinderUnicodeTest-1855596390 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:37:45 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-315f98e8-ddfc-4191-9856-2c9d06c04694 tempest-CinderUnicodeTest-1855596390 None] Creating offline snapshot 492b6f84-9ba2-4ffa-a58d-7273b3aad9d3 of volume 5e9fccdc-d42f-41c2-b0cb-37818fa463c2 {{(pid=89182) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 31 12:37:45 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f745395-7d2a-4b85-a569-9d8f2d575ebd]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:37:45 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-315f98e8-ddfc-4191-9856-2c9d06c04694 tempest-CinderUnicodeTest-1855596390 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-5e9fccdc-d42f-41c2-b0cb-37818fa463c2 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:37:45 devstack cinder-volume[89182]: DEBUG cinder.quota [None req-f76068b0-18d4-4e85-9d5d-43fee5e99957 tempest-VolumeDependencyTests-442009576 None] Created reservations ['09ed574e-29df-433f-bddc-172f536ed725', '9b9cb6e6-0fde-47cc-bb23-d3c16000b9d5', 'c0b6d69d-b503-40ee-8f8d-aaa70125a451', 'd630503d-7a5e-413f-9148-131b472e2781'] {{(pid=89182) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 12:37:45 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-f76068b0-18d4-4e85-9d5d-43fee5e99957 tempest-VolumeDependencyTests-442009576 None] Delete snapshot completed successfully. Jul 31 12:37:45 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-f76068b0-18d4-4e85-9d5d-43fee5e99957 tempest-VolumeDependencyTests-442009576 None] Lock "cinder-982a5875-ef30-4b3f-9788-25d99ba142c2-delete_snapshot" released by "delete_snapshot" :: held 2.514s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:37:45 devstack sudo[113188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-5e9fccdc-d42f-41c2-b0cb-37818fa463c2 Jul 31 12:37:45 devstack sudo[113188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:37:45 devstack sudo[113188]: pam_unix(sudo:session): session closed for user root Jul 31 12:37:45 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-315f98e8-ddfc-4191-9856-2c9d06c04694 tempest-CinderUnicodeTest-1855596390 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-5e9fccdc-d42f-41c2-b0cb-37818fa463c2" returned: 0 in 0.467s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:37:45 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-315f98e8-ddfc-4191-9856-2c9d06c04694 tempest-CinderUnicodeTest-1855596390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-5e9fccdc-d42f-41c2-b0cb-37818fa463c2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-5e9fccdc-d42f-41c2-b0cb-37818fa463c2.492b6f84-9ba2-4ffa-a58d-7273b3aad9d3 1G {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:37:45 devstack sudo[113194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-5e9fccdc-d42f-41c2-b0cb-37818fa463c2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-5e9fccdc-d42f-41c2-b0cb-37818fa463c2.492b6f84-9ba2-4ffa-a58d-7273b3aad9d3 1G Jul 31 12:37:45 devstack sudo[113194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:37:46 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-62916c3a-ae4c-4f7c-99f1-50676d2e670f tempest-VolumeDependencyTests-442009576 None] Acquiring lock "cinder-d9823284-8e6b-48fc-bbbb-dfd45bc614d5-delete_snapshot" by "delete_snapshot" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:37:46 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-62916c3a-ae4c-4f7c-99f1-50676d2e670f tempest-VolumeDependencyTests-442009576 None] Lock "cinder-d9823284-8e6b-48fc-bbbb-dfd45bc614d5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:37:46 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-62916c3a-ae4c-4f7c-99f1-50676d2e670f tempest-VolumeDependencyTests-442009576 None] Acquiring lock "cinder-quobyte-4ce7c091-c8b0-432c-a840-fa5ce161abbf" by "delete_snapshot" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:37:46 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-62916c3a-ae4c-4f7c-99f1-50676d2e670f tempest-VolumeDependencyTests-442009576 None] Lock "cinder-quobyte-4ce7c091-c8b0-432c-a840-fa5ce161abbf" acquired by "delete_snapshot" :: waited 0.026s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:37:46 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-62916c3a-ae4c-4f7c-99f1-50676d2e670f tempest-VolumeDependencyTests-442009576 None] Acquiring lock "cinder-quobyte-d9823284-8e6b-48fc-bbbb-dfd45bc614d5" by "_delete_snapshot" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:37:46 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-62916c3a-ae4c-4f7c-99f1-50676d2e670f tempest-VolumeDependencyTests-442009576 None] Lock "cinder-quobyte-d9823284-8e6b-48fc-bbbb-dfd45bc614d5" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:37:46 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-62916c3a-ae4c-4f7c-99f1-50676d2e670f tempest-VolumeDependencyTests-442009576 None] Deleting offline snapshot d9823284-8e6b-48fc-bbbb-dfd45bc614d5 of volume 4ce7c091-c8b0-432c-a840-fa5ce161abbf {{(pid=89182) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 31 12:37:46 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-62916c3a-ae4c-4f7c-99f1-50676d2e670f tempest-VolumeDependencyTests-442009576 None] snapshot_file for this snap is: volume-4ce7c091-c8b0-432c-a840-fa5ce161abbf.d9823284-8e6b-48fc-bbbb-dfd45bc614d5 {{(pid=89182) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 31 12:37:46 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc4d0423-16f3-4d4c-924d-7d0d2dada73d]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:37:46 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-62916c3a-ae4c-4f7c-99f1-50676d2e670f tempest-VolumeDependencyTests-442009576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-4ce7c091-c8b0-432c-a840-fa5ce161abbf.d9823284-8e6b-48fc-bbbb-dfd45bc614d5 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:37:46 devstack sudo[113194]: pam_unix(sudo:session): session closed for user root Jul 31 12:37:46 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-315f98e8-ddfc-4191-9856-2c9d06c04694 tempest-CinderUnicodeTest-1855596390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-5e9fccdc-d42f-41c2-b0cb-37818fa463c2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-5e9fccdc-d42f-41c2-b0cb-37818fa463c2.492b6f84-9ba2-4ffa-a58d-7273b3aad9d3 1G" returned: 0 in 0.532s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:37:46 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-315f98e8-ddfc-4191-9856-2c9d06c04694 tempest-CinderUnicodeTest-1855596390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5e9fccdc-d42f-41c2-b0cb-37818fa463c2 -F qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-5e9fccdc-d42f-41c2-b0cb-37818fa463c2.492b6f84-9ba2-4ffa-a58d-7273b3aad9d3 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:37:46 devstack sudo[113200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5e9fccdc-d42f-41c2-b0cb-37818fa463c2 -F qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-5e9fccdc-d42f-41c2-b0cb-37818fa463c2.492b6f84-9ba2-4ffa-a58d-7273b3aad9d3 Jul 31 12:37:46 devstack sudo[113200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:37:46 devstack sudo[113199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-4ce7c091-c8b0-432c-a840-fa5ce161abbf.d9823284-8e6b-48fc-bbbb-dfd45bc614d5 Jul 31 12:37:46 devstack sudo[113199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:37:46 devstack sudo[113199]: pam_unix(sudo:session): session closed for user root Jul 31 12:37:46 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-62916c3a-ae4c-4f7c-99f1-50676d2e670f tempest-VolumeDependencyTests-442009576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-4ce7c091-c8b0-432c-a840-fa5ce161abbf.d9823284-8e6b-48fc-bbbb-dfd45bc614d5" returned: 0 in 0.392s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:37:46 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-62916c3a-ae4c-4f7c-99f1-50676d2e670f tempest-VolumeDependencyTests-442009576 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4ce7c091-c8b0-432c-a840-fa5ce161abbf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89182) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 12:37:46 devstack sudo[113200]: pam_unix(sudo:session): session closed for user root Jul 31 12:37:46 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-315f98e8-ddfc-4191-9856-2c9d06c04694 tempest-CinderUnicodeTest-1855596390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5e9fccdc-d42f-41c2-b0cb-37818fa463c2 -F qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-5e9fccdc-d42f-41c2-b0cb-37818fa463c2.492b6f84-9ba2-4ffa-a58d-7273b3aad9d3" returned: 0 in 0.369s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:37:46 devstack cinder-volume[89182]: WARNING cinder.volume.drivers.remotefs [None req-315f98e8-ddfc-4191-9856-2c9d06c04694 tempest-CinderUnicodeTest-1855596390 None] /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-5e9fccdc-d42f-41c2-b0cb-37818fa463c2.492b6f84-9ba2-4ffa-a58d-7273b3aad9d3 is being set with open permissions: ugo+rw Jul 31 12:37:46 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-315f98e8-ddfc-4191-9856-2c9d06c04694 tempest-CinderUnicodeTest-1855596390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-5e9fccdc-d42f-41c2-b0cb-37818fa463c2.492b6f84-9ba2-4ffa-a58d-7273b3aad9d3 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:37:46 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[086721bd-3d9f-483c-9f76-688a33d634bb]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:37:46 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-62916c3a-ae4c-4f7c-99f1-50676d2e670f tempest-VolumeDependencyTests-442009576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-4ce7c091-c8b0-432c-a840-fa5ce161abbf {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:37:46 devstack sudo[113216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-5e9fccdc-d42f-41c2-b0cb-37818fa463c2.492b6f84-9ba2-4ffa-a58d-7273b3aad9d3 Jul 31 12:37:46 devstack sudo[113216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:37:46 devstack sudo[113217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-4ce7c091-c8b0-432c-a840-fa5ce161abbf Jul 31 12:37:46 devstack sudo[113217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:37:46 devstack sudo[113216]: pam_unix(sudo:session): session closed for user root Jul 31 12:37:46 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-315f98e8-ddfc-4191-9856-2c9d06c04694 tempest-CinderUnicodeTest-1855596390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-5e9fccdc-d42f-41c2-b0cb-37818fa463c2.492b6f84-9ba2-4ffa-a58d-7273b3aad9d3" returned: 0 in 0.320s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:37:46 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-315f98e8-ddfc-4191-9856-2c9d06c04694 tempest-CinderUnicodeTest-1855596390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-5e9fccdc-d42f-41c2-b0cb-37818fa463c2.info {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:37:47 devstack sudo[113244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-5e9fccdc-d42f-41c2-b0cb-37818fa463c2.info Jul 31 12:37:47 devstack sudo[113244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:37:47 devstack sudo[113217]: pam_unix(sudo:session): session closed for user root Jul 31 12:37:47 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-62916c3a-ae4c-4f7c-99f1-50676d2e670f tempest-VolumeDependencyTests-442009576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-4ce7c091-c8b0-432c-a840-fa5ce161abbf" returned: 0 in 0.465s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:37:47 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-62916c3a-ae4c-4f7c-99f1-50676d2e670f tempest-VolumeDependencyTests-442009576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-4ce7c091-c8b0-432c-a840-fa5ce161abbf.d9823284-8e6b-48fc-bbbb-dfd45bc614d5 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:37:47 devstack sudo[113275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-4ce7c091-c8b0-432c-a840-fa5ce161abbf.d9823284-8e6b-48fc-bbbb-dfd45bc614d5 Jul 31 12:37:47 devstack sudo[113275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:37:47 devstack sudo[113244]: pam_unix(sudo:session): session closed for user root Jul 31 12:37:47 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-315f98e8-ddfc-4191-9856-2c9d06c04694 tempest-CinderUnicodeTest-1855596390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-5e9fccdc-d42f-41c2-b0cb-37818fa463c2.info" returned: 0 in 0.389s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:37:47 devstack cinder-volume[89182]: WARNING cinder.volume.drivers.remotefs [None req-315f98e8-ddfc-4191-9856-2c9d06c04694 tempest-CinderUnicodeTest-1855596390 None] /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-5e9fccdc-d42f-41c2-b0cb-37818fa463c2.info is being set with open permissions: ugo+rw Jul 31 12:37:47 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-315f98e8-ddfc-4191-9856-2c9d06c04694 tempest-CinderUnicodeTest-1855596390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-5e9fccdc-d42f-41c2-b0cb-37818fa463c2.info {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:37:47 devstack sudo[113283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-5e9fccdc-d42f-41c2-b0cb-37818fa463c2.info Jul 31 12:37:47 devstack sudo[113283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:37:47 devstack sudo[113283]: pam_unix(sudo:session): session closed for user root Jul 31 12:37:47 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-315f98e8-ddfc-4191-9856-2c9d06c04694 tempest-CinderUnicodeTest-1855596390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-5e9fccdc-d42f-41c2-b0cb-37818fa463c2.info" returned: 0 in 0.364s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:37:47 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-315f98e8-ddfc-4191-9856-2c9d06c04694 tempest-CinderUnicodeTest-1855596390 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.576s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:37:47 devstack sudo[113275]: pam_unix(sudo:session): session closed for user root Jul 31 12:37:47 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-315f98e8-ddfc-4191-9856-2c9d06c04694 tempest-CinderUnicodeTest-1855596390 None] Create snapshot completed successfully Jul 31 12:37:47 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-62916c3a-ae4c-4f7c-99f1-50676d2e670f tempest-VolumeDependencyTests-442009576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-4ce7c091-c8b0-432c-a840-fa5ce161abbf.d9823284-8e6b-48fc-bbbb-dfd45bc614d5" returned: 0 in 0.721s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:37:47 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-62916c3a-ae4c-4f7c-99f1-50676d2e670f tempest-VolumeDependencyTests-442009576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-4ce7c091-c8b0-432c-a840-fa5ce161abbf.d9823284-8e6b-48fc-bbbb-dfd45bc614d5 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:37:47 devstack sudo[113301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-4ce7c091-c8b0-432c-a840-fa5ce161abbf.d9823284-8e6b-48fc-bbbb-dfd45bc614d5 Jul 31 12:37:47 devstack sudo[113301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:37:48 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-6f827f60-1a4a-4517-852c-03a201a2f0f8 tempest-SnapshotDataIntegrityTests-898447071 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:37:48 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-6f827f60-1a4a-4517-852c-03a201a2f0f8 tempest-SnapshotDataIntegrityTests-898447071 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:37:48 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-6f827f60-1a4a-4517-852c-03a201a2f0f8 tempest-SnapshotDataIntegrityTests-898447071 None] Creating online snapshot 4a5c6e12-2302-44db-ab0e-eedae12ca53f of volume e6acfb11-941d-450b-8d93-0e32240df94a {{(pid=89182) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 31 12:37:48 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[45ffb649-57ef-49ab-9d4c-d725504b05a4]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:37:48 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-6f827f60-1a4a-4517-852c-03a201a2f0f8 tempest-SnapshotDataIntegrityTests-898447071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e6acfb11-941d-450b-8d93-0e32240df94a {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:37:48 devstack sudo[113301]: pam_unix(sudo:session): session closed for user root Jul 31 12:37:48 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-62916c3a-ae4c-4f7c-99f1-50676d2e670f tempest-VolumeDependencyTests-442009576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-4ce7c091-c8b0-432c-a840-fa5ce161abbf.d9823284-8e6b-48fc-bbbb-dfd45bc614d5" returned: 0 in 0.359s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:37:48 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-62916c3a-ae4c-4f7c-99f1-50676d2e670f tempest-VolumeDependencyTests-442009576 None] Lock "cinder-quobyte-d9823284-8e6b-48fc-bbbb-dfd45bc614d5" released by "_delete_snapshot" :: held 2.123s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:37:48 devstack sudo[113307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e6acfb11-941d-450b-8d93-0e32240df94a Jul 31 12:37:48 devstack sudo[113307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:37:48 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-62916c3a-ae4c-4f7c-99f1-50676d2e670f tempest-VolumeDependencyTests-442009576 None] Lock "cinder-quobyte-4ce7c091-c8b0-432c-a840-fa5ce161abbf" released by "delete_snapshot" :: held 2.155s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:37:48 devstack cinder-volume[89182]: DEBUG cinder.quota [None req-62916c3a-ae4c-4f7c-99f1-50676d2e670f tempest-VolumeDependencyTests-442009576 None] Created reservations ['badbcd66-df66-4178-8971-3a62263fd16b', 'a54f7f54-59bc-4c0c-a344-b694bcceb96c', '22cca156-1929-4960-b770-1c9d34fc24fa', 'ee6d7120-1815-43ba-8fff-429d1e9b3ea0'] {{(pid=89182) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 12:37:48 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-ee0d2799-1081-4b22-b144-3aec2836dc94 tempest-CinderUnicodeTest-1855596390 None] Acquiring lock "cinder-492b6f84-9ba2-4ffa-a58d-7273b3aad9d3-delete_snapshot" by "delete_snapshot" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:37:48 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-ee0d2799-1081-4b22-b144-3aec2836dc94 tempest-CinderUnicodeTest-1855596390 None] Lock "cinder-492b6f84-9ba2-4ffa-a58d-7273b3aad9d3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:37:48 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-ee0d2799-1081-4b22-b144-3aec2836dc94 tempest-CinderUnicodeTest-1855596390 None] Acquiring lock "cinder-quobyte-5e9fccdc-d42f-41c2-b0cb-37818fa463c2" by "delete_snapshot" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:37:48 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-ee0d2799-1081-4b22-b144-3aec2836dc94 tempest-CinderUnicodeTest-1855596390 None] Lock "cinder-quobyte-5e9fccdc-d42f-41c2-b0cb-37818fa463c2" acquired by "delete_snapshot" :: waited 0.022s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:37:48 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-ee0d2799-1081-4b22-b144-3aec2836dc94 tempest-CinderUnicodeTest-1855596390 None] Acquiring lock "cinder-quobyte-492b6f84-9ba2-4ffa-a58d-7273b3aad9d3" by "_delete_snapshot" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:37:48 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-62916c3a-ae4c-4f7c-99f1-50676d2e670f tempest-VolumeDependencyTests-442009576 None] Delete snapshot completed successfully. Jul 31 12:37:48 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-ee0d2799-1081-4b22-b144-3aec2836dc94 tempest-CinderUnicodeTest-1855596390 None] Lock "cinder-quobyte-492b6f84-9ba2-4ffa-a58d-7273b3aad9d3" acquired by "_delete_snapshot" :: waited 0.037s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:37:48 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-ee0d2799-1081-4b22-b144-3aec2836dc94 tempest-CinderUnicodeTest-1855596390 None] Deleting offline snapshot 492b6f84-9ba2-4ffa-a58d-7273b3aad9d3 of volume 5e9fccdc-d42f-41c2-b0cb-37818fa463c2 {{(pid=89182) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 31 12:37:48 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-ee0d2799-1081-4b22-b144-3aec2836dc94 tempest-CinderUnicodeTest-1855596390 None] snapshot_file for this snap is: volume-5e9fccdc-d42f-41c2-b0cb-37818fa463c2.492b6f84-9ba2-4ffa-a58d-7273b3aad9d3 {{(pid=89182) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 31 12:37:48 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-62916c3a-ae4c-4f7c-99f1-50676d2e670f tempest-VolumeDependencyTests-442009576 None] Lock "cinder-d9823284-8e6b-48fc-bbbb-dfd45bc614d5-delete_snapshot" released by "delete_snapshot" :: held 2.488s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:37:48 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb9abd14-73e0-4a23-9173-819056b869a3]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:37:48 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-ee0d2799-1081-4b22-b144-3aec2836dc94 tempest-CinderUnicodeTest-1855596390 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-5e9fccdc-d42f-41c2-b0cb-37818fa463c2.492b6f84-9ba2-4ffa-a58d-7273b3aad9d3 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:37:48 devstack sudo[113307]: pam_unix(sudo:session): session closed for user root Jul 31 12:37:48 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-6f827f60-1a4a-4517-852c-03a201a2f0f8 tempest-SnapshotDataIntegrityTests-898447071 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e6acfb11-941d-450b-8d93-0e32240df94a" returned: 0 in 0.518s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:37:48 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-6f827f60-1a4a-4517-852c-03a201a2f0f8 tempest-SnapshotDataIntegrityTests-898447071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e6acfb11-941d-450b-8d93-0e32240df94a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e6acfb11-941d-450b-8d93-0e32240df94a.4a5c6e12-2302-44db-ab0e-eedae12ca53f 1G {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:37:48 devstack sudo[113313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e6acfb11-941d-450b-8d93-0e32240df94a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e6acfb11-941d-450b-8d93-0e32240df94a.4a5c6e12-2302-44db-ab0e-eedae12ca53f 1G Jul 31 12:37:48 devstack sudo[113313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:37:48 devstack sudo[113312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-5e9fccdc-d42f-41c2-b0cb-37818fa463c2.492b6f84-9ba2-4ffa-a58d-7273b3aad9d3 Jul 31 12:37:48 devstack sudo[113312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:37:48 devstack cinder-volume[89182]: DEBUG cinder.volume.flows.manager.create_volume [None req-46392afe-4ccf-4c85-a16c-fdfe2489fbaf tempest-VolumeImageDependencyTests-1366750687 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89182) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 12:37:48 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-46392afe-4ccf-4c85-a16c-fdfe2489fbaf tempest-VolumeImageDependencyTests-1366750687 None] Flow 'volume_create_manager' (e1ea95ee-4bef-4da3-bbff-d0d08e940c03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:37:48 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-46392afe-4ccf-4c85-a16c-fdfe2489fbaf tempest-VolumeImageDependencyTests-1366750687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e6e1982-45bd-4645-8d36-5121e08f307f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:37:48 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-46392afe-4ccf-4c85-a16c-fdfe2489fbaf tempest-VolumeImageDependencyTests-1366750687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e6e1982-45bd-4645-8d36-5121e08f307f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:37:49Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test0e20bd6e-440f-41d8-9b5d-fc047ac00423',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b1ce179-4800-405a-a0dd-40b9d0c101be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d0755f1e2ea4124a760580edccedbe3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:37:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:37:49Z,use_quota=True,user_id='b44e6e9d7b9542c6aea2ca270c251a89',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:37:48 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-46392afe-4ccf-4c85-a16c-fdfe2489fbaf tempest-VolumeImageDependencyTests-1366750687 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b011448-f46f-41fa-9aaf-1ef3121b20e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:37:48 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-46392afe-4ccf-4c85-a16c-fdfe2489fbaf tempest-VolumeImageDependencyTests-1366750687 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b011448-f46f-41fa-9aaf-1ef3121b20e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:37:48 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-46392afe-4ccf-4c85-a16c-fdfe2489fbaf tempest-VolumeImageDependencyTests-1366750687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (476dd24d-3c4f-436d-bf5c-c77b91ad3386) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:37:48 devstack cinder-volume[89182]: DEBUG cinder.image.glance [None req-46392afe-4ccf-4c85-a16c-fdfe2489fbaf tempest-VolumeImageDependencyTests-1366750687 None] Creating Keystone auth plugin from conf {{(pid=89182) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 31 12:37:49 devstack sudo[113312]: pam_unix(sudo:session): session closed for user root Jul 31 12:37:49 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-ee0d2799-1081-4b22-b144-3aec2836dc94 tempest-CinderUnicodeTest-1855596390 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-5e9fccdc-d42f-41c2-b0cb-37818fa463c2.492b6f84-9ba2-4ffa-a58d-7273b3aad9d3" returned: 0 in 0.449s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:37:49 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-ee0d2799-1081-4b22-b144-3aec2836dc94 tempest-CinderUnicodeTest-1855596390 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5e9fccdc-d42f-41c2-b0cb-37818fa463c2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89182) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 12:37:49 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c43ca4f-c602-495a-b4d0-4a88e143cfb3]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:37:49 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-ee0d2799-1081-4b22-b144-3aec2836dc94 tempest-CinderUnicodeTest-1855596390 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-5e9fccdc-d42f-41c2-b0cb-37818fa463c2 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:37:49 devstack sudo[113313]: pam_unix(sudo:session): session closed for user root Jul 31 12:37:49 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-6f827f60-1a4a-4517-852c-03a201a2f0f8 tempest-SnapshotDataIntegrityTests-898447071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e6acfb11-941d-450b-8d93-0e32240df94a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e6acfb11-941d-450b-8d93-0e32240df94a.4a5c6e12-2302-44db-ab0e-eedae12ca53f 1G" returned: 0 in 0.502s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:37:49 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-6f827f60-1a4a-4517-852c-03a201a2f0f8 tempest-SnapshotDataIntegrityTests-898447071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e6acfb11-941d-450b-8d93-0e32240df94a -F qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e6acfb11-941d-450b-8d93-0e32240df94a.4a5c6e12-2302-44db-ab0e-eedae12ca53f {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:37:49 devstack sudo[113324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e6acfb11-941d-450b-8d93-0e32240df94a -F qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e6acfb11-941d-450b-8d93-0e32240df94a.4a5c6e12-2302-44db-ab0e-eedae12ca53f Jul 31 12:37:49 devstack sudo[113324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:37:49 devstack sudo[113323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-5e9fccdc-d42f-41c2-b0cb-37818fa463c2 Jul 31 12:37:49 devstack sudo[113323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:37:49 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-46392afe-4ccf-4c85-a16c-fdfe2489fbaf tempest-VolumeImageDependencyTests-1366750687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (476dd24d-3c4f-436d-bf5c-c77b91ad3386) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '0b1ce179-4800-405a-a0dd-40b9d0c101be', 'volume_name': 'volume-0b1ce179-4800-405a-a0dd-40b9d0c101be', 'volume_size': 1, 'image_id': 'a5b7e21f-2ffb-42f3-b82c-c200fd635a4a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a5b7e21f-2ffb-42f3-b82c-c200fd635a4a', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-0e20bd6e-440f-41d8-9b5d-fc047ac00423', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'f2cf6eac46858c46f4324eab5314b60f', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '2d0755f1e2ea4124a760580edccedbe3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'faa45ddd10af801fba1a4bd3fc82c3dce8311bc105fd3b0ac383daa4dd4101cee024133168c4ae81a23e2c1468b1595db940ccd0db7d59775b7ed439b513fdfc', 'id': 'a5b7e21f-2ffb-42f3-b82c-c200fd635a4a', 'created_at': datetime.datetime(2026, 7, 31, 10, 37, 46, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 31, 10, 37, 48, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a5b7e21f-2ffb-42f3-b82c-c200fd635a4a/file', 'properties': {}}, 'image_service': }' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:37:49 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-46392afe-4ccf-4c85-a16c-fdfe2489fbaf tempest-VolumeImageDependencyTests-1366750687 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c2e8ae0-90dc-4387-8eea-1448c59fb834) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:37:49 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-46392afe-4ccf-4c85-a16c-fdfe2489fbaf tempest-VolumeImageDependencyTests-1366750687 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c2e8ae0-90dc-4387-8eea-1448c59fb834) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:37:49 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-46392afe-4ccf-4c85-a16c-fdfe2489fbaf tempest-VolumeImageDependencyTests-1366750687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49bc8664-ae95-4ec3-9881-93bddd5c1cb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:37:49 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-46392afe-4ccf-4c85-a16c-fdfe2489fbaf tempest-VolumeImageDependencyTests-1366750687 None] Volume 0b1ce179-4800-405a-a0dd-40b9d0c101be: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-0b1ce179-4800-405a-a0dd-40b9d0c101be', 'volume_size': 1, 'image_id': 'a5b7e21f-2ffb-42f3-b82c-c200fd635a4a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a5b7e21f-2ffb-42f3-b82c-c200fd635a4a', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-0e20bd6e-440f-41d8-9b5d-fc047ac00423', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'f2cf6eac46858c46f4324eab5314b60f', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '2d0755f1e2ea4124a760580edccedbe3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'faa45ddd10af801fba1a4bd3fc82c3dce8311bc105fd3b0ac383daa4dd4101cee024133168c4ae81a23e2c1468b1595db940ccd0db7d59775b7ed439b513fdfc', 'id': 'a5b7e21f-2ffb-42f3-b82c-c200fd635a4a', 'created_at': datetime.datetime(2026, 7, 31, 10, 37, 46, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 31, 10, 37, 48, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a5b7e21f-2ffb-42f3-b82c-c200fd635a4a/file', 'properties': {}}, 'image_service': } Jul 31 12:37:49 devstack cinder-volume[89182]: DEBUG cinder.volume.flows.manager.create_volume [None req-46392afe-4ccf-4c85-a16c-fdfe2489fbaf tempest-VolumeImageDependencyTests-1366750687 None] Trying to clone 0b1ce179-4800-405a-a0dd-40b9d0c101be from image a5b7e21f-2ffb-42f3-b82c-c200fd635a4a at location (None, [{'url': 'file:///opt/stack/data/glance/images/a5b7e21f-2ffb-42f3-b82c-c200fd635a4a', 'metadata': {}}]). {{(pid=89182) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 31 12:37:49 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-800598f7-e442-46e5-b07c-8d52be77af84 tempest-VolumeDependencyTests-442009576 None] Acquiring lock "cinder-70102b3e-c9c8-455a-8df8-bbdf3afdeaee-delete_volume" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:37:49 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-800598f7-e442-46e5-b07c-8d52be77af84 tempest-VolumeDependencyTests-442009576 None] Lock "cinder-70102b3e-c9c8-455a-8df8-bbdf3afdeaee-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:37:49 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-800598f7-e442-46e5-b07c-8d52be77af84 tempest-VolumeDependencyTests-442009576 None] Acquiring lock "cinder-quobyte-70102b3e-c9c8-455a-8df8-bbdf3afdeaee" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:37:49 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-800598f7-e442-46e5-b07c-8d52be77af84 tempest-VolumeDependencyTests-442009576 None] Lock "cinder-quobyte-70102b3e-c9c8-455a-8df8-bbdf3afdeaee" acquired by "delete_volume" :: waited 0.020s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:37:49 devstack sudo[113324]: pam_unix(sudo:session): session closed for user root Jul 31 12:37:49 devstack sudo[113323]: pam_unix(sudo:session): session closed for user root Jul 31 12:37:49 devstack cinder-volume[89182]: DEBUG cinder.image.image_utils [None req-46392afe-4ccf-4c85-a16c-fdfe2489fbaf tempest-VolumeImageDependencyTests-1366750687 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_a5b7e21f-2ffb-42f3-b82c-c200fd635a4a_pxjgftmpdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=89182) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 31 12:37:49 devstack cinder-volume[89182]: INFO cinder.image.image_utils [None req-46392afe-4ccf-4c85-a16c-fdfe2489fbaf tempest-VolumeImageDependencyTests-1366750687 None] Image download 0.00 MB at 0.00 MB/s Jul 31 12:37:49 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-ee0d2799-1081-4b22-b144-3aec2836dc94 tempest-CinderUnicodeTest-1855596390 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-5e9fccdc-d42f-41c2-b0cb-37818fa463c2" returned: 0 in 0.446s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:37:49 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-6f827f60-1a4a-4517-852c-03a201a2f0f8 tempest-SnapshotDataIntegrityTests-898447071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e6acfb11-941d-450b-8d93-0e32240df94a -F qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e6acfb11-941d-450b-8d93-0e32240df94a.4a5c6e12-2302-44db-ab0e-eedae12ca53f" returned: 0 in 0.381s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:37:49 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-ee0d2799-1081-4b22-b144-3aec2836dc94 tempest-CinderUnicodeTest-1855596390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-5e9fccdc-d42f-41c2-b0cb-37818fa463c2.492b6f84-9ba2-4ffa-a58d-7273b3aad9d3 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:37:49 devstack cinder-volume[89182]: WARNING cinder.volume.drivers.remotefs [None req-6f827f60-1a4a-4517-852c-03a201a2f0f8 tempest-SnapshotDataIntegrityTests-898447071 None] /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e6acfb11-941d-450b-8d93-0e32240df94a.4a5c6e12-2302-44db-ab0e-eedae12ca53f is being set with open permissions: ugo+rw Jul 31 12:37:49 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-6f827f60-1a4a-4517-852c-03a201a2f0f8 tempest-SnapshotDataIntegrityTests-898447071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e6acfb11-941d-450b-8d93-0e32240df94a.4a5c6e12-2302-44db-ab0e-eedae12ca53f {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:37:49 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc109ce6-b529-4034-90f6-9c51bb238772]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:37:49 devstack sudo[113334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-5e9fccdc-d42f-41c2-b0cb-37818fa463c2.492b6f84-9ba2-4ffa-a58d-7273b3aad9d3 Jul 31 12:37:49 devstack sudo[113334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:37:49 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-800598f7-e442-46e5-b07c-8d52be77af84 tempest-VolumeDependencyTests-442009576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-70102b3e-c9c8-455a-8df8-bbdf3afdeaee {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:37:49 devstack sudo[113335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e6acfb11-941d-450b-8d93-0e32240df94a.4a5c6e12-2302-44db-ab0e-eedae12ca53f Jul 31 12:37:49 devstack sudo[113335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:37:49 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d5805ac-3a03-4b0c-a309-9aacb44d86e5]: (4, 'raw') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:37:49 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-46392afe-4ccf-4c85-a16c-fdfe2489fbaf tempest-VolumeImageDependencyTests-1366750687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a5b7e21f-2ffb-42f3-b82c-c200fd635a4a_pxjgftmpdevstack@QuobyteHD {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:37:49 devstack sudo[113337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-70102b3e-c9c8-455a-8df8-bbdf3afdeaee Jul 31 12:37:49 devstack sudo[113337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:37:49 devstack sudo[113339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a5b7e21f-2ffb-42f3-b82c-c200fd635a4a_pxjgftmpdevstack@QuobyteHD Jul 31 12:37:49 devstack sudo[113339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:37:49 devstack sudo[113335]: pam_unix(sudo:session): session closed for user root Jul 31 12:37:49 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-6f827f60-1a4a-4517-852c-03a201a2f0f8 tempest-SnapshotDataIntegrityTests-898447071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e6acfb11-941d-450b-8d93-0e32240df94a.4a5c6e12-2302-44db-ab0e-eedae12ca53f" returned: 0 in 0.311s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:37:49 devstack cinder-volume[89182]: DEBUG cinder.compute.nova [None req-6f827f60-1a4a-4517-852c-03a201a2f0f8 tempest-SnapshotDataIntegrityTests-898447071 None] Creating Keystone auth plugin from conf {{(pid=89182) novaclient /opt/stack/cinder/cinder/compute/nova.py:99}} Jul 31 12:37:49 devstack sudo[113334]: pam_unix(sudo:session): session closed for user root Jul 31 12:37:49 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-ee0d2799-1081-4b22-b144-3aec2836dc94 tempest-CinderUnicodeTest-1855596390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-5e9fccdc-d42f-41c2-b0cb-37818fa463c2.492b6f84-9ba2-4ffa-a58d-7273b3aad9d3" returned: 0 in 0.453s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:37:49 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-ee0d2799-1081-4b22-b144-3aec2836dc94 tempest-CinderUnicodeTest-1855596390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-5e9fccdc-d42f-41c2-b0cb-37818fa463c2.492b6f84-9ba2-4ffa-a58d-7273b3aad9d3 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:37:49 devstack sudo[113337]: pam_unix(sudo:session): session closed for user root Jul 31 12:37:50 devstack cinder-volume[89182]: DEBUG novaclient.v2.client [None req-6f827f60-1a4a-4517-852c-03a201a2f0f8 tempest-SnapshotDataIntegrityTests-898447071 None] REQ: curl -g -i -X POST http://192.168.122.21/compute/v2.1/os-assisted-volume-snapshots -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}66e585edb0440115b47e6c50bed96ae0a11d44d21561bf1fa12572e3f5560607" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-6f827f60-1a4a-4517-852c-03a201a2f0f8" -H "X-Service-Token: {SHA256}02a8645ba5bc7d3f7d0a93a9d02f784466607492168e4b335483720fa1daddd6" -d '{"snapshot": {"volume_id": "e6acfb11-941d-450b-8d93-0e32240df94a", "create_info": {"type": "qcow2", "new_file": "volume-e6acfb11-941d-450b-8d93-0e32240df94a.4a5c6e12-2302-44db-ab0e-eedae12ca53f", "snapshot_id": "4a5c6e12-2302-44db-ab0e-eedae12ca53f"}}}' {{(pid=89182) _http_log_request /opt/stack/data/venv/lib/python3.12/site-packages/keystoneauth1/session.py:575}} Jul 31 12:37:50 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-800598f7-e442-46e5-b07c-8d52be77af84 tempest-VolumeDependencyTests-442009576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-70102b3e-c9c8-455a-8df8-bbdf3afdeaee" returned: 0 in 0.436s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:37:50 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-800598f7-e442-46e5-b07c-8d52be77af84 tempest-VolumeDependencyTests-442009576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-70102b3e-c9c8-455a-8df8-bbdf3afdeaee {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:37:50 devstack sudo[113351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-5e9fccdc-d42f-41c2-b0cb-37818fa463c2.492b6f84-9ba2-4ffa-a58d-7273b3aad9d3 Jul 31 12:37:50 devstack sudo[113351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:37:50 devstack sudo[113339]: pam_unix(sudo:session): session closed for user root Jul 31 12:37:50 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-46392afe-4ccf-4c85-a16c-fdfe2489fbaf tempest-VolumeImageDependencyTests-1366750687 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a5b7e21f-2ffb-42f3-b82c-c200fd635a4a_pxjgftmpdevstack@QuobyteHD" returned: 0 in 0.424s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:37:50 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-46392afe-4ccf-4c85-a16c-fdfe2489fbaf tempest-VolumeImageDependencyTests-1366750687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a5b7e21f-2ffb-42f3-b82c-c200fd635a4a_pxjgftmpdevstack@QuobyteHD {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:37:50 devstack sudo[113356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-70102b3e-c9c8-455a-8df8-bbdf3afdeaee Jul 31 12:37:50 devstack sudo[113356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:37:50 devstack sudo[113357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a5b7e21f-2ffb-42f3-b82c-c200fd635a4a_pxjgftmpdevstack@QuobyteHD Jul 31 12:37:50 devstack sudo[113357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:37:50 devstack cinder-volume[89182]: DEBUG novaclient.v2.client [None req-6f827f60-1a4a-4517-852c-03a201a2f0f8 tempest-SnapshotDataIntegrityTests-898447071 None] RESP: [200] Connection: close Content-Length: 78 Content-Type: application/json Date: Fri, 31 Jul 2026 10:37:50 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.58 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-60b61963-ea0b-41d4-9ceb-0c13912e5367 x-openstack-request-id: req-60b61963-ea0b-41d4-9ceb-0c13912e5367 {{(pid=89182) _http_log_response /opt/stack/data/venv/lib/python3.12/site-packages/keystoneauth1/session.py:616}} Jul 31 12:37:50 devstack cinder-volume[89182]: DEBUG novaclient.v2.client [None req-6f827f60-1a4a-4517-852c-03a201a2f0f8 tempest-SnapshotDataIntegrityTests-898447071 None] RESP BODY: {"snapshot": {"id": null, "volumeId": "e6acfb11-941d-450b-8d93-0e32240df94a"}} {{(pid=89182) _http_log_response /opt/stack/data/venv/lib/python3.12/site-packages/keystoneauth1/session.py:651}} Jul 31 12:37:50 devstack cinder-volume[89182]: DEBUG novaclient.v2.client [None req-6f827f60-1a4a-4517-852c-03a201a2f0f8 tempest-SnapshotDataIntegrityTests-898447071 None] POST call to compute for http://192.168.122.21/compute/v2.1/os-assisted-volume-snapshots used request id req-60b61963-ea0b-41d4-9ceb-0c13912e5367 {{(pid=89182) request /opt/stack/data/venv/lib/python3.12/site-packages/keystoneauth1/session.py:1076}} Jul 31 12:37:50 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-6f827f60-1a4a-4517-852c-03a201a2f0f8 tempest-SnapshotDataIntegrityTests-898447071 None] nova call result: None {{(pid=89182) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1910}} Jul 31 12:37:50 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-6f827f60-1a4a-4517-852c-03a201a2f0f8 tempest-SnapshotDataIntegrityTests-898447071 None] Status of snapshot 4a5c6e12-2302-44db-ab0e-eedae12ca53f is now creating {{(pid=89182) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Jul 31 12:37:50 devstack sudo[113351]: pam_unix(sudo:session): session closed for user root Jul 31 12:37:50 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-ee0d2799-1081-4b22-b144-3aec2836dc94 tempest-CinderUnicodeTest-1855596390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-5e9fccdc-d42f-41c2-b0cb-37818fa463c2.492b6f84-9ba2-4ffa-a58d-7273b3aad9d3" returned: 0 in 0.319s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:37:50 devstack sudo[113356]: pam_unix(sudo:session): session closed for user root Jul 31 12:37:50 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-800598f7-e442-46e5-b07c-8d52be77af84 tempest-VolumeDependencyTests-442009576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-70102b3e-c9c8-455a-8df8-bbdf3afdeaee" returned: 0 in 0.342s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:37:50 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-ee0d2799-1081-4b22-b144-3aec2836dc94 tempest-CinderUnicodeTest-1855596390 None] Lock "cinder-quobyte-492b6f84-9ba2-4ffa-a58d-7273b3aad9d3" released by "_delete_snapshot" :: held 1.830s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:37:50 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-ee0d2799-1081-4b22-b144-3aec2836dc94 tempest-CinderUnicodeTest-1855596390 None] Lock "cinder-quobyte-5e9fccdc-d42f-41c2-b0cb-37818fa463c2" released by "delete_snapshot" :: held 1.876s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:37:50 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-800598f7-e442-46e5-b07c-8d52be77af84 tempest-VolumeDependencyTests-442009576 None] Lock "cinder-quobyte-70102b3e-c9c8-455a-8df8-bbdf3afdeaee" released by "delete_volume" :: held 0.911s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:37:50 devstack cinder-volume[89182]: DEBUG cinder.quota [None req-800598f7-e442-46e5-b07c-8d52be77af84 tempest-VolumeDependencyTests-442009576 None] Created reservations ['9e664680-0899-41b0-9507-4c2b105f05ce', 'd12308e5-6688-4479-8f03-4e185428af7f', '581bc87a-e445-4568-be12-bbd5e8a4458a', '31dedced-ea2d-4e9c-a73b-9d09ec2afcce'] {{(pid=89182) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 12:37:50 devstack cinder-volume[89182]: DEBUG cinder.quota [None req-ee0d2799-1081-4b22-b144-3aec2836dc94 tempest-CinderUnicodeTest-1855596390 None] Created reservations ['938c50d9-8eb8-409d-823a-eb2c11bfa0be', '9ac91b25-86b5-4d19-98a0-434f31fcd273', '2d990150-bb55-4355-ae8e-75115b18923f', 'f541c765-fe0d-413e-942c-92ef8e00a688'] {{(pid=89182) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 12:37:50 devstack sudo[113357]: pam_unix(sudo:session): session closed for user root Jul 31 12:37:50 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-46392afe-4ccf-4c85-a16c-fdfe2489fbaf tempest-VolumeImageDependencyTests-1366750687 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a5b7e21f-2ffb-42f3-b82c-c200fd635a4a_pxjgftmpdevstack@QuobyteHD" returned: 1 in 0.457s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:37:50 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-46392afe-4ccf-4c85-a16c-fdfe2489fbaf tempest-VolumeImageDependencyTests-1366750687 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a5b7e21f-2ffb-42f3-b82c-c200fd635a4a_pxjgftmpdevstack@QuobyteHD' failed. Not Retrying. {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 31 12:37:50 devstack cinder-volume[89182]: DEBUG cinder.image.image_utils [None req-46392afe-4ccf-4c85-a16c-fdfe2489fbaf tempest-VolumeImageDependencyTests-1366750687 None] Temporary image a5b7e21f-2ffb-42f3-b82c-c200fd635a4a is fetched for user b44e6e9d7b9542c6aea2ca270c251a89. {{(pid=89182) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 31 12:37:50 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-800598f7-e442-46e5-b07c-8d52be77af84 tempest-VolumeDependencyTests-442009576 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:37:50 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-800598f7-e442-46e5-b07c-8d52be77af84 tempest-VolumeDependencyTests-442009576 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:37:50 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-800598f7-e442-46e5-b07c-8d52be77af84 tempest-VolumeDependencyTests-442009576 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:37:50 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-800598f7-e442-46e5-b07c-8d52be77af84 tempest-VolumeDependencyTests-442009576 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:37:50 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-800598f7-e442-46e5-b07c-8d52be77af84 tempest-VolumeDependencyTests-442009576 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:37:50 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-800598f7-e442-46e5-b07c-8d52be77af84 tempest-VolumeDependencyTests-442009576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:37:50 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cdac7b3-d666-4fc7-b193-531bce081df0]: (4, 'raw') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:37:50 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-46392afe-4ccf-4c85-a16c-fdfe2489fbaf tempest-VolumeImageDependencyTests-1366750687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a5b7e21f-2ffb-42f3-b82c-c200fd635a4a_pxjgftmpdevstack@QuobyteHD {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:37:50 devstack sudo[113372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 Jul 31 12:37:50 devstack sudo[113372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:37:50 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-ee0d2799-1081-4b22-b144-3aec2836dc94 tempest-CinderUnicodeTest-1855596390 None] Delete snapshot completed successfully. Jul 31 12:37:50 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-ee0d2799-1081-4b22-b144-3aec2836dc94 tempest-CinderUnicodeTest-1855596390 None] Lock "cinder-492b6f84-9ba2-4ffa-a58d-7273b3aad9d3-delete_snapshot" released by "delete_snapshot" :: held 2.178s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:37:50 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-2a9d9db7-c999-4f8b-8bf8-a9febb163f3e tempest-CinderUnicodeTest-1855596390 None] Acquiring lock "cinder-5e9fccdc-d42f-41c2-b0cb-37818fa463c2-delete_volume" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:37:50 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-2a9d9db7-c999-4f8b-8bf8-a9febb163f3e tempest-CinderUnicodeTest-1855596390 None] Lock "cinder-5e9fccdc-d42f-41c2-b0cb-37818fa463c2-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:37:50 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-2a9d9db7-c999-4f8b-8bf8-a9febb163f3e tempest-CinderUnicodeTest-1855596390 None] Acquiring lock "cinder-quobyte-5e9fccdc-d42f-41c2-b0cb-37818fa463c2" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:37:50 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-2a9d9db7-c999-4f8b-8bf8-a9febb163f3e tempest-CinderUnicodeTest-1855596390 None] Lock "cinder-quobyte-5e9fccdc-d42f-41c2-b0cb-37818fa463c2" acquired by "delete_volume" :: waited 0.022s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:37:50 devstack sudo[113374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a5b7e21f-2ffb-42f3-b82c-c200fd635a4a_pxjgftmpdevstack@QuobyteHD Jul 31 12:37:50 devstack sudo[113374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:37:50 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[90fc8ad5-579c-477b-a39e-ef3f5b9c38b5]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:37:50 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-2a9d9db7-c999-4f8b-8bf8-a9febb163f3e tempest-CinderUnicodeTest-1855596390 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-5e9fccdc-d42f-41c2-b0cb-37818fa463c2 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:37:50 devstack sudo[113372]: pam_unix(sudo:session): session closed for user root Jul 31 12:37:50 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-800598f7-e442-46e5-b07c-8d52be77af84 tempest-VolumeDependencyTests-442009576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2" returned: 0 in 0.324s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:37:50 devstack cinder-volume[89182]: DEBUG cinder.manager [None req-800598f7-e442-46e5-b07c-8d52be77af84 tempest-VolumeDependencyTests-442009576 None] Notifying Schedulers of capabilities ... {{(pid=89182) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 12:37:50 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-800598f7-e442-46e5-b07c-8d52be77af84 tempest-VolumeDependencyTests-442009576 None] Deleted volume successfully. Jul 31 12:37:50 devstack sudo[113377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-5e9fccdc-d42f-41c2-b0cb-37818fa463c2 Jul 31 12:37:50 devstack sudo[113377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:37:50 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-800598f7-e442-46e5-b07c-8d52be77af84 tempest-VolumeDependencyTests-442009576 None] Lock "cinder-70102b3e-c9c8-455a-8df8-bbdf3afdeaee-delete_volume" released by "delete_volume" :: held 1.549s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:37:51 devstack sudo[113374]: pam_unix(sudo:session): session closed for user root Jul 31 12:37:51 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-46392afe-4ccf-4c85-a16c-fdfe2489fbaf tempest-VolumeImageDependencyTests-1366750687 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a5b7e21f-2ffb-42f3-b82c-c200fd635a4a_pxjgftmpdevstack@QuobyteHD" returned: 0 in 0.414s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:37:51 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-46392afe-4ccf-4c85-a16c-fdfe2489fbaf tempest-VolumeImageDependencyTests-1366750687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a5b7e21f-2ffb-42f3-b82c-c200fd635a4a_pxjgftmpdevstack@QuobyteHD {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:37:51 devstack sudo[113382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a5b7e21f-2ffb-42f3-b82c-c200fd635a4a_pxjgftmpdevstack@QuobyteHD Jul 31 12:37:51 devstack sudo[113382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:37:51 devstack sudo[113377]: pam_unix(sudo:session): session closed for user root Jul 31 12:37:51 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-2a9d9db7-c999-4f8b-8bf8-a9febb163f3e tempest-CinderUnicodeTest-1855596390 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-5e9fccdc-d42f-41c2-b0cb-37818fa463c2" returned: 0 in 0.388s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:37:51 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-2a9d9db7-c999-4f8b-8bf8-a9febb163f3e tempest-CinderUnicodeTest-1855596390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-5e9fccdc-d42f-41c2-b0cb-37818fa463c2 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:37:51 devstack sudo[113387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-5e9fccdc-d42f-41c2-b0cb-37818fa463c2 Jul 31 12:37:51 devstack sudo[113387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:37:51 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-6f827f60-1a4a-4517-852c-03a201a2f0f8 tempest-SnapshotDataIntegrityTests-898447071 None] Status of snapshot 4a5c6e12-2302-44db-ab0e-eedae12ca53f is now creating {{(pid=89182) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Jul 31 12:37:51 devstack sudo[113382]: pam_unix(sudo:session): session closed for user root Jul 31 12:37:51 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-46392afe-4ccf-4c85-a16c-fdfe2489fbaf tempest-VolumeImageDependencyTests-1366750687 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a5b7e21f-2ffb-42f3-b82c-c200fd635a4a_pxjgftmpdevstack@QuobyteHD" returned: 1 in 0.345s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:37:51 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-46392afe-4ccf-4c85-a16c-fdfe2489fbaf tempest-VolumeImageDependencyTests-1366750687 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a5b7e21f-2ffb-42f3-b82c-c200fd635a4a_pxjgftmpdevstack@QuobyteHD' failed. Not Retrying. {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 31 12:37:51 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-46392afe-4ccf-4c85-a16c-fdfe2489fbaf tempest-VolumeImageDependencyTests-1366750687 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:37:51 devstack sudo[113387]: pam_unix(sudo:session): session closed for user root Jul 31 12:37:51 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-2a9d9db7-c999-4f8b-8bf8-a9febb163f3e tempest-CinderUnicodeTest-1855596390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-5e9fccdc-d42f-41c2-b0cb-37818fa463c2" returned: 0 in 0.269s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:37:51 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-2a9d9db7-c999-4f8b-8bf8-a9febb163f3e tempest-CinderUnicodeTest-1855596390 None] Lock "cinder-quobyte-5e9fccdc-d42f-41c2-b0cb-37818fa463c2" released by "delete_volume" :: held 0.720s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:37:51 devstack cinder-volume[89182]: DEBUG cinder.quota [None req-2a9d9db7-c999-4f8b-8bf8-a9febb163f3e tempest-CinderUnicodeTest-1855596390 None] Created reservations ['f287264f-4c09-423e-a653-100243c91f30', 'db12d68a-45cf-48d3-8a3c-9d0a5cc43f49', 'de17bb00-e7b1-4b09-846a-1f0fb6757706', '3fa36841-15a8-4e0d-9d5e-ead5f1700981'] {{(pid=89182) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 12:37:51 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-2a9d9db7-c999-4f8b-8bf8-a9febb163f3e tempest-CinderUnicodeTest-1855596390 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:37:51 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-2a9d9db7-c999-4f8b-8bf8-a9febb163f3e tempest-CinderUnicodeTest-1855596390 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:37:51 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-2a9d9db7-c999-4f8b-8bf8-a9febb163f3e tempest-CinderUnicodeTest-1855596390 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:37:51 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-2a9d9db7-c999-4f8b-8bf8-a9febb163f3e tempest-CinderUnicodeTest-1855596390 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:37:51 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-2a9d9db7-c999-4f8b-8bf8-a9febb163f3e tempest-CinderUnicodeTest-1855596390 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:37:51 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-2a9d9db7-c999-4f8b-8bf8-a9febb163f3e tempest-CinderUnicodeTest-1855596390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:37:51 devstack sudo[113393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 Jul 31 12:37:51 devstack sudo[113393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:37:51 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-b4e2220e-924c-41e0-81f9-c2b9647eefbe tempest-VolumeDependencyTests-442009576 None] Acquiring lock "cinder-4ce7c091-c8b0-432c-a840-fa5ce161abbf-delete_volume" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:37:51 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-b4e2220e-924c-41e0-81f9-c2b9647eefbe tempest-VolumeDependencyTests-442009576 None] Lock "cinder-4ce7c091-c8b0-432c-a840-fa5ce161abbf-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:37:51 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-b4e2220e-924c-41e0-81f9-c2b9647eefbe tempest-VolumeDependencyTests-442009576 None] Acquiring lock "cinder-quobyte-4ce7c091-c8b0-432c-a840-fa5ce161abbf" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:37:51 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-b4e2220e-924c-41e0-81f9-c2b9647eefbe tempest-VolumeDependencyTests-442009576 None] Lock "cinder-quobyte-4ce7c091-c8b0-432c-a840-fa5ce161abbf" acquired by "delete_volume" :: waited 0.017s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:37:51 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[5493f2b0-e23f-4615-834d-e5fbcc5d8041]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:37:51 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-b4e2220e-924c-41e0-81f9-c2b9647eefbe tempest-VolumeDependencyTests-442009576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-4ce7c091-c8b0-432c-a840-fa5ce161abbf {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:37:51 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-fdcbc35a-89b3-4092-aa1f-0e2e5e36d988 tempest-CinderUnicodeTest-1855596390 None] Acquiring lock "cinder-f00ccd36-d9cf-4015-82ed-6352d569b09a-delete_volume" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:37:51 devstack sudo[113393]: pam_unix(sudo:session): session closed for user root Jul 31 12:37:51 devstack sudo[113395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-4ce7c091-c8b0-432c-a840-fa5ce161abbf Jul 31 12:37:51 devstack sudo[113395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:37:51 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-2a9d9db7-c999-4f8b-8bf8-a9febb163f3e tempest-CinderUnicodeTest-1855596390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2" returned: 0 in 0.295s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:37:51 devstack cinder-volume[89182]: DEBUG cinder.manager [None req-2a9d9db7-c999-4f8b-8bf8-a9febb163f3e tempest-CinderUnicodeTest-1855596390 None] Notifying Schedulers of capabilities ... {{(pid=89182) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 12:37:51 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-2a9d9db7-c999-4f8b-8bf8-a9febb163f3e tempest-CinderUnicodeTest-1855596390 None] Deleted volume successfully. Jul 31 12:37:51 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-fdcbc35a-89b3-4092-aa1f-0e2e5e36d988 tempest-CinderUnicodeTest-1855596390 None] Lock "cinder-f00ccd36-d9cf-4015-82ed-6352d569b09a-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:37:51 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-2a9d9db7-c999-4f8b-8bf8-a9febb163f3e tempest-CinderUnicodeTest-1855596390 None] Lock "cinder-5e9fccdc-d42f-41c2-b0cb-37818fa463c2-delete_volume" released by "delete_volume" :: held 1.257s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:37:51 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-fdcbc35a-89b3-4092-aa1f-0e2e5e36d988 tempest-CinderUnicodeTest-1855596390 None] Acquiring lock "cinder-quobyte-f00ccd36-d9cf-4015-82ed-6352d569b09a" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:37:52 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-fdcbc35a-89b3-4092-aa1f-0e2e5e36d988 tempest-CinderUnicodeTest-1855596390 None] Lock "cinder-quobyte-f00ccd36-d9cf-4015-82ed-6352d569b09a" acquired by "delete_volume" :: waited 0.016s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:37:52 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[673f28b2-6557-47f0-a1de-a9dd08de0a0e]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:37:52 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-fdcbc35a-89b3-4092-aa1f-0e2e5e36d988 tempest-CinderUnicodeTest-1855596390 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-f00ccd36-d9cf-4015-82ed-6352d569b09a {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:37:52 devstack sudo[113398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-f00ccd36-d9cf-4015-82ed-6352d569b09a Jul 31 12:37:52 devstack sudo[113398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:37:52 devstack sudo[113395]: pam_unix(sudo:session): session closed for user root Jul 31 12:37:52 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-b4e2220e-924c-41e0-81f9-c2b9647eefbe tempest-VolumeDependencyTests-442009576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-4ce7c091-c8b0-432c-a840-fa5ce161abbf" returned: 0 in 0.434s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:37:52 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-b4e2220e-924c-41e0-81f9-c2b9647eefbe tempest-VolumeDependencyTests-442009576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-4ce7c091-c8b0-432c-a840-fa5ce161abbf {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:37:52 devstack sudo[113403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-4ce7c091-c8b0-432c-a840-fa5ce161abbf Jul 31 12:37:52 devstack sudo[113403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:37:52 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-6f827f60-1a4a-4517-852c-03a201a2f0f8 tempest-SnapshotDataIntegrityTests-898447071 None] Status of snapshot 4a5c6e12-2302-44db-ab0e-eedae12ca53f is now creating {{(pid=89182) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Jul 31 12:37:52 devstack sudo[113398]: pam_unix(sudo:session): session closed for user root Jul 31 12:37:52 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-fdcbc35a-89b3-4092-aa1f-0e2e5e36d988 tempest-CinderUnicodeTest-1855596390 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-f00ccd36-d9cf-4015-82ed-6352d569b09a" returned: 0 in 0.384s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:37:52 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-fdcbc35a-89b3-4092-aa1f-0e2e5e36d988 tempest-CinderUnicodeTest-1855596390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-f00ccd36-d9cf-4015-82ed-6352d569b09a {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:37:52 devstack sudo[113409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-f00ccd36-d9cf-4015-82ed-6352d569b09a Jul 31 12:37:52 devstack sudo[113409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:37:52 devstack sudo[113403]: pam_unix(sudo:session): session closed for user root Jul 31 12:37:52 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-b4e2220e-924c-41e0-81f9-c2b9647eefbe tempest-VolumeDependencyTests-442009576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-4ce7c091-c8b0-432c-a840-fa5ce161abbf" returned: 0 in 0.284s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:37:52 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-b4e2220e-924c-41e0-81f9-c2b9647eefbe tempest-VolumeDependencyTests-442009576 None] Lock "cinder-quobyte-4ce7c091-c8b0-432c-a840-fa5ce161abbf" released by "delete_volume" :: held 0.773s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:37:52 devstack cinder-volume[89182]: DEBUG cinder.quota [None req-b4e2220e-924c-41e0-81f9-c2b9647eefbe tempest-VolumeDependencyTests-442009576 None] Created reservations ['3bdc9ba1-c52d-4d0f-8102-05948fa1c703', '83173795-8a26-4de6-9eb0-bdafd8150118', '9a3f7896-1759-4e57-a505-2ae8bbeea0b9', '8749d333-0980-4849-b3da-3dfc0676e96e'] {{(pid=89182) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 12:37:52 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-b4e2220e-924c-41e0-81f9-c2b9647eefbe tempest-VolumeDependencyTests-442009576 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:37:52 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-b4e2220e-924c-41e0-81f9-c2b9647eefbe tempest-VolumeDependencyTests-442009576 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:37:52 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-b4e2220e-924c-41e0-81f9-c2b9647eefbe tempest-VolumeDependencyTests-442009576 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:37:52 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-b4e2220e-924c-41e0-81f9-c2b9647eefbe tempest-VolumeDependencyTests-442009576 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:37:52 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-b4e2220e-924c-41e0-81f9-c2b9647eefbe tempest-VolumeDependencyTests-442009576 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:37:52 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-b4e2220e-924c-41e0-81f9-c2b9647eefbe tempest-VolumeDependencyTests-442009576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:37:52 devstack sudo[113411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 Jul 31 12:37:52 devstack sudo[113411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:37:52 devstack sudo[113409]: pam_unix(sudo:session): session closed for user root Jul 31 12:37:52 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-fdcbc35a-89b3-4092-aa1f-0e2e5e36d988 tempest-CinderUnicodeTest-1855596390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-f00ccd36-d9cf-4015-82ed-6352d569b09a" returned: 0 in 0.262s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:37:52 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-fdcbc35a-89b3-4092-aa1f-0e2e5e36d988 tempest-CinderUnicodeTest-1855596390 None] Lock "cinder-quobyte-f00ccd36-d9cf-4015-82ed-6352d569b09a" released by "delete_volume" :: held 0.696s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:37:52 devstack cinder-volume[89182]: DEBUG cinder.quota [None req-fdcbc35a-89b3-4092-aa1f-0e2e5e36d988 tempest-CinderUnicodeTest-1855596390 None] Created reservations ['3da5eec0-6bd6-4eca-beda-3237b2768b95', 'f039b8fd-3bee-4f50-9a36-62bca7fb282d', '17efd837-1c4a-4039-80b6-de24efda90de', 'db9319b6-fff2-457e-af22-455fe4e13043'] {{(pid=89182) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 12:37:52 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-3e07c8f7-e4fd-4a73-a687-ef914b965165 tempest-VolumeDependencyTests-442009576 None] Acquiring lock "cinder-62e947b3-0c3c-48ec-8f5f-d92cd882e684-delete_volume" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:37:52 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-3e07c8f7-e4fd-4a73-a687-ef914b965165 tempest-VolumeDependencyTests-442009576 None] Lock "cinder-62e947b3-0c3c-48ec-8f5f-d92cd882e684-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:37:52 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-fdcbc35a-89b3-4092-aa1f-0e2e5e36d988 tempest-CinderUnicodeTest-1855596390 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:37:52 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-fdcbc35a-89b3-4092-aa1f-0e2e5e36d988 tempest-CinderUnicodeTest-1855596390 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:37:52 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-fdcbc35a-89b3-4092-aa1f-0e2e5e36d988 tempest-CinderUnicodeTest-1855596390 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:37:52 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-fdcbc35a-89b3-4092-aa1f-0e2e5e36d988 tempest-CinderUnicodeTest-1855596390 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:37:52 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-fdcbc35a-89b3-4092-aa1f-0e2e5e36d988 tempest-CinderUnicodeTest-1855596390 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:37:52 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-fdcbc35a-89b3-4092-aa1f-0e2e5e36d988 tempest-CinderUnicodeTest-1855596390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:37:52 devstack sudo[113414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 Jul 31 12:37:52 devstack sudo[113414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:37:52 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-3e07c8f7-e4fd-4a73-a687-ef914b965165 tempest-VolumeDependencyTests-442009576 None] Acquiring lock "cinder-quobyte-62e947b3-0c3c-48ec-8f5f-d92cd882e684" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:37:52 devstack sudo[113411]: pam_unix(sudo:session): session closed for user root Jul 31 12:37:52 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-b4e2220e-924c-41e0-81f9-c2b9647eefbe tempest-VolumeDependencyTests-442009576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2" returned: 0 in 0.324s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:37:52 devstack cinder-volume[89182]: DEBUG cinder.manager [None req-b4e2220e-924c-41e0-81f9-c2b9647eefbe tempest-VolumeDependencyTests-442009576 None] Notifying Schedulers of capabilities ... {{(pid=89182) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 12:37:52 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-3e07c8f7-e4fd-4a73-a687-ef914b965165 tempest-VolumeDependencyTests-442009576 None] Lock "cinder-quobyte-62e947b3-0c3c-48ec-8f5f-d92cd882e684" acquired by "delete_volume" :: waited 0.031s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:37:52 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-b4e2220e-924c-41e0-81f9-c2b9647eefbe tempest-VolumeDependencyTests-442009576 None] Deleted volume successfully. Jul 31 12:37:52 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[25c80b8d-5728-41bb-a366-d0e8e2093000]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:37:53 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-3e07c8f7-e4fd-4a73-a687-ef914b965165 tempest-VolumeDependencyTests-442009576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-62e947b3-0c3c-48ec-8f5f-d92cd882e684 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:37:53 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-b4e2220e-924c-41e0-81f9-c2b9647eefbe tempest-VolumeDependencyTests-442009576 None] Lock "cinder-4ce7c091-c8b0-432c-a840-fa5ce161abbf-delete_volume" released by "delete_volume" :: held 1.358s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:37:53 devstack sudo[113414]: pam_unix(sudo:session): session closed for user root Jul 31 12:37:53 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-fdcbc35a-89b3-4092-aa1f-0e2e5e36d988 tempest-CinderUnicodeTest-1855596390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2" returned: 0 in 0.287s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:37:53 devstack cinder-volume[89182]: DEBUG cinder.manager [None req-fdcbc35a-89b3-4092-aa1f-0e2e5e36d988 tempest-CinderUnicodeTest-1855596390 None] Notifying Schedulers of capabilities ... {{(pid=89182) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 12:37:53 devstack sudo[113417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-62e947b3-0c3c-48ec-8f5f-d92cd882e684 Jul 31 12:37:53 devstack sudo[113417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:37:53 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-fdcbc35a-89b3-4092-aa1f-0e2e5e36d988 tempest-CinderUnicodeTest-1855596390 None] Deleted volume successfully. Jul 31 12:37:53 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-fdcbc35a-89b3-4092-aa1f-0e2e5e36d988 tempest-CinderUnicodeTest-1855596390 None] Lock "cinder-f00ccd36-d9cf-4015-82ed-6352d569b09a-delete_volume" released by "delete_volume" :: held 1.270s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:37:53 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-6f827f60-1a4a-4517-852c-03a201a2f0f8 tempest-SnapshotDataIntegrityTests-898447071 None] Status of snapshot 4a5c6e12-2302-44db-ab0e-eedae12ca53f is now creating {{(pid=89182) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Jul 31 12:37:53 devstack sudo[113417]: pam_unix(sudo:session): session closed for user root Jul 31 12:37:53 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-3e07c8f7-e4fd-4a73-a687-ef914b965165 tempest-VolumeDependencyTests-442009576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-62e947b3-0c3c-48ec-8f5f-d92cd882e684" returned: 0 in 0.425s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:37:53 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-3e07c8f7-e4fd-4a73-a687-ef914b965165 tempest-VolumeDependencyTests-442009576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-62e947b3-0c3c-48ec-8f5f-d92cd882e684 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:37:53 devstack sudo[113423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-62e947b3-0c3c-48ec-8f5f-d92cd882e684 Jul 31 12:37:53 devstack sudo[113423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:37:53 devstack sudo[113423]: pam_unix(sudo:session): session closed for user root Jul 31 12:37:53 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-3e07c8f7-e4fd-4a73-a687-ef914b965165 tempest-VolumeDependencyTests-442009576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-62e947b3-0c3c-48ec-8f5f-d92cd882e684" returned: 0 in 0.250s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:37:53 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-3e07c8f7-e4fd-4a73-a687-ef914b965165 tempest-VolumeDependencyTests-442009576 None] Lock "cinder-quobyte-62e947b3-0c3c-48ec-8f5f-d92cd882e684" released by "delete_volume" :: held 0.729s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:37:53 devstack cinder-volume[89182]: DEBUG cinder.quota [None req-3e07c8f7-e4fd-4a73-a687-ef914b965165 tempest-VolumeDependencyTests-442009576 None] Created reservations ['93cceeef-2a48-4bfb-a783-1ddf804b784b', '60a48c77-c466-4f1f-a535-094833a6f46d', '39be0dc6-8b82-4bb8-a30a-423e1710c9b6', 'e2c6bc23-300e-4346-a859-232315b260c2'] {{(pid=89182) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 12:37:53 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-3e07c8f7-e4fd-4a73-a687-ef914b965165 tempest-VolumeDependencyTests-442009576 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:37:53 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-3e07c8f7-e4fd-4a73-a687-ef914b965165 tempest-VolumeDependencyTests-442009576 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:37:53 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-3e07c8f7-e4fd-4a73-a687-ef914b965165 tempest-VolumeDependencyTests-442009576 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:37:53 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-3e07c8f7-e4fd-4a73-a687-ef914b965165 tempest-VolumeDependencyTests-442009576 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:37:53 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-3e07c8f7-e4fd-4a73-a687-ef914b965165 tempest-VolumeDependencyTests-442009576 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:37:53 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-3e07c8f7-e4fd-4a73-a687-ef914b965165 tempest-VolumeDependencyTests-442009576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:37:53 devstack sudo[113426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 Jul 31 12:37:53 devstack sudo[113426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:37:54 devstack sudo[113426]: pam_unix(sudo:session): session closed for user root Jul 31 12:37:54 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-3e07c8f7-e4fd-4a73-a687-ef914b965165 tempest-VolumeDependencyTests-442009576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2" returned: 0 in 0.302s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:37:54 devstack cinder-volume[89182]: DEBUG cinder.manager [None req-3e07c8f7-e4fd-4a73-a687-ef914b965165 tempest-VolumeDependencyTests-442009576 None] Notifying Schedulers of capabilities ... {{(pid=89182) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 12:37:54 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-3e07c8f7-e4fd-4a73-a687-ef914b965165 tempest-VolumeDependencyTests-442009576 None] Deleted volume successfully. Jul 31 12:37:54 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-3e07c8f7-e4fd-4a73-a687-ef914b965165 tempest-VolumeDependencyTests-442009576 None] Lock "cinder-62e947b3-0c3c-48ec-8f5f-d92cd882e684-delete_volume" released by "delete_volume" :: held 1.331s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:37:54 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-6f827f60-1a4a-4517-852c-03a201a2f0f8 tempest-SnapshotDataIntegrityTests-898447071 None] Status of snapshot 4a5c6e12-2302-44db-ab0e-eedae12ca53f is now creating {{(pid=89182) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Jul 31 12:37:54 devstack cinder-volume[89182]: DEBUG cinder.volume.flows.manager.create_volume [None req-f7fd0472-8c22-42f3-9c34-eeca648935e2 tempest-VolumeDependencyTests-442009576 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89182) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 12:37:54 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-f7fd0472-8c22-42f3-9c34-eeca648935e2 tempest-VolumeDependencyTests-442009576 None] Flow 'volume_create_manager' (301fd9ab-138b-478e-b5ff-6221e007e7cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:37:54 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-f7fd0472-8c22-42f3-9c34-eeca648935e2 tempest-VolumeDependencyTests-442009576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7bbd78b5-56e0-4841-a605-601fb951970d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:37:54 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-f7fd0472-8c22-42f3-9c34-eeca648935e2 tempest-VolumeDependencyTests-442009576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7bbd78b5-56e0-4841-a605-601fb951970d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:37:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1717317213',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45b0745c-de5b-49ba-afd5-559c565cbf66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c622d586c4c9404ead8c06d764810df1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:37:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:37:55Z,use_quota=True,user_id='cfc528fe8ec2487bb4171d283c222b1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:37:54 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-f7fd0472-8c22-42f3-9c34-eeca648935e2 tempest-VolumeDependencyTests-442009576 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f350900-3ce4-4195-b3d7-a44a57fb7350) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:37:54 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-f7fd0472-8c22-42f3-9c34-eeca648935e2 tempest-VolumeDependencyTests-442009576 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f350900-3ce4-4195-b3d7-a44a57fb7350) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:37:54 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-f7fd0472-8c22-42f3-9c34-eeca648935e2 tempest-VolumeDependencyTests-442009576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b1feb55-dbfc-4ae5-9754-b9c01a9e8a6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:37:54 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-f7fd0472-8c22-42f3-9c34-eeca648935e2 tempest-VolumeDependencyTests-442009576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b1feb55-dbfc-4ae5-9754-b9c01a9e8a6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '45b0745c-de5b-49ba-afd5-559c565cbf66', 'volume_name': 'volume-45b0745c-de5b-49ba-afd5-559c565cbf66', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:37:54 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-f7fd0472-8c22-42f3-9c34-eeca648935e2 tempest-VolumeDependencyTests-442009576 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8f9a1c3-44c2-401b-9c56-617f8942a28a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:37:54 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-f7fd0472-8c22-42f3-9c34-eeca648935e2 tempest-VolumeDependencyTests-442009576 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8f9a1c3-44c2-401b-9c56-617f8942a28a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:37:54 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-f7fd0472-8c22-42f3-9c34-eeca648935e2 tempest-VolumeDependencyTests-442009576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07495bbd-7525-4209-91f4-e2f5df1b0b5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:37:54 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-f7fd0472-8c22-42f3-9c34-eeca648935e2 tempest-VolumeDependencyTests-442009576 None] Volume 45b0745c-de5b-49ba-afd5-559c565cbf66: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-45b0745c-de5b-49ba-afd5-559c565cbf66', 'volume_size': 1} Jul 31 12:37:54 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-f7fd0472-8c22-42f3-9c34-eeca648935e2 tempest-VolumeDependencyTests-442009576 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:37:55 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-6f827f60-1a4a-4517-852c-03a201a2f0f8 tempest-SnapshotDataIntegrityTests-898447071 None] Status of snapshot 4a5c6e12-2302-44db-ab0e-eedae12ca53f is now creating {{(pid=89182) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Jul 31 12:37:56 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-6f827f60-1a4a-4517-852c-03a201a2f0f8 tempest-SnapshotDataIntegrityTests-898447071 None] Status of snapshot 4a5c6e12-2302-44db-ab0e-eedae12ca53f is now creating {{(pid=89182) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Jul 31 12:37:57 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-6f827f60-1a4a-4517-852c-03a201a2f0f8 tempest-SnapshotDataIntegrityTests-898447071 None] Status of snapshot 4a5c6e12-2302-44db-ab0e-eedae12ca53f is now creating {{(pid=89182) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Jul 31 12:37:58 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-6f827f60-1a4a-4517-852c-03a201a2f0f8 tempest-SnapshotDataIntegrityTests-898447071 None] Status of snapshot 4a5c6e12-2302-44db-ab0e-eedae12ca53f is now creating {{(pid=89182) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Jul 31 12:37:59 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-6f827f60-1a4a-4517-852c-03a201a2f0f8 tempest-SnapshotDataIntegrityTests-898447071 None] Status of snapshot 4a5c6e12-2302-44db-ab0e-eedae12ca53f is now creating {{(pid=89182) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Jul 31 12:38:00 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-6f827f60-1a4a-4517-852c-03a201a2f0f8 tempest-SnapshotDataIntegrityTests-898447071 None] Status of snapshot 4a5c6e12-2302-44db-ab0e-eedae12ca53f is now creating {{(pid=89182) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Jul 31 12:38:01 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-6f827f60-1a4a-4517-852c-03a201a2f0f8 tempest-SnapshotDataIntegrityTests-898447071 None] Status of snapshot 4a5c6e12-2302-44db-ab0e-eedae12ca53f is now creating {{(pid=89182) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Jul 31 12:38:03 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-6f827f60-1a4a-4517-852c-03a201a2f0f8 tempest-SnapshotDataIntegrityTests-898447071 None] Status of snapshot 4a5c6e12-2302-44db-ab0e-eedae12ca53f is now creating {{(pid=89182) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Jul 31 12:38:05 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-6f827f60-1a4a-4517-852c-03a201a2f0f8 tempest-SnapshotDataIntegrityTests-898447071 None] Status of snapshot 4a5c6e12-2302-44db-ab0e-eedae12ca53f is now creating {{(pid=89182) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Jul 31 12:38:07 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-6f827f60-1a4a-4517-852c-03a201a2f0f8 tempest-SnapshotDataIntegrityTests-898447071 None] Status of snapshot 4a5c6e12-2302-44db-ab0e-eedae12ca53f is now creating {{(pid=89182) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Jul 31 12:38:07 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-6f827f60-1a4a-4517-852c-03a201a2f0f8 tempest-SnapshotDataIntegrityTests-898447071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e6acfb11-941d-450b-8d93-0e32240df94a.info {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:38:07 devstack sudo[113460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e6acfb11-941d-450b-8d93-0e32240df94a.info Jul 31 12:38:07 devstack sudo[113460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:38:07 devstack sudo[113460]: pam_unix(sudo:session): session closed for user root Jul 31 12:38:07 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-6f827f60-1a4a-4517-852c-03a201a2f0f8 tempest-SnapshotDataIntegrityTests-898447071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e6acfb11-941d-450b-8d93-0e32240df94a.info" returned: 0 in 0.265s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:38:07 devstack cinder-volume[89182]: WARNING cinder.volume.drivers.remotefs [None req-6f827f60-1a4a-4517-852c-03a201a2f0f8 tempest-SnapshotDataIntegrityTests-898447071 None] /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e6acfb11-941d-450b-8d93-0e32240df94a.info is being set with open permissions: ugo+rw Jul 31 12:38:07 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-6f827f60-1a4a-4517-852c-03a201a2f0f8 tempest-SnapshotDataIntegrityTests-898447071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e6acfb11-941d-450b-8d93-0e32240df94a.info {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:38:07 devstack sudo[113463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e6acfb11-941d-450b-8d93-0e32240df94a.info Jul 31 12:38:07 devstack sudo[113463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:38:08 devstack sudo[113463]: pam_unix(sudo:session): session closed for user root Jul 31 12:38:08 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-6f827f60-1a4a-4517-852c-03a201a2f0f8 tempest-SnapshotDataIntegrityTests-898447071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e6acfb11-941d-450b-8d93-0e32240df94a.info" returned: 0 in 0.255s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:38:08 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-6f827f60-1a4a-4517-852c-03a201a2f0f8 tempest-SnapshotDataIntegrityTests-898447071 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 19.972s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:38:08 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-46392afe-4ccf-4c85-a16c-fdfe2489fbaf tempest-VolumeImageDependencyTests-1366750687 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 16.665s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:38:08 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-46392afe-4ccf-4c85-a16c-fdfe2489fbaf tempest-VolumeImageDependencyTests-1366750687 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:37:49Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test0e20bd6e-440f-41d8-9b5d-fc047ac00423',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b1ce179-4800-405a-a0dd-40b9d0c101be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d0755f1e2ea4124a760580edccedbe3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:37:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:37:49Z,use_quota=True,user_id='b44e6e9d7b9542c6aea2ca270c251a89',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)}" {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 12:38:08 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-46392afe-4ccf-4c85-a16c-fdfe2489fbaf tempest-VolumeImageDependencyTests-1366750687 None] Creating volume 0b1ce179-4800-405a-a0dd-40b9d0c101be {{(pid=89182) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 12:38:08 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-46392afe-4ccf-4c85-a16c-fdfe2489fbaf tempest-VolumeImageDependencyTests-1366750687 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:38:08 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-46392afe-4ccf-4c85-a16c-fdfe2489fbaf tempest-VolumeImageDependencyTests-1366750687 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:38:08 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-46392afe-4ccf-4c85-a16c-fdfe2489fbaf tempest-VolumeImageDependencyTests-1366750687 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:38:08 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-46392afe-4ccf-4c85-a16c-fdfe2489fbaf tempest-VolumeImageDependencyTests-1366750687 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:38:08 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-46392afe-4ccf-4c85-a16c-fdfe2489fbaf tempest-VolumeImageDependencyTests-1366750687 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:38:08 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-46392afe-4ccf-4c85-a16c-fdfe2489fbaf tempest-VolumeImageDependencyTests-1366750687 None] Selected osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 as target Quobyte volume. {{(pid=89182) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 12:38:08 devstack cinder-volume[89182]: INFO cinder.volume.drivers.remotefs [None req-46392afe-4ccf-4c85-a16c-fdfe2489fbaf tempest-VolumeImageDependencyTests-1366750687 None] casted to osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 Jul 31 12:38:08 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-46392afe-4ccf-4c85-a16c-fdfe2489fbaf tempest-VolumeImageDependencyTests-1366750687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0b1ce179-4800-405a-a0dd-40b9d0c101be 1073741824 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:38:08 devstack sudo[113466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0b1ce179-4800-405a-a0dd-40b9d0c101be 1073741824 Jul 31 12:38:08 devstack sudo[113466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:38:08 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-6f827f60-1a4a-4517-852c-03a201a2f0f8 tempest-SnapshotDataIntegrityTests-898447071 None] Create snapshot completed successfully Jul 31 12:38:08 devstack sudo[113466]: pam_unix(sudo:session): session closed for user root Jul 31 12:38:08 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-46392afe-4ccf-4c85-a16c-fdfe2489fbaf tempest-VolumeImageDependencyTests-1366750687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0b1ce179-4800-405a-a0dd-40b9d0c101be 1073741824" returned: 0 in 0.486s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:38:08 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-46392afe-4ccf-4c85-a16c-fdfe2489fbaf tempest-VolumeImageDependencyTests-1366750687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0b1ce179-4800-405a-a0dd-40b9d0c101be {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:38:08 devstack sudo[113472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0b1ce179-4800-405a-a0dd-40b9d0c101be Jul 31 12:38:08 devstack sudo[113472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:38:08 devstack sudo[113472]: pam_unix(sudo:session): session closed for user root Jul 31 12:38:08 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-46392afe-4ccf-4c85-a16c-fdfe2489fbaf tempest-VolumeImageDependencyTests-1366750687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0b1ce179-4800-405a-a0dd-40b9d0c101be" returned: 0 in 0.279s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:38:08 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-46392afe-4ccf-4c85-a16c-fdfe2489fbaf tempest-VolumeImageDependencyTests-1366750687 None] <== create_volume: return (813ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'} {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 12:38:08 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-46392afe-4ccf-4c85-a16c-fdfe2489fbaf tempest-VolumeImageDependencyTests-1366750687 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.817s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:38:08 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-f7fd0472-8c22-42f3-9c34-eeca648935e2 tempest-VolumeDependencyTests-442009576 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 14.159s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:38:08 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-f7fd0472-8c22-42f3-9c34-eeca648935e2 tempest-VolumeDependencyTests-442009576 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:37:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1717317213',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45b0745c-de5b-49ba-afd5-559c565cbf66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c622d586c4c9404ead8c06d764810df1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:37:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:37:55Z,use_quota=True,user_id='cfc528fe8ec2487bb4171d283c222b1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)}" {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 12:38:08 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-f7fd0472-8c22-42f3-9c34-eeca648935e2 tempest-VolumeDependencyTests-442009576 None] Creating volume 45b0745c-de5b-49ba-afd5-559c565cbf66 {{(pid=89182) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 12:38:08 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-f7fd0472-8c22-42f3-9c34-eeca648935e2 tempest-VolumeDependencyTests-442009576 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:38:08 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-f7fd0472-8c22-42f3-9c34-eeca648935e2 tempest-VolumeDependencyTests-442009576 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:38:08 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-f7fd0472-8c22-42f3-9c34-eeca648935e2 tempest-VolumeDependencyTests-442009576 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:38:08 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-f7fd0472-8c22-42f3-9c34-eeca648935e2 tempest-VolumeDependencyTests-442009576 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:38:08 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-f7fd0472-8c22-42f3-9c34-eeca648935e2 tempest-VolumeDependencyTests-442009576 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:38:08 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-f7fd0472-8c22-42f3-9c34-eeca648935e2 tempest-VolumeDependencyTests-442009576 None] Selected osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 as target Quobyte volume. {{(pid=89182) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 12:38:08 devstack cinder-volume[89182]: INFO cinder.volume.drivers.remotefs [None req-f7fd0472-8c22-42f3-9c34-eeca648935e2 tempest-VolumeDependencyTests-442009576 None] casted to osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 Jul 31 12:38:08 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-f7fd0472-8c22-42f3-9c34-eeca648935e2 tempest-VolumeDependencyTests-442009576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-45b0745c-de5b-49ba-afd5-559c565cbf66 1073741824 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:38:08 devstack sudo[113479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-45b0745c-de5b-49ba-afd5-559c565cbf66 1073741824 Jul 31 12:38:08 devstack sudo[113479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:38:08 devstack cinder-volume[89182]: DEBUG cinder.volume.volume_utils [None req-46392afe-4ccf-4c85-a16c-fdfe2489fbaf tempest-VolumeImageDependencyTests-1366750687 None] Attempting download of a5b7e21f-2ffb-42f3-b82c-c200fd635a4a ((None, [{'url': 'file:///opt/stack/data/glance/images/a5b7e21f-2ffb-42f3-b82c-c200fd635a4a', 'metadata': {}}])) to volume 0b1ce179-4800-405a-a0dd-40b9d0c101be. {{(pid=89182) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 31 12:38:08 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[8400ebf9-d181-4ea4-937f-3ad4cdbba399]: (4, 'raw') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:38:08 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-46392afe-4ccf-4c85-a16c-fdfe2489fbaf tempest-VolumeImageDependencyTests-1366750687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a5b7e21f-2ffb-42f3-b82c-c200fd635a4a_6gvf43pp {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:38:09 devstack sudo[113481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a5b7e21f-2ffb-42f3-b82c-c200fd635a4a_6gvf43pp Jul 31 12:38:09 devstack sudo[113481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:38:09 devstack sudo[113479]: pam_unix(sudo:session): session closed for user root Jul 31 12:38:09 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-f7fd0472-8c22-42f3-9c34-eeca648935e2 tempest-VolumeDependencyTests-442009576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-45b0745c-de5b-49ba-afd5-559c565cbf66 1073741824" returned: 0 in 0.542s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:38:09 devstack sudo[113481]: pam_unix(sudo:session): session closed for user root Jul 31 12:38:09 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-f7fd0472-8c22-42f3-9c34-eeca648935e2 tempest-VolumeDependencyTests-442009576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-45b0745c-de5b-49ba-afd5-559c565cbf66 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:38:09 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-46392afe-4ccf-4c85-a16c-fdfe2489fbaf tempest-VolumeImageDependencyTests-1366750687 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a5b7e21f-2ffb-42f3-b82c-c200fd635a4a_6gvf43pp" returned: 0 in 0.503s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:38:09 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-46392afe-4ccf-4c85-a16c-fdfe2489fbaf tempest-VolumeImageDependencyTests-1366750687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a5b7e21f-2ffb-42f3-b82c-c200fd635a4a_6gvf43pp {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:38:09 devstack sudo[113495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-45b0745c-de5b-49ba-afd5-559c565cbf66 Jul 31 12:38:09 devstack sudo[113495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:38:09 devstack sudo[113496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a5b7e21f-2ffb-42f3-b82c-c200fd635a4a_6gvf43pp Jul 31 12:38:09 devstack sudo[113496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:38:09 devstack sudo[113495]: pam_unix(sudo:session): session closed for user root Jul 31 12:38:09 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-f7fd0472-8c22-42f3-9c34-eeca648935e2 tempest-VolumeDependencyTests-442009576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-45b0745c-de5b-49ba-afd5-559c565cbf66" returned: 0 in 0.294s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:38:09 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-f7fd0472-8c22-42f3-9c34-eeca648935e2 tempest-VolumeDependencyTests-442009576 None] <== create_volume: return (893ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'} {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 12:38:09 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-f7fd0472-8c22-42f3-9c34-eeca648935e2 tempest-VolumeDependencyTests-442009576 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.897s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:38:09 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-f7fd0472-8c22-42f3-9c34-eeca648935e2 tempest-VolumeDependencyTests-442009576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07495bbd-7525-4209-91f4-e2f5df1b0b5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-45b0745c-de5b-49ba-afd5-559c565cbf66', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:38:09 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-f7fd0472-8c22-42f3-9c34-eeca648935e2 tempest-VolumeDependencyTests-442009576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e655374-b433-40fa-ad15-948b055e5f36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:38:09 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-f7fd0472-8c22-42f3-9c34-eeca648935e2 tempest-VolumeDependencyTests-442009576 None] Volume volume-45b0745c-de5b-49ba-afd5-559c565cbf66 (45b0745c-de5b-49ba-afd5-559c565cbf66): created successfully Jul 31 12:38:09 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-f7fd0472-8c22-42f3-9c34-eeca648935e2 tempest-VolumeDependencyTests-442009576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e655374-b433-40fa-ad15-948b055e5f36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:38:09 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-f7fd0472-8c22-42f3-9c34-eeca648935e2 tempest-VolumeDependencyTests-442009576 None] Flow 'volume_create_manager' (301fd9ab-138b-478e-b5ff-6221e007e7cd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:38:09 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-f7fd0472-8c22-42f3-9c34-eeca648935e2 tempest-VolumeDependencyTests-442009576 None] Created volume successfully. Jul 31 12:38:09 devstack sudo[113496]: pam_unix(sudo:session): session closed for user root Jul 31 12:38:09 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-46392afe-4ccf-4c85-a16c-fdfe2489fbaf tempest-VolumeImageDependencyTests-1366750687 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a5b7e21f-2ffb-42f3-b82c-c200fd635a4a_6gvf43pp" returned: 1 in 0.466s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:38:09 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-46392afe-4ccf-4c85-a16c-fdfe2489fbaf tempest-VolumeImageDependencyTests-1366750687 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a5b7e21f-2ffb-42f3-b82c-c200fd635a4a_6gvf43pp' failed. Not Retrying. {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 31 12:38:09 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[33d8e812-fd71-4832-a363-79113fb7d6af]: (4, 'raw') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:38:09 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-46392afe-4ccf-4c85-a16c-fdfe2489fbaf tempest-VolumeImageDependencyTests-1366750687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a5b7e21f-2ffb-42f3-b82c-c200fd635a4a_pxjgftmpdevstack@QuobyteHD {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:38:09 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-2e273dd5-85c5-406c-8ee9-a844f4732afd tempest-SnapshotDataIntegrityTests-898447071 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:38:09 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-2e273dd5-85c5-406c-8ee9-a844f4732afd tempest-SnapshotDataIntegrityTests-898447071 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:38:09 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-2e273dd5-85c5-406c-8ee9-a844f4732afd tempest-SnapshotDataIntegrityTests-898447071 None] Creating online snapshot 629af985-2bb6-4b68-b00b-b49a9e715090 of volume e6acfb11-941d-450b-8d93-0e32240df94a {{(pid=89182) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 31 12:38:10 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[0afbaae1-d7e6-4275-b768-f8f5b06f600b]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:38:10 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-2e273dd5-85c5-406c-8ee9-a844f4732afd tempest-SnapshotDataIntegrityTests-898447071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e6acfb11-941d-450b-8d93-0e32240df94a.4a5c6e12-2302-44db-ab0e-eedae12ca53f {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:38:10 devstack sudo[113502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a5b7e21f-2ffb-42f3-b82c-c200fd635a4a_pxjgftmpdevstack@QuobyteHD Jul 31 12:38:10 devstack sudo[113502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:38:10 devstack sudo[113503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e6acfb11-941d-450b-8d93-0e32240df94a.4a5c6e12-2302-44db-ab0e-eedae12ca53f Jul 31 12:38:10 devstack sudo[113503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:38:10 devstack sudo[113502]: pam_unix(sudo:session): session closed for user root Jul 31 12:38:10 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-46392afe-4ccf-4c85-a16c-fdfe2489fbaf tempest-VolumeImageDependencyTests-1366750687 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a5b7e21f-2ffb-42f3-b82c-c200fd635a4a_pxjgftmpdevstack@QuobyteHD" returned: 0 in 0.372s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:38:10 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-46392afe-4ccf-4c85-a16c-fdfe2489fbaf tempest-VolumeImageDependencyTests-1366750687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a5b7e21f-2ffb-42f3-b82c-c200fd635a4a_pxjgftmpdevstack@QuobyteHD {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:38:10 devstack sudo[113508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a5b7e21f-2ffb-42f3-b82c-c200fd635a4a_pxjgftmpdevstack@QuobyteHD Jul 31 12:38:10 devstack sudo[113508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:38:10 devstack sudo[113503]: pam_unix(sudo:session): session closed for user root Jul 31 12:38:10 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-2e273dd5-85c5-406c-8ee9-a844f4732afd tempest-SnapshotDataIntegrityTests-898447071 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e6acfb11-941d-450b-8d93-0e32240df94a.4a5c6e12-2302-44db-ab0e-eedae12ca53f" returned: 0 in 0.489s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:38:10 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-2e273dd5-85c5-406c-8ee9-a844f4732afd tempest-SnapshotDataIntegrityTests-898447071 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e6acfb11-941d-450b-8d93-0e32240df94a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89182) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 12:38:10 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-2e273dd5-85c5-406c-8ee9-a844f4732afd tempest-SnapshotDataIntegrityTests-898447071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e6acfb11-941d-450b-8d93-0e32240df94a.4a5c6e12-2302-44db-ab0e-eedae12ca53f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e6acfb11-941d-450b-8d93-0e32240df94a.629af985-2bb6-4b68-b00b-b49a9e715090 1G {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:38:10 devstack sudo[113514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e6acfb11-941d-450b-8d93-0e32240df94a.4a5c6e12-2302-44db-ab0e-eedae12ca53f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e6acfb11-941d-450b-8d93-0e32240df94a.629af985-2bb6-4b68-b00b-b49a9e715090 1G Jul 31 12:38:10 devstack sudo[113514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:38:10 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-70319a08-0879-4dff-815d-98b09d474fe9 tempest-VolumeDependencyTests-442009576 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:38:10 devstack sudo[113508]: pam_unix(sudo:session): session closed for user root Jul 31 12:38:10 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-46392afe-4ccf-4c85-a16c-fdfe2489fbaf tempest-VolumeImageDependencyTests-1366750687 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a5b7e21f-2ffb-42f3-b82c-c200fd635a4a_pxjgftmpdevstack@QuobyteHD" returned: 1 in 0.394s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:38:10 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-46392afe-4ccf-4c85-a16c-fdfe2489fbaf tempest-VolumeImageDependencyTests-1366750687 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a5b7e21f-2ffb-42f3-b82c-c200fd635a4a_pxjgftmpdevstack@QuobyteHD' failed. Not Retrying. {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 31 12:38:10 devstack cinder-volume[89182]: DEBUG cinder.image.image_utils [None req-46392afe-4ccf-4c85-a16c-fdfe2489fbaf tempest-VolumeImageDependencyTests-1366750687 None] a5b7e21f-2ffb-42f3-b82c-c200fd635a4a was raw, converting to qcow2 {{(pid=89182) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 31 12:38:10 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-46392afe-4ccf-4c85-a16c-fdfe2489fbaf tempest-VolumeImageDependencyTests-1366750687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_a5b7e21f-2ffb-42f3-b82c-c200fd635a4a_pxjgftmpdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0b1ce179-4800-405a-a0dd-40b9d0c101be {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:38:10 devstack sudo[113519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_a5b7e21f-2ffb-42f3-b82c-c200fd635a4a_pxjgftmpdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0b1ce179-4800-405a-a0dd-40b9d0c101be Jul 31 12:38:10 devstack sudo[113519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:38:11 devstack sudo[113514]: pam_unix(sudo:session): session closed for user root Jul 31 12:38:11 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-2e273dd5-85c5-406c-8ee9-a844f4732afd tempest-SnapshotDataIntegrityTests-898447071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e6acfb11-941d-450b-8d93-0e32240df94a.4a5c6e12-2302-44db-ab0e-eedae12ca53f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e6acfb11-941d-450b-8d93-0e32240df94a.629af985-2bb6-4b68-b00b-b49a9e715090 1G" returned: 0 in 0.511s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:38:11 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-2e273dd5-85c5-406c-8ee9-a844f4732afd tempest-SnapshotDataIntegrityTests-898447071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e6acfb11-941d-450b-8d93-0e32240df94a.4a5c6e12-2302-44db-ab0e-eedae12ca53f -F qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e6acfb11-941d-450b-8d93-0e32240df94a.629af985-2bb6-4b68-b00b-b49a9e715090 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:38:11 devstack sudo[113528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e6acfb11-941d-450b-8d93-0e32240df94a.4a5c6e12-2302-44db-ab0e-eedae12ca53f -F qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e6acfb11-941d-450b-8d93-0e32240df94a.629af985-2bb6-4b68-b00b-b49a9e715090 Jul 31 12:38:11 devstack sudo[113528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:38:11 devstack sudo[113519]: pam_unix(sudo:session): session closed for user root Jul 31 12:38:11 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-46392afe-4ccf-4c85-a16c-fdfe2489fbaf tempest-VolumeImageDependencyTests-1366750687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_a5b7e21f-2ffb-42f3-b82c-c200fd635a4a_pxjgftmpdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0b1ce179-4800-405a-a0dd-40b9d0c101be" returned: 0 in 0.579s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:38:11 devstack cinder-volume[89182]: DEBUG cinder.image.image_utils [None req-46392afe-4ccf-4c85-a16c-fdfe2489fbaf tempest-VolumeImageDependencyTests-1366750687 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_a5b7e21f-2ffb-42f3-b82c-c200fd635a4a_pxjgftmpdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0b1ce179-4800-405a-a0dd-40b9d0c101be {{(pid=89182) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 31 12:38:11 devstack cinder-volume[89182]: INFO cinder.image.image_utils [None req-46392afe-4ccf-4c85-a16c-fdfe2489fbaf tempest-VolumeImageDependencyTests-1366750687 None] Converted 0.00 MB image at 0.00 MB/s Jul 31 12:38:11 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-46392afe-4ccf-4c85-a16c-fdfe2489fbaf tempest-VolumeImageDependencyTests-1366750687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0b1ce179-4800-405a-a0dd-40b9d0c101be 1G {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:38:11 devstack sudo[113531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0b1ce179-4800-405a-a0dd-40b9d0c101be 1G Jul 31 12:38:11 devstack sudo[113531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:38:11 devstack sudo[113528]: pam_unix(sudo:session): session closed for user root Jul 31 12:38:11 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-2e273dd5-85c5-406c-8ee9-a844f4732afd tempest-SnapshotDataIntegrityTests-898447071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e6acfb11-941d-450b-8d93-0e32240df94a.4a5c6e12-2302-44db-ab0e-eedae12ca53f -F qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e6acfb11-941d-450b-8d93-0e32240df94a.629af985-2bb6-4b68-b00b-b49a9e715090" returned: 0 in 0.357s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:38:11 devstack cinder-volume[89182]: WARNING cinder.volume.drivers.remotefs [None req-2e273dd5-85c5-406c-8ee9-a844f4732afd tempest-SnapshotDataIntegrityTests-898447071 None] /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e6acfb11-941d-450b-8d93-0e32240df94a.629af985-2bb6-4b68-b00b-b49a9e715090 is being set with open permissions: ugo+rw Jul 31 12:38:11 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-2e273dd5-85c5-406c-8ee9-a844f4732afd tempest-SnapshotDataIntegrityTests-898447071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e6acfb11-941d-450b-8d93-0e32240df94a.629af985-2bb6-4b68-b00b-b49a9e715090 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:38:11 devstack sudo[113536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e6acfb11-941d-450b-8d93-0e32240df94a.629af985-2bb6-4b68-b00b-b49a9e715090 Jul 31 12:38:11 devstack sudo[113536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:38:11 devstack sudo[113531]: pam_unix(sudo:session): session closed for user root Jul 31 12:38:11 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-46392afe-4ccf-4c85-a16c-fdfe2489fbaf tempest-VolumeImageDependencyTests-1366750687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0b1ce179-4800-405a-a0dd-40b9d0c101be 1G" returned: 0 in 0.374s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:38:11 devstack cinder-volume[89182]: DEBUG cinder.volume.volume_utils [None req-46392afe-4ccf-4c85-a16c-fdfe2489fbaf tempest-VolumeImageDependencyTests-1366750687 None] Downloaded image a5b7e21f-2ffb-42f3-b82c-c200fd635a4a ((None, [{'url': 'file:///opt/stack/data/glance/images/a5b7e21f-2ffb-42f3-b82c-c200fd635a4a', 'metadata': {}}])) to volume 0b1ce179-4800-405a-a0dd-40b9d0c101be successfully. {{(pid=89182) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 31 12:38:11 devstack cinder-volume[89182]: DEBUG cinder.image.image_utils [None req-46392afe-4ccf-4c85-a16c-fdfe2489fbaf tempest-VolumeImageDependencyTests-1366750687 None] Temporary image a5b7e21f-2ffb-42f3-b82c-c200fd635a4a for user b44e6e9d7b9542c6aea2ca270c251a89 is deleted. {{(pid=89182) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 31 12:38:11 devstack cinder-volume[89182]: DEBUG cinder.volume.volume_utils [None req-46392afe-4ccf-4c85-a16c-fdfe2489fbaf tempest-VolumeImageDependencyTests-1366750687 None] Marking volume 0b1ce179-4800-405a-a0dd-40b9d0c101be as bootable. {{(pid=89182) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 31 12:38:11 devstack sudo[113536]: pam_unix(sudo:session): session closed for user root Jul 31 12:38:11 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-2e273dd5-85c5-406c-8ee9-a844f4732afd tempest-SnapshotDataIntegrityTests-898447071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e6acfb11-941d-450b-8d93-0e32240df94a.629af985-2bb6-4b68-b00b-b49a9e715090" returned: 0 in 0.277s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:38:11 devstack cinder-volume[89182]: DEBUG cinder.compute.nova [None req-2e273dd5-85c5-406c-8ee9-a844f4732afd tempest-SnapshotDataIntegrityTests-898447071 None] Creating Keystone auth plugin from conf {{(pid=89182) novaclient /opt/stack/cinder/cinder/compute/nova.py:99}} Jul 31 12:38:11 devstack cinder-volume[89182]: DEBUG cinder.volume.flows.manager.create_volume [None req-46392afe-4ccf-4c85-a16c-fdfe2489fbaf tempest-VolumeImageDependencyTests-1366750687 None] Copying metadata from image a5b7e21f-2ffb-42f3-b82c-c200fd635a4a to 0b1ce179-4800-405a-a0dd-40b9d0c101be. {{(pid=89182) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 31 12:38:11 devstack cinder-volume[89182]: DEBUG cinder.volume.flows.manager.create_volume [None req-46392afe-4ccf-4c85-a16c-fdfe2489fbaf tempest-VolumeImageDependencyTests-1366750687 None] Creating volume glance metadata for volume 0b1ce179-4800-405a-a0dd-40b9d0c101be backed by image a5b7e21f-2ffb-42f3-b82c-c200fd635a4a with: {'image_id': 'a5b7e21f-2ffb-42f3-b82c-c200fd635a4a', 'image_name': 'image-for-test-0e20bd6e-440f-41d8-9b5d-fc047ac00423', 'checksum': 'f2cf6eac46858c46f4324eab5314b60f', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=89182) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 31 12:38:11 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-46392afe-4ccf-4c85-a16c-fdfe2489fbaf tempest-VolumeImageDependencyTests-1366750687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49bc8664-ae95-4ec3-9881-93bddd5c1cb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0b1ce179-4800-405a-a0dd-40b9d0c101be', 'volume_size': 1, 'image_id': 'a5b7e21f-2ffb-42f3-b82c-c200fd635a4a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a5b7e21f-2ffb-42f3-b82c-c200fd635a4a', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-0e20bd6e-440f-41d8-9b5d-fc047ac00423', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'f2cf6eac46858c46f4324eab5314b60f', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '2d0755f1e2ea4124a760580edccedbe3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'faa45ddd10af801fba1a4bd3fc82c3dce8311bc105fd3b0ac383daa4dd4101cee024133168c4ae81a23e2c1468b1595db940ccd0db7d59775b7ed439b513fdfc', 'id': 'a5b7e21f-2ffb-42f3-b82c-c200fd635a4a', 'created_at': datetime.datetime(2026, 7, 31, 10, 37, 46, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 31, 10, 37, 48, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a5b7e21f-2ffb-42f3-b82c-c200fd635a4a/file', 'properties': {}}, 'image_service': }' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:38:11 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-46392afe-4ccf-4c85-a16c-fdfe2489fbaf tempest-VolumeImageDependencyTests-1366750687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12656739-8acb-4ae0-b7d2-d38d48a2212f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:38:11 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-46392afe-4ccf-4c85-a16c-fdfe2489fbaf tempest-VolumeImageDependencyTests-1366750687 None] Volume volume-0b1ce179-4800-405a-a0dd-40b9d0c101be (0b1ce179-4800-405a-a0dd-40b9d0c101be): created successfully Jul 31 12:38:11 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-46392afe-4ccf-4c85-a16c-fdfe2489fbaf tempest-VolumeImageDependencyTests-1366750687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12656739-8acb-4ae0-b7d2-d38d48a2212f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:38:11 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-46392afe-4ccf-4c85-a16c-fdfe2489fbaf tempest-VolumeImageDependencyTests-1366750687 None] Flow 'volume_create_manager' (e1ea95ee-4bef-4da3-bbff-d0d08e940c03) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:38:11 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-46392afe-4ccf-4c85-a16c-fdfe2489fbaf tempest-VolumeImageDependencyTests-1366750687 None] Created volume successfully. Jul 31 12:38:11 devstack cinder-volume[89182]: DEBUG novaclient.v2.client [None req-2e273dd5-85c5-406c-8ee9-a844f4732afd tempest-SnapshotDataIntegrityTests-898447071 None] REQ: curl -g -i -X POST http://192.168.122.21/compute/v2.1/os-assisted-volume-snapshots -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}98f3ae1e78c8212b06d56b6c2c28b6a53a43b363e7d727cdc1f7bdc2fb3033a1" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-2e273dd5-85c5-406c-8ee9-a844f4732afd" -H "X-Service-Token: {SHA256}02a8645ba5bc7d3f7d0a93a9d02f784466607492168e4b335483720fa1daddd6" -d '{"snapshot": {"volume_id": "e6acfb11-941d-450b-8d93-0e32240df94a", "create_info": {"type": "qcow2", "new_file": "volume-e6acfb11-941d-450b-8d93-0e32240df94a.629af985-2bb6-4b68-b00b-b49a9e715090", "snapshot_id": "629af985-2bb6-4b68-b00b-b49a9e715090"}}}' {{(pid=89182) _http_log_request /opt/stack/data/venv/lib/python3.12/site-packages/keystoneauth1/session.py:575}} Jul 31 12:38:12 devstack cinder-volume[89182]: DEBUG novaclient.v2.client [None req-2e273dd5-85c5-406c-8ee9-a844f4732afd tempest-SnapshotDataIntegrityTests-898447071 None] RESP: [200] Connection: close Content-Length: 78 Content-Type: application/json Date: Fri, 31 Jul 2026 10:38:11 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.58 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-b6e75fa0-4ddb-45b2-b402-1335d271af5c x-openstack-request-id: req-b6e75fa0-4ddb-45b2-b402-1335d271af5c {{(pid=89182) _http_log_response /opt/stack/data/venv/lib/python3.12/site-packages/keystoneauth1/session.py:616}} Jul 31 12:38:12 devstack cinder-volume[89182]: DEBUG novaclient.v2.client [None req-2e273dd5-85c5-406c-8ee9-a844f4732afd tempest-SnapshotDataIntegrityTests-898447071 None] RESP BODY: {"snapshot": {"id": null, "volumeId": "e6acfb11-941d-450b-8d93-0e32240df94a"}} {{(pid=89182) _http_log_response /opt/stack/data/venv/lib/python3.12/site-packages/keystoneauth1/session.py:651}} Jul 31 12:38:12 devstack cinder-volume[89182]: DEBUG novaclient.v2.client [None req-2e273dd5-85c5-406c-8ee9-a844f4732afd tempest-SnapshotDataIntegrityTests-898447071 None] POST call to compute for http://192.168.122.21/compute/v2.1/os-assisted-volume-snapshots used request id req-b6e75fa0-4ddb-45b2-b402-1335d271af5c {{(pid=89182) request /opt/stack/data/venv/lib/python3.12/site-packages/keystoneauth1/session.py:1076}} Jul 31 12:38:12 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-2e273dd5-85c5-406c-8ee9-a844f4732afd tempest-SnapshotDataIntegrityTests-898447071 None] nova call result: None {{(pid=89182) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1910}} Jul 31 12:38:12 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-2e273dd5-85c5-406c-8ee9-a844f4732afd tempest-SnapshotDataIntegrityTests-898447071 None] Status of snapshot 629af985-2bb6-4b68-b00b-b49a9e715090 is now creating {{(pid=89182) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Jul 31 12:38:13 devstack cinder-volume[89182]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ca1aaaf-14b7-43fb-bcae-8323f137f8c2 tempest-VolumeImageDependencyTests-1366750687 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89182) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 12:38:13 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-9ca1aaaf-14b7-43fb-bcae-8323f137f8c2 tempest-VolumeImageDependencyTests-1366750687 None] Flow 'volume_create_manager' (74f7d6f5-55f9-48e3-b650-93cebc5f62fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:38:13 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-9ca1aaaf-14b7-43fb-bcae-8323f137f8c2 tempest-VolumeImageDependencyTests-1366750687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (655c44a8-88a7-4e02-ac71-2f5f536b98c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:38:13 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-9ca1aaaf-14b7-43fb-bcae-8323f137f8c2 tempest-VolumeImageDependencyTests-1366750687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (655c44a8-88a7-4e02-ac71-2f5f536b98c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=True,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:38:13Z,deleted=False,deleted_at=None,display_description=None,display_name='volume2-for-test-0e20bd6e-440f-41d8-9b5d-fc047ac00423',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5703b33-7a0d-4e4c-9dd1-fccc166c569d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d0755f1e2ea4124a760580edccedbe3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:38:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=0b1ce179-4800-405a-a0dd-40b9d0c101be,status='creating',terminated_at=None,updated_at=2026-07-31T10:38:13Z,use_quota=True,user_id='b44e6e9d7b9542c6aea2ca270c251a89',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:38:13 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-9ca1aaaf-14b7-43fb-bcae-8323f137f8c2 tempest-VolumeImageDependencyTests-1366750687 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3968f357-8efa-45cf-b433-21a029087b75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:38:13 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-9ca1aaaf-14b7-43fb-bcae-8323f137f8c2 tempest-VolumeImageDependencyTests-1366750687 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3968f357-8efa-45cf-b433-21a029087b75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:38:13 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-9ca1aaaf-14b7-43fb-bcae-8323f137f8c2 tempest-VolumeImageDependencyTests-1366750687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cdfbef2e-0396-40e9-979c-b41a76d41eb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:38:13 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-9ca1aaaf-14b7-43fb-bcae-8323f137f8c2 tempest-VolumeImageDependencyTests-1366750687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cdfbef2e-0396-40e9-979c-b41a76d41eb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'c5703b33-7a0d-4e4c-9dd1-fccc166c569d', 'volume_name': 'volume-c5703b33-7a0d-4e4c-9dd1-fccc166c569d', 'volume_size': 1, 'source_volid': '0b1ce179-4800-405a-a0dd-40b9d0c101be', 'source_volstatus': 'available'}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:38:13 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-9ca1aaaf-14b7-43fb-bcae-8323f137f8c2 tempest-VolumeImageDependencyTests-1366750687 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04e24749-d466-49d3-871a-abd0102a7560) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:38:13 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-9ca1aaaf-14b7-43fb-bcae-8323f137f8c2 tempest-VolumeImageDependencyTests-1366750687 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04e24749-d466-49d3-871a-abd0102a7560) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:38:13 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-9ca1aaaf-14b7-43fb-bcae-8323f137f8c2 tempest-VolumeImageDependencyTests-1366750687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cfd9a73f-003b-424c-8230-fdd639f6d2bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:38:13 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-9ca1aaaf-14b7-43fb-bcae-8323f137f8c2 tempest-VolumeImageDependencyTests-1366750687 None] Volume c5703b33-7a0d-4e4c-9dd1-fccc166c569d: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-c5703b33-7a0d-4e4c-9dd1-fccc166c569d', 'volume_size': 1, 'source_volid': '0b1ce179-4800-405a-a0dd-40b9d0c101be', 'source_volstatus': 'available'} Jul 31 12:38:13 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-9ca1aaaf-14b7-43fb-bcae-8323f137f8c2 tempest-VolumeImageDependencyTests-1366750687 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:38:13 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-2e273dd5-85c5-406c-8ee9-a844f4732afd tempest-SnapshotDataIntegrityTests-898447071 None] Status of snapshot 629af985-2bb6-4b68-b00b-b49a9e715090 is now creating {{(pid=89182) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Jul 31 12:38:14 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-2e273dd5-85c5-406c-8ee9-a844f4732afd tempest-SnapshotDataIntegrityTests-898447071 None] Status of snapshot 629af985-2bb6-4b68-b00b-b49a9e715090 is now creating {{(pid=89182) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Jul 31 12:38:15 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-2e273dd5-85c5-406c-8ee9-a844f4732afd tempest-SnapshotDataIntegrityTests-898447071 None] Status of snapshot 629af985-2bb6-4b68-b00b-b49a9e715090 is now creating {{(pid=89182) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Jul 31 12:38:16 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-2e273dd5-85c5-406c-8ee9-a844f4732afd tempest-SnapshotDataIntegrityTests-898447071 None] Status of snapshot 629af985-2bb6-4b68-b00b-b49a9e715090 is now creating {{(pid=89182) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Jul 31 12:38:17 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-2e273dd5-85c5-406c-8ee9-a844f4732afd tempest-SnapshotDataIntegrityTests-898447071 None] Status of snapshot 629af985-2bb6-4b68-b00b-b49a9e715090 is now creating {{(pid=89182) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Jul 31 12:38:18 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-2e273dd5-85c5-406c-8ee9-a844f4732afd tempest-SnapshotDataIntegrityTests-898447071 None] Status of snapshot 629af985-2bb6-4b68-b00b-b49a9e715090 is now creating {{(pid=89182) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Jul 31 12:38:18 devstack cinder-volume[89182]: DEBUG cinder.volume.flows.manager.create_volume [None req-88cee8a8-db12-4371-8423-b04a62af6362 tempest-ProjectReaderTests-1403756841 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89182) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 12:38:18 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-88cee8a8-db12-4371-8423-b04a62af6362 tempest-ProjectReaderTests-1403756841 None] Flow 'volume_create_manager' (fb5771d9-7ad3-4ba8-a486-d9bd762f726e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:38:18 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-88cee8a8-db12-4371-8423-b04a62af6362 tempest-ProjectReaderTests-1403756841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03885b4e-e67b-48e4-b487-4ead81c17af1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:38:18 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-88cee8a8-db12-4371-8423-b04a62af6362 tempest-ProjectReaderTests-1403756841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03885b4e-e67b-48e4-b487-4ead81c17af1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:38:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1664131092',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c56b3165-dc88-48c1-a1b8-e325bcf9d9c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f3d0306f6a14ffa9b6c897b6fc4c21a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:38:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:38:19Z,use_quota=True,user_id='21a6903f438141de9ad7d31e5e806c6f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:38:18 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-88cee8a8-db12-4371-8423-b04a62af6362 tempest-ProjectReaderTests-1403756841 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec164433-ea52-45d8-851c-bcb2cdfd3c33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:38:18 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-88cee8a8-db12-4371-8423-b04a62af6362 tempest-ProjectReaderTests-1403756841 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec164433-ea52-45d8-851c-bcb2cdfd3c33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:38:18 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-88cee8a8-db12-4371-8423-b04a62af6362 tempest-ProjectReaderTests-1403756841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a90a1f5a-3c02-46e5-bb8d-4dbe07b6f43b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:38:18 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-88cee8a8-db12-4371-8423-b04a62af6362 tempest-ProjectReaderTests-1403756841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a90a1f5a-3c02-46e5-bb8d-4dbe07b6f43b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c56b3165-dc88-48c1-a1b8-e325bcf9d9c7', 'volume_name': 'volume-c56b3165-dc88-48c1-a1b8-e325bcf9d9c7', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:38:18 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-88cee8a8-db12-4371-8423-b04a62af6362 tempest-ProjectReaderTests-1403756841 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06d4a410-9423-4c9a-ac09-1764595fc1da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:38:18 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-88cee8a8-db12-4371-8423-b04a62af6362 tempest-ProjectReaderTests-1403756841 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06d4a410-9423-4c9a-ac09-1764595fc1da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:38:18 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-88cee8a8-db12-4371-8423-b04a62af6362 tempest-ProjectReaderTests-1403756841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d795170f-8e64-43b6-af1e-13292e3d4130) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:38:18 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-88cee8a8-db12-4371-8423-b04a62af6362 tempest-ProjectReaderTests-1403756841 None] Volume c56b3165-dc88-48c1-a1b8-e325bcf9d9c7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c56b3165-dc88-48c1-a1b8-e325bcf9d9c7', 'volume_size': 1} Jul 31 12:38:18 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-88cee8a8-db12-4371-8423-b04a62af6362 tempest-ProjectReaderTests-1403756841 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:38:19 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-2e273dd5-85c5-406c-8ee9-a844f4732afd tempest-SnapshotDataIntegrityTests-898447071 None] Status of snapshot 629af985-2bb6-4b68-b00b-b49a9e715090 is now creating {{(pid=89182) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Jul 31 12:38:20 devstack cinder-volume[89182]: DEBUG dbcounter [-] [89182] Writing DB stats cinder:SELECT=160,cinder:INSERT=55,cinder:UPDATE=187,cinder:DELETE=15 {{(pid=89182) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 12:38:20 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-2e273dd5-85c5-406c-8ee9-a844f4732afd tempest-SnapshotDataIntegrityTests-898447071 None] Status of snapshot 629af985-2bb6-4b68-b00b-b49a9e715090 is now creating {{(pid=89182) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Jul 31 12:38:21 devstack cinder-volume[89182]: DEBUG dbcounter [-] [89182] Writing DB stats cinder:SELECT=171,cinder:INSERT=52,cinder:UPDATE=176,cinder:DELETE=13 {{(pid=89182) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 12:38:21 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-2e273dd5-85c5-406c-8ee9-a844f4732afd tempest-SnapshotDataIntegrityTests-898447071 None] Status of snapshot 629af985-2bb6-4b68-b00b-b49a9e715090 is now creating {{(pid=89182) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Jul 31 12:38:21 devstack cinder-volume[89182]: DEBUG oslo_service.periodic_task [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89182) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 31 12:38:21 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:38:21 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:38:21 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:38:21 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:38:21 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:38:21 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:38:22 devstack sudo[113551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 Jul 31 12:38:22 devstack sudo[113551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:38:22 devstack sudo[113551]: pam_unix(sudo:session): session closed for user root Jul 31 12:38:22 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2" returned: 0 in 0.256s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:38:22 devstack cinder-volume[89182]: DEBUG cinder.manager [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] Notifying Schedulers of capabilities ... {{(pid=89182) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 12:38:22 devstack cinder-volume[89182]: DEBUG oslo_service.periodic_task [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] Running periodic task VolumeManager._thread_info {{(pid=89182) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 31 12:38:22 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] thread count: 28 {{(pid=89182) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 31 12:38:22 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] thread info: [<_MainThread(MainThread, started 136154603720832)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=89182) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 31 12:38:22 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-2e273dd5-85c5-406c-8ee9-a844f4732afd tempest-SnapshotDataIntegrityTests-898447071 None] Status of snapshot 629af985-2bb6-4b68-b00b-b49a9e715090 is now creating {{(pid=89182) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Jul 31 12:38:23 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-2e273dd5-85c5-406c-8ee9-a844f4732afd tempest-SnapshotDataIntegrityTests-898447071 None] Status of snapshot 629af985-2bb6-4b68-b00b-b49a9e715090 is now creating {{(pid=89182) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Jul 31 12:38:25 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-2e273dd5-85c5-406c-8ee9-a844f4732afd tempest-SnapshotDataIntegrityTests-898447071 None] Status of snapshot 629af985-2bb6-4b68-b00b-b49a9e715090 is now creating {{(pid=89182) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Jul 31 12:38:27 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-2e273dd5-85c5-406c-8ee9-a844f4732afd tempest-SnapshotDataIntegrityTests-898447071 None] Status of snapshot 629af985-2bb6-4b68-b00b-b49a9e715090 is now creating {{(pid=89182) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Jul 31 12:38:29 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-2e273dd5-85c5-406c-8ee9-a844f4732afd tempest-SnapshotDataIntegrityTests-898447071 None] Status of snapshot 629af985-2bb6-4b68-b00b-b49a9e715090 is now creating {{(pid=89182) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Jul 31 12:38:29 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-2e273dd5-85c5-406c-8ee9-a844f4732afd tempest-SnapshotDataIntegrityTests-898447071 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 19.384s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:38:29 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-70319a08-0879-4dff-815d-98b09d474fe9 tempest-VolumeDependencyTests-442009576 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 18.698s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:38:29 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-70319a08-0879-4dff-815d-98b09d474fe9 tempest-VolumeDependencyTests-442009576 None] Creating offline snapshot f9e81161-c5c2-415a-bfde-8c397c2bd711 of volume 45b0745c-de5b-49ba-afd5-559c565cbf66 {{(pid=89182) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 31 12:38:29 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-2e273dd5-85c5-406c-8ee9-a844f4732afd tempest-SnapshotDataIntegrityTests-898447071 None] Create snapshot completed successfully Jul 31 12:38:29 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[2998e597-3f86-4cf8-b338-ddbdd8c36dab]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:38:29 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-70319a08-0879-4dff-815d-98b09d474fe9 tempest-VolumeDependencyTests-442009576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-45b0745c-de5b-49ba-afd5-559c565cbf66 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:38:29 devstack sudo[113556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-45b0745c-de5b-49ba-afd5-559c565cbf66 Jul 31 12:38:29 devstack sudo[113556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:38:29 devstack sudo[113556]: pam_unix(sudo:session): session closed for user root Jul 31 12:38:29 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-70319a08-0879-4dff-815d-98b09d474fe9 tempest-VolumeDependencyTests-442009576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-45b0745c-de5b-49ba-afd5-559c565cbf66" returned: 0 in 0.390s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:38:29 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-70319a08-0879-4dff-815d-98b09d474fe9 tempest-VolumeDependencyTests-442009576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-45b0745c-de5b-49ba-afd5-559c565cbf66,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-45b0745c-de5b-49ba-afd5-559c565cbf66.f9e81161-c5c2-415a-bfde-8c397c2bd711 1G {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:38:29 devstack sudo[113567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-45b0745c-de5b-49ba-afd5-559c565cbf66,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-45b0745c-de5b-49ba-afd5-559c565cbf66.f9e81161-c5c2-415a-bfde-8c397c2bd711 1G Jul 31 12:38:29 devstack sudo[113567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:38:30 devstack sudo[113567]: pam_unix(sudo:session): session closed for user root Jul 31 12:38:30 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-70319a08-0879-4dff-815d-98b09d474fe9 tempest-VolumeDependencyTests-442009576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-45b0745c-de5b-49ba-afd5-559c565cbf66,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-45b0745c-de5b-49ba-afd5-559c565cbf66.f9e81161-c5c2-415a-bfde-8c397c2bd711 1G" returned: 0 in 0.454s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:38:30 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-70319a08-0879-4dff-815d-98b09d474fe9 tempest-VolumeDependencyTests-442009576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-45b0745c-de5b-49ba-afd5-559c565cbf66 -F qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-45b0745c-de5b-49ba-afd5-559c565cbf66.f9e81161-c5c2-415a-bfde-8c397c2bd711 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:38:30 devstack sudo[113576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-45b0745c-de5b-49ba-afd5-559c565cbf66 -F qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-45b0745c-de5b-49ba-afd5-559c565cbf66.f9e81161-c5c2-415a-bfde-8c397c2bd711 Jul 31 12:38:30 devstack sudo[113576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:38:30 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-f8c4529d-0d33-42e2-973f-2e272dcea2e7 tempest-SnapshotDataIntegrityTests-898447071 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:38:30 devstack sudo[113576]: pam_unix(sudo:session): session closed for user root Jul 31 12:38:30 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-70319a08-0879-4dff-815d-98b09d474fe9 tempest-VolumeDependencyTests-442009576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-45b0745c-de5b-49ba-afd5-559c565cbf66 -F qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-45b0745c-de5b-49ba-afd5-559c565cbf66.f9e81161-c5c2-415a-bfde-8c397c2bd711" returned: 0 in 0.316s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:38:30 devstack cinder-volume[89182]: WARNING cinder.volume.drivers.remotefs [None req-70319a08-0879-4dff-815d-98b09d474fe9 tempest-VolumeDependencyTests-442009576 None] /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-45b0745c-de5b-49ba-afd5-559c565cbf66.f9e81161-c5c2-415a-bfde-8c397c2bd711 is being set with open permissions: ugo+rw Jul 31 12:38:30 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-70319a08-0879-4dff-815d-98b09d474fe9 tempest-VolumeDependencyTests-442009576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-45b0745c-de5b-49ba-afd5-559c565cbf66.f9e81161-c5c2-415a-bfde-8c397c2bd711 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:38:30 devstack sudo[113581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-45b0745c-de5b-49ba-afd5-559c565cbf66.f9e81161-c5c2-415a-bfde-8c397c2bd711 Jul 31 12:38:30 devstack sudo[113581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:38:30 devstack sudo[113581]: pam_unix(sudo:session): session closed for user root Jul 31 12:38:30 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-70319a08-0879-4dff-815d-98b09d474fe9 tempest-VolumeDependencyTests-442009576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-45b0745c-de5b-49ba-afd5-559c565cbf66.f9e81161-c5c2-415a-bfde-8c397c2bd711" returned: 0 in 0.250s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:38:30 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-70319a08-0879-4dff-815d-98b09d474fe9 tempest-VolumeDependencyTests-442009576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-45b0745c-de5b-49ba-afd5-559c565cbf66.info {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:38:30 devstack sudo[113584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-45b0745c-de5b-49ba-afd5-559c565cbf66.info Jul 31 12:38:30 devstack sudo[113584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:38:31 devstack sudo[113584]: pam_unix(sudo:session): session closed for user root Jul 31 12:38:31 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-70319a08-0879-4dff-815d-98b09d474fe9 tempest-VolumeDependencyTests-442009576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-45b0745c-de5b-49ba-afd5-559c565cbf66.info" returned: 0 in 0.253s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:38:31 devstack cinder-volume[89182]: WARNING cinder.volume.drivers.remotefs [None req-70319a08-0879-4dff-815d-98b09d474fe9 tempest-VolumeDependencyTests-442009576 None] /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-45b0745c-de5b-49ba-afd5-559c565cbf66.info is being set with open permissions: ugo+rw Jul 31 12:38:31 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-70319a08-0879-4dff-815d-98b09d474fe9 tempest-VolumeDependencyTests-442009576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-45b0745c-de5b-49ba-afd5-559c565cbf66.info {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:38:31 devstack sudo[113587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-45b0745c-de5b-49ba-afd5-559c565cbf66.info Jul 31 12:38:31 devstack sudo[113587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:38:31 devstack sudo[113587]: pam_unix(sudo:session): session closed for user root Jul 31 12:38:31 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-70319a08-0879-4dff-815d-98b09d474fe9 tempest-VolumeDependencyTests-442009576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-45b0745c-de5b-49ba-afd5-559c565cbf66.info" returned: 0 in 0.257s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:38:31 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-70319a08-0879-4dff-815d-98b09d474fe9 tempest-VolumeDependencyTests-442009576 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.015s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:38:31 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-9ca1aaaf-14b7-43fb-bcae-8323f137f8c2 tempest-VolumeImageDependencyTests-1366750687 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 18.205s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:38:31 devstack cinder-volume[89182]: INFO cinder.volume.drivers.remotefs [None req-9ca1aaaf-14b7-43fb-bcae-8323f137f8c2 tempest-VolumeImageDependencyTests-1366750687 None] Cloning volume 0b1ce179-4800-405a-a0dd-40b9d0c101be to volume c5703b33-7a0d-4e4c-9dd1-fccc166c569d Jul 31 12:38:31 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-70319a08-0879-4dff-815d-98b09d474fe9 tempest-VolumeDependencyTests-442009576 None] Create snapshot completed successfully Jul 31 12:38:31 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-9ca1aaaf-14b7-43fb-bcae-8323f137f8c2 tempest-VolumeImageDependencyTests-1366750687 None] Creating offline snapshot da0ec732-5825-4d2e-a0c5-90a57ad09c63 of volume 0b1ce179-4800-405a-a0dd-40b9d0c101be {{(pid=89182) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 31 12:38:31 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ed9f0db-d93c-4706-9fa5-7b006b59e819]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:38:31 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-9ca1aaaf-14b7-43fb-bcae-8323f137f8c2 tempest-VolumeImageDependencyTests-1366750687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0b1ce179-4800-405a-a0dd-40b9d0c101be {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:38:31 devstack sudo[113590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0b1ce179-4800-405a-a0dd-40b9d0c101be Jul 31 12:38:31 devstack sudo[113590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:38:31 devstack sudo[113590]: pam_unix(sudo:session): session closed for user root Jul 31 12:38:31 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-9ca1aaaf-14b7-43fb-bcae-8323f137f8c2 tempest-VolumeImageDependencyTests-1366750687 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0b1ce179-4800-405a-a0dd-40b9d0c101be" returned: 0 in 0.362s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:38:31 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-9ca1aaaf-14b7-43fb-bcae-8323f137f8c2 tempest-VolumeImageDependencyTests-1366750687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0b1ce179-4800-405a-a0dd-40b9d0c101be,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0b1ce179-4800-405a-a0dd-40b9d0c101be.da0ec732-5825-4d2e-a0c5-90a57ad09c63 1G {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:38:31 devstack sudo[113595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0b1ce179-4800-405a-a0dd-40b9d0c101be,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0b1ce179-4800-405a-a0dd-40b9d0c101be.da0ec732-5825-4d2e-a0c5-90a57ad09c63 1G Jul 31 12:38:31 devstack sudo[113595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:38:32 devstack sudo[113595]: pam_unix(sudo:session): session closed for user root Jul 31 12:38:32 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-9ca1aaaf-14b7-43fb-bcae-8323f137f8c2 tempest-VolumeImageDependencyTests-1366750687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0b1ce179-4800-405a-a0dd-40b9d0c101be,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0b1ce179-4800-405a-a0dd-40b9d0c101be.da0ec732-5825-4d2e-a0c5-90a57ad09c63 1G" returned: 0 in 0.385s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:38:32 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-9ca1aaaf-14b7-43fb-bcae-8323f137f8c2 tempest-VolumeImageDependencyTests-1366750687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0b1ce179-4800-405a-a0dd-40b9d0c101be -F qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0b1ce179-4800-405a-a0dd-40b9d0c101be.da0ec732-5825-4d2e-a0c5-90a57ad09c63 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:38:32 devstack sudo[113601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0b1ce179-4800-405a-a0dd-40b9d0c101be -F qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0b1ce179-4800-405a-a0dd-40b9d0c101be.da0ec732-5825-4d2e-a0c5-90a57ad09c63 Jul 31 12:38:32 devstack sudo[113601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:38:32 devstack sudo[113601]: pam_unix(sudo:session): session closed for user root Jul 31 12:38:32 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-9ca1aaaf-14b7-43fb-bcae-8323f137f8c2 tempest-VolumeImageDependencyTests-1366750687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0b1ce179-4800-405a-a0dd-40b9d0c101be -F qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0b1ce179-4800-405a-a0dd-40b9d0c101be.da0ec732-5825-4d2e-a0c5-90a57ad09c63" returned: 0 in 0.292s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:38:32 devstack cinder-volume[89182]: WARNING cinder.volume.drivers.remotefs [None req-9ca1aaaf-14b7-43fb-bcae-8323f137f8c2 tempest-VolumeImageDependencyTests-1366750687 None] /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0b1ce179-4800-405a-a0dd-40b9d0c101be.da0ec732-5825-4d2e-a0c5-90a57ad09c63 is being set with open permissions: ugo+rw Jul 31 12:38:32 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-9ca1aaaf-14b7-43fb-bcae-8323f137f8c2 tempest-VolumeImageDependencyTests-1366750687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0b1ce179-4800-405a-a0dd-40b9d0c101be.da0ec732-5825-4d2e-a0c5-90a57ad09c63 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:38:32 devstack sudo[113606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0b1ce179-4800-405a-a0dd-40b9d0c101be.da0ec732-5825-4d2e-a0c5-90a57ad09c63 Jul 31 12:38:32 devstack sudo[113606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:38:32 devstack sudo[113606]: pam_unix(sudo:session): session closed for user root Jul 31 12:38:32 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-9ca1aaaf-14b7-43fb-bcae-8323f137f8c2 tempest-VolumeImageDependencyTests-1366750687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0b1ce179-4800-405a-a0dd-40b9d0c101be.da0ec732-5825-4d2e-a0c5-90a57ad09c63" returned: 0 in 0.267s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:38:32 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-9ca1aaaf-14b7-43fb-bcae-8323f137f8c2 tempest-VolumeImageDependencyTests-1366750687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0b1ce179-4800-405a-a0dd-40b9d0c101be.info {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:38:32 devstack sudo[113609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0b1ce179-4800-405a-a0dd-40b9d0c101be.info Jul 31 12:38:32 devstack sudo[113609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:38:32 devstack cinder-volume[89182]: DEBUG cinder.volume.flows.manager.create_volume [None req-27c9cfcb-4d9d-4d83-8617-34afc11f46f6 tempest-VolumeDependencyTests-442009576 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89182) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 12:38:32 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-27c9cfcb-4d9d-4d83-8617-34afc11f46f6 tempest-VolumeDependencyTests-442009576 None] Flow 'volume_create_manager' (36fd0f7c-e680-464a-afe4-9cd79bdaa14f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:38:32 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-27c9cfcb-4d9d-4d83-8617-34afc11f46f6 tempest-VolumeDependencyTests-442009576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14b1170a-02c9-400e-920c-74fa159fb8c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:38:32 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-27c9cfcb-4d9d-4d83-8617-34afc11f46f6 tempest-VolumeDependencyTests-442009576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14b1170a-02c9-400e-920c-74fa159fb8c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:38:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1567064440',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7df6ef4-cfe2-419c-85f1-b7b92de716fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c622d586c4c9404ead8c06d764810df1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:38:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=f9e81161-c5c2-415a-bfde-8c397c2bd711,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:38:33Z,use_quota=True,user_id='cfc528fe8ec2487bb4171d283c222b1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:38:32 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-27c9cfcb-4d9d-4d83-8617-34afc11f46f6 tempest-VolumeDependencyTests-442009576 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4781c5c9-949a-4352-bad7-b8195a63f8b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:38:32 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-27c9cfcb-4d9d-4d83-8617-34afc11f46f6 tempest-VolumeDependencyTests-442009576 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4781c5c9-949a-4352-bad7-b8195a63f8b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:38:32 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-27c9cfcb-4d9d-4d83-8617-34afc11f46f6 tempest-VolumeDependencyTests-442009576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a89849e0-baf0-4253-a223-24cd134ad210) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:38:32 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-27c9cfcb-4d9d-4d83-8617-34afc11f46f6 tempest-VolumeDependencyTests-442009576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a89849e0-baf0-4253-a223-24cd134ad210) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'a7df6ef4-cfe2-419c-85f1-b7b92de716fa', 'volume_name': 'volume-a7df6ef4-cfe2-419c-85f1-b7b92de716fa', 'volume_size': 1, 'snapshot_id': 'f9e81161-c5c2-415a-bfde-8c397c2bd711'}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:38:32 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-27c9cfcb-4d9d-4d83-8617-34afc11f46f6 tempest-VolumeDependencyTests-442009576 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5894edb3-8830-4409-bef7-d76c87f8b1a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:38:33 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-27c9cfcb-4d9d-4d83-8617-34afc11f46f6 tempest-VolumeDependencyTests-442009576 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5894edb3-8830-4409-bef7-d76c87f8b1a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:38:33 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-27c9cfcb-4d9d-4d83-8617-34afc11f46f6 tempest-VolumeDependencyTests-442009576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3598a921-6824-4222-b5b4-29b931373d71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:38:33 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-27c9cfcb-4d9d-4d83-8617-34afc11f46f6 tempest-VolumeDependencyTests-442009576 None] Volume a7df6ef4-cfe2-419c-85f1-b7b92de716fa: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-a7df6ef4-cfe2-419c-85f1-b7b92de716fa', 'volume_size': 1, 'snapshot_id': 'f9e81161-c5c2-415a-bfde-8c397c2bd711'} Jul 31 12:38:33 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-27c9cfcb-4d9d-4d83-8617-34afc11f46f6 tempest-VolumeDependencyTests-442009576 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:38:33 devstack sudo[113609]: pam_unix(sudo:session): session closed for user root Jul 31 12:38:33 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-9ca1aaaf-14b7-43fb-bcae-8323f137f8c2 tempest-VolumeImageDependencyTests-1366750687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0b1ce179-4800-405a-a0dd-40b9d0c101be.info" returned: 0 in 0.284s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:38:33 devstack cinder-volume[89182]: WARNING cinder.volume.drivers.remotefs [None req-9ca1aaaf-14b7-43fb-bcae-8323f137f8c2 tempest-VolumeImageDependencyTests-1366750687 None] /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0b1ce179-4800-405a-a0dd-40b9d0c101be.info is being set with open permissions: ugo+rw Jul 31 12:38:33 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-9ca1aaaf-14b7-43fb-bcae-8323f137f8c2 tempest-VolumeImageDependencyTests-1366750687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0b1ce179-4800-405a-a0dd-40b9d0c101be.info {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:38:33 devstack sudo[113612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0b1ce179-4800-405a-a0dd-40b9d0c101be.info Jul 31 12:38:33 devstack sudo[113612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:38:33 devstack sudo[113612]: pam_unix(sudo:session): session closed for user root Jul 31 12:38:33 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-9ca1aaaf-14b7-43fb-bcae-8323f137f8c2 tempest-VolumeImageDependencyTests-1366750687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0b1ce179-4800-405a-a0dd-40b9d0c101be.info" returned: 0 in 0.259s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:38:33 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-9ca1aaaf-14b7-43fb-bcae-8323f137f8c2 tempest-VolumeImageDependencyTests-1366750687 None] Acquiring lock "cinder-quobyte-c5703b33-7a0d-4e4c-9dd1-fccc166c569d" by "_copy_volume_from_snapshot" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:38:33 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-9ca1aaaf-14b7-43fb-bcae-8323f137f8c2 tempest-VolumeImageDependencyTests-1366750687 None] Lock "cinder-quobyte-c5703b33-7a0d-4e4c-9dd1-fccc166c569d" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:38:33 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-9ca1aaaf-14b7-43fb-bcae-8323f137f8c2 tempest-VolumeImageDependencyTests-1366750687 None] snapshot: da0ec732-5825-4d2e-a0c5-90a57ad09c63, volume: c5703b33-7a0d-4e4c-9dd1-fccc166c569d, {{(pid=89182) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Jul 31 12:38:33 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-9ca1aaaf-14b7-43fb-bcae-8323f137f8c2 tempest-VolumeImageDependencyTests-1366750687 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:38:33 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-9ca1aaaf-14b7-43fb-bcae-8323f137f8c2 tempest-VolumeImageDependencyTests-1366750687 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:38:33 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-9ca1aaaf-14b7-43fb-bcae-8323f137f8c2 tempest-VolumeImageDependencyTests-1366750687 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:38:33 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-9ca1aaaf-14b7-43fb-bcae-8323f137f8c2 tempest-VolumeImageDependencyTests-1366750687 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:38:33 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-9ca1aaaf-14b7-43fb-bcae-8323f137f8c2 tempest-VolumeImageDependencyTests-1366750687 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:38:33 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c6b7b83-55e7-4b6d-8064-0ce6fd565b26]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:38:33 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-9ca1aaaf-14b7-43fb-bcae-8323f137f8c2 tempest-VolumeImageDependencyTests-1366750687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0b1ce179-4800-405a-a0dd-40b9d0c101be.da0ec732-5825-4d2e-a0c5-90a57ad09c63 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:38:33 devstack sudo[113615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0b1ce179-4800-405a-a0dd-40b9d0c101be.da0ec732-5825-4d2e-a0c5-90a57ad09c63 Jul 31 12:38:33 devstack sudo[113615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:38:33 devstack sudo[113615]: pam_unix(sudo:session): session closed for user root Jul 31 12:38:33 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-9ca1aaaf-14b7-43fb-bcae-8323f137f8c2 tempest-VolumeImageDependencyTests-1366750687 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0b1ce179-4800-405a-a0dd-40b9d0c101be.da0ec732-5825-4d2e-a0c5-90a57ad09c63" returned: 0 in 0.347s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:38:33 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-9ca1aaaf-14b7-43fb-bcae-8323f137f8c2 tempest-VolumeImageDependencyTests-1366750687 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0b1ce179-4800-405a-a0dd-40b9d0c101be(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89182) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 12:38:33 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[94442e34-6ae5-4829-b676-bcc220405682]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:38:33 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-9ca1aaaf-14b7-43fb-bcae-8323f137f8c2 tempest-VolumeImageDependencyTests-1366750687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0b1ce179-4800-405a-a0dd-40b9d0c101be {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:38:33 devstack sudo[113620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0b1ce179-4800-405a-a0dd-40b9d0c101be Jul 31 12:38:33 devstack sudo[113620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:38:34 devstack sudo[113620]: pam_unix(sudo:session): session closed for user root Jul 31 12:38:34 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-9ca1aaaf-14b7-43fb-bcae-8323f137f8c2 tempest-VolumeImageDependencyTests-1366750687 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0b1ce179-4800-405a-a0dd-40b9d0c101be" returned: 0 in 0.363s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:38:34 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-9ca1aaaf-14b7-43fb-bcae-8323f137f8c2 tempest-VolumeImageDependencyTests-1366750687 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0b1ce179-4800-405a-a0dd-40b9d0c101be {{(pid=89182) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Jul 31 12:38:34 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-9ca1aaaf-14b7-43fb-bcae-8323f137f8c2 tempest-VolumeImageDependencyTests-1366750687 None] Creating direct copy from snapshot {{(pid=89182) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Jul 31 12:38:34 devstack cinder-volume[89182]: DEBUG cinder.utils [None req-9ca1aaaf-14b7-43fb-bcae-8323f137f8c2 tempest-VolumeImageDependencyTests-1366750687 None] Path /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-c5703b33-7a0d-4e4c-9dd1-fccc166c569d not found in is_blk_device check {{(pid=89182) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 31 12:38:34 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-9ca1aaaf-14b7-43fb-bcae-8323f137f8c2 tempest-VolumeImageDependencyTests-1366750687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0b1ce179-4800-405a-a0dd-40b9d0c101be /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-c5703b33-7a0d-4e4c-9dd1-fccc166c569d {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:38:34 devstack sudo[113626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0b1ce179-4800-405a-a0dd-40b9d0c101be /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-c5703b33-7a0d-4e4c-9dd1-fccc166c569d Jul 31 12:38:34 devstack sudo[113626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:38:34 devstack sudo[113626]: pam_unix(sudo:session): session closed for user root Jul 31 12:38:34 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-9ca1aaaf-14b7-43fb-bcae-8323f137f8c2 tempest-VolumeImageDependencyTests-1366750687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0b1ce179-4800-405a-a0dd-40b9d0c101be /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-c5703b33-7a0d-4e4c-9dd1-fccc166c569d" returned: 0 in 0.455s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:38:34 devstack cinder-volume[89182]: DEBUG cinder.image.image_utils [None req-9ca1aaaf-14b7-43fb-bcae-8323f137f8c2 tempest-VolumeImageDependencyTests-1366750687 None] Image conversion details: src /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0b1ce179-4800-405a-a0dd-40b9d0c101be, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-c5703b33-7a0d-4e4c-9dd1-fccc166c569d {{(pid=89182) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 31 12:38:34 devstack cinder-volume[89182]: INFO cinder.image.image_utils [None req-9ca1aaaf-14b7-43fb-bcae-8323f137f8c2 tempest-VolumeImageDependencyTests-1366750687 None] Converted 1024.00 MB image at 1024.00 MB/s Jul 31 12:38:34 devstack cinder-volume[89182]: WARNING cinder.volume.drivers.remotefs [None req-9ca1aaaf-14b7-43fb-bcae-8323f137f8c2 tempest-VolumeImageDependencyTests-1366750687 None] /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-c5703b33-7a0d-4e4c-9dd1-fccc166c569d is being set with open permissions: ugo+rw Jul 31 12:38:34 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-9ca1aaaf-14b7-43fb-bcae-8323f137f8c2 tempest-VolumeImageDependencyTests-1366750687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-c5703b33-7a0d-4e4c-9dd1-fccc166c569d {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:38:34 devstack sudo[113632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-c5703b33-7a0d-4e4c-9dd1-fccc166c569d Jul 31 12:38:34 devstack sudo[113632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:38:34 devstack sudo[113632]: pam_unix(sudo:session): session closed for user root Jul 31 12:38:34 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-9ca1aaaf-14b7-43fb-bcae-8323f137f8c2 tempest-VolumeImageDependencyTests-1366750687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-c5703b33-7a0d-4e4c-9dd1-fccc166c569d" returned: 0 in 0.248s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:38:34 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-9ca1aaaf-14b7-43fb-bcae-8323f137f8c2 tempest-VolumeImageDependencyTests-1366750687 None] Lock "cinder-quobyte-c5703b33-7a0d-4e4c-9dd1-fccc166c569d" released by "_copy_volume_from_snapshot" :: held 1.478s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:38:34 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-9ca1aaaf-14b7-43fb-bcae-8323f137f8c2 tempest-VolumeImageDependencyTests-1366750687 None] Acquiring lock "cinder-quobyte-da0ec732-5825-4d2e-a0c5-90a57ad09c63" by "_delete_snapshot" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:38:34 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-9ca1aaaf-14b7-43fb-bcae-8323f137f8c2 tempest-VolumeImageDependencyTests-1366750687 None] Lock "cinder-quobyte-da0ec732-5825-4d2e-a0c5-90a57ad09c63" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:38:34 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-9ca1aaaf-14b7-43fb-bcae-8323f137f8c2 tempest-VolumeImageDependencyTests-1366750687 None] Deleting offline snapshot da0ec732-5825-4d2e-a0c5-90a57ad09c63 of volume 0b1ce179-4800-405a-a0dd-40b9d0c101be {{(pid=89182) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 31 12:38:34 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-9ca1aaaf-14b7-43fb-bcae-8323f137f8c2 tempest-VolumeImageDependencyTests-1366750687 None] snapshot_file for this snap is: volume-0b1ce179-4800-405a-a0dd-40b9d0c101be.da0ec732-5825-4d2e-a0c5-90a57ad09c63 {{(pid=89182) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 31 12:38:34 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[660489e9-c5aa-40ce-bb89-13d748b87669]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:38:34 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-9ca1aaaf-14b7-43fb-bcae-8323f137f8c2 tempest-VolumeImageDependencyTests-1366750687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0b1ce179-4800-405a-a0dd-40b9d0c101be.da0ec732-5825-4d2e-a0c5-90a57ad09c63 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:38:35 devstack sudo[113635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0b1ce179-4800-405a-a0dd-40b9d0c101be.da0ec732-5825-4d2e-a0c5-90a57ad09c63 Jul 31 12:38:35 devstack sudo[113635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:38:35 devstack sudo[113635]: pam_unix(sudo:session): session closed for user root Jul 31 12:38:35 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-9ca1aaaf-14b7-43fb-bcae-8323f137f8c2 tempest-VolumeImageDependencyTests-1366750687 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0b1ce179-4800-405a-a0dd-40b9d0c101be.da0ec732-5825-4d2e-a0c5-90a57ad09c63" returned: 0 in 0.359s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:38:35 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-9ca1aaaf-14b7-43fb-bcae-8323f137f8c2 tempest-VolumeImageDependencyTests-1366750687 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0b1ce179-4800-405a-a0dd-40b9d0c101be(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89182) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 12:38:35 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[294f828e-56c2-4b7f-8590-4a17de74db58]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:38:35 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-9ca1aaaf-14b7-43fb-bcae-8323f137f8c2 tempest-VolumeImageDependencyTests-1366750687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0b1ce179-4800-405a-a0dd-40b9d0c101be {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:38:35 devstack sudo[113640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0b1ce179-4800-405a-a0dd-40b9d0c101be Jul 31 12:38:35 devstack sudo[113640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:38:35 devstack sudo[113640]: pam_unix(sudo:session): session closed for user root Jul 31 12:38:35 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-9ca1aaaf-14b7-43fb-bcae-8323f137f8c2 tempest-VolumeImageDependencyTests-1366750687 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0b1ce179-4800-405a-a0dd-40b9d0c101be" returned: 0 in 0.355s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:38:35 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-9ca1aaaf-14b7-43fb-bcae-8323f137f8c2 tempest-VolumeImageDependencyTests-1366750687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0b1ce179-4800-405a-a0dd-40b9d0c101be.da0ec732-5825-4d2e-a0c5-90a57ad09c63 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:38:35 devstack sudo[113645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0b1ce179-4800-405a-a0dd-40b9d0c101be.da0ec732-5825-4d2e-a0c5-90a57ad09c63 Jul 31 12:38:35 devstack sudo[113645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:38:35 devstack sudo[113645]: pam_unix(sudo:session): session closed for user root Jul 31 12:38:35 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-9ca1aaaf-14b7-43fb-bcae-8323f137f8c2 tempest-VolumeImageDependencyTests-1366750687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0b1ce179-4800-405a-a0dd-40b9d0c101be.da0ec732-5825-4d2e-a0c5-90a57ad09c63" returned: 0 in 0.351s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:38:35 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-9ca1aaaf-14b7-43fb-bcae-8323f137f8c2 tempest-VolumeImageDependencyTests-1366750687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0b1ce179-4800-405a-a0dd-40b9d0c101be.da0ec732-5825-4d2e-a0c5-90a57ad09c63 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:38:36 devstack sudo[113650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0b1ce179-4800-405a-a0dd-40b9d0c101be.da0ec732-5825-4d2e-a0c5-90a57ad09c63 Jul 31 12:38:36 devstack sudo[113650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:38:36 devstack sudo[113650]: pam_unix(sudo:session): session closed for user root Jul 31 12:38:36 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-9ca1aaaf-14b7-43fb-bcae-8323f137f8c2 tempest-VolumeImageDependencyTests-1366750687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0b1ce179-4800-405a-a0dd-40b9d0c101be.da0ec732-5825-4d2e-a0c5-90a57ad09c63" returned: 0 in 0.247s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:38:36 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-9ca1aaaf-14b7-43fb-bcae-8323f137f8c2 tempest-VolumeImageDependencyTests-1366750687 None] Lock "cinder-quobyte-da0ec732-5825-4d2e-a0c5-90a57ad09c63" released by "_delete_snapshot" :: held 1.395s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:38:36 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-9ca1aaaf-14b7-43fb-bcae-8323f137f8c2 tempest-VolumeImageDependencyTests-1366750687 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 4.917s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:38:36 devstack cinder-volume[89182]: DEBUG cinder.volume.volume_utils [None req-9ca1aaaf-14b7-43fb-bcae-8323f137f8c2 tempest-VolumeImageDependencyTests-1366750687 None] Marking volume c5703b33-7a0d-4e4c-9dd1-fccc166c569d as bootable. {{(pid=89182) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 31 12:38:36 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-88cee8a8-db12-4371-8423-b04a62af6362 tempest-ProjectReaderTests-1403756841 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 17.561s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:38:36 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-88cee8a8-db12-4371-8423-b04a62af6362 tempest-ProjectReaderTests-1403756841 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:38:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1664131092',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c56b3165-dc88-48c1-a1b8-e325bcf9d9c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f3d0306f6a14ffa9b6c897b6fc4c21a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:38:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:38:19Z,use_quota=True,user_id='21a6903f438141de9ad7d31e5e806c6f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)}" {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 12:38:36 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-88cee8a8-db12-4371-8423-b04a62af6362 tempest-ProjectReaderTests-1403756841 None] Creating volume c56b3165-dc88-48c1-a1b8-e325bcf9d9c7 {{(pid=89182) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 12:38:36 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-88cee8a8-db12-4371-8423-b04a62af6362 tempest-ProjectReaderTests-1403756841 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:38:36 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-88cee8a8-db12-4371-8423-b04a62af6362 tempest-ProjectReaderTests-1403756841 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:38:36 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-88cee8a8-db12-4371-8423-b04a62af6362 tempest-ProjectReaderTests-1403756841 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:38:36 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-88cee8a8-db12-4371-8423-b04a62af6362 tempest-ProjectReaderTests-1403756841 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:38:36 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-88cee8a8-db12-4371-8423-b04a62af6362 tempest-ProjectReaderTests-1403756841 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:38:36 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-88cee8a8-db12-4371-8423-b04a62af6362 tempest-ProjectReaderTests-1403756841 None] Selected osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 as target Quobyte volume. {{(pid=89182) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 12:38:36 devstack cinder-volume[89182]: INFO cinder.volume.drivers.remotefs [None req-88cee8a8-db12-4371-8423-b04a62af6362 tempest-ProjectReaderTests-1403756841 None] casted to osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 Jul 31 12:38:36 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-88cee8a8-db12-4371-8423-b04a62af6362 tempest-ProjectReaderTests-1403756841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-c56b3165-dc88-48c1-a1b8-e325bcf9d9c7 1073741824 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:38:36 devstack cinder-volume[89182]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ca1aaaf-14b7-43fb-bcae-8323f137f8c2 tempest-VolumeImageDependencyTests-1366750687 None] Copying metadata from source volume 0b1ce179-4800-405a-a0dd-40b9d0c101be to c5703b33-7a0d-4e4c-9dd1-fccc166c569d. {{(pid=89182) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:438}} Jul 31 12:38:36 devstack sudo[113653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-c56b3165-dc88-48c1-a1b8-e325bcf9d9c7 1073741824 Jul 31 12:38:36 devstack sudo[113653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:38:36 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-9ca1aaaf-14b7-43fb-bcae-8323f137f8c2 tempest-VolumeImageDependencyTests-1366750687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cfd9a73f-003b-424c-8230-fdd639f6d2bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c5703b33-7a0d-4e4c-9dd1-fccc166c569d', 'volume_size': 1, 'source_volid': '0b1ce179-4800-405a-a0dd-40b9d0c101be', 'source_volstatus': 'available'}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:38:36 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-9ca1aaaf-14b7-43fb-bcae-8323f137f8c2 tempest-VolumeImageDependencyTests-1366750687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37b3f445-ce1f-4bfa-95ce-538d915e0794) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:38:36 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-9ca1aaaf-14b7-43fb-bcae-8323f137f8c2 tempest-VolumeImageDependencyTests-1366750687 None] Volume volume-c5703b33-7a0d-4e4c-9dd1-fccc166c569d (c5703b33-7a0d-4e4c-9dd1-fccc166c569d): created successfully Jul 31 12:38:36 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-9ca1aaaf-14b7-43fb-bcae-8323f137f8c2 tempest-VolumeImageDependencyTests-1366750687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37b3f445-ce1f-4bfa-95ce-538d915e0794) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:38:36 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-9ca1aaaf-14b7-43fb-bcae-8323f137f8c2 tempest-VolumeImageDependencyTests-1366750687 None] Flow 'volume_create_manager' (74f7d6f5-55f9-48e3-b650-93cebc5f62fb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:38:36 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-9ca1aaaf-14b7-43fb-bcae-8323f137f8c2 tempest-VolumeImageDependencyTests-1366750687 None] Created volume successfully. Jul 31 12:38:36 devstack sudo[113653]: pam_unix(sudo:session): session closed for user root Jul 31 12:38:36 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-88cee8a8-db12-4371-8423-b04a62af6362 tempest-ProjectReaderTests-1403756841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-c56b3165-dc88-48c1-a1b8-e325bcf9d9c7 1073741824" returned: 0 in 0.426s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:38:36 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-88cee8a8-db12-4371-8423-b04a62af6362 tempest-ProjectReaderTests-1403756841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-c56b3165-dc88-48c1-a1b8-e325bcf9d9c7 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:38:36 devstack sudo[113659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-c56b3165-dc88-48c1-a1b8-e325bcf9d9c7 Jul 31 12:38:36 devstack sudo[113659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:38:37 devstack sudo[113659]: pam_unix(sudo:session): session closed for user root Jul 31 12:38:37 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-88cee8a8-db12-4371-8423-b04a62af6362 tempest-ProjectReaderTests-1403756841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-c56b3165-dc88-48c1-a1b8-e325bcf9d9c7" returned: 0 in 0.247s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:38:37 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-88cee8a8-db12-4371-8423-b04a62af6362 tempest-ProjectReaderTests-1403756841 None] <== create_volume: return (708ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'} {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 12:38:37 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-88cee8a8-db12-4371-8423-b04a62af6362 tempest-ProjectReaderTests-1403756841 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.710s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:38:37 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-f8c4529d-0d33-42e2-973f-2e272dcea2e7 tempest-SnapshotDataIntegrityTests-898447071 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 6.491s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:38:37 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-88cee8a8-db12-4371-8423-b04a62af6362 tempest-ProjectReaderTests-1403756841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d795170f-8e64-43b6-af1e-13292e3d4130) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c56b3165-dc88-48c1-a1b8-e325bcf9d9c7', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:38:37 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-88cee8a8-db12-4371-8423-b04a62af6362 tempest-ProjectReaderTests-1403756841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1740ec51-3c66-44bd-9f99-7e4995347ac6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:38:37 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-f8c4529d-0d33-42e2-973f-2e272dcea2e7 tempest-SnapshotDataIntegrityTests-898447071 None] Creating online snapshot f5d7c5e3-8c41-42e0-b50d-8b1ebe936b3c of volume e6acfb11-941d-450b-8d93-0e32240df94a {{(pid=89182) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 31 12:38:37 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-88cee8a8-db12-4371-8423-b04a62af6362 tempest-ProjectReaderTests-1403756841 None] Volume volume-c56b3165-dc88-48c1-a1b8-e325bcf9d9c7 (c56b3165-dc88-48c1-a1b8-e325bcf9d9c7): created successfully Jul 31 12:38:37 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-88cee8a8-db12-4371-8423-b04a62af6362 tempest-ProjectReaderTests-1403756841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1740ec51-3c66-44bd-9f99-7e4995347ac6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:38:37 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-88cee8a8-db12-4371-8423-b04a62af6362 tempest-ProjectReaderTests-1403756841 None] Flow 'volume_create_manager' (fb5771d9-7ad3-4ba8-a486-d9bd762f726e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:38:37 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[f61a7ca8-689b-4f85-8444-09566e7ac0c6]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:38:37 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-f8c4529d-0d33-42e2-973f-2e272dcea2e7 tempest-SnapshotDataIntegrityTests-898447071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e6acfb11-941d-450b-8d93-0e32240df94a.629af985-2bb6-4b68-b00b-b49a9e715090 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:38:37 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-88cee8a8-db12-4371-8423-b04a62af6362 tempest-ProjectReaderTests-1403756841 None] Created volume successfully. Jul 31 12:38:37 devstack sudo[113662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e6acfb11-941d-450b-8d93-0e32240df94a.629af985-2bb6-4b68-b00b-b49a9e715090 Jul 31 12:38:37 devstack sudo[113662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:38:37 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-1041e9e8-7196-4686-af83-8f3852b0ab55 tempest-VolumeImageDependencyTests-1366750687 None] Acquiring lock "cinder-0b1ce179-4800-405a-a0dd-40b9d0c101be-delete_volume" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:38:37 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-1041e9e8-7196-4686-af83-8f3852b0ab55 tempest-VolumeImageDependencyTests-1366750687 None] Lock "cinder-0b1ce179-4800-405a-a0dd-40b9d0c101be-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:38:37 devstack sudo[113662]: pam_unix(sudo:session): session closed for user root Jul 31 12:38:37 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-f8c4529d-0d33-42e2-973f-2e272dcea2e7 tempest-SnapshotDataIntegrityTests-898447071 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e6acfb11-941d-450b-8d93-0e32240df94a.629af985-2bb6-4b68-b00b-b49a9e715090" returned: 0 in 0.376s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:38:37 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-f8c4529d-0d33-42e2-973f-2e272dcea2e7 tempest-SnapshotDataIntegrityTests-898447071 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e6acfb11-941d-450b-8d93-0e32240df94a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89182) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 12:38:37 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-f8c4529d-0d33-42e2-973f-2e272dcea2e7 tempest-SnapshotDataIntegrityTests-898447071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e6acfb11-941d-450b-8d93-0e32240df94a.629af985-2bb6-4b68-b00b-b49a9e715090,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e6acfb11-941d-450b-8d93-0e32240df94a.f5d7c5e3-8c41-42e0-b50d-8b1ebe936b3c 1G {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:38:37 devstack sudo[113669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e6acfb11-941d-450b-8d93-0e32240df94a.629af985-2bb6-4b68-b00b-b49a9e715090,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e6acfb11-941d-450b-8d93-0e32240df94a.f5d7c5e3-8c41-42e0-b50d-8b1ebe936b3c 1G Jul 31 12:38:37 devstack sudo[113669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:38:37 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-1041e9e8-7196-4686-af83-8f3852b0ab55 tempest-VolumeImageDependencyTests-1366750687 None] Acquiring lock "cinder-quobyte-0b1ce179-4800-405a-a0dd-40b9d0c101be" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:38:37 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-1041e9e8-7196-4686-af83-8f3852b0ab55 tempest-VolumeImageDependencyTests-1366750687 None] Lock "cinder-quobyte-0b1ce179-4800-405a-a0dd-40b9d0c101be" acquired by "delete_volume" :: waited 0.020s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:38:37 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[d31ea287-74c6-446a-8db0-981d8bc54db8]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:38:37 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-1041e9e8-7196-4686-af83-8f3852b0ab55 tempest-VolumeImageDependencyTests-1366750687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0b1ce179-4800-405a-a0dd-40b9d0c101be {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:38:37 devstack sudo[113671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0b1ce179-4800-405a-a0dd-40b9d0c101be Jul 31 12:38:37 devstack sudo[113671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:38:37 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-e32ee960-9985-42f4-8eaa-e5a6e69e42a8 tempest-ProjectReaderTests-1403756841 None] Acquiring lock "cinder-c56b3165-dc88-48c1-a1b8-e325bcf9d9c7-delete_volume" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:38:37 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-e32ee960-9985-42f4-8eaa-e5a6e69e42a8 tempest-ProjectReaderTests-1403756841 None] Lock "cinder-c56b3165-dc88-48c1-a1b8-e325bcf9d9c7-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:38:37 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-e32ee960-9985-42f4-8eaa-e5a6e69e42a8 tempest-ProjectReaderTests-1403756841 None] Acquiring lock "cinder-quobyte-c56b3165-dc88-48c1-a1b8-e325bcf9d9c7" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:38:37 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-e32ee960-9985-42f4-8eaa-e5a6e69e42a8 tempest-ProjectReaderTests-1403756841 None] Lock "cinder-quobyte-c56b3165-dc88-48c1-a1b8-e325bcf9d9c7" acquired by "delete_volume" :: waited 0.025s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:38:37 devstack sudo[113671]: pam_unix(sudo:session): session closed for user root Jul 31 12:38:38 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-1041e9e8-7196-4686-af83-8f3852b0ab55 tempest-VolumeImageDependencyTests-1366750687 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0b1ce179-4800-405a-a0dd-40b9d0c101be" returned: 0 in 0.424s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:38:38 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-1041e9e8-7196-4686-af83-8f3852b0ab55 tempest-VolumeImageDependencyTests-1366750687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0b1ce179-4800-405a-a0dd-40b9d0c101be {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:38:38 devstack sudo[113669]: pam_unix(sudo:session): session closed for user root Jul 31 12:38:38 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[92ac2935-74cc-42da-a05f-1ce2a1351032]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:38:38 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-e32ee960-9985-42f4-8eaa-e5a6e69e42a8 tempest-ProjectReaderTests-1403756841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-c56b3165-dc88-48c1-a1b8-e325bcf9d9c7 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:38:38 devstack sudo[113680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0b1ce179-4800-405a-a0dd-40b9d0c101be Jul 31 12:38:38 devstack sudo[113680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:38:38 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-f8c4529d-0d33-42e2-973f-2e272dcea2e7 tempest-SnapshotDataIntegrityTests-898447071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e6acfb11-941d-450b-8d93-0e32240df94a.629af985-2bb6-4b68-b00b-b49a9e715090,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e6acfb11-941d-450b-8d93-0e32240df94a.f5d7c5e3-8c41-42e0-b50d-8b1ebe936b3c 1G" returned: 0 in 0.566s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:38:38 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-f8c4529d-0d33-42e2-973f-2e272dcea2e7 tempest-SnapshotDataIntegrityTests-898447071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e6acfb11-941d-450b-8d93-0e32240df94a.629af985-2bb6-4b68-b00b-b49a9e715090 -F qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e6acfb11-941d-450b-8d93-0e32240df94a.f5d7c5e3-8c41-42e0-b50d-8b1ebe936b3c {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:38:38 devstack sudo[113683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e6acfb11-941d-450b-8d93-0e32240df94a.629af985-2bb6-4b68-b00b-b49a9e715090 -F qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e6acfb11-941d-450b-8d93-0e32240df94a.f5d7c5e3-8c41-42e0-b50d-8b1ebe936b3c Jul 31 12:38:38 devstack sudo[113683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:38:38 devstack sudo[113681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-c56b3165-dc88-48c1-a1b8-e325bcf9d9c7 Jul 31 12:38:38 devstack sudo[113681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:38:38 devstack sudo[113680]: pam_unix(sudo:session): session closed for user root Jul 31 12:38:38 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-1041e9e8-7196-4686-af83-8f3852b0ab55 tempest-VolumeImageDependencyTests-1366750687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0b1ce179-4800-405a-a0dd-40b9d0c101be" returned: 0 in 0.261s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:38:38 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-1041e9e8-7196-4686-af83-8f3852b0ab55 tempest-VolumeImageDependencyTests-1366750687 None] Lock "cinder-quobyte-0b1ce179-4800-405a-a0dd-40b9d0c101be" released by "delete_volume" :: held 0.767s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:38:38 devstack cinder-volume[89182]: DEBUG cinder.quota [None req-1041e9e8-7196-4686-af83-8f3852b0ab55 tempest-VolumeImageDependencyTests-1366750687 None] Created reservations ['4df643fe-1480-4957-a378-af3f74fed9cc', '244c7428-4e3d-443e-aa76-decc9b3d1086', '9faeba67-9c10-4e24-b8c9-bdc79f41f954', 'b1c3f77a-8314-4903-a684-cf8720c163de'] {{(pid=89182) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 12:38:38 devstack sudo[113683]: pam_unix(sudo:session): session closed for user root Jul 31 12:38:38 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-f8c4529d-0d33-42e2-973f-2e272dcea2e7 tempest-SnapshotDataIntegrityTests-898447071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e6acfb11-941d-450b-8d93-0e32240df94a.629af985-2bb6-4b68-b00b-b49a9e715090 -F qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e6acfb11-941d-450b-8d93-0e32240df94a.f5d7c5e3-8c41-42e0-b50d-8b1ebe936b3c" returned: 0 in 0.353s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:38:38 devstack cinder-volume[89182]: WARNING cinder.volume.drivers.remotefs [None req-f8c4529d-0d33-42e2-973f-2e272dcea2e7 tempest-SnapshotDataIntegrityTests-898447071 None] /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e6acfb11-941d-450b-8d93-0e32240df94a.f5d7c5e3-8c41-42e0-b50d-8b1ebe936b3c is being set with open permissions: ugo+rw Jul 31 12:38:38 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-f8c4529d-0d33-42e2-973f-2e272dcea2e7 tempest-SnapshotDataIntegrityTests-898447071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e6acfb11-941d-450b-8d93-0e32240df94a.f5d7c5e3-8c41-42e0-b50d-8b1ebe936b3c {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:38:38 devstack sudo[113681]: pam_unix(sudo:session): session closed for user root Jul 31 12:38:38 devstack sudo[113694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e6acfb11-941d-450b-8d93-0e32240df94a.f5d7c5e3-8c41-42e0-b50d-8b1ebe936b3c Jul 31 12:38:38 devstack sudo[113694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:38:38 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-e32ee960-9985-42f4-8eaa-e5a6e69e42a8 tempest-ProjectReaderTests-1403756841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-c56b3165-dc88-48c1-a1b8-e325bcf9d9c7" returned: 0 in 0.417s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:38:38 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-e32ee960-9985-42f4-8eaa-e5a6e69e42a8 tempest-ProjectReaderTests-1403756841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-c56b3165-dc88-48c1-a1b8-e325bcf9d9c7 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:38:38 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-1041e9e8-7196-4686-af83-8f3852b0ab55 tempest-VolumeImageDependencyTests-1366750687 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:38:38 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-1041e9e8-7196-4686-af83-8f3852b0ab55 tempest-VolumeImageDependencyTests-1366750687 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:38:38 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-1041e9e8-7196-4686-af83-8f3852b0ab55 tempest-VolumeImageDependencyTests-1366750687 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:38:38 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-1041e9e8-7196-4686-af83-8f3852b0ab55 tempest-VolumeImageDependencyTests-1366750687 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:38:38 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-1041e9e8-7196-4686-af83-8f3852b0ab55 tempest-VolumeImageDependencyTests-1366750687 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:38:38 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-1041e9e8-7196-4686-af83-8f3852b0ab55 tempest-VolumeImageDependencyTests-1366750687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:38:38 devstack sudo[113696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-c56b3165-dc88-48c1-a1b8-e325bcf9d9c7 Jul 31 12:38:38 devstack sudo[113696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:38:38 devstack sudo[113698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 Jul 31 12:38:38 devstack sudo[113698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:38:38 devstack sudo[113694]: pam_unix(sudo:session): session closed for user root Jul 31 12:38:38 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-f8c4529d-0d33-42e2-973f-2e272dcea2e7 tempest-SnapshotDataIntegrityTests-898447071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e6acfb11-941d-450b-8d93-0e32240df94a.f5d7c5e3-8c41-42e0-b50d-8b1ebe936b3c" returned: 0 in 0.291s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:38:38 devstack cinder-volume[89182]: DEBUG cinder.compute.nova [None req-f8c4529d-0d33-42e2-973f-2e272dcea2e7 tempest-SnapshotDataIntegrityTests-898447071 None] Creating Keystone auth plugin from conf {{(pid=89182) novaclient /opt/stack/cinder/cinder/compute/nova.py:99}} Jul 31 12:38:38 devstack sudo[113696]: pam_unix(sudo:session): session closed for user root Jul 31 12:38:38 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-e32ee960-9985-42f4-8eaa-e5a6e69e42a8 tempest-ProjectReaderTests-1403756841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-c56b3165-dc88-48c1-a1b8-e325bcf9d9c7" returned: 0 in 0.283s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:38:38 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-e32ee960-9985-42f4-8eaa-e5a6e69e42a8 tempest-ProjectReaderTests-1403756841 None] Lock "cinder-quobyte-c56b3165-dc88-48c1-a1b8-e325bcf9d9c7" released by "delete_volume" :: held 0.764s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:38:38 devstack sudo[113698]: pam_unix(sudo:session): session closed for user root Jul 31 12:38:38 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-1041e9e8-7196-4686-af83-8f3852b0ab55 tempest-VolumeImageDependencyTests-1366750687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2" returned: 0 in 0.328s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:38:38 devstack cinder-volume[89182]: DEBUG cinder.manager [None req-1041e9e8-7196-4686-af83-8f3852b0ab55 tempest-VolumeImageDependencyTests-1366750687 None] Notifying Schedulers of capabilities ... {{(pid=89182) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 12:38:38 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-1041e9e8-7196-4686-af83-8f3852b0ab55 tempest-VolumeImageDependencyTests-1366750687 None] Deleted volume successfully. Jul 31 12:38:38 devstack cinder-volume[89182]: DEBUG cinder.quota [None req-e32ee960-9985-42f4-8eaa-e5a6e69e42a8 tempest-ProjectReaderTests-1403756841 None] Created reservations ['d29174bd-d557-472d-844f-3491bfb854f6', '37bcf862-dfbb-4ee8-9d1e-7962ca1f18a6', '031bea7f-bca6-4472-91d4-4470a3d0dad2', '819811c4-2103-460b-b271-0d86b1bb2728'] {{(pid=89182) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 12:38:38 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-1041e9e8-7196-4686-af83-8f3852b0ab55 tempest-VolumeImageDependencyTests-1366750687 None] Lock "cinder-0b1ce179-4800-405a-a0dd-40b9d0c101be-delete_volume" released by "delete_volume" :: held 1.408s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:38:38 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-e32ee960-9985-42f4-8eaa-e5a6e69e42a8 tempest-ProjectReaderTests-1403756841 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:38:38 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-e32ee960-9985-42f4-8eaa-e5a6e69e42a8 tempest-ProjectReaderTests-1403756841 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:38:38 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-e32ee960-9985-42f4-8eaa-e5a6e69e42a8 tempest-ProjectReaderTests-1403756841 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:38:38 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-e32ee960-9985-42f4-8eaa-e5a6e69e42a8 tempest-ProjectReaderTests-1403756841 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:38:38 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-e32ee960-9985-42f4-8eaa-e5a6e69e42a8 tempest-ProjectReaderTests-1403756841 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:38:38 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-e32ee960-9985-42f4-8eaa-e5a6e69e42a8 tempest-ProjectReaderTests-1403756841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:38:38 devstack sudo[113703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 Jul 31 12:38:38 devstack sudo[113703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:38:38 devstack cinder-volume[89182]: DEBUG novaclient.v2.client [None req-f8c4529d-0d33-42e2-973f-2e272dcea2e7 tempest-SnapshotDataIntegrityTests-898447071 None] REQ: curl -g -i -X POST http://192.168.122.21/compute/v2.1/os-assisted-volume-snapshots -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}5aab0478b781b754393de59863a3acc895035678244f1726ad488a0115318b9f" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-f8c4529d-0d33-42e2-973f-2e272dcea2e7" -H "X-Service-Token: {SHA256}02a8645ba5bc7d3f7d0a93a9d02f784466607492168e4b335483720fa1daddd6" -d '{"snapshot": {"volume_id": "e6acfb11-941d-450b-8d93-0e32240df94a", "create_info": {"type": "qcow2", "new_file": "volume-e6acfb11-941d-450b-8d93-0e32240df94a.f5d7c5e3-8c41-42e0-b50d-8b1ebe936b3c", "snapshot_id": "f5d7c5e3-8c41-42e0-b50d-8b1ebe936b3c"}}}' {{(pid=89182) _http_log_request /opt/stack/data/venv/lib/python3.12/site-packages/keystoneauth1/session.py:575}} Jul 31 12:38:39 devstack cinder-volume[89182]: DEBUG novaclient.v2.client [None req-f8c4529d-0d33-42e2-973f-2e272dcea2e7 tempest-SnapshotDataIntegrityTests-898447071 None] RESP: [200] Connection: close Content-Length: 78 Content-Type: application/json Date: Fri, 31 Jul 2026 10:38:38 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.58 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-ad475371-f481-4592-a8ef-0d593dd559b7 x-openstack-request-id: req-ad475371-f481-4592-a8ef-0d593dd559b7 {{(pid=89182) _http_log_response /opt/stack/data/venv/lib/python3.12/site-packages/keystoneauth1/session.py:616}} Jul 31 12:38:39 devstack cinder-volume[89182]: DEBUG novaclient.v2.client [None req-f8c4529d-0d33-42e2-973f-2e272dcea2e7 tempest-SnapshotDataIntegrityTests-898447071 None] RESP BODY: {"snapshot": {"id": null, "volumeId": "e6acfb11-941d-450b-8d93-0e32240df94a"}} {{(pid=89182) _http_log_response /opt/stack/data/venv/lib/python3.12/site-packages/keystoneauth1/session.py:651}} Jul 31 12:38:39 devstack cinder-volume[89182]: DEBUG novaclient.v2.client [None req-f8c4529d-0d33-42e2-973f-2e272dcea2e7 tempest-SnapshotDataIntegrityTests-898447071 None] POST call to compute for http://192.168.122.21/compute/v2.1/os-assisted-volume-snapshots used request id req-ad475371-f481-4592-a8ef-0d593dd559b7 {{(pid=89182) request /opt/stack/data/venv/lib/python3.12/site-packages/keystoneauth1/session.py:1076}} Jul 31 12:38:39 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-f8c4529d-0d33-42e2-973f-2e272dcea2e7 tempest-SnapshotDataIntegrityTests-898447071 None] nova call result: None {{(pid=89182) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1910}} Jul 31 12:38:39 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-f8c4529d-0d33-42e2-973f-2e272dcea2e7 tempest-SnapshotDataIntegrityTests-898447071 None] Status of snapshot f5d7c5e3-8c41-42e0-b50d-8b1ebe936b3c is now creating {{(pid=89182) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Jul 31 12:38:39 devstack sudo[113703]: pam_unix(sudo:session): session closed for user root Jul 31 12:38:39 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-e32ee960-9985-42f4-8eaa-e5a6e69e42a8 tempest-ProjectReaderTests-1403756841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2" returned: 0 in 0.329s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:38:39 devstack cinder-volume[89182]: DEBUG cinder.manager [None req-e32ee960-9985-42f4-8eaa-e5a6e69e42a8 tempest-ProjectReaderTests-1403756841 None] Notifying Schedulers of capabilities ... {{(pid=89182) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 12:38:39 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-e32ee960-9985-42f4-8eaa-e5a6e69e42a8 tempest-ProjectReaderTests-1403756841 None] Deleted volume successfully. Jul 31 12:38:39 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-e32ee960-9985-42f4-8eaa-e5a6e69e42a8 tempest-ProjectReaderTests-1403756841 None] Lock "cinder-c56b3165-dc88-48c1-a1b8-e325bcf9d9c7-delete_volume" released by "delete_volume" :: held 1.368s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:38:39 devstack cinder-volume[89182]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd573246-bc94-4a64-9e81-c8aa630147c7 tempest-ProjectReaderTests-1403756841 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89182) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 12:38:39 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-bd573246-bc94-4a64-9e81-c8aa630147c7 tempest-ProjectReaderTests-1403756841 None] Flow 'volume_create_manager' (a352c1c3-97b3-40e5-b0d2-83f2948af4a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:38:39 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-bd573246-bc94-4a64-9e81-c8aa630147c7 tempest-ProjectReaderTests-1403756841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (873c14d1-bca3-4551-9e8b-2f76b6049e94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:38:39 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-bd573246-bc94-4a64-9e81-c8aa630147c7 tempest-ProjectReaderTests-1403756841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (873c14d1-bca3-4551-9e8b-2f76b6049e94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:38:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-101145333',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8509895-f89a-4bc9-bcd8-141e67ef7496,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f3d0306f6a14ffa9b6c897b6fc4c21a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:38:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:38:40Z,use_quota=True,user_id='21a6903f438141de9ad7d31e5e806c6f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:38:39 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-bd573246-bc94-4a64-9e81-c8aa630147c7 tempest-ProjectReaderTests-1403756841 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0fc57a39-eecf-4953-838c-0e91674c9c68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:38:39 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-bd573246-bc94-4a64-9e81-c8aa630147c7 tempest-ProjectReaderTests-1403756841 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0fc57a39-eecf-4953-838c-0e91674c9c68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:38:39 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-bd573246-bc94-4a64-9e81-c8aa630147c7 tempest-ProjectReaderTests-1403756841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80687312-285b-4156-ad96-daf953cc6ca4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:38:39 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-bd573246-bc94-4a64-9e81-c8aa630147c7 tempest-ProjectReaderTests-1403756841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80687312-285b-4156-ad96-daf953cc6ca4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e8509895-f89a-4bc9-bcd8-141e67ef7496', 'volume_name': 'volume-e8509895-f89a-4bc9-bcd8-141e67ef7496', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:38:39 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-bd573246-bc94-4a64-9e81-c8aa630147c7 tempest-ProjectReaderTests-1403756841 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c816338-4c5f-45e6-9dbb-d6e0cac3d078) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:38:39 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-bd573246-bc94-4a64-9e81-c8aa630147c7 tempest-ProjectReaderTests-1403756841 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c816338-4c5f-45e6-9dbb-d6e0cac3d078) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:38:39 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-bd573246-bc94-4a64-9e81-c8aa630147c7 tempest-ProjectReaderTests-1403756841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1afb579-382b-4e59-96b2-b4fa3484605a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:38:39 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-bd573246-bc94-4a64-9e81-c8aa630147c7 tempest-ProjectReaderTests-1403756841 None] Volume e8509895-f89a-4bc9-bcd8-141e67ef7496: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e8509895-f89a-4bc9-bcd8-141e67ef7496', 'volume_size': 1} Jul 31 12:38:39 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-bd573246-bc94-4a64-9e81-c8aa630147c7 tempest-ProjectReaderTests-1403756841 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:38:40 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-f8c4529d-0d33-42e2-973f-2e272dcea2e7 tempest-SnapshotDataIntegrityTests-898447071 None] Status of snapshot f5d7c5e3-8c41-42e0-b50d-8b1ebe936b3c is now creating {{(pid=89182) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Jul 31 12:38:41 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-f8c4529d-0d33-42e2-973f-2e272dcea2e7 tempest-SnapshotDataIntegrityTests-898447071 None] Status of snapshot f5d7c5e3-8c41-42e0-b50d-8b1ebe936b3c is now creating {{(pid=89182) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Jul 31 12:38:41 devstack cinder-volume[89182]: DEBUG cinder.volume.flows.manager.create_volume [None req-9081e8c7-78bd-4a69-b588-ddbfbf9d506f tempest-VolumeImageDependencyTests-1366750687 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89182) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 12:38:41 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-9081e8c7-78bd-4a69-b588-ddbfbf9d506f tempest-VolumeImageDependencyTests-1366750687 None] Flow 'volume_create_manager' (08d9d435-f8cc-41c7-a03f-f5c0cd83272d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:38:41 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-9081e8c7-78bd-4a69-b588-ddbfbf9d506f tempest-VolumeImageDependencyTests-1366750687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7aba1cb7-9a48-4b4a-a518-319fc7b98c51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:38:41 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-9081e8c7-78bd-4a69-b588-ddbfbf9d506f tempest-VolumeImageDependencyTests-1366750687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7aba1cb7-9a48-4b4a-a518-319fc7b98c51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:38:41Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-teste6050452-06bd-4c7f-9912-45178c83e379',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c968dbb-687c-450d-a061-fe29cb89c249,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d0755f1e2ea4124a760580edccedbe3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:38:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:38:42Z,use_quota=True,user_id='b44e6e9d7b9542c6aea2ca270c251a89',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:38:41 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-9081e8c7-78bd-4a69-b588-ddbfbf9d506f tempest-VolumeImageDependencyTests-1366750687 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eab0e85f-bee1-48eb-b5d8-9b42ec4cf916) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:38:41 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-9081e8c7-78bd-4a69-b588-ddbfbf9d506f tempest-VolumeImageDependencyTests-1366750687 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eab0e85f-bee1-48eb-b5d8-9b42ec4cf916) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:38:41 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-9081e8c7-78bd-4a69-b588-ddbfbf9d506f tempest-VolumeImageDependencyTests-1366750687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f35fce39-24ce-4ff4-9abf-1e4d397b7218) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:38:41 devstack cinder-volume[89182]: DEBUG cinder.image.glance [None req-9081e8c7-78bd-4a69-b588-ddbfbf9d506f tempest-VolumeImageDependencyTests-1366750687 None] Creating Keystone auth plugin from conf {{(pid=89182) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 31 12:38:41 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-9081e8c7-78bd-4a69-b588-ddbfbf9d506f tempest-VolumeImageDependencyTests-1366750687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f35fce39-24ce-4ff4-9abf-1e4d397b7218) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '7c968dbb-687c-450d-a061-fe29cb89c249', 'volume_name': 'volume-7c968dbb-687c-450d-a061-fe29cb89c249', 'volume_size': 1, 'image_id': '70ac6b45-8eec-49b4-aabc-77d3741406c4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/70ac6b45-8eec-49b4-aabc-77d3741406c4', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-e6050452-06bd-4c7f-9912-45178c83e379', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'c193dec42b6800c0a63c5e152dfa11a2', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '2d0755f1e2ea4124a760580edccedbe3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '4cf21071519b06cb6064afc4fabaf2e1eb6d96e8dd427331d4a2e7ed26e4e0ced7d504ba19480e0d1e7733dae10a1c5653787c7b84b04f14c346f7923341f466', 'id': '70ac6b45-8eec-49b4-aabc-77d3741406c4', 'created_at': datetime.datetime(2026, 7, 31, 10, 38, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 31, 10, 38, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/70ac6b45-8eec-49b4-aabc-77d3741406c4/file', 'properties': {}}, 'image_service': }' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:38:41 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-9081e8c7-78bd-4a69-b588-ddbfbf9d506f tempest-VolumeImageDependencyTests-1366750687 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec8646d9-2811-462b-9a26-5f64e13c1c5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:38:41 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-9081e8c7-78bd-4a69-b588-ddbfbf9d506f tempest-VolumeImageDependencyTests-1366750687 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec8646d9-2811-462b-9a26-5f64e13c1c5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:38:41 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-9081e8c7-78bd-4a69-b588-ddbfbf9d506f tempest-VolumeImageDependencyTests-1366750687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0260b99-9614-46f6-94ae-42d1ffc9479d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:38:41 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-9081e8c7-78bd-4a69-b588-ddbfbf9d506f tempest-VolumeImageDependencyTests-1366750687 None] Volume 7c968dbb-687c-450d-a061-fe29cb89c249: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-7c968dbb-687c-450d-a061-fe29cb89c249', 'volume_size': 1, 'image_id': '70ac6b45-8eec-49b4-aabc-77d3741406c4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/70ac6b45-8eec-49b4-aabc-77d3741406c4', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-e6050452-06bd-4c7f-9912-45178c83e379', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'c193dec42b6800c0a63c5e152dfa11a2', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '2d0755f1e2ea4124a760580edccedbe3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '4cf21071519b06cb6064afc4fabaf2e1eb6d96e8dd427331d4a2e7ed26e4e0ced7d504ba19480e0d1e7733dae10a1c5653787c7b84b04f14c346f7923341f466', 'id': '70ac6b45-8eec-49b4-aabc-77d3741406c4', 'created_at': datetime.datetime(2026, 7, 31, 10, 38, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 31, 10, 38, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/70ac6b45-8eec-49b4-aabc-77d3741406c4/file', 'properties': {}}, 'image_service': } Jul 31 12:38:42 devstack cinder-volume[89182]: DEBUG cinder.volume.flows.manager.create_volume [None req-9081e8c7-78bd-4a69-b588-ddbfbf9d506f tempest-VolumeImageDependencyTests-1366750687 None] Trying to clone 7c968dbb-687c-450d-a061-fe29cb89c249 from image 70ac6b45-8eec-49b4-aabc-77d3741406c4 at location (None, [{'url': 'file:///opt/stack/data/glance/images/70ac6b45-8eec-49b4-aabc-77d3741406c4', 'metadata': {}}]). {{(pid=89182) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 31 12:38:42 devstack cinder-volume[89182]: DEBUG cinder.image.image_utils [None req-9081e8c7-78bd-4a69-b588-ddbfbf9d506f tempest-VolumeImageDependencyTests-1366750687 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_70ac6b45-8eec-49b4-aabc-77d3741406c4_o51e93_fdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=89182) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 31 12:38:42 devstack cinder-volume[89182]: INFO cinder.image.image_utils [None req-9081e8c7-78bd-4a69-b588-ddbfbf9d506f tempest-VolumeImageDependencyTests-1366750687 None] Image download 0.00 MB at 0.00 MB/s Jul 31 12:38:42 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[f550b74b-19c4-4f19-8302-cd04b23b8ccf]: (4, 'raw') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:38:42 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-9081e8c7-78bd-4a69-b588-ddbfbf9d506f tempest-VolumeImageDependencyTests-1366750687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_70ac6b45-8eec-49b4-aabc-77d3741406c4_o51e93_fdevstack@QuobyteHD {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:38:42 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-f8c4529d-0d33-42e2-973f-2e272dcea2e7 tempest-SnapshotDataIntegrityTests-898447071 None] Status of snapshot f5d7c5e3-8c41-42e0-b50d-8b1ebe936b3c is now creating {{(pid=89182) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Jul 31 12:38:42 devstack sudo[113711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_70ac6b45-8eec-49b4-aabc-77d3741406c4_o51e93_fdevstack@QuobyteHD Jul 31 12:38:42 devstack sudo[113711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:38:42 devstack sudo[113711]: pam_unix(sudo:session): session closed for user root Jul 31 12:38:42 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-9081e8c7-78bd-4a69-b588-ddbfbf9d506f tempest-VolumeImageDependencyTests-1366750687 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_70ac6b45-8eec-49b4-aabc-77d3741406c4_o51e93_fdevstack@QuobyteHD" returned: 0 in 0.330s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:38:42 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-9081e8c7-78bd-4a69-b588-ddbfbf9d506f tempest-VolumeImageDependencyTests-1366750687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_70ac6b45-8eec-49b4-aabc-77d3741406c4_o51e93_fdevstack@QuobyteHD {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:38:42 devstack sudo[113715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_70ac6b45-8eec-49b4-aabc-77d3741406c4_o51e93_fdevstack@QuobyteHD Jul 31 12:38:42 devstack sudo[113715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:38:42 devstack sudo[113715]: pam_unix(sudo:session): session closed for user root Jul 31 12:38:42 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-9081e8c7-78bd-4a69-b588-ddbfbf9d506f tempest-VolumeImageDependencyTests-1366750687 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_70ac6b45-8eec-49b4-aabc-77d3741406c4_o51e93_fdevstack@QuobyteHD" returned: 1 in 0.325s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:38:42 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-9081e8c7-78bd-4a69-b588-ddbfbf9d506f tempest-VolumeImageDependencyTests-1366750687 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_70ac6b45-8eec-49b4-aabc-77d3741406c4_o51e93_fdevstack@QuobyteHD' failed. Not Retrying. {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 31 12:38:42 devstack cinder-volume[89182]: DEBUG cinder.image.image_utils [None req-9081e8c7-78bd-4a69-b588-ddbfbf9d506f tempest-VolumeImageDependencyTests-1366750687 None] Temporary image 70ac6b45-8eec-49b4-aabc-77d3741406c4 is fetched for user b44e6e9d7b9542c6aea2ca270c251a89. {{(pid=89182) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 31 12:38:42 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[a89f4694-8468-44d2-b775-eb9bb2e5d72e]: (4, 'raw') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:38:42 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-9081e8c7-78bd-4a69-b588-ddbfbf9d506f tempest-VolumeImageDependencyTests-1366750687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_70ac6b45-8eec-49b4-aabc-77d3741406c4_o51e93_fdevstack@QuobyteHD {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:38:42 devstack sudo[113720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_70ac6b45-8eec-49b4-aabc-77d3741406c4_o51e93_fdevstack@QuobyteHD Jul 31 12:38:42 devstack sudo[113720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:38:43 devstack sudo[113720]: pam_unix(sudo:session): session closed for user root Jul 31 12:38:43 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-9081e8c7-78bd-4a69-b588-ddbfbf9d506f tempest-VolumeImageDependencyTests-1366750687 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_70ac6b45-8eec-49b4-aabc-77d3741406c4_o51e93_fdevstack@QuobyteHD" returned: 0 in 0.338s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:38:43 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-9081e8c7-78bd-4a69-b588-ddbfbf9d506f tempest-VolumeImageDependencyTests-1366750687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_70ac6b45-8eec-49b4-aabc-77d3741406c4_o51e93_fdevstack@QuobyteHD {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:38:43 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-f8c4529d-0d33-42e2-973f-2e272dcea2e7 tempest-SnapshotDataIntegrityTests-898447071 None] Status of snapshot f5d7c5e3-8c41-42e0-b50d-8b1ebe936b3c is now creating {{(pid=89182) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Jul 31 12:38:43 devstack sudo[113724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_70ac6b45-8eec-49b4-aabc-77d3741406c4_o51e93_fdevstack@QuobyteHD Jul 31 12:38:43 devstack sudo[113724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:38:43 devstack sudo[113724]: pam_unix(sudo:session): session closed for user root Jul 31 12:38:43 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-9081e8c7-78bd-4a69-b588-ddbfbf9d506f tempest-VolumeImageDependencyTests-1366750687 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_70ac6b45-8eec-49b4-aabc-77d3741406c4_o51e93_fdevstack@QuobyteHD" returned: 1 in 0.336s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:38:43 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-9081e8c7-78bd-4a69-b588-ddbfbf9d506f tempest-VolumeImageDependencyTests-1366750687 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_70ac6b45-8eec-49b4-aabc-77d3741406c4_o51e93_fdevstack@QuobyteHD' failed. Not Retrying. {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 31 12:38:43 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-9081e8c7-78bd-4a69-b588-ddbfbf9d506f tempest-VolumeImageDependencyTests-1366750687 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:38:44 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-f8c4529d-0d33-42e2-973f-2e272dcea2e7 tempest-SnapshotDataIntegrityTests-898447071 None] Status of snapshot f5d7c5e3-8c41-42e0-b50d-8b1ebe936b3c is now creating {{(pid=89182) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Jul 31 12:38:45 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-f8c4529d-0d33-42e2-973f-2e272dcea2e7 tempest-SnapshotDataIntegrityTests-898447071 None] Status of snapshot f5d7c5e3-8c41-42e0-b50d-8b1ebe936b3c is now creating {{(pid=89182) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Jul 31 12:38:46 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-f8c4529d-0d33-42e2-973f-2e272dcea2e7 tempest-SnapshotDataIntegrityTests-898447071 None] Status of snapshot f5d7c5e3-8c41-42e0-b50d-8b1ebe936b3c is now creating {{(pid=89182) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Jul 31 12:38:47 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-f8c4529d-0d33-42e2-973f-2e272dcea2e7 tempest-SnapshotDataIntegrityTests-898447071 None] Status of snapshot f5d7c5e3-8c41-42e0-b50d-8b1ebe936b3c is now creating {{(pid=89182) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Jul 31 12:38:48 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-f8c4529d-0d33-42e2-973f-2e272dcea2e7 tempest-SnapshotDataIntegrityTests-898447071 None] Status of snapshot f5d7c5e3-8c41-42e0-b50d-8b1ebe936b3c is now creating {{(pid=89182) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Jul 31 12:38:49 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-f8c4529d-0d33-42e2-973f-2e272dcea2e7 tempest-SnapshotDataIntegrityTests-898447071 None] Status of snapshot f5d7c5e3-8c41-42e0-b50d-8b1ebe936b3c is now creating {{(pid=89182) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Jul 31 12:38:50 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-f8c4529d-0d33-42e2-973f-2e272dcea2e7 tempest-SnapshotDataIntegrityTests-898447071 None] Status of snapshot f5d7c5e3-8c41-42e0-b50d-8b1ebe936b3c is now creating {{(pid=89182) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Jul 31 12:38:52 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-f8c4529d-0d33-42e2-973f-2e272dcea2e7 tempest-SnapshotDataIntegrityTests-898447071 None] Status of snapshot f5d7c5e3-8c41-42e0-b50d-8b1ebe936b3c is now creating {{(pid=89182) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Jul 31 12:38:54 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-f8c4529d-0d33-42e2-973f-2e272dcea2e7 tempest-SnapshotDataIntegrityTests-898447071 None] Status of snapshot f5d7c5e3-8c41-42e0-b50d-8b1ebe936b3c is now creating {{(pid=89182) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Jul 31 12:38:56 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-f8c4529d-0d33-42e2-973f-2e272dcea2e7 tempest-SnapshotDataIntegrityTests-898447071 None] Status of snapshot f5d7c5e3-8c41-42e0-b50d-8b1ebe936b3c is now creating {{(pid=89182) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Jul 31 12:38:56 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-f8c4529d-0d33-42e2-973f-2e272dcea2e7 tempest-SnapshotDataIntegrityTests-898447071 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 19.365s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:38:56 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-27c9cfcb-4d9d-4d83-8617-34afc11f46f6 tempest-VolumeDependencyTests-442009576 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 23.362s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:38:56 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-27c9cfcb-4d9d-4d83-8617-34afc11f46f6 tempest-VolumeDependencyTests-442009576 None] Acquiring lock "cinder-quobyte-f9e81161-c5c2-415a-bfde-8c397c2bd711-a7df6ef4-cfe2-419c-85f1-b7b92de716fa" by "_create_volume_from_snapshot" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:38:56 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-27c9cfcb-4d9d-4d83-8617-34afc11f46f6 tempest-VolumeDependencyTests-442009576 None] Lock "cinder-quobyte-f9e81161-c5c2-415a-bfde-8c397c2bd711-a7df6ef4-cfe2-419c-85f1-b7b92de716fa" acquired by "_create_volume_from_snapshot" :: waited 0.020s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:38:56 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-27c9cfcb-4d9d-4d83-8617-34afc11f46f6 tempest-VolumeDependencyTests-442009576 None] Creating volume a7df6ef4-cfe2-419c-85f1-b7b92de716fa from snapshot f9e81161-c5c2-415a-bfde-8c397c2bd711 {{(pid=89182) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 31 12:38:56 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-27c9cfcb-4d9d-4d83-8617-34afc11f46f6 tempest-VolumeDependencyTests-442009576 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:38:56 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-27c9cfcb-4d9d-4d83-8617-34afc11f46f6 tempest-VolumeDependencyTests-442009576 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:38:56 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-27c9cfcb-4d9d-4d83-8617-34afc11f46f6 tempest-VolumeDependencyTests-442009576 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:38:56 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-27c9cfcb-4d9d-4d83-8617-34afc11f46f6 tempest-VolumeDependencyTests-442009576 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:38:56 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-27c9cfcb-4d9d-4d83-8617-34afc11f46f6 tempest-VolumeDependencyTests-442009576 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:38:56 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-27c9cfcb-4d9d-4d83-8617-34afc11f46f6 tempest-VolumeDependencyTests-442009576 None] Selected osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 as target Quobyte volume. {{(pid=89182) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 12:38:56 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-27c9cfcb-4d9d-4d83-8617-34afc11f46f6 tempest-VolumeDependencyTests-442009576 None] Acquiring lock "cinder-quobyte-a7df6ef4-cfe2-419c-85f1-b7b92de716fa" by "_copy_volume_from_snapshot" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:38:56 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-27c9cfcb-4d9d-4d83-8617-34afc11f46f6 tempest-VolumeDependencyTests-442009576 None] Lock "cinder-quobyte-a7df6ef4-cfe2-419c-85f1-b7b92de716fa" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:38:56 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-27c9cfcb-4d9d-4d83-8617-34afc11f46f6 tempest-VolumeDependencyTests-442009576 None] snapshot: f9e81161-c5c2-415a-bfde-8c397c2bd711, volume: a7df6ef4-cfe2-419c-85f1-b7b92de716fa, {{(pid=89182) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Jul 31 12:38:56 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-27c9cfcb-4d9d-4d83-8617-34afc11f46f6 tempest-VolumeDependencyTests-442009576 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:38:56 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-27c9cfcb-4d9d-4d83-8617-34afc11f46f6 tempest-VolumeDependencyTests-442009576 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:38:56 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-27c9cfcb-4d9d-4d83-8617-34afc11f46f6 tempest-VolumeDependencyTests-442009576 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:38:56 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-27c9cfcb-4d9d-4d83-8617-34afc11f46f6 tempest-VolumeDependencyTests-442009576 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:38:56 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-27c9cfcb-4d9d-4d83-8617-34afc11f46f6 tempest-VolumeDependencyTests-442009576 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:38:56 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bbe52b9-9cb1-44ae-ac02-e21fa43de90f]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:38:56 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-27c9cfcb-4d9d-4d83-8617-34afc11f46f6 tempest-VolumeDependencyTests-442009576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-45b0745c-de5b-49ba-afd5-559c565cbf66.f9e81161-c5c2-415a-bfde-8c397c2bd711 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:38:56 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-f8c4529d-0d33-42e2-973f-2e272dcea2e7 tempest-SnapshotDataIntegrityTests-898447071 None] Create snapshot completed successfully Jul 31 12:38:56 devstack sudo[113780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-45b0745c-de5b-49ba-afd5-559c565cbf66.f9e81161-c5c2-415a-bfde-8c397c2bd711 Jul 31 12:38:56 devstack sudo[113780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:38:56 devstack sudo[113780]: pam_unix(sudo:session): session closed for user root Jul 31 12:38:56 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-27c9cfcb-4d9d-4d83-8617-34afc11f46f6 tempest-VolumeDependencyTests-442009576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-45b0745c-de5b-49ba-afd5-559c565cbf66.f9e81161-c5c2-415a-bfde-8c397c2bd711" returned: 0 in 0.372s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:38:56 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-27c9cfcb-4d9d-4d83-8617-34afc11f46f6 tempest-VolumeDependencyTests-442009576 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-45b0745c-de5b-49ba-afd5-559c565cbf66(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89182) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 12:38:56 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[8164a54e-797b-43db-a35f-32c89a065f64]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:38:56 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-27c9cfcb-4d9d-4d83-8617-34afc11f46f6 tempest-VolumeDependencyTests-442009576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-45b0745c-de5b-49ba-afd5-559c565cbf66 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:38:56 devstack sudo[113785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-45b0745c-de5b-49ba-afd5-559c565cbf66 Jul 31 12:38:56 devstack sudo[113785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:38:57 devstack sudo[113785]: pam_unix(sudo:session): session closed for user root Jul 31 12:38:57 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-27c9cfcb-4d9d-4d83-8617-34afc11f46f6 tempest-VolumeDependencyTests-442009576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-45b0745c-de5b-49ba-afd5-559c565cbf66" returned: 0 in 0.382s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:38:57 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-27c9cfcb-4d9d-4d83-8617-34afc11f46f6 tempest-VolumeDependencyTests-442009576 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-45b0745c-de5b-49ba-afd5-559c565cbf66 {{(pid=89182) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Jul 31 12:38:57 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-27c9cfcb-4d9d-4d83-8617-34afc11f46f6 tempest-VolumeDependencyTests-442009576 None] Creating direct copy from snapshot {{(pid=89182) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Jul 31 12:38:57 devstack cinder-volume[89182]: DEBUG cinder.utils [None req-27c9cfcb-4d9d-4d83-8617-34afc11f46f6 tempest-VolumeDependencyTests-442009576 None] Path /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-a7df6ef4-cfe2-419c-85f1-b7b92de716fa not found in is_blk_device check {{(pid=89182) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 31 12:38:57 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-27c9cfcb-4d9d-4d83-8617-34afc11f46f6 tempest-VolumeDependencyTests-442009576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-45b0745c-de5b-49ba-afd5-559c565cbf66 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-a7df6ef4-cfe2-419c-85f1-b7b92de716fa {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:38:57 devstack sudo[113791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-45b0745c-de5b-49ba-afd5-559c565cbf66 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-a7df6ef4-cfe2-419c-85f1-b7b92de716fa Jul 31 12:38:57 devstack sudo[113791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:38:59 devstack cinder-volume[89182]: INFO cinder.volume.manager [req-1f6e2348-a91e-40e4-b7f0-b44437c443f7 req-28e09574-a020-4f23-b152-83ea5ff9b9af tempest-SnapshotDataIntegrityTests-898447071 None] Terminate volume connection completed successfully. Jul 31 12:38:59 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [req-1f6e2348-a91e-40e4-b7f0-b44437c443f7 req-28e09574-a020-4f23-b152-83ea5ff9b9af tempest-SnapshotDataIntegrityTests-898447071 None] Deleting attachment 06625027-6497-4634-90ec-02195b5dad3d. {{(pid=89182) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 31 12:39:01 devstack cinder-volume[89182]: DEBUG cinder.volume.flows.manager.create_volume [None req-e6f01f74-f1a2-4873-a7ed-4a489f8d596e tempest-SnapshotDataIntegrityTests-898447071 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89182) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 12:39:01 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-e6f01f74-f1a2-4873-a7ed-4a489f8d596e tempest-SnapshotDataIntegrityTests-898447071 None] Flow 'volume_create_manager' (01da153f-9965-46f8-a40c-c01f3dfe7edc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:39:01 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-e6f01f74-f1a2-4873-a7ed-4a489f8d596e tempest-SnapshotDataIntegrityTests-898447071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a237185-549e-447a-9379-322eb7777463) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:39:01 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-e6f01f74-f1a2-4873-a7ed-4a489f8d596e tempest-SnapshotDataIntegrityTests-898447071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a237185-549e-447a-9379-322eb7777463) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:39:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDataIntegrityTests-volume-1898138534',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bfdefc1b-faed-41b9-ba29-9e1696a07089,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e47adc7d32b64078850d9d94d5cb10bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:39:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=4a5c6e12-2302-44db-ab0e-eedae12ca53f,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:39:02Z,use_quota=True,user_id='6344cc57ebdb4e02aae72e7a719cd916',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:39:01 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-e6f01f74-f1a2-4873-a7ed-4a489f8d596e tempest-SnapshotDataIntegrityTests-898447071 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ac8cd72-805f-45a2-8a36-fcddfcdcff7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:39:01 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-e6f01f74-f1a2-4873-a7ed-4a489f8d596e tempest-SnapshotDataIntegrityTests-898447071 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ac8cd72-805f-45a2-8a36-fcddfcdcff7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:39:01 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-e6f01f74-f1a2-4873-a7ed-4a489f8d596e tempest-SnapshotDataIntegrityTests-898447071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5282a18f-a678-4f01-a2cf-457022143c25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:39:01 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-e6f01f74-f1a2-4873-a7ed-4a489f8d596e tempest-SnapshotDataIntegrityTests-898447071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5282a18f-a678-4f01-a2cf-457022143c25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'bfdefc1b-faed-41b9-ba29-9e1696a07089', 'volume_name': 'volume-bfdefc1b-faed-41b9-ba29-9e1696a07089', 'volume_size': 1, 'snapshot_id': '4a5c6e12-2302-44db-ab0e-eedae12ca53f'}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:39:01 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-e6f01f74-f1a2-4873-a7ed-4a489f8d596e tempest-SnapshotDataIntegrityTests-898447071 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf1a16fe-ac3d-4241-bdfc-e7b0e5d671fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:39:01 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-e6f01f74-f1a2-4873-a7ed-4a489f8d596e tempest-SnapshotDataIntegrityTests-898447071 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf1a16fe-ac3d-4241-bdfc-e7b0e5d671fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:39:01 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-e6f01f74-f1a2-4873-a7ed-4a489f8d596e tempest-SnapshotDataIntegrityTests-898447071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97ea10b4-7311-4489-8743-e18aaa7aa757) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:39:01 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-e6f01f74-f1a2-4873-a7ed-4a489f8d596e tempest-SnapshotDataIntegrityTests-898447071 None] Volume bfdefc1b-faed-41b9-ba29-9e1696a07089: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-bfdefc1b-faed-41b9-ba29-9e1696a07089', 'volume_size': 1, 'snapshot_id': '4a5c6e12-2302-44db-ab0e-eedae12ca53f'} Jul 31 12:39:01 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-e6f01f74-f1a2-4873-a7ed-4a489f8d596e tempest-SnapshotDataIntegrityTests-898447071 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:39:02 devstack sudo[113791]: pam_unix(sudo:session): session closed for user root Jul 31 12:39:02 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-27c9cfcb-4d9d-4d83-8617-34afc11f46f6 tempest-VolumeDependencyTests-442009576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-45b0745c-de5b-49ba-afd5-559c565cbf66 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-a7df6ef4-cfe2-419c-85f1-b7b92de716fa" returned: 0 in 4.941s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:39:02 devstack cinder-volume[89182]: DEBUG cinder.image.image_utils [None req-27c9cfcb-4d9d-4d83-8617-34afc11f46f6 tempest-VolumeDependencyTests-442009576 None] Image conversion details: src /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-45b0745c-de5b-49ba-afd5-559c565cbf66, size 1024.00 MB, duration 4.94 sec, destination /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-a7df6ef4-cfe2-419c-85f1-b7b92de716fa {{(pid=89182) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 31 12:39:02 devstack cinder-volume[89182]: INFO cinder.image.image_utils [None req-27c9cfcb-4d9d-4d83-8617-34afc11f46f6 tempest-VolumeDependencyTests-442009576 None] Converted 1024.00 MB image at 207.22 MB/s Jul 31 12:39:02 devstack cinder-volume[89182]: WARNING cinder.volume.drivers.remotefs [None req-27c9cfcb-4d9d-4d83-8617-34afc11f46f6 tempest-VolumeDependencyTests-442009576 None] /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-a7df6ef4-cfe2-419c-85f1-b7b92de716fa is being set with open permissions: ugo+rw Jul 31 12:39:02 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-27c9cfcb-4d9d-4d83-8617-34afc11f46f6 tempest-VolumeDependencyTests-442009576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-a7df6ef4-cfe2-419c-85f1-b7b92de716fa {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:39:02 devstack sudo[113811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-a7df6ef4-cfe2-419c-85f1-b7b92de716fa Jul 31 12:39:02 devstack sudo[113811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:39:02 devstack sudo[113811]: pam_unix(sudo:session): session closed for user root Jul 31 12:39:02 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-27c9cfcb-4d9d-4d83-8617-34afc11f46f6 tempest-VolumeDependencyTests-442009576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-a7df6ef4-cfe2-419c-85f1-b7b92de716fa" returned: 0 in 0.243s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:39:02 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-27c9cfcb-4d9d-4d83-8617-34afc11f46f6 tempest-VolumeDependencyTests-442009576 None] Lock "cinder-quobyte-a7df6ef4-cfe2-419c-85f1-b7b92de716fa" released by "_copy_volume_from_snapshot" :: held 6.008s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:39:02 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-27c9cfcb-4d9d-4d83-8617-34afc11f46f6 tempest-VolumeDependencyTests-442009576 None] Lock "cinder-quobyte-f9e81161-c5c2-415a-bfde-8c397c2bd711-a7df6ef4-cfe2-419c-85f1-b7b92de716fa" released by "_create_volume_from_snapshot" :: held 6.070s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:39:02 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-27c9cfcb-4d9d-4d83-8617-34afc11f46f6 tempest-VolumeDependencyTests-442009576 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.092s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:39:02 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-bd573246-bc94-4a64-9e81-c8aa630147c7 tempest-ProjectReaderTests-1403756841 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 22.727s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:39:02 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-bd573246-bc94-4a64-9e81-c8aa630147c7 tempest-ProjectReaderTests-1403756841 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:38:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-101145333',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8509895-f89a-4bc9-bcd8-141e67ef7496,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f3d0306f6a14ffa9b6c897b6fc4c21a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:38:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:38:40Z,use_quota=True,user_id='21a6903f438141de9ad7d31e5e806c6f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)}" {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 12:39:02 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-bd573246-bc94-4a64-9e81-c8aa630147c7 tempest-ProjectReaderTests-1403756841 None] Creating volume e8509895-f89a-4bc9-bcd8-141e67ef7496 {{(pid=89182) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 12:39:02 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-bd573246-bc94-4a64-9e81-c8aa630147c7 tempest-ProjectReaderTests-1403756841 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:39:02 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-bd573246-bc94-4a64-9e81-c8aa630147c7 tempest-ProjectReaderTests-1403756841 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:39:02 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-bd573246-bc94-4a64-9e81-c8aa630147c7 tempest-ProjectReaderTests-1403756841 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:39:02 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-bd573246-bc94-4a64-9e81-c8aa630147c7 tempest-ProjectReaderTests-1403756841 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:39:02 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-bd573246-bc94-4a64-9e81-c8aa630147c7 tempest-ProjectReaderTests-1403756841 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:39:02 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-bd573246-bc94-4a64-9e81-c8aa630147c7 tempest-ProjectReaderTests-1403756841 None] Selected osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 as target Quobyte volume. {{(pid=89182) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 12:39:02 devstack cinder-volume[89182]: INFO cinder.volume.drivers.remotefs [None req-bd573246-bc94-4a64-9e81-c8aa630147c7 tempest-ProjectReaderTests-1403756841 None] casted to osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 Jul 31 12:39:02 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-bd573246-bc94-4a64-9e81-c8aa630147c7 tempest-ProjectReaderTests-1403756841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e8509895-f89a-4bc9-bcd8-141e67ef7496 1073741824 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:39:02 devstack sudo[113814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e8509895-f89a-4bc9-bcd8-141e67ef7496 1073741824 Jul 31 12:39:02 devstack sudo[113814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:39:02 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-27c9cfcb-4d9d-4d83-8617-34afc11f46f6 tempest-VolumeDependencyTests-442009576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3598a921-6824-4222-b5b4-29b931373d71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a7df6ef4-cfe2-419c-85f1-b7b92de716fa', 'volume_size': 1, 'snapshot_id': 'f9e81161-c5c2-415a-bfde-8c397c2bd711'}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:39:02 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-27c9cfcb-4d9d-4d83-8617-34afc11f46f6 tempest-VolumeDependencyTests-442009576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7114d21e-5750-4ffb-9ccd-e91f8fd29760) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:39:02 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-27c9cfcb-4d9d-4d83-8617-34afc11f46f6 tempest-VolumeDependencyTests-442009576 None] Volume volume-a7df6ef4-cfe2-419c-85f1-b7b92de716fa (a7df6ef4-cfe2-419c-85f1-b7b92de716fa): created successfully Jul 31 12:39:02 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-27c9cfcb-4d9d-4d83-8617-34afc11f46f6 tempest-VolumeDependencyTests-442009576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7114d21e-5750-4ffb-9ccd-e91f8fd29760) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:39:02 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-27c9cfcb-4d9d-4d83-8617-34afc11f46f6 tempest-VolumeDependencyTests-442009576 None] Flow 'volume_create_manager' (36fd0f7c-e680-464a-afe4-9cd79bdaa14f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:39:02 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-27c9cfcb-4d9d-4d83-8617-34afc11f46f6 tempest-VolumeDependencyTests-442009576 None] Created volume successfully. Jul 31 12:39:02 devstack sudo[113814]: pam_unix(sudo:session): session closed for user root Jul 31 12:39:02 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-bd573246-bc94-4a64-9e81-c8aa630147c7 tempest-ProjectReaderTests-1403756841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e8509895-f89a-4bc9-bcd8-141e67ef7496 1073741824" returned: 0 in 0.432s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:39:02 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-bd573246-bc94-4a64-9e81-c8aa630147c7 tempest-ProjectReaderTests-1403756841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e8509895-f89a-4bc9-bcd8-141e67ef7496 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:39:02 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-9c82c496-9aba-4c27-8ff4-8702c0c9c82a tempest-VolumeDependencyTests-442009576 None] Acquiring lock "cinder-f9e81161-c5c2-415a-bfde-8c397c2bd711-delete_snapshot" by "delete_snapshot" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:39:02 devstack sudo[113820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e8509895-f89a-4bc9-bcd8-141e67ef7496 Jul 31 12:39:02 devstack sudo[113820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:39:03 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-9c82c496-9aba-4c27-8ff4-8702c0c9c82a tempest-VolumeDependencyTests-442009576 None] Lock "cinder-f9e81161-c5c2-415a-bfde-8c397c2bd711-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:39:03 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-9c82c496-9aba-4c27-8ff4-8702c0c9c82a tempest-VolumeDependencyTests-442009576 None] Acquiring lock "cinder-quobyte-45b0745c-de5b-49ba-afd5-559c565cbf66" by "delete_snapshot" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:39:03 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-9c82c496-9aba-4c27-8ff4-8702c0c9c82a tempest-VolumeDependencyTests-442009576 None] Lock "cinder-quobyte-45b0745c-de5b-49ba-afd5-559c565cbf66" acquired by "delete_snapshot" :: waited 0.018s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:39:03 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-9c82c496-9aba-4c27-8ff4-8702c0c9c82a tempest-VolumeDependencyTests-442009576 None] Acquiring lock "cinder-quobyte-f9e81161-c5c2-415a-bfde-8c397c2bd711" by "_delete_snapshot" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:39:03 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-9c82c496-9aba-4c27-8ff4-8702c0c9c82a tempest-VolumeDependencyTests-442009576 None] Lock "cinder-quobyte-f9e81161-c5c2-415a-bfde-8c397c2bd711" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:39:03 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-9c82c496-9aba-4c27-8ff4-8702c0c9c82a tempest-VolumeDependencyTests-442009576 None] Deleting offline snapshot f9e81161-c5c2-415a-bfde-8c397c2bd711 of volume 45b0745c-de5b-49ba-afd5-559c565cbf66 {{(pid=89182) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 31 12:39:03 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-9c82c496-9aba-4c27-8ff4-8702c0c9c82a tempest-VolumeDependencyTests-442009576 None] snapshot_file for this snap is: volume-45b0745c-de5b-49ba-afd5-559c565cbf66.f9e81161-c5c2-415a-bfde-8c397c2bd711 {{(pid=89182) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 31 12:39:03 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[098b37cf-1dfa-4979-8bea-415975000d0e]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:39:03 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-9c82c496-9aba-4c27-8ff4-8702c0c9c82a tempest-VolumeDependencyTests-442009576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-45b0745c-de5b-49ba-afd5-559c565cbf66.f9e81161-c5c2-415a-bfde-8c397c2bd711 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:39:03 devstack sudo[113823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-45b0745c-de5b-49ba-afd5-559c565cbf66.f9e81161-c5c2-415a-bfde-8c397c2bd711 Jul 31 12:39:03 devstack sudo[113823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:39:03 devstack sudo[113820]: pam_unix(sudo:session): session closed for user root Jul 31 12:39:03 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-bd573246-bc94-4a64-9e81-c8aa630147c7 tempest-ProjectReaderTests-1403756841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e8509895-f89a-4bc9-bcd8-141e67ef7496" returned: 0 in 0.270s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:39:03 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-bd573246-bc94-4a64-9e81-c8aa630147c7 tempest-ProjectReaderTests-1403756841 None] <== create_volume: return (742ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'} {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 12:39:03 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-bd573246-bc94-4a64-9e81-c8aa630147c7 tempest-ProjectReaderTests-1403756841 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.746s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:39:03 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-9081e8c7-78bd-4a69-b588-ddbfbf9d506f tempest-VolumeImageDependencyTests-1366750687 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 19.689s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:39:03 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-9081e8c7-78bd-4a69-b588-ddbfbf9d506f tempest-VolumeImageDependencyTests-1366750687 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:38:41Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-teste6050452-06bd-4c7f-9912-45178c83e379',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c968dbb-687c-450d-a061-fe29cb89c249,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d0755f1e2ea4124a760580edccedbe3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:38:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:38:42Z,use_quota=True,user_id='b44e6e9d7b9542c6aea2ca270c251a89',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)}" {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 12:39:03 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-9081e8c7-78bd-4a69-b588-ddbfbf9d506f tempest-VolumeImageDependencyTests-1366750687 None] Creating volume 7c968dbb-687c-450d-a061-fe29cb89c249 {{(pid=89182) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 12:39:03 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-9081e8c7-78bd-4a69-b588-ddbfbf9d506f tempest-VolumeImageDependencyTests-1366750687 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:39:03 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-9081e8c7-78bd-4a69-b588-ddbfbf9d506f tempest-VolumeImageDependencyTests-1366750687 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:39:03 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-9081e8c7-78bd-4a69-b588-ddbfbf9d506f tempest-VolumeImageDependencyTests-1366750687 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:39:03 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-9081e8c7-78bd-4a69-b588-ddbfbf9d506f tempest-VolumeImageDependencyTests-1366750687 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:39:03 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-9081e8c7-78bd-4a69-b588-ddbfbf9d506f tempest-VolumeImageDependencyTests-1366750687 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:39:03 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-9081e8c7-78bd-4a69-b588-ddbfbf9d506f tempest-VolumeImageDependencyTests-1366750687 None] Selected osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 as target Quobyte volume. {{(pid=89182) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 12:39:03 devstack cinder-volume[89182]: INFO cinder.volume.drivers.remotefs [None req-9081e8c7-78bd-4a69-b588-ddbfbf9d506f tempest-VolumeImageDependencyTests-1366750687 None] casted to osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 Jul 31 12:39:03 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-9081e8c7-78bd-4a69-b588-ddbfbf9d506f tempest-VolumeImageDependencyTests-1366750687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-7c968dbb-687c-450d-a061-fe29cb89c249 1073741824 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:39:03 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-bd573246-bc94-4a64-9e81-c8aa630147c7 tempest-ProjectReaderTests-1403756841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1afb579-382b-4e59-96b2-b4fa3484605a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e8509895-f89a-4bc9-bcd8-141e67ef7496', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:39:03 devstack sudo[113826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-7c968dbb-687c-450d-a061-fe29cb89c249 1073741824 Jul 31 12:39:03 devstack sudo[113826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:39:03 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-bd573246-bc94-4a64-9e81-c8aa630147c7 tempest-ProjectReaderTests-1403756841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0630523-e3cd-4708-be24-5c38ae612e69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:39:03 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-bd573246-bc94-4a64-9e81-c8aa630147c7 tempest-ProjectReaderTests-1403756841 None] Volume volume-e8509895-f89a-4bc9-bcd8-141e67ef7496 (e8509895-f89a-4bc9-bcd8-141e67ef7496): created successfully Jul 31 12:39:03 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-bd573246-bc94-4a64-9e81-c8aa630147c7 tempest-ProjectReaderTests-1403756841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0630523-e3cd-4708-be24-5c38ae612e69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:39:03 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-bd573246-bc94-4a64-9e81-c8aa630147c7 tempest-ProjectReaderTests-1403756841 None] Flow 'volume_create_manager' (a352c1c3-97b3-40e5-b0d2-83f2948af4a1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:39:03 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-bd573246-bc94-4a64-9e81-c8aa630147c7 tempest-ProjectReaderTests-1403756841 None] Created volume successfully. Jul 31 12:39:03 devstack sudo[113823]: pam_unix(sudo:session): session closed for user root Jul 31 12:39:03 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-9c82c496-9aba-4c27-8ff4-8702c0c9c82a tempest-VolumeDependencyTests-442009576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-45b0745c-de5b-49ba-afd5-559c565cbf66.f9e81161-c5c2-415a-bfde-8c397c2bd711" returned: 0 in 0.385s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:39:03 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-9c82c496-9aba-4c27-8ff4-8702c0c9c82a tempest-VolumeDependencyTests-442009576 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-45b0745c-de5b-49ba-afd5-559c565cbf66(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89182) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 12:39:03 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa9f3061-897e-4374-8041-b91aa9be9973]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:39:03 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-9c82c496-9aba-4c27-8ff4-8702c0c9c82a tempest-VolumeDependencyTests-442009576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-45b0745c-de5b-49ba-afd5-559c565cbf66 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:39:03 devstack sudo[113834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-45b0745c-de5b-49ba-afd5-559c565cbf66 Jul 31 12:39:03 devstack sudo[113834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:39:03 devstack sudo[113826]: pam_unix(sudo:session): session closed for user root Jul 31 12:39:03 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-9081e8c7-78bd-4a69-b588-ddbfbf9d506f tempest-VolumeImageDependencyTests-1366750687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-7c968dbb-687c-450d-a061-fe29cb89c249 1073741824" returned: 0 in 0.441s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:39:03 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-9081e8c7-78bd-4a69-b588-ddbfbf9d506f tempest-VolumeImageDependencyTests-1366750687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-7c968dbb-687c-450d-a061-fe29cb89c249 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:39:03 devstack sudo[113836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-7c968dbb-687c-450d-a061-fe29cb89c249 Jul 31 12:39:03 devstack sudo[113836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:39:03 devstack sudo[113836]: pam_unix(sudo:session): session closed for user root Jul 31 12:39:03 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-9081e8c7-78bd-4a69-b588-ddbfbf9d506f tempest-VolumeImageDependencyTests-1366750687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-7c968dbb-687c-450d-a061-fe29cb89c249" returned: 0 in 0.256s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:39:03 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-9081e8c7-78bd-4a69-b588-ddbfbf9d506f tempest-VolumeImageDependencyTests-1366750687 None] <== create_volume: return (738ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'} {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 12:39:03 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-9081e8c7-78bd-4a69-b588-ddbfbf9d506f tempest-VolumeImageDependencyTests-1366750687 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.743s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:39:03 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-e6f01f74-f1a2-4873-a7ed-4a489f8d596e tempest-SnapshotDataIntegrityTests-898447071 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 2.041s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:39:03 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-e6f01f74-f1a2-4873-a7ed-4a489f8d596e tempest-SnapshotDataIntegrityTests-898447071 None] Acquiring lock "cinder-quobyte-4a5c6e12-2302-44db-ab0e-eedae12ca53f-bfdefc1b-faed-41b9-ba29-9e1696a07089" by "_create_volume_from_snapshot" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:39:03 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-e6f01f74-f1a2-4873-a7ed-4a489f8d596e tempest-SnapshotDataIntegrityTests-898447071 None] Lock "cinder-quobyte-4a5c6e12-2302-44db-ab0e-eedae12ca53f-bfdefc1b-faed-41b9-ba29-9e1696a07089" acquired by "_create_volume_from_snapshot" :: waited 0.021s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:39:03 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-e6f01f74-f1a2-4873-a7ed-4a489f8d596e tempest-SnapshotDataIntegrityTests-898447071 None] Creating volume bfdefc1b-faed-41b9-ba29-9e1696a07089 from snapshot 4a5c6e12-2302-44db-ab0e-eedae12ca53f {{(pid=89182) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 31 12:39:03 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-e6f01f74-f1a2-4873-a7ed-4a489f8d596e tempest-SnapshotDataIntegrityTests-898447071 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:39:03 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-e6f01f74-f1a2-4873-a7ed-4a489f8d596e tempest-SnapshotDataIntegrityTests-898447071 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:39:03 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-e6f01f74-f1a2-4873-a7ed-4a489f8d596e tempest-SnapshotDataIntegrityTests-898447071 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:39:04 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-e6f01f74-f1a2-4873-a7ed-4a489f8d596e tempest-SnapshotDataIntegrityTests-898447071 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:39:04 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-e6f01f74-f1a2-4873-a7ed-4a489f8d596e tempest-SnapshotDataIntegrityTests-898447071 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:39:04 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-e6f01f74-f1a2-4873-a7ed-4a489f8d596e tempest-SnapshotDataIntegrityTests-898447071 None] Selected osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 as target Quobyte volume. {{(pid=89182) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 12:39:04 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-e6f01f74-f1a2-4873-a7ed-4a489f8d596e tempest-SnapshotDataIntegrityTests-898447071 None] Acquiring lock "cinder-quobyte-bfdefc1b-faed-41b9-ba29-9e1696a07089" by "_copy_volume_from_snapshot" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:39:04 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-e6f01f74-f1a2-4873-a7ed-4a489f8d596e tempest-SnapshotDataIntegrityTests-898447071 None] Lock "cinder-quobyte-bfdefc1b-faed-41b9-ba29-9e1696a07089" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:39:04 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-e6f01f74-f1a2-4873-a7ed-4a489f8d596e tempest-SnapshotDataIntegrityTests-898447071 None] snapshot: 4a5c6e12-2302-44db-ab0e-eedae12ca53f, volume: bfdefc1b-faed-41b9-ba29-9e1696a07089, {{(pid=89182) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Jul 31 12:39:04 devstack cinder-volume[89182]: DEBUG cinder.volume.volume_utils [None req-9081e8c7-78bd-4a69-b588-ddbfbf9d506f tempest-VolumeImageDependencyTests-1366750687 None] Attempting download of 70ac6b45-8eec-49b4-aabc-77d3741406c4 ((None, [{'url': 'file:///opt/stack/data/glance/images/70ac6b45-8eec-49b4-aabc-77d3741406c4', 'metadata': {}}])) to volume 7c968dbb-687c-450d-a061-fe29cb89c249. {{(pid=89182) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 31 12:39:04 devstack sudo[113834]: pam_unix(sudo:session): session closed for user root Jul 31 12:39:04 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-e6f01f74-f1a2-4873-a7ed-4a489f8d596e tempest-SnapshotDataIntegrityTests-898447071 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:39:04 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-e6f01f74-f1a2-4873-a7ed-4a489f8d596e tempest-SnapshotDataIntegrityTests-898447071 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:39:04 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-e6f01f74-f1a2-4873-a7ed-4a489f8d596e tempest-SnapshotDataIntegrityTests-898447071 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:39:04 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-e6f01f74-f1a2-4873-a7ed-4a489f8d596e tempest-SnapshotDataIntegrityTests-898447071 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:39:04 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-e6f01f74-f1a2-4873-a7ed-4a489f8d596e tempest-SnapshotDataIntegrityTests-898447071 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:39:04 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-9c82c496-9aba-4c27-8ff4-8702c0c9c82a tempest-VolumeDependencyTests-442009576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-45b0745c-de5b-49ba-afd5-559c565cbf66" returned: 0 in 0.594s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:39:04 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-9c82c496-9aba-4c27-8ff4-8702c0c9c82a tempest-VolumeDependencyTests-442009576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-45b0745c-de5b-49ba-afd5-559c565cbf66.f9e81161-c5c2-415a-bfde-8c397c2bd711 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:39:04 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[71986515-65aa-4b60-87a7-256fe87fd38a]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:39:04 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7d8c3d4-d6dc-4e6d-aa64-1704e724eab1]: (4, 'raw') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:39:04 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-e6f01f74-f1a2-4873-a7ed-4a489f8d596e tempest-SnapshotDataIntegrityTests-898447071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e6acfb11-941d-450b-8d93-0e32240df94a.4a5c6e12-2302-44db-ab0e-eedae12ca53f {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:39:04 devstack sudo[113842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-45b0745c-de5b-49ba-afd5-559c565cbf66.f9e81161-c5c2-415a-bfde-8c397c2bd711 Jul 31 12:39:04 devstack sudo[113842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:39:04 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-9081e8c7-78bd-4a69-b588-ddbfbf9d506f tempest-VolumeImageDependencyTests-1366750687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_70ac6b45-8eec-49b4-aabc-77d3741406c4_xx0543h_ {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:39:04 devstack sudo[113845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_70ac6b45-8eec-49b4-aabc-77d3741406c4_xx0543h_ Jul 31 12:39:04 devstack sudo[113845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:39:04 devstack sudo[113844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e6acfb11-941d-450b-8d93-0e32240df94a.4a5c6e12-2302-44db-ab0e-eedae12ca53f Jul 31 12:39:04 devstack sudo[113844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:39:04 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-f9ed3282-7e71-403c-9d52-af678279148b tempest-ProjectReaderTests-1403756841 None] Acquiring lock "cinder-e8509895-f89a-4bc9-bcd8-141e67ef7496-delete_volume" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:39:04 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-f9ed3282-7e71-403c-9d52-af678279148b tempest-ProjectReaderTests-1403756841 None] Lock "cinder-e8509895-f89a-4bc9-bcd8-141e67ef7496-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:39:04 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-f9ed3282-7e71-403c-9d52-af678279148b tempest-ProjectReaderTests-1403756841 None] Acquiring lock "cinder-quobyte-e8509895-f89a-4bc9-bcd8-141e67ef7496" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:39:04 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-f9ed3282-7e71-403c-9d52-af678279148b tempest-ProjectReaderTests-1403756841 None] Lock "cinder-quobyte-e8509895-f89a-4bc9-bcd8-141e67ef7496" acquired by "delete_volume" :: waited 0.021s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:39:04 devstack sudo[113842]: pam_unix(sudo:session): session closed for user root Jul 31 12:39:04 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-9c82c496-9aba-4c27-8ff4-8702c0c9c82a tempest-VolumeDependencyTests-442009576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-45b0745c-de5b-49ba-afd5-559c565cbf66.f9e81161-c5c2-415a-bfde-8c397c2bd711" returned: 0 in 0.436s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:39:04 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-9c82c496-9aba-4c27-8ff4-8702c0c9c82a tempest-VolumeDependencyTests-442009576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-45b0745c-de5b-49ba-afd5-559c565cbf66.f9e81161-c5c2-415a-bfde-8c397c2bd711 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:39:04 devstack sudo[113845]: pam_unix(sudo:session): session closed for user root Jul 31 12:39:04 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2e5604c-8793-4194-b739-403e223d0263]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:39:04 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-f9ed3282-7e71-403c-9d52-af678279148b tempest-ProjectReaderTests-1403756841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e8509895-f89a-4bc9-bcd8-141e67ef7496 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:39:04 devstack sudo[113857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-45b0745c-de5b-49ba-afd5-559c565cbf66.f9e81161-c5c2-415a-bfde-8c397c2bd711 Jul 31 12:39:04 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-9081e8c7-78bd-4a69-b588-ddbfbf9d506f tempest-VolumeImageDependencyTests-1366750687 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_70ac6b45-8eec-49b4-aabc-77d3741406c4_xx0543h_" returned: 0 in 0.434s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:39:04 devstack sudo[113857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:39:04 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-9081e8c7-78bd-4a69-b588-ddbfbf9d506f tempest-VolumeImageDependencyTests-1366750687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_70ac6b45-8eec-49b4-aabc-77d3741406c4_xx0543h_ {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:39:04 devstack sudo[113844]: pam_unix(sudo:session): session closed for user root Jul 31 12:39:04 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-e6f01f74-f1a2-4873-a7ed-4a489f8d596e tempest-SnapshotDataIntegrityTests-898447071 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e6acfb11-941d-450b-8d93-0e32240df94a.4a5c6e12-2302-44db-ab0e-eedae12ca53f" returned: 0 in 0.470s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:39:04 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-e6f01f74-f1a2-4873-a7ed-4a489f8d596e tempest-SnapshotDataIntegrityTests-898447071 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e6acfb11-941d-450b-8d93-0e32240df94a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89182) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 12:39:04 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[71eba5b3-0360-4bb6-99e6-4258a22bfa56]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:39:04 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-e6f01f74-f1a2-4873-a7ed-4a489f8d596e tempest-SnapshotDataIntegrityTests-898447071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e6acfb11-941d-450b-8d93-0e32240df94a {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:39:04 devstack sudo[113858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e8509895-f89a-4bc9-bcd8-141e67ef7496 Jul 31 12:39:04 devstack sudo[113858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:39:04 devstack sudo[113860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_70ac6b45-8eec-49b4-aabc-77d3741406c4_xx0543h_ Jul 31 12:39:04 devstack sudo[113860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:39:04 devstack sudo[113861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e6acfb11-941d-450b-8d93-0e32240df94a Jul 31 12:39:04 devstack sudo[113861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:39:04 devstack sudo[113857]: pam_unix(sudo:session): session closed for user root Jul 31 12:39:04 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-9c82c496-9aba-4c27-8ff4-8702c0c9c82a tempest-VolumeDependencyTests-442009576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-45b0745c-de5b-49ba-afd5-559c565cbf66.f9e81161-c5c2-415a-bfde-8c397c2bd711" returned: 0 in 0.283s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:39:04 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-9c82c496-9aba-4c27-8ff4-8702c0c9c82a tempest-VolumeDependencyTests-442009576 None] Lock "cinder-quobyte-f9e81161-c5c2-415a-bfde-8c397c2bd711" released by "_delete_snapshot" :: held 1.827s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:39:04 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-9c82c496-9aba-4c27-8ff4-8702c0c9c82a tempest-VolumeDependencyTests-442009576 None] Lock "cinder-quobyte-45b0745c-de5b-49ba-afd5-559c565cbf66" released by "delete_snapshot" :: held 1.857s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:39:04 devstack cinder-volume[89182]: DEBUG cinder.quota [None req-9c82c496-9aba-4c27-8ff4-8702c0c9c82a tempest-VolumeDependencyTests-442009576 None] Created reservations ['1b87852d-244f-4d90-9390-f231f67e5d2f', '40853c0e-f90f-4f89-8f39-a9799fa06dc0', '4c3140a5-7162-4cf4-8713-574a0816beb4', 'e9413aef-441f-490a-b672-576ea5c1c486'] {{(pid=89182) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 12:39:04 devstack sudo[113860]: pam_unix(sudo:session): session closed for user root Jul 31 12:39:04 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-9081e8c7-78bd-4a69-b588-ddbfbf9d506f tempest-VolumeImageDependencyTests-1366750687 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_70ac6b45-8eec-49b4-aabc-77d3741406c4_xx0543h_" returned: 1 in 0.404s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:39:04 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-9081e8c7-78bd-4a69-b588-ddbfbf9d506f tempest-VolumeImageDependencyTests-1366750687 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_70ac6b45-8eec-49b4-aabc-77d3741406c4_xx0543h_' failed. Not Retrying. {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 31 12:39:04 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[3faf3c26-cd1c-4cfd-a4cf-b1d50e0ac666]: (4, 'raw') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:39:04 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-9081e8c7-78bd-4a69-b588-ddbfbf9d506f tempest-VolumeImageDependencyTests-1366750687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_70ac6b45-8eec-49b4-aabc-77d3741406c4_o51e93_fdevstack@QuobyteHD {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:39:04 devstack sudo[113858]: pam_unix(sudo:session): session closed for user root Jul 31 12:39:04 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-f9ed3282-7e71-403c-9d52-af678279148b tempest-ProjectReaderTests-1403756841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e8509895-f89a-4bc9-bcd8-141e67ef7496" returned: 0 in 0.444s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:39:04 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-f9ed3282-7e71-403c-9d52-af678279148b tempest-ProjectReaderTests-1403756841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e8509895-f89a-4bc9-bcd8-141e67ef7496 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:39:05 devstack sudo[113873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e8509895-f89a-4bc9-bcd8-141e67ef7496 Jul 31 12:39:05 devstack sudo[113873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:39:05 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-9c82c496-9aba-4c27-8ff4-8702c0c9c82a tempest-VolumeDependencyTests-442009576 None] Delete snapshot completed successfully. Jul 31 12:39:05 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-9c82c496-9aba-4c27-8ff4-8702c0c9c82a tempest-VolumeDependencyTests-442009576 None] Lock "cinder-f9e81161-c5c2-415a-bfde-8c397c2bd711-delete_snapshot" released by "delete_snapshot" :: held 2.054s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:39:05 devstack sudo[113861]: pam_unix(sudo:session): session closed for user root Jul 31 12:39:05 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-e6f01f74-f1a2-4873-a7ed-4a489f8d596e tempest-SnapshotDataIntegrityTests-898447071 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e6acfb11-941d-450b-8d93-0e32240df94a" returned: 0 in 0.483s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:39:05 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-e6f01f74-f1a2-4873-a7ed-4a489f8d596e tempest-SnapshotDataIntegrityTests-898447071 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e6acfb11-941d-450b-8d93-0e32240df94a {{(pid=89182) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Jul 31 12:39:05 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-e6f01f74-f1a2-4873-a7ed-4a489f8d596e tempest-SnapshotDataIntegrityTests-898447071 None] Creating direct copy from snapshot {{(pid=89182) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Jul 31 12:39:05 devstack cinder-volume[89182]: DEBUG cinder.utils [None req-e6f01f74-f1a2-4873-a7ed-4a489f8d596e tempest-SnapshotDataIntegrityTests-898447071 None] Path /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-bfdefc1b-faed-41b9-ba29-9e1696a07089 not found in is_blk_device check {{(pid=89182) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 31 12:39:05 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-e6f01f74-f1a2-4873-a7ed-4a489f8d596e tempest-SnapshotDataIntegrityTests-898447071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e6acfb11-941d-450b-8d93-0e32240df94a /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-bfdefc1b-faed-41b9-ba29-9e1696a07089 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:39:05 devstack sudo[113877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e6acfb11-941d-450b-8d93-0e32240df94a /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-bfdefc1b-faed-41b9-ba29-9e1696a07089 Jul 31 12:39:05 devstack sudo[113877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:39:05 devstack sudo[113871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_70ac6b45-8eec-49b4-aabc-77d3741406c4_o51e93_fdevstack@QuobyteHD Jul 31 12:39:05 devstack sudo[113871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:39:05 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-5e1aed97-fbf5-4a6e-9bbc-8a6ce6f8ac99 tempest-VolumeDependencyTests-442009576 None] Acquiring lock "cinder-45b0745c-de5b-49ba-afd5-559c565cbf66-delete_volume" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:39:05 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-5e1aed97-fbf5-4a6e-9bbc-8a6ce6f8ac99 tempest-VolumeDependencyTests-442009576 None] Lock "cinder-45b0745c-de5b-49ba-afd5-559c565cbf66-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:39:05 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-5e1aed97-fbf5-4a6e-9bbc-8a6ce6f8ac99 tempest-VolumeDependencyTests-442009576 None] Acquiring lock "cinder-quobyte-45b0745c-de5b-49ba-afd5-559c565cbf66" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:39:05 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-5e1aed97-fbf5-4a6e-9bbc-8a6ce6f8ac99 tempest-VolumeDependencyTests-442009576 None] Lock "cinder-quobyte-45b0745c-de5b-49ba-afd5-559c565cbf66" acquired by "delete_volume" :: waited 0.018s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:39:05 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[63fcb26e-32c2-451d-bc5b-c58ee86a1967]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:39:05 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-5e1aed97-fbf5-4a6e-9bbc-8a6ce6f8ac99 tempest-VolumeDependencyTests-442009576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-45b0745c-de5b-49ba-afd5-559c565cbf66 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:39:05 devstack sudo[113873]: pam_unix(sudo:session): session closed for user root Jul 31 12:39:05 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-f9ed3282-7e71-403c-9d52-af678279148b tempest-ProjectReaderTests-1403756841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e8509895-f89a-4bc9-bcd8-141e67ef7496" returned: 0 in 0.428s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:39:05 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-f9ed3282-7e71-403c-9d52-af678279148b tempest-ProjectReaderTests-1403756841 None] Lock "cinder-quobyte-e8509895-f89a-4bc9-bcd8-141e67ef7496" released by "delete_volume" :: held 0.928s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:39:05 devstack cinder-volume[89182]: DEBUG cinder.quota [None req-f9ed3282-7e71-403c-9d52-af678279148b tempest-ProjectReaderTests-1403756841 None] Created reservations ['b96b8f0f-0dbe-4117-aac4-14a06bad27b2', '4b688ce0-af83-4454-a146-92f2676d0700', '9fc924bd-36ac-44a7-968f-2a4487aff607', 'd154d187-66dc-4a2e-a1e5-9a0b104e990d'] {{(pid=89182) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 12:39:05 devstack sudo[113871]: pam_unix(sudo:session): session closed for user root Jul 31 12:39:05 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-9081e8c7-78bd-4a69-b588-ddbfbf9d506f tempest-VolumeImageDependencyTests-1366750687 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_70ac6b45-8eec-49b4-aabc-77d3741406c4_o51e93_fdevstack@QuobyteHD" returned: 0 in 0.526s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:39:05 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-9081e8c7-78bd-4a69-b588-ddbfbf9d506f tempest-VolumeImageDependencyTests-1366750687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_70ac6b45-8eec-49b4-aabc-77d3741406c4_o51e93_fdevstack@QuobyteHD {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:39:05 devstack sudo[113884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-45b0745c-de5b-49ba-afd5-559c565cbf66 Jul 31 12:39:05 devstack sudo[113884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:39:05 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-f9ed3282-7e71-403c-9d52-af678279148b tempest-ProjectReaderTests-1403756841 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:39:05 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-f9ed3282-7e71-403c-9d52-af678279148b tempest-ProjectReaderTests-1403756841 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:39:05 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-f9ed3282-7e71-403c-9d52-af678279148b tempest-ProjectReaderTests-1403756841 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:39:05 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-f9ed3282-7e71-403c-9d52-af678279148b tempest-ProjectReaderTests-1403756841 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:39:05 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-f9ed3282-7e71-403c-9d52-af678279148b tempest-ProjectReaderTests-1403756841 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:39:05 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-f9ed3282-7e71-403c-9d52-af678279148b tempest-ProjectReaderTests-1403756841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:39:05 devstack sudo[113888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_70ac6b45-8eec-49b4-aabc-77d3741406c4_o51e93_fdevstack@QuobyteHD Jul 31 12:39:05 devstack sudo[113888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:39:05 devstack sudo[113890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 Jul 31 12:39:05 devstack sudo[113890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:39:05 devstack sudo[113884]: pam_unix(sudo:session): session closed for user root Jul 31 12:39:05 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-5e1aed97-fbf5-4a6e-9bbc-8a6ce6f8ac99 tempest-VolumeDependencyTests-442009576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-45b0745c-de5b-49ba-afd5-559c565cbf66" returned: 0 in 0.528s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:39:05 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-5e1aed97-fbf5-4a6e-9bbc-8a6ce6f8ac99 tempest-VolumeDependencyTests-442009576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-45b0745c-de5b-49ba-afd5-559c565cbf66 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:39:05 devstack sudo[113899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-45b0745c-de5b-49ba-afd5-559c565cbf66 Jul 31 12:39:05 devstack sudo[113899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:39:06 devstack sudo[113888]: pam_unix(sudo:session): session closed for user root Jul 31 12:39:06 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-9081e8c7-78bd-4a69-b588-ddbfbf9d506f tempest-VolumeImageDependencyTests-1366750687 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_70ac6b45-8eec-49b4-aabc-77d3741406c4_o51e93_fdevstack@QuobyteHD" returned: 1 in 0.601s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:39:06 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-9081e8c7-78bd-4a69-b588-ddbfbf9d506f tempest-VolumeImageDependencyTests-1366750687 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_70ac6b45-8eec-49b4-aabc-77d3741406c4_o51e93_fdevstack@QuobyteHD' failed. Not Retrying. {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 31 12:39:06 devstack cinder-volume[89182]: DEBUG cinder.image.image_utils [None req-9081e8c7-78bd-4a69-b588-ddbfbf9d506f tempest-VolumeImageDependencyTests-1366750687 None] 70ac6b45-8eec-49b4-aabc-77d3741406c4 was raw, converting to qcow2 {{(pid=89182) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 31 12:39:06 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-9081e8c7-78bd-4a69-b588-ddbfbf9d506f tempest-VolumeImageDependencyTests-1366750687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_70ac6b45-8eec-49b4-aabc-77d3741406c4_o51e93_fdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-7c968dbb-687c-450d-a061-fe29cb89c249 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:39:06 devstack sudo[113890]: pam_unix(sudo:session): session closed for user root Jul 31 12:39:06 devstack sudo[113910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_70ac6b45-8eec-49b4-aabc-77d3741406c4_o51e93_fdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-7c968dbb-687c-450d-a061-fe29cb89c249 Jul 31 12:39:06 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-f9ed3282-7e71-403c-9d52-af678279148b tempest-ProjectReaderTests-1403756841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2" returned: 0 in 0.579s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:39:06 devstack sudo[113910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:39:06 devstack cinder-volume[89182]: DEBUG cinder.manager [None req-f9ed3282-7e71-403c-9d52-af678279148b tempest-ProjectReaderTests-1403756841 None] Notifying Schedulers of capabilities ... {{(pid=89182) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 12:39:06 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-f9ed3282-7e71-403c-9d52-af678279148b tempest-ProjectReaderTests-1403756841 None] Deleted volume successfully. Jul 31 12:39:06 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-f9ed3282-7e71-403c-9d52-af678279148b tempest-ProjectReaderTests-1403756841 None] Lock "cinder-e8509895-f89a-4bc9-bcd8-141e67ef7496-delete_volume" released by "delete_volume" :: held 1.879s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:39:06 devstack sudo[113899]: pam_unix(sudo:session): session closed for user root Jul 31 12:39:06 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-5e1aed97-fbf5-4a6e-9bbc-8a6ce6f8ac99 tempest-VolumeDependencyTests-442009576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-45b0745c-de5b-49ba-afd5-559c565cbf66" returned: 0 in 0.766s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:39:06 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-5e1aed97-fbf5-4a6e-9bbc-8a6ce6f8ac99 tempest-VolumeDependencyTests-442009576 None] Lock "cinder-quobyte-45b0745c-de5b-49ba-afd5-559c565cbf66" released by "delete_volume" :: held 1.387s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:39:06 devstack cinder-volume[89182]: DEBUG cinder.quota [None req-5e1aed97-fbf5-4a6e-9bbc-8a6ce6f8ac99 tempest-VolumeDependencyTests-442009576 None] Created reservations ['069f75a6-4e6b-44d5-a47d-6f6ab59b9b06', 'f8da0da9-dc4e-4e75-bfa7-569b70aa2900', '9810a60e-9e5f-4df1-bb14-109248b50203', 'ea7072d0-08fc-43a1-bb80-e8f0612071c0'] {{(pid=89182) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 12:39:07 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-5e1aed97-fbf5-4a6e-9bbc-8a6ce6f8ac99 tempest-VolumeDependencyTests-442009576 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:39:07 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-5e1aed97-fbf5-4a6e-9bbc-8a6ce6f8ac99 tempest-VolumeDependencyTests-442009576 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:39:07 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-5e1aed97-fbf5-4a6e-9bbc-8a6ce6f8ac99 tempest-VolumeDependencyTests-442009576 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:39:07 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-5e1aed97-fbf5-4a6e-9bbc-8a6ce6f8ac99 tempest-VolumeDependencyTests-442009576 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:39:07 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-5e1aed97-fbf5-4a6e-9bbc-8a6ce6f8ac99 tempest-VolumeDependencyTests-442009576 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:39:07 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-5e1aed97-fbf5-4a6e-9bbc-8a6ce6f8ac99 tempest-VolumeDependencyTests-442009576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:39:07 devstack sudo[113918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 Jul 31 12:39:07 devstack sudo[113918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:39:07 devstack sudo[113910]: pam_unix(sudo:session): session closed for user root Jul 31 12:39:07 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-9081e8c7-78bd-4a69-b588-ddbfbf9d506f tempest-VolumeImageDependencyTests-1366750687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_70ac6b45-8eec-49b4-aabc-77d3741406c4_o51e93_fdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-7c968dbb-687c-450d-a061-fe29cb89c249" returned: 0 in 1.473s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:39:07 devstack cinder-volume[89182]: DEBUG cinder.image.image_utils [None req-9081e8c7-78bd-4a69-b588-ddbfbf9d506f tempest-VolumeImageDependencyTests-1366750687 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_70ac6b45-8eec-49b4-aabc-77d3741406c4_o51e93_fdevstack@QuobyteHD, size 0.00 MB, duration 1.47 sec, destination /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-7c968dbb-687c-450d-a061-fe29cb89c249 {{(pid=89182) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 31 12:39:07 devstack cinder-volume[89182]: INFO cinder.image.image_utils [None req-9081e8c7-78bd-4a69-b588-ddbfbf9d506f tempest-VolumeImageDependencyTests-1366750687 None] Converted 0.00 MB image at 0.00 MB/s Jul 31 12:39:07 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-9081e8c7-78bd-4a69-b588-ddbfbf9d506f tempest-VolumeImageDependencyTests-1366750687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-7c968dbb-687c-450d-a061-fe29cb89c249 1G {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:39:07 devstack sudo[113921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-7c968dbb-687c-450d-a061-fe29cb89c249 1G Jul 31 12:39:07 devstack sudo[113921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:39:07 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-7f3ea6ee-7e81-4dcb-b7d8-69722e9a3769 tempest-VolumeDependencyTests-442009576 None] Acquiring lock "cinder-a7df6ef4-cfe2-419c-85f1-b7b92de716fa-delete_volume" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:39:07 devstack sudo[113918]: pam_unix(sudo:session): session closed for user root Jul 31 12:39:07 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-5e1aed97-fbf5-4a6e-9bbc-8a6ce6f8ac99 tempest-VolumeDependencyTests-442009576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2" returned: 0 in 0.867s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:39:07 devstack cinder-volume[89182]: DEBUG cinder.manager [None req-5e1aed97-fbf5-4a6e-9bbc-8a6ce6f8ac99 tempest-VolumeDependencyTests-442009576 None] Notifying Schedulers of capabilities ... {{(pid=89182) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 12:39:07 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-7f3ea6ee-7e81-4dcb-b7d8-69722e9a3769 tempest-VolumeDependencyTests-442009576 None] Lock "cinder-a7df6ef4-cfe2-419c-85f1-b7b92de716fa-delete_volume" acquired by "delete_volume" :: waited 0.109s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:39:07 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-5e1aed97-fbf5-4a6e-9bbc-8a6ce6f8ac99 tempest-VolumeDependencyTests-442009576 None] Deleted volume successfully. Jul 31 12:39:08 devstack cinder-volume[89182]: DEBUG cinder.volume.flows.manager.create_volume [None req-b11ca895-d4d8-4668-b24d-817a06da1e30 tempest-ProjectReaderTests-1403756841 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89182) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 12:39:08 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-b11ca895-d4d8-4668-b24d-817a06da1e30 tempest-ProjectReaderTests-1403756841 None] Flow 'volume_create_manager' (940659ca-c8ab-4316-8e21-3818d645bb86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:39:08 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-b11ca895-d4d8-4668-b24d-817a06da1e30 tempest-ProjectReaderTests-1403756841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84326a93-4292-4f05-978a-00f047197948) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:39:08 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-b11ca895-d4d8-4668-b24d-817a06da1e30 tempest-ProjectReaderTests-1403756841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84326a93-4292-4f05-978a-00f047197948) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:39:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1166072835',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5742adc1-aaad-4d66-a0ce-2277fdfdc60a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f3d0306f6a14ffa9b6c897b6fc4c21a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:39:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:39:08Z,use_quota=True,user_id='21a6903f438141de9ad7d31e5e806c6f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:39:08 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-b11ca895-d4d8-4668-b24d-817a06da1e30 tempest-ProjectReaderTests-1403756841 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9bdad72a-63c3-40e7-819a-25fe96edd9cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:39:08 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-b11ca895-d4d8-4668-b24d-817a06da1e30 tempest-ProjectReaderTests-1403756841 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9bdad72a-63c3-40e7-819a-25fe96edd9cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:39:08 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-b11ca895-d4d8-4668-b24d-817a06da1e30 tempest-ProjectReaderTests-1403756841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bdfdc33b-6f69-4eb0-b5e8-e5b0dcc06723) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:39:08 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-b11ca895-d4d8-4668-b24d-817a06da1e30 tempest-ProjectReaderTests-1403756841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bdfdc33b-6f69-4eb0-b5e8-e5b0dcc06723) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5742adc1-aaad-4d66-a0ce-2277fdfdc60a', 'volume_name': 'volume-5742adc1-aaad-4d66-a0ce-2277fdfdc60a', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:39:08 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-b11ca895-d4d8-4668-b24d-817a06da1e30 tempest-ProjectReaderTests-1403756841 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e79d75e8-9f66-4252-9808-a2e541c5603e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:39:08 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-b11ca895-d4d8-4668-b24d-817a06da1e30 tempest-ProjectReaderTests-1403756841 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e79d75e8-9f66-4252-9808-a2e541c5603e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:39:08 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-b11ca895-d4d8-4668-b24d-817a06da1e30 tempest-ProjectReaderTests-1403756841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd6ca37c-4fc6-4d7a-8e2a-78c5c734361a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:39:08 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-b11ca895-d4d8-4668-b24d-817a06da1e30 tempest-ProjectReaderTests-1403756841 None] Volume 5742adc1-aaad-4d66-a0ce-2277fdfdc60a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5742adc1-aaad-4d66-a0ce-2277fdfdc60a', 'volume_size': 1} Jul 31 12:39:08 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-b11ca895-d4d8-4668-b24d-817a06da1e30 tempest-ProjectReaderTests-1403756841 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:39:08 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-5e1aed97-fbf5-4a6e-9bbc-8a6ce6f8ac99 tempest-VolumeDependencyTests-442009576 None] Lock "cinder-45b0745c-de5b-49ba-afd5-559c565cbf66-delete_volume" released by "delete_volume" :: held 3.059s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:39:08 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-7f3ea6ee-7e81-4dcb-b7d8-69722e9a3769 tempest-VolumeDependencyTests-442009576 None] Acquiring lock "cinder-quobyte-a7df6ef4-cfe2-419c-85f1-b7b92de716fa" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:39:08 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-7f3ea6ee-7e81-4dcb-b7d8-69722e9a3769 tempest-VolumeDependencyTests-442009576 None] Lock "cinder-quobyte-a7df6ef4-cfe2-419c-85f1-b7b92de716fa" acquired by "delete_volume" :: waited 0.056s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:39:08 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[db100b75-7e96-4fbb-83b3-c253435fac17]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:39:08 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-7f3ea6ee-7e81-4dcb-b7d8-69722e9a3769 tempest-VolumeDependencyTests-442009576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-a7df6ef4-cfe2-419c-85f1-b7b92de716fa {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:39:08 devstack sudo[113921]: pam_unix(sudo:session): session closed for user root Jul 31 12:39:08 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-9081e8c7-78bd-4a69-b588-ddbfbf9d506f tempest-VolumeImageDependencyTests-1366750687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-7c968dbb-687c-450d-a061-fe29cb89c249 1G" returned: 0 in 0.946s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:39:08 devstack cinder-volume[89182]: DEBUG cinder.volume.volume_utils [None req-9081e8c7-78bd-4a69-b588-ddbfbf9d506f tempest-VolumeImageDependencyTests-1366750687 None] Downloaded image 70ac6b45-8eec-49b4-aabc-77d3741406c4 ((None, [{'url': 'file:///opt/stack/data/glance/images/70ac6b45-8eec-49b4-aabc-77d3741406c4', 'metadata': {}}])) to volume 7c968dbb-687c-450d-a061-fe29cb89c249 successfully. {{(pid=89182) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 31 12:39:08 devstack cinder-volume[89182]: DEBUG cinder.image.image_utils [None req-9081e8c7-78bd-4a69-b588-ddbfbf9d506f tempest-VolumeImageDependencyTests-1366750687 None] Temporary image 70ac6b45-8eec-49b4-aabc-77d3741406c4 for user b44e6e9d7b9542c6aea2ca270c251a89 is deleted. {{(pid=89182) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 31 12:39:08 devstack cinder-volume[89182]: DEBUG cinder.volume.volume_utils [None req-9081e8c7-78bd-4a69-b588-ddbfbf9d506f tempest-VolumeImageDependencyTests-1366750687 None] Marking volume 7c968dbb-687c-450d-a061-fe29cb89c249 as bootable. {{(pid=89182) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 31 12:39:08 devstack cinder-volume[89182]: DEBUG cinder.volume.flows.manager.create_volume [None req-9081e8c7-78bd-4a69-b588-ddbfbf9d506f tempest-VolumeImageDependencyTests-1366750687 None] Copying metadata from image 70ac6b45-8eec-49b4-aabc-77d3741406c4 to 7c968dbb-687c-450d-a061-fe29cb89c249. {{(pid=89182) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 31 12:39:08 devstack cinder-volume[89182]: DEBUG cinder.volume.flows.manager.create_volume [None req-9081e8c7-78bd-4a69-b588-ddbfbf9d506f tempest-VolumeImageDependencyTests-1366750687 None] Creating volume glance metadata for volume 7c968dbb-687c-450d-a061-fe29cb89c249 backed by image 70ac6b45-8eec-49b4-aabc-77d3741406c4 with: {'image_id': '70ac6b45-8eec-49b4-aabc-77d3741406c4', 'image_name': 'image-for-test-e6050452-06bd-4c7f-9912-45178c83e379', 'checksum': 'c193dec42b6800c0a63c5e152dfa11a2', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=89182) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 31 12:39:08 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-9081e8c7-78bd-4a69-b588-ddbfbf9d506f tempest-VolumeImageDependencyTests-1366750687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0260b99-9614-46f6-94ae-42d1ffc9479d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7c968dbb-687c-450d-a061-fe29cb89c249', 'volume_size': 1, 'image_id': '70ac6b45-8eec-49b4-aabc-77d3741406c4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/70ac6b45-8eec-49b4-aabc-77d3741406c4', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-e6050452-06bd-4c7f-9912-45178c83e379', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'c193dec42b6800c0a63c5e152dfa11a2', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '2d0755f1e2ea4124a760580edccedbe3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '4cf21071519b06cb6064afc4fabaf2e1eb6d96e8dd427331d4a2e7ed26e4e0ced7d504ba19480e0d1e7733dae10a1c5653787c7b84b04f14c346f7923341f466', 'id': '70ac6b45-8eec-49b4-aabc-77d3741406c4', 'created_at': datetime.datetime(2026, 7, 31, 10, 38, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 31, 10, 38, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/70ac6b45-8eec-49b4-aabc-77d3741406c4/file', 'properties': {}}, 'image_service': }' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:39:08 devstack sudo[113927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-a7df6ef4-cfe2-419c-85f1-b7b92de716fa Jul 31 12:39:08 devstack sudo[113927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:39:08 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-9081e8c7-78bd-4a69-b588-ddbfbf9d506f tempest-VolumeImageDependencyTests-1366750687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa581adf-644c-4ed9-9a79-a29e4c661026) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:39:08 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-9081e8c7-78bd-4a69-b588-ddbfbf9d506f tempest-VolumeImageDependencyTests-1366750687 None] Volume volume-7c968dbb-687c-450d-a061-fe29cb89c249 (7c968dbb-687c-450d-a061-fe29cb89c249): created successfully Jul 31 12:39:08 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-9081e8c7-78bd-4a69-b588-ddbfbf9d506f tempest-VolumeImageDependencyTests-1366750687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa581adf-644c-4ed9-9a79-a29e4c661026) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:39:08 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-9081e8c7-78bd-4a69-b588-ddbfbf9d506f tempest-VolumeImageDependencyTests-1366750687 None] Flow 'volume_create_manager' (08d9d435-f8cc-41c7-a03f-f5c0cd83272d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:39:08 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-9081e8c7-78bd-4a69-b588-ddbfbf9d506f tempest-VolumeImageDependencyTests-1366750687 None] Created volume successfully. Jul 31 12:39:09 devstack sudo[113927]: pam_unix(sudo:session): session closed for user root Jul 31 12:39:09 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-7f3ea6ee-7e81-4dcb-b7d8-69722e9a3769 tempest-VolumeDependencyTests-442009576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-a7df6ef4-cfe2-419c-85f1-b7b92de716fa" returned: 0 in 0.806s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:39:09 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-7f3ea6ee-7e81-4dcb-b7d8-69722e9a3769 tempest-VolumeDependencyTests-442009576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-a7df6ef4-cfe2-419c-85f1-b7b92de716fa {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:39:09 devstack sudo[113932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-a7df6ef4-cfe2-419c-85f1-b7b92de716fa Jul 31 12:39:09 devstack sudo[113932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:39:09 devstack sudo[113932]: pam_unix(sudo:session): session closed for user root Jul 31 12:39:09 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-7f3ea6ee-7e81-4dcb-b7d8-69722e9a3769 tempest-VolumeDependencyTests-442009576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-a7df6ef4-cfe2-419c-85f1-b7b92de716fa" returned: 0 in 0.499s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:39:09 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-7f3ea6ee-7e81-4dcb-b7d8-69722e9a3769 tempest-VolumeDependencyTests-442009576 None] Lock "cinder-quobyte-a7df6ef4-cfe2-419c-85f1-b7b92de716fa" released by "delete_volume" :: held 1.426s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:39:10 devstack cinder-volume[89182]: DEBUG cinder.quota [None req-7f3ea6ee-7e81-4dcb-b7d8-69722e9a3769 tempest-VolumeDependencyTests-442009576 None] Created reservations ['10a941a6-44ef-455e-b3e4-d72f24980e93', 'a5f78f45-1e7b-4353-a811-08097b50abb3', '82187dce-6bb5-4a6b-b2a7-4b035d9477a8', 'eb729d08-f54a-4b50-8c1c-12e85ab6bcdb'] {{(pid=89182) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 12:39:10 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-7f3ea6ee-7e81-4dcb-b7d8-69722e9a3769 tempest-VolumeDependencyTests-442009576 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:39:10 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-7f3ea6ee-7e81-4dcb-b7d8-69722e9a3769 tempest-VolumeDependencyTests-442009576 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:39:10 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-7f3ea6ee-7e81-4dcb-b7d8-69722e9a3769 tempest-VolumeDependencyTests-442009576 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:39:10 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-7f3ea6ee-7e81-4dcb-b7d8-69722e9a3769 tempest-VolumeDependencyTests-442009576 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:39:10 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-7f3ea6ee-7e81-4dcb-b7d8-69722e9a3769 tempest-VolumeDependencyTests-442009576 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:39:10 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-7f3ea6ee-7e81-4dcb-b7d8-69722e9a3769 tempest-VolumeDependencyTests-442009576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:39:10 devstack sudo[113935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 Jul 31 12:39:10 devstack sudo[113935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:39:10 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-5bb43a4a-0da8-48a3-8184-018d0a2553be tempest-VolumeImageDependencyTests-1366750687 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:39:11 devstack sudo[113877]: pam_unix(sudo:session): session closed for user root Jul 31 12:39:11 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-e6f01f74-f1a2-4873-a7ed-4a489f8d596e tempest-SnapshotDataIntegrityTests-898447071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e6acfb11-941d-450b-8d93-0e32240df94a /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-bfdefc1b-faed-41b9-ba29-9e1696a07089" returned: 0 in 5.940s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:39:11 devstack cinder-volume[89182]: DEBUG cinder.image.image_utils [None req-e6f01f74-f1a2-4873-a7ed-4a489f8d596e tempest-SnapshotDataIntegrityTests-898447071 None] Image conversion details: src /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e6acfb11-941d-450b-8d93-0e32240df94a, size 1024.00 MB, duration 5.94 sec, destination /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-bfdefc1b-faed-41b9-ba29-9e1696a07089 {{(pid=89182) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 31 12:39:11 devstack cinder-volume[89182]: INFO cinder.image.image_utils [None req-e6f01f74-f1a2-4873-a7ed-4a489f8d596e tempest-SnapshotDataIntegrityTests-898447071 None] Converted 1024.00 MB image at 172.36 MB/s Jul 31 12:39:11 devstack cinder-volume[89182]: WARNING cinder.volume.drivers.remotefs [None req-e6f01f74-f1a2-4873-a7ed-4a489f8d596e tempest-SnapshotDataIntegrityTests-898447071 None] /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-bfdefc1b-faed-41b9-ba29-9e1696a07089 is being set with open permissions: ugo+rw Jul 31 12:39:11 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-e6f01f74-f1a2-4873-a7ed-4a489f8d596e tempest-SnapshotDataIntegrityTests-898447071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-bfdefc1b-faed-41b9-ba29-9e1696a07089 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:39:11 devstack sudo[113935]: pam_unix(sudo:session): session closed for user root Jul 31 12:39:11 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-7f3ea6ee-7e81-4dcb-b7d8-69722e9a3769 tempest-VolumeDependencyTests-442009576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2" returned: 0 in 0.776s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:39:11 devstack cinder-volume[89182]: DEBUG cinder.manager [None req-7f3ea6ee-7e81-4dcb-b7d8-69722e9a3769 tempest-VolumeDependencyTests-442009576 None] Notifying Schedulers of capabilities ... {{(pid=89182) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 12:39:11 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-7f3ea6ee-7e81-4dcb-b7d8-69722e9a3769 tempest-VolumeDependencyTests-442009576 None] Deleted volume successfully. Jul 31 12:39:11 devstack sudo[113938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-bfdefc1b-faed-41b9-ba29-9e1696a07089 Jul 31 12:39:11 devstack sudo[113938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:39:11 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-7f3ea6ee-7e81-4dcb-b7d8-69722e9a3769 tempest-VolumeDependencyTests-442009576 None] Lock "cinder-a7df6ef4-cfe2-419c-85f1-b7b92de716fa-delete_volume" released by "delete_volume" :: held 3.099s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:39:11 devstack sudo[113938]: pam_unix(sudo:session): session closed for user root Jul 31 12:39:11 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-e6f01f74-f1a2-4873-a7ed-4a489f8d596e tempest-SnapshotDataIntegrityTests-898447071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-bfdefc1b-faed-41b9-ba29-9e1696a07089" returned: 0 in 0.251s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:39:11 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-e6f01f74-f1a2-4873-a7ed-4a489f8d596e tempest-SnapshotDataIntegrityTests-898447071 None] Lock "cinder-quobyte-bfdefc1b-faed-41b9-ba29-9e1696a07089" released by "_copy_volume_from_snapshot" :: held 7.271s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:39:11 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-e6f01f74-f1a2-4873-a7ed-4a489f8d596e tempest-SnapshotDataIntegrityTests-898447071 None] Lock "cinder-quobyte-4a5c6e12-2302-44db-ab0e-eedae12ca53f-bfdefc1b-faed-41b9-ba29-9e1696a07089" released by "_create_volume_from_snapshot" :: held 7.339s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:39:11 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-e6f01f74-f1a2-4873-a7ed-4a489f8d596e tempest-SnapshotDataIntegrityTests-898447071 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.361s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:39:11 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-b11ca895-d4d8-4668-b24d-817a06da1e30 tempest-ProjectReaderTests-1403756841 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.055s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:39:11 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-b11ca895-d4d8-4668-b24d-817a06da1e30 tempest-ProjectReaderTests-1403756841 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:39:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1166072835',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5742adc1-aaad-4d66-a0ce-2277fdfdc60a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f3d0306f6a14ffa9b6c897b6fc4c21a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:39:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:39:08Z,use_quota=True,user_id='21a6903f438141de9ad7d31e5e806c6f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)}" {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 12:39:11 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-b11ca895-d4d8-4668-b24d-817a06da1e30 tempest-ProjectReaderTests-1403756841 None] Creating volume 5742adc1-aaad-4d66-a0ce-2277fdfdc60a {{(pid=89182) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 12:39:11 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-b11ca895-d4d8-4668-b24d-817a06da1e30 tempest-ProjectReaderTests-1403756841 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:39:11 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-b11ca895-d4d8-4668-b24d-817a06da1e30 tempest-ProjectReaderTests-1403756841 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:39:11 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-b11ca895-d4d8-4668-b24d-817a06da1e30 tempest-ProjectReaderTests-1403756841 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:39:11 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-b11ca895-d4d8-4668-b24d-817a06da1e30 tempest-ProjectReaderTests-1403756841 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:39:11 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-b11ca895-d4d8-4668-b24d-817a06da1e30 tempest-ProjectReaderTests-1403756841 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:39:11 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-b11ca895-d4d8-4668-b24d-817a06da1e30 tempest-ProjectReaderTests-1403756841 None] Selected osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 as target Quobyte volume. {{(pid=89182) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 12:39:11 devstack cinder-volume[89182]: INFO cinder.volume.drivers.remotefs [None req-b11ca895-d4d8-4668-b24d-817a06da1e30 tempest-ProjectReaderTests-1403756841 None] casted to osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 Jul 31 12:39:11 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-b11ca895-d4d8-4668-b24d-817a06da1e30 tempest-ProjectReaderTests-1403756841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-5742adc1-aaad-4d66-a0ce-2277fdfdc60a 1073741824 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:39:11 devstack sudo[113941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-5742adc1-aaad-4d66-a0ce-2277fdfdc60a 1073741824 Jul 31 12:39:11 devstack sudo[113941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:39:11 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-e6f01f74-f1a2-4873-a7ed-4a489f8d596e tempest-SnapshotDataIntegrityTests-898447071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97ea10b4-7311-4489-8743-e18aaa7aa757) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bfdefc1b-faed-41b9-ba29-9e1696a07089', 'volume_size': 1, 'snapshot_id': '4a5c6e12-2302-44db-ab0e-eedae12ca53f'}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:39:11 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-e6f01f74-f1a2-4873-a7ed-4a489f8d596e tempest-SnapshotDataIntegrityTests-898447071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4bf7d7f8-c90f-4770-b557-839cce55b7db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:39:11 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-e6f01f74-f1a2-4873-a7ed-4a489f8d596e tempest-SnapshotDataIntegrityTests-898447071 None] Volume volume-bfdefc1b-faed-41b9-ba29-9e1696a07089 (bfdefc1b-faed-41b9-ba29-9e1696a07089): created successfully Jul 31 12:39:11 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-e6f01f74-f1a2-4873-a7ed-4a489f8d596e tempest-SnapshotDataIntegrityTests-898447071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4bf7d7f8-c90f-4770-b557-839cce55b7db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:39:11 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-e6f01f74-f1a2-4873-a7ed-4a489f8d596e tempest-SnapshotDataIntegrityTests-898447071 None] Flow 'volume_create_manager' (01da153f-9965-46f8-a40c-c01f3dfe7edc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:39:11 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-e6f01f74-f1a2-4873-a7ed-4a489f8d596e tempest-SnapshotDataIntegrityTests-898447071 None] Created volume successfully. Jul 31 12:39:11 devstack sudo[113941]: pam_unix(sudo:session): session closed for user root Jul 31 12:39:11 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-b11ca895-d4d8-4668-b24d-817a06da1e30 tempest-ProjectReaderTests-1403756841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-5742adc1-aaad-4d66-a0ce-2277fdfdc60a 1073741824" returned: 0 in 0.496s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:39:11 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-b11ca895-d4d8-4668-b24d-817a06da1e30 tempest-ProjectReaderTests-1403756841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-5742adc1-aaad-4d66-a0ce-2277fdfdc60a {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:39:11 devstack sudo[113951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-5742adc1-aaad-4d66-a0ce-2277fdfdc60a Jul 31 12:39:11 devstack sudo[113951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:39:12 devstack sudo[113951]: pam_unix(sudo:session): session closed for user root Jul 31 12:39:12 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-b11ca895-d4d8-4668-b24d-817a06da1e30 tempest-ProjectReaderTests-1403756841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-5742adc1-aaad-4d66-a0ce-2277fdfdc60a" returned: 0 in 0.325s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:39:12 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-b11ca895-d4d8-4668-b24d-817a06da1e30 tempest-ProjectReaderTests-1403756841 None] <== create_volume: return (869ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'} {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 12:39:12 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-b11ca895-d4d8-4668-b24d-817a06da1e30 tempest-ProjectReaderTests-1403756841 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.871s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:39:12 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-5bb43a4a-0da8-48a3-8184-018d0a2553be tempest-VolumeImageDependencyTests-1366750687 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.231s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:39:12 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-b11ca895-d4d8-4668-b24d-817a06da1e30 tempest-ProjectReaderTests-1403756841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd6ca37c-4fc6-4d7a-8e2a-78c5c734361a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5742adc1-aaad-4d66-a0ce-2277fdfdc60a', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:39:12 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-b11ca895-d4d8-4668-b24d-817a06da1e30 tempest-ProjectReaderTests-1403756841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (333d4912-368d-448b-b45a-9e858c92a1d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:39:12 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-5bb43a4a-0da8-48a3-8184-018d0a2553be tempest-VolumeImageDependencyTests-1366750687 None] Creating offline snapshot 3781e7fb-be32-4ee7-87fd-e8a132f3d6ac of volume 7c968dbb-687c-450d-a061-fe29cb89c249 {{(pid=89182) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 31 12:39:12 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-b11ca895-d4d8-4668-b24d-817a06da1e30 tempest-ProjectReaderTests-1403756841 None] Volume volume-5742adc1-aaad-4d66-a0ce-2277fdfdc60a (5742adc1-aaad-4d66-a0ce-2277fdfdc60a): created successfully Jul 31 12:39:12 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-b11ca895-d4d8-4668-b24d-817a06da1e30 tempest-ProjectReaderTests-1403756841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (333d4912-368d-448b-b45a-9e858c92a1d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:39:12 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-b11ca895-d4d8-4668-b24d-817a06da1e30 tempest-ProjectReaderTests-1403756841 None] Flow 'volume_create_manager' (940659ca-c8ab-4316-8e21-3818d645bb86) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:39:12 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d8fe6f0-0338-4640-8dfe-5029b9df8252]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:39:12 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-5bb43a4a-0da8-48a3-8184-018d0a2553be tempest-VolumeImageDependencyTests-1366750687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-7c968dbb-687c-450d-a061-fe29cb89c249 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:39:12 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-b11ca895-d4d8-4668-b24d-817a06da1e30 tempest-ProjectReaderTests-1403756841 None] Created volume successfully. Jul 31 12:39:12 devstack sudo[113957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-7c968dbb-687c-450d-a061-fe29cb89c249 Jul 31 12:39:12 devstack sudo[113957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:39:12 devstack sudo[113957]: pam_unix(sudo:session): session closed for user root Jul 31 12:39:12 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-5bb43a4a-0da8-48a3-8184-018d0a2553be tempest-VolumeImageDependencyTests-1366750687 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-7c968dbb-687c-450d-a061-fe29cb89c249" returned: 0 in 0.449s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:39:12 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-5bb43a4a-0da8-48a3-8184-018d0a2553be tempest-VolumeImageDependencyTests-1366750687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-7c968dbb-687c-450d-a061-fe29cb89c249,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-7c968dbb-687c-450d-a061-fe29cb89c249.3781e7fb-be32-4ee7-87fd-e8a132f3d6ac 1G {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:39:12 devstack sudo[113963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-7c968dbb-687c-450d-a061-fe29cb89c249,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-7c968dbb-687c-450d-a061-fe29cb89c249.3781e7fb-be32-4ee7-87fd-e8a132f3d6ac 1G Jul 31 12:39:12 devstack sudo[113963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:39:13 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [req-7fde1166-6944-466e-ba1d-d644a5332424 req-26270cc6-4a99-42fc-8a99-080103883900 tempest-SnapshotDataIntegrityTests-898447071 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:39:13 devstack sudo[113963]: pam_unix(sudo:session): session closed for user root Jul 31 12:39:13 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-5bb43a4a-0da8-48a3-8184-018d0a2553be tempest-VolumeImageDependencyTests-1366750687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-7c968dbb-687c-450d-a061-fe29cb89c249,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-7c968dbb-687c-450d-a061-fe29cb89c249.3781e7fb-be32-4ee7-87fd-e8a132f3d6ac 1G" returned: 0 in 0.510s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:39:13 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-5bb43a4a-0da8-48a3-8184-018d0a2553be tempest-VolumeImageDependencyTests-1366750687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7c968dbb-687c-450d-a061-fe29cb89c249 -F qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-7c968dbb-687c-450d-a061-fe29cb89c249.3781e7fb-be32-4ee7-87fd-e8a132f3d6ac {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:39:13 devstack sudo[113978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7c968dbb-687c-450d-a061-fe29cb89c249 -F qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-7c968dbb-687c-450d-a061-fe29cb89c249.3781e7fb-be32-4ee7-87fd-e8a132f3d6ac Jul 31 12:39:13 devstack sudo[113978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:39:13 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-1019c6aa-8a57-481d-b673-680604110b7c tempest-ProjectReaderTests-1403756841 None] Acquiring lock "cinder-5742adc1-aaad-4d66-a0ce-2277fdfdc60a-delete_volume" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:39:13 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-1019c6aa-8a57-481d-b673-680604110b7c tempest-ProjectReaderTests-1403756841 None] Lock "cinder-5742adc1-aaad-4d66-a0ce-2277fdfdc60a-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:39:13 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-1019c6aa-8a57-481d-b673-680604110b7c tempest-ProjectReaderTests-1403756841 None] Acquiring lock "cinder-quobyte-5742adc1-aaad-4d66-a0ce-2277fdfdc60a" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:39:13 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-1019c6aa-8a57-481d-b673-680604110b7c tempest-ProjectReaderTests-1403756841 None] Lock "cinder-quobyte-5742adc1-aaad-4d66-a0ce-2277fdfdc60a" acquired by "delete_volume" :: waited 0.017s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:39:13 devstack sudo[113978]: pam_unix(sudo:session): session closed for user root Jul 31 12:39:13 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-5bb43a4a-0da8-48a3-8184-018d0a2553be tempest-VolumeImageDependencyTests-1366750687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7c968dbb-687c-450d-a061-fe29cb89c249 -F qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-7c968dbb-687c-450d-a061-fe29cb89c249.3781e7fb-be32-4ee7-87fd-e8a132f3d6ac" returned: 0 in 0.332s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:39:13 devstack cinder-volume[89182]: WARNING cinder.volume.drivers.remotefs [None req-5bb43a4a-0da8-48a3-8184-018d0a2553be tempest-VolumeImageDependencyTests-1366750687 None] /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-7c968dbb-687c-450d-a061-fe29cb89c249.3781e7fb-be32-4ee7-87fd-e8a132f3d6ac is being set with open permissions: ugo+rw Jul 31 12:39:13 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-5bb43a4a-0da8-48a3-8184-018d0a2553be tempest-VolumeImageDependencyTests-1366750687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-7c968dbb-687c-450d-a061-fe29cb89c249.3781e7fb-be32-4ee7-87fd-e8a132f3d6ac {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:39:13 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c0753a5-adca-481b-8245-6875fa0a10c4]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:39:13 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-1019c6aa-8a57-481d-b673-680604110b7c tempest-ProjectReaderTests-1403756841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-5742adc1-aaad-4d66-a0ce-2277fdfdc60a {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:39:13 devstack sudo[113983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-7c968dbb-687c-450d-a061-fe29cb89c249.3781e7fb-be32-4ee7-87fd-e8a132f3d6ac Jul 31 12:39:13 devstack sudo[113983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:39:13 devstack sudo[113984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-5742adc1-aaad-4d66-a0ce-2277fdfdc60a Jul 31 12:39:13 devstack sudo[113984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:39:13 devstack sudo[113983]: pam_unix(sudo:session): session closed for user root Jul 31 12:39:13 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-5bb43a4a-0da8-48a3-8184-018d0a2553be tempest-VolumeImageDependencyTests-1366750687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-7c968dbb-687c-450d-a061-fe29cb89c249.3781e7fb-be32-4ee7-87fd-e8a132f3d6ac" returned: 0 in 0.301s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:39:13 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-5bb43a4a-0da8-48a3-8184-018d0a2553be tempest-VolumeImageDependencyTests-1366750687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-7c968dbb-687c-450d-a061-fe29cb89c249.info {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:39:13 devstack sudo[113989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-7c968dbb-687c-450d-a061-fe29cb89c249.info Jul 31 12:39:13 devstack sudo[113989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:39:14 devstack sudo[113984]: pam_unix(sudo:session): session closed for user root Jul 31 12:39:14 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-1019c6aa-8a57-481d-b673-680604110b7c tempest-ProjectReaderTests-1403756841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-5742adc1-aaad-4d66-a0ce-2277fdfdc60a" returned: 0 in 0.424s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:39:14 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-1019c6aa-8a57-481d-b673-680604110b7c tempest-ProjectReaderTests-1403756841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-5742adc1-aaad-4d66-a0ce-2277fdfdc60a {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:39:14 devstack sudo[113993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-5742adc1-aaad-4d66-a0ce-2277fdfdc60a Jul 31 12:39:14 devstack sudo[113993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:39:14 devstack sudo[113989]: pam_unix(sudo:session): session closed for user root Jul 31 12:39:14 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-5bb43a4a-0da8-48a3-8184-018d0a2553be tempest-VolumeImageDependencyTests-1366750687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-7c968dbb-687c-450d-a061-fe29cb89c249.info" returned: 0 in 0.280s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:39:14 devstack cinder-volume[89182]: WARNING cinder.volume.drivers.remotefs [None req-5bb43a4a-0da8-48a3-8184-018d0a2553be tempest-VolumeImageDependencyTests-1366750687 None] /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-7c968dbb-687c-450d-a061-fe29cb89c249.info is being set with open permissions: ugo+rw Jul 31 12:39:14 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-5bb43a4a-0da8-48a3-8184-018d0a2553be tempest-VolumeImageDependencyTests-1366750687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-7c968dbb-687c-450d-a061-fe29cb89c249.info {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:39:14 devstack sudo[113996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-7c968dbb-687c-450d-a061-fe29cb89c249.info Jul 31 12:39:14 devstack sudo[113996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:39:14 devstack sudo[113993]: pam_unix(sudo:session): session closed for user root Jul 31 12:39:14 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-1019c6aa-8a57-481d-b673-680604110b7c tempest-ProjectReaderTests-1403756841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-5742adc1-aaad-4d66-a0ce-2277fdfdc60a" returned: 0 in 0.269s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:39:14 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-1019c6aa-8a57-481d-b673-680604110b7c tempest-ProjectReaderTests-1403756841 None] Lock "cinder-quobyte-5742adc1-aaad-4d66-a0ce-2277fdfdc60a" released by "delete_volume" :: held 0.753s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:39:14 devstack cinder-volume[89182]: DEBUG cinder.quota [None req-1019c6aa-8a57-481d-b673-680604110b7c tempest-ProjectReaderTests-1403756841 None] Created reservations ['c002fa6b-0cff-4260-a14d-228dacf14666', '96b5c8d6-88a9-4d5e-8d72-5d4f5a4559f8', '4e78042f-99f4-4832-9acd-81318ba36483', 'f005ea0d-858b-4068-af64-3cbb84edf1b7'] {{(pid=89182) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 12:39:14 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-1019c6aa-8a57-481d-b673-680604110b7c tempest-ProjectReaderTests-1403756841 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:39:14 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-1019c6aa-8a57-481d-b673-680604110b7c tempest-ProjectReaderTests-1403756841 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:39:14 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-1019c6aa-8a57-481d-b673-680604110b7c tempest-ProjectReaderTests-1403756841 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:39:14 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-1019c6aa-8a57-481d-b673-680604110b7c tempest-ProjectReaderTests-1403756841 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:39:14 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-1019c6aa-8a57-481d-b673-680604110b7c tempest-ProjectReaderTests-1403756841 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:39:14 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-1019c6aa-8a57-481d-b673-680604110b7c tempest-ProjectReaderTests-1403756841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:39:14 devstack sudo[113996]: pam_unix(sudo:session): session closed for user root Jul 31 12:39:14 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-5bb43a4a-0da8-48a3-8184-018d0a2553be tempest-VolumeImageDependencyTests-1366750687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-7c968dbb-687c-450d-a061-fe29cb89c249.info" returned: 0 in 0.269s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:39:14 devstack sudo[114000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 Jul 31 12:39:14 devstack sudo[114000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:39:14 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-5bb43a4a-0da8-48a3-8184-018d0a2553be tempest-VolumeImageDependencyTests-1366750687 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.306s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:39:14 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [req-7fde1166-6944-466e-ba1d-d644a5332424 req-26270cc6-4a99-42fc-8a99-080103883900 tempest-SnapshotDataIntegrityTests-898447071 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.383s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:39:14 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [req-7fde1166-6944-466e-ba1d-d644a5332424 req-26270cc6-4a99-42fc-8a99-080103883900 tempest-SnapshotDataIntegrityTests-898447071 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.021s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:39:14 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [req-7fde1166-6944-466e-ba1d-d644a5332424 req-26270cc6-4a99-42fc-8a99-080103883900 tempest-SnapshotDataIntegrityTests-898447071 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88', 'name': 'volume-bfdefc1b-faed-41b9-ba29-9e1696a07089', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0e9f2d20-ff4e-47f6-a178-b7113e90f33e', 'enforce_multipath': True} {{(pid=89182) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 31 12:39:14 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-5bb43a4a-0da8-48a3-8184-018d0a2553be tempest-VolumeImageDependencyTests-1366750687 None] Create snapshot completed successfully Jul 31 12:39:14 devstack cinder-volume[89182]: INFO cinder.volume.manager [req-7fde1166-6944-466e-ba1d-d644a5332424 req-26270cc6-4a99-42fc-8a99-080103883900 tempest-SnapshotDataIntegrityTests-898447071 None] attachment_update completed successfully. Jul 31 12:39:14 devstack sudo[114000]: pam_unix(sudo:session): session closed for user root Jul 31 12:39:14 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-1019c6aa-8a57-481d-b673-680604110b7c tempest-ProjectReaderTests-1403756841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2" returned: 0 in 0.357s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:39:14 devstack cinder-volume[89182]: DEBUG cinder.manager [None req-1019c6aa-8a57-481d-b673-680604110b7c tempest-ProjectReaderTests-1403756841 None] Notifying Schedulers of capabilities ... {{(pid=89182) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 12:39:14 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-1019c6aa-8a57-481d-b673-680604110b7c tempest-ProjectReaderTests-1403756841 None] Deleted volume successfully. Jul 31 12:39:14 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-1019c6aa-8a57-481d-b673-680604110b7c tempest-ProjectReaderTests-1403756841 None] Lock "cinder-5742adc1-aaad-4d66-a0ce-2277fdfdc60a-delete_volume" released by "delete_volume" :: held 1.371s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:39:15 devstack cinder-volume[89182]: DEBUG cinder.volume.flows.manager.create_volume [None req-7df6df56-476f-4377-aab9-a53371e16fe1 tempest-ProjectReaderTests-1403756841 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89182) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 12:39:15 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-7df6df56-476f-4377-aab9-a53371e16fe1 tempest-ProjectReaderTests-1403756841 None] Flow 'volume_create_manager' (2b4a795c-984d-4f8d-9bbb-e00f8abca84c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:39:15 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-7df6df56-476f-4377-aab9-a53371e16fe1 tempest-ProjectReaderTests-1403756841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11e7f827-ea91-4737-b1dd-22625bed732f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:39:15 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-bfd92e2a-d075-40c4-bdba-5eb82a8ef0f1 tempest-ProjectAdminTests-388294704 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.637077331543, 'free_capacity_gb': 1775.637077331543, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=89182) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 31 12:39:15 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-7df6df56-476f-4377-aab9-a53371e16fe1 tempest-ProjectReaderTests-1403756841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11e7f827-ea91-4737-b1dd-22625bed732f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:39:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1838673347',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f2e83e9-5dfd-4f64-bac6-8888922ee371,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f3d0306f6a14ffa9b6c897b6fc4c21a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:39:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:39:15Z,use_quota=True,user_id='21a6903f438141de9ad7d31e5e806c6f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:39:15 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-7df6df56-476f-4377-aab9-a53371e16fe1 tempest-ProjectReaderTests-1403756841 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd041754-6f17-4e00-8807-4eb06a1f31cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:39:15 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-7df6df56-476f-4377-aab9-a53371e16fe1 tempest-ProjectReaderTests-1403756841 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd041754-6f17-4e00-8807-4eb06a1f31cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:39:15 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-7df6df56-476f-4377-aab9-a53371e16fe1 tempest-ProjectReaderTests-1403756841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37033e72-d3eb-4141-ba18-b75a1fe2be67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:39:15 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-7df6df56-476f-4377-aab9-a53371e16fe1 tempest-ProjectReaderTests-1403756841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37033e72-d3eb-4141-ba18-b75a1fe2be67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8f2e83e9-5dfd-4f64-bac6-8888922ee371', 'volume_name': 'volume-8f2e83e9-5dfd-4f64-bac6-8888922ee371', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:39:15 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-7df6df56-476f-4377-aab9-a53371e16fe1 tempest-ProjectReaderTests-1403756841 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82622089-0299-46b8-80b9-d27c1f07ba87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:39:15 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-7df6df56-476f-4377-aab9-a53371e16fe1 tempest-ProjectReaderTests-1403756841 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82622089-0299-46b8-80b9-d27c1f07ba87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:39:15 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-7df6df56-476f-4377-aab9-a53371e16fe1 tempest-ProjectReaderTests-1403756841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d20ac2c-908b-42f8-a02a-bcade7042b6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:39:15 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-7df6df56-476f-4377-aab9-a53371e16fe1 tempest-ProjectReaderTests-1403756841 None] Volume 8f2e83e9-5dfd-4f64-bac6-8888922ee371: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8f2e83e9-5dfd-4f64-bac6-8888922ee371', 'volume_size': 1} Jul 31 12:39:15 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-7df6df56-476f-4377-aab9-a53371e16fe1 tempest-ProjectReaderTests-1403756841 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:39:15 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-7df6df56-476f-4377-aab9-a53371e16fe1 tempest-ProjectReaderTests-1403756841 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:39:15 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-7df6df56-476f-4377-aab9-a53371e16fe1 tempest-ProjectReaderTests-1403756841 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:39:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1838673347',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f2e83e9-5dfd-4f64-bac6-8888922ee371,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f3d0306f6a14ffa9b6c897b6fc4c21a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:39:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:39:15Z,use_quota=True,user_id='21a6903f438141de9ad7d31e5e806c6f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)}" {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 12:39:15 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-7df6df56-476f-4377-aab9-a53371e16fe1 tempest-ProjectReaderTests-1403756841 None] Creating volume 8f2e83e9-5dfd-4f64-bac6-8888922ee371 {{(pid=89182) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 12:39:15 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-7df6df56-476f-4377-aab9-a53371e16fe1 tempest-ProjectReaderTests-1403756841 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:39:15 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-7df6df56-476f-4377-aab9-a53371e16fe1 tempest-ProjectReaderTests-1403756841 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:39:15 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-7df6df56-476f-4377-aab9-a53371e16fe1 tempest-ProjectReaderTests-1403756841 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:39:15 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-7df6df56-476f-4377-aab9-a53371e16fe1 tempest-ProjectReaderTests-1403756841 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:39:15 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-7df6df56-476f-4377-aab9-a53371e16fe1 tempest-ProjectReaderTests-1403756841 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:39:15 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-7df6df56-476f-4377-aab9-a53371e16fe1 tempest-ProjectReaderTests-1403756841 None] Selected osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 as target Quobyte volume. {{(pid=89182) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 12:39:15 devstack cinder-volume[89182]: INFO cinder.volume.drivers.remotefs [None req-7df6df56-476f-4377-aab9-a53371e16fe1 tempest-ProjectReaderTests-1403756841 None] casted to osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 Jul 31 12:39:15 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-7df6df56-476f-4377-aab9-a53371e16fe1 tempest-ProjectReaderTests-1403756841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-8f2e83e9-5dfd-4f64-bac6-8888922ee371 1073741824 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:39:15 devstack sudo[114390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-8f2e83e9-5dfd-4f64-bac6-8888922ee371 1073741824 Jul 31 12:39:15 devstack sudo[114390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:39:15 devstack cinder-volume[89182]: DEBUG cinder.volume.flows.manager.create_volume [None req-42a8b29c-57e1-41e8-a267-7e845ee5b7a7 tempest-VolumeImageDependencyTests-1366750687 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89182) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 12:39:15 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-42a8b29c-57e1-41e8-a267-7e845ee5b7a7 tempest-VolumeImageDependencyTests-1366750687 None] Flow 'volume_create_manager' (709ef2bb-8a07-4329-ab7a-7c33bb7852db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:39:15 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-42a8b29c-57e1-41e8-a267-7e845ee5b7a7 tempest-VolumeImageDependencyTests-1366750687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00fd2172-b1ea-449c-bae6-9afe828d04cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:39:16 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-42a8b29c-57e1-41e8-a267-7e845ee5b7a7 tempest-VolumeImageDependencyTests-1366750687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00fd2172-b1ea-449c-bae6-9afe828d04cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=True,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:39:15Z,deleted=False,deleted_at=None,display_description=None,display_name='volume2-for-test-e6050452-06bd-4c7f-9912-45178c83e379',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bfea7fe4-52be-4067-a42c-56f645b6c545,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d0755f1e2ea4124a760580edccedbe3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:39:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=3781e7fb-be32-4ee7-87fd-e8a132f3d6ac,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:39:16Z,use_quota=True,user_id='b44e6e9d7b9542c6aea2ca270c251a89',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:39:16 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-42a8b29c-57e1-41e8-a267-7e845ee5b7a7 tempest-VolumeImageDependencyTests-1366750687 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30b97388-4559-41e0-b831-04a3bf702e0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:39:16 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-42a8b29c-57e1-41e8-a267-7e845ee5b7a7 tempest-VolumeImageDependencyTests-1366750687 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30b97388-4559-41e0-b831-04a3bf702e0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:39:16 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-42a8b29c-57e1-41e8-a267-7e845ee5b7a7 tempest-VolumeImageDependencyTests-1366750687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bbefafca-f2c4-4b4d-ba8b-4abb2cd00897) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:39:16 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-42a8b29c-57e1-41e8-a267-7e845ee5b7a7 tempest-VolumeImageDependencyTests-1366750687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bbefafca-f2c4-4b4d-ba8b-4abb2cd00897) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'bfea7fe4-52be-4067-a42c-56f645b6c545', 'volume_name': 'volume-bfea7fe4-52be-4067-a42c-56f645b6c545', 'volume_size': 1, 'snapshot_id': '3781e7fb-be32-4ee7-87fd-e8a132f3d6ac'}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:39:16 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-42a8b29c-57e1-41e8-a267-7e845ee5b7a7 tempest-VolumeImageDependencyTests-1366750687 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4f2a4bd-e20b-4417-9aeb-0a249d66d51e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:39:16 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-42a8b29c-57e1-41e8-a267-7e845ee5b7a7 tempest-VolumeImageDependencyTests-1366750687 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4f2a4bd-e20b-4417-9aeb-0a249d66d51e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:39:16 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-42a8b29c-57e1-41e8-a267-7e845ee5b7a7 tempest-VolumeImageDependencyTests-1366750687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dac25444-7997-4d68-9669-0185cd73f985) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:39:16 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-42a8b29c-57e1-41e8-a267-7e845ee5b7a7 tempest-VolumeImageDependencyTests-1366750687 None] Volume bfea7fe4-52be-4067-a42c-56f645b6c545: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-bfea7fe4-52be-4067-a42c-56f645b6c545', 'volume_size': 1, 'snapshot_id': '3781e7fb-be32-4ee7-87fd-e8a132f3d6ac'} Jul 31 12:39:16 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-42a8b29c-57e1-41e8-a267-7e845ee5b7a7 tempest-VolumeImageDependencyTests-1366750687 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:39:16 devstack sudo[114390]: pam_unix(sudo:session): session closed for user root Jul 31 12:39:16 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-7df6df56-476f-4377-aab9-a53371e16fe1 tempest-ProjectReaderTests-1403756841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-8f2e83e9-5dfd-4f64-bac6-8888922ee371 1073741824" returned: 0 in 0.688s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:39:16 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-7df6df56-476f-4377-aab9-a53371e16fe1 tempest-ProjectReaderTests-1403756841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-8f2e83e9-5dfd-4f64-bac6-8888922ee371 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:39:16 devstack sudo[114401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-8f2e83e9-5dfd-4f64-bac6-8888922ee371 Jul 31 12:39:16 devstack sudo[114401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:39:16 devstack sudo[114401]: pam_unix(sudo:session): session closed for user root Jul 31 12:39:16 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-7df6df56-476f-4377-aab9-a53371e16fe1 tempest-ProjectReaderTests-1403756841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-8f2e83e9-5dfd-4f64-bac6-8888922ee371" returned: 0 in 0.276s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:39:16 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-7df6df56-476f-4377-aab9-a53371e16fe1 tempest-ProjectReaderTests-1403756841 None] <== create_volume: return (1009ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'} {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 12:39:16 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-7df6df56-476f-4377-aab9-a53371e16fe1 tempest-ProjectReaderTests-1403756841 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.012s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:39:16 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-42a8b29c-57e1-41e8-a267-7e845ee5b7a7 tempest-VolumeImageDependencyTests-1366750687 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.346s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:39:16 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-42a8b29c-57e1-41e8-a267-7e845ee5b7a7 tempest-VolumeImageDependencyTests-1366750687 None] Acquiring lock "cinder-quobyte-3781e7fb-be32-4ee7-87fd-e8a132f3d6ac-bfea7fe4-52be-4067-a42c-56f645b6c545" by "_create_volume_from_snapshot" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:39:16 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-7df6df56-476f-4377-aab9-a53371e16fe1 tempest-ProjectReaderTests-1403756841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d20ac2c-908b-42f8-a02a-bcade7042b6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8f2e83e9-5dfd-4f64-bac6-8888922ee371', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:39:16 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-7df6df56-476f-4377-aab9-a53371e16fe1 tempest-ProjectReaderTests-1403756841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55f76073-43c5-43b6-afa3-07ddc4ea7623) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:39:16 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-42a8b29c-57e1-41e8-a267-7e845ee5b7a7 tempest-VolumeImageDependencyTests-1366750687 None] Lock "cinder-quobyte-3781e7fb-be32-4ee7-87fd-e8a132f3d6ac-bfea7fe4-52be-4067-a42c-56f645b6c545" acquired by "_create_volume_from_snapshot" :: waited 0.038s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:39:16 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-42a8b29c-57e1-41e8-a267-7e845ee5b7a7 tempest-VolumeImageDependencyTests-1366750687 None] Creating volume bfea7fe4-52be-4067-a42c-56f645b6c545 from snapshot 3781e7fb-be32-4ee7-87fd-e8a132f3d6ac {{(pid=89182) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 31 12:39:16 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-42a8b29c-57e1-41e8-a267-7e845ee5b7a7 tempest-VolumeImageDependencyTests-1366750687 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:39:16 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-42a8b29c-57e1-41e8-a267-7e845ee5b7a7 tempest-VolumeImageDependencyTests-1366750687 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:39:16 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-42a8b29c-57e1-41e8-a267-7e845ee5b7a7 tempest-VolumeImageDependencyTests-1366750687 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:39:16 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-42a8b29c-57e1-41e8-a267-7e845ee5b7a7 tempest-VolumeImageDependencyTests-1366750687 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:39:16 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-42a8b29c-57e1-41e8-a267-7e845ee5b7a7 tempest-VolumeImageDependencyTests-1366750687 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:39:16 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-42a8b29c-57e1-41e8-a267-7e845ee5b7a7 tempest-VolumeImageDependencyTests-1366750687 None] Selected osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 as target Quobyte volume. {{(pid=89182) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 12:39:16 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-42a8b29c-57e1-41e8-a267-7e845ee5b7a7 tempest-VolumeImageDependencyTests-1366750687 None] Acquiring lock "cinder-quobyte-bfea7fe4-52be-4067-a42c-56f645b6c545" by "_copy_volume_from_snapshot" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:39:16 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-7df6df56-476f-4377-aab9-a53371e16fe1 tempest-ProjectReaderTests-1403756841 None] Volume volume-8f2e83e9-5dfd-4f64-bac6-8888922ee371 (8f2e83e9-5dfd-4f64-bac6-8888922ee371): created successfully Jul 31 12:39:16 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-7df6df56-476f-4377-aab9-a53371e16fe1 tempest-ProjectReaderTests-1403756841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55f76073-43c5-43b6-afa3-07ddc4ea7623) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:39:16 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-7df6df56-476f-4377-aab9-a53371e16fe1 tempest-ProjectReaderTests-1403756841 None] Flow 'volume_create_manager' (2b4a795c-984d-4f8d-9bbb-e00f8abca84c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:39:16 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-42a8b29c-57e1-41e8-a267-7e845ee5b7a7 tempest-VolumeImageDependencyTests-1366750687 None] Lock "cinder-quobyte-bfea7fe4-52be-4067-a42c-56f645b6c545" acquired by "_copy_volume_from_snapshot" :: waited 0.033s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:39:16 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-42a8b29c-57e1-41e8-a267-7e845ee5b7a7 tempest-VolumeImageDependencyTests-1366750687 None] snapshot: 3781e7fb-be32-4ee7-87fd-e8a132f3d6ac, volume: bfea7fe4-52be-4067-a42c-56f645b6c545, {{(pid=89182) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Jul 31 12:39:16 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-7df6df56-476f-4377-aab9-a53371e16fe1 tempest-ProjectReaderTests-1403756841 None] Created volume successfully. Jul 31 12:39:16 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-42a8b29c-57e1-41e8-a267-7e845ee5b7a7 tempest-VolumeImageDependencyTests-1366750687 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:39:16 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-42a8b29c-57e1-41e8-a267-7e845ee5b7a7 tempest-VolumeImageDependencyTests-1366750687 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:39:16 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-42a8b29c-57e1-41e8-a267-7e845ee5b7a7 tempest-VolumeImageDependencyTests-1366750687 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:39:16 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-42a8b29c-57e1-41e8-a267-7e845ee5b7a7 tempest-VolumeImageDependencyTests-1366750687 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:39:16 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-42a8b29c-57e1-41e8-a267-7e845ee5b7a7 tempest-VolumeImageDependencyTests-1366750687 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:39:16 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[2514dcff-1129-465b-8450-86ce58c8f104]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:39:16 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-42a8b29c-57e1-41e8-a267-7e845ee5b7a7 tempest-VolumeImageDependencyTests-1366750687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-7c968dbb-687c-450d-a061-fe29cb89c249.3781e7fb-be32-4ee7-87fd-e8a132f3d6ac {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:39:16 devstack sudo[114414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-7c968dbb-687c-450d-a061-fe29cb89c249.3781e7fb-be32-4ee7-87fd-e8a132f3d6ac Jul 31 12:39:16 devstack sudo[114414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:39:17 devstack sudo[114414]: pam_unix(sudo:session): session closed for user root Jul 31 12:39:17 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-42a8b29c-57e1-41e8-a267-7e845ee5b7a7 tempest-VolumeImageDependencyTests-1366750687 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-7c968dbb-687c-450d-a061-fe29cb89c249.3781e7fb-be32-4ee7-87fd-e8a132f3d6ac" returned: 0 in 0.428s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:39:17 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-42a8b29c-57e1-41e8-a267-7e845ee5b7a7 tempest-VolumeImageDependencyTests-1366750687 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7c968dbb-687c-450d-a061-fe29cb89c249(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89182) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 12:39:17 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fcc1c4f-a5dc-4113-9f1f-bf5dc7689917]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:39:17 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-42a8b29c-57e1-41e8-a267-7e845ee5b7a7 tempest-VolumeImageDependencyTests-1366750687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-7c968dbb-687c-450d-a061-fe29cb89c249 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:39:17 devstack sudo[114425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-7c968dbb-687c-450d-a061-fe29cb89c249 Jul 31 12:39:17 devstack sudo[114425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:39:17 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-e72152a7-40b3-4fe3-8c32-4e1de3230614 tempest-ProjectReaderTests-1403756841 None] Acquiring lock "cinder-8f2e83e9-5dfd-4f64-bac6-8888922ee371-delete_volume" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:39:17 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-e72152a7-40b3-4fe3-8c32-4e1de3230614 tempest-ProjectReaderTests-1403756841 None] Lock "cinder-8f2e83e9-5dfd-4f64-bac6-8888922ee371-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:39:17 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-e72152a7-40b3-4fe3-8c32-4e1de3230614 tempest-ProjectReaderTests-1403756841 None] Acquiring lock "cinder-quobyte-8f2e83e9-5dfd-4f64-bac6-8888922ee371" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:39:17 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-e72152a7-40b3-4fe3-8c32-4e1de3230614 tempest-ProjectReaderTests-1403756841 None] Lock "cinder-quobyte-8f2e83e9-5dfd-4f64-bac6-8888922ee371" acquired by "delete_volume" :: waited 0.027s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:39:17 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[30ee1fe2-2e92-4b89-838f-fa9401c08d6c]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:39:17 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-e72152a7-40b3-4fe3-8c32-4e1de3230614 tempest-ProjectReaderTests-1403756841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-8f2e83e9-5dfd-4f64-bac6-8888922ee371 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:39:17 devstack sudo[114425]: pam_unix(sudo:session): session closed for user root Jul 31 12:39:17 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-42a8b29c-57e1-41e8-a267-7e845ee5b7a7 tempest-VolumeImageDependencyTests-1366750687 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-7c968dbb-687c-450d-a061-fe29cb89c249" returned: 0 in 0.503s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:39:17 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-42a8b29c-57e1-41e8-a267-7e845ee5b7a7 tempest-VolumeImageDependencyTests-1366750687 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-7c968dbb-687c-450d-a061-fe29cb89c249 {{(pid=89182) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Jul 31 12:39:17 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-42a8b29c-57e1-41e8-a267-7e845ee5b7a7 tempest-VolumeImageDependencyTests-1366750687 None] Creating direct copy from snapshot {{(pid=89182) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Jul 31 12:39:17 devstack cinder-volume[89182]: DEBUG cinder.utils [None req-42a8b29c-57e1-41e8-a267-7e845ee5b7a7 tempest-VolumeImageDependencyTests-1366750687 None] Path /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-bfea7fe4-52be-4067-a42c-56f645b6c545 not found in is_blk_device check {{(pid=89182) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 31 12:39:17 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-42a8b29c-57e1-41e8-a267-7e845ee5b7a7 tempest-VolumeImageDependencyTests-1366750687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-7c968dbb-687c-450d-a061-fe29cb89c249 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-bfea7fe4-52be-4067-a42c-56f645b6c545 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:39:17 devstack sudo[114434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-7c968dbb-687c-450d-a061-fe29cb89c249 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-bfea7fe4-52be-4067-a42c-56f645b6c545 Jul 31 12:39:17 devstack sudo[114434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:39:17 devstack sudo[114433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-8f2e83e9-5dfd-4f64-bac6-8888922ee371 Jul 31 12:39:17 devstack sudo[114433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:39:18 devstack sudo[114433]: pam_unix(sudo:session): session closed for user root Jul 31 12:39:18 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-e72152a7-40b3-4fe3-8c32-4e1de3230614 tempest-ProjectReaderTests-1403756841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-8f2e83e9-5dfd-4f64-bac6-8888922ee371" returned: 0 in 0.507s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:39:18 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-e72152a7-40b3-4fe3-8c32-4e1de3230614 tempest-ProjectReaderTests-1403756841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-8f2e83e9-5dfd-4f64-bac6-8888922ee371 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:39:18 devstack sudo[114443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-8f2e83e9-5dfd-4f64-bac6-8888922ee371 Jul 31 12:39:18 devstack sudo[114443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:39:18 devstack sudo[114434]: pam_unix(sudo:session): session closed for user root Jul 31 12:39:18 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-42a8b29c-57e1-41e8-a267-7e845ee5b7a7 tempest-VolumeImageDependencyTests-1366750687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-7c968dbb-687c-450d-a061-fe29cb89c249 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-bfea7fe4-52be-4067-a42c-56f645b6c545" returned: 0 in 0.673s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:39:18 devstack cinder-volume[89182]: DEBUG cinder.image.image_utils [None req-42a8b29c-57e1-41e8-a267-7e845ee5b7a7 tempest-VolumeImageDependencyTests-1366750687 None] Image conversion details: src /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-7c968dbb-687c-450d-a061-fe29cb89c249, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-bfea7fe4-52be-4067-a42c-56f645b6c545 {{(pid=89182) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 31 12:39:18 devstack cinder-volume[89182]: INFO cinder.image.image_utils [None req-42a8b29c-57e1-41e8-a267-7e845ee5b7a7 tempest-VolumeImageDependencyTests-1366750687 None] Converted 1024.00 MB image at 1024.00 MB/s Jul 31 12:39:18 devstack cinder-volume[89182]: WARNING cinder.volume.drivers.remotefs [None req-42a8b29c-57e1-41e8-a267-7e845ee5b7a7 tempest-VolumeImageDependencyTests-1366750687 None] /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-bfea7fe4-52be-4067-a42c-56f645b6c545 is being set with open permissions: ugo+rw Jul 31 12:39:18 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-42a8b29c-57e1-41e8-a267-7e845ee5b7a7 tempest-VolumeImageDependencyTests-1366750687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-bfea7fe4-52be-4067-a42c-56f645b6c545 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:39:18 devstack sudo[114446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-bfea7fe4-52be-4067-a42c-56f645b6c545 Jul 31 12:39:18 devstack sudo[114446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:39:18 devstack sudo[114443]: pam_unix(sudo:session): session closed for user root Jul 31 12:39:18 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-e72152a7-40b3-4fe3-8c32-4e1de3230614 tempest-ProjectReaderTests-1403756841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-8f2e83e9-5dfd-4f64-bac6-8888922ee371" returned: 0 in 0.289s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:39:18 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-e72152a7-40b3-4fe3-8c32-4e1de3230614 tempest-ProjectReaderTests-1403756841 None] Lock "cinder-quobyte-8f2e83e9-5dfd-4f64-bac6-8888922ee371" released by "delete_volume" :: held 0.854s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:39:18 devstack cinder-volume[89182]: DEBUG cinder.quota [None req-e72152a7-40b3-4fe3-8c32-4e1de3230614 tempest-ProjectReaderTests-1403756841 None] Created reservations ['a0888c1d-ba74-438d-8938-30a54713d21f', '1451a090-a603-440d-95b6-de11b9a8fc3d', '641afe4c-48c5-4702-a639-21b11f0c8e15', '7179eb07-0903-4b60-966f-44e0e08f314b'] {{(pid=89182) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 12:39:18 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-e72152a7-40b3-4fe3-8c32-4e1de3230614 tempest-ProjectReaderTests-1403756841 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:39:18 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-e72152a7-40b3-4fe3-8c32-4e1de3230614 tempest-ProjectReaderTests-1403756841 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:39:18 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-e72152a7-40b3-4fe3-8c32-4e1de3230614 tempest-ProjectReaderTests-1403756841 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:39:18 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-e72152a7-40b3-4fe3-8c32-4e1de3230614 tempest-ProjectReaderTests-1403756841 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:39:18 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-e72152a7-40b3-4fe3-8c32-4e1de3230614 tempest-ProjectReaderTests-1403756841 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:39:18 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-e72152a7-40b3-4fe3-8c32-4e1de3230614 tempest-ProjectReaderTests-1403756841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:39:18 devstack sudo[114453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 Jul 31 12:39:18 devstack sudo[114453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:39:18 devstack sudo[114446]: pam_unix(sudo:session): session closed for user root Jul 31 12:39:18 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-42a8b29c-57e1-41e8-a267-7e845ee5b7a7 tempest-VolumeImageDependencyTests-1366750687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-bfea7fe4-52be-4067-a42c-56f645b6c545" returned: 0 in 0.349s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:39:18 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-42a8b29c-57e1-41e8-a267-7e845ee5b7a7 tempest-VolumeImageDependencyTests-1366750687 None] Lock "cinder-quobyte-bfea7fe4-52be-4067-a42c-56f645b6c545" released by "_copy_volume_from_snapshot" :: held 2.102s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:39:18 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-42a8b29c-57e1-41e8-a267-7e845ee5b7a7 tempest-VolumeImageDependencyTests-1366750687 None] Lock "cinder-quobyte-3781e7fb-be32-4ee7-87fd-e8a132f3d6ac-bfea7fe4-52be-4067-a42c-56f645b6c545" released by "_create_volume_from_snapshot" :: held 2.210s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:39:18 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-42a8b29c-57e1-41e8-a267-7e845ee5b7a7 tempest-VolumeImageDependencyTests-1366750687 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 2.250s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:39:18 devstack cinder-volume[89182]: DEBUG cinder.volume.volume_utils [None req-42a8b29c-57e1-41e8-a267-7e845ee5b7a7 tempest-VolumeImageDependencyTests-1366750687 None] Marking volume bfea7fe4-52be-4067-a42c-56f645b6c545 as bootable. {{(pid=89182) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 31 12:39:18 devstack cinder-volume[89182]: DEBUG cinder.volume.flows.manager.create_volume [None req-42a8b29c-57e1-41e8-a267-7e845ee5b7a7 tempest-VolumeImageDependencyTests-1366750687 None] Copying metadata from snapshot 3781e7fb-be32-4ee7-87fd-e8a132f3d6ac to bfea7fe4-52be-4067-a42c-56f645b6c545. {{(pid=89182) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:429}} Jul 31 12:39:18 devstack cinder-volume[89182]: INFO cinder.volume.manager [req-b4842736-f54d-4c15-acc8-2ee58530a8e8 req-b23e76bd-476c-4f49-9cc4-81e580c91ac1 tempest-SnapshotDataIntegrityTests-898447071 None] Terminate volume connection completed successfully. Jul 31 12:39:18 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [req-b4842736-f54d-4c15-acc8-2ee58530a8e8 req-b23e76bd-476c-4f49-9cc4-81e580c91ac1 tempest-SnapshotDataIntegrityTests-898447071 None] Deleting attachment 0e9f2d20-ff4e-47f6-a178-b7113e90f33e. {{(pid=89182) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 31 12:39:18 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-42a8b29c-57e1-41e8-a267-7e845ee5b7a7 tempest-VolumeImageDependencyTests-1366750687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dac25444-7997-4d68-9669-0185cd73f985) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bfea7fe4-52be-4067-a42c-56f645b6c545', 'volume_size': 1, 'snapshot_id': '3781e7fb-be32-4ee7-87fd-e8a132f3d6ac'}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:39:18 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-42a8b29c-57e1-41e8-a267-7e845ee5b7a7 tempest-VolumeImageDependencyTests-1366750687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b61bc2a5-a1d2-49a8-82c7-c7d705ddaed6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:39:18 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-42a8b29c-57e1-41e8-a267-7e845ee5b7a7 tempest-VolumeImageDependencyTests-1366750687 None] Volume volume-bfea7fe4-52be-4067-a42c-56f645b6c545 (bfea7fe4-52be-4067-a42c-56f645b6c545): created successfully Jul 31 12:39:18 devstack sudo[114453]: pam_unix(sudo:session): session closed for user root Jul 31 12:39:18 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-42a8b29c-57e1-41e8-a267-7e845ee5b7a7 tempest-VolumeImageDependencyTests-1366750687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b61bc2a5-a1d2-49a8-82c7-c7d705ddaed6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:39:18 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-42a8b29c-57e1-41e8-a267-7e845ee5b7a7 tempest-VolumeImageDependencyTests-1366750687 None] Flow 'volume_create_manager' (709ef2bb-8a07-4329-ab7a-7c33bb7852db) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:39:18 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-e72152a7-40b3-4fe3-8c32-4e1de3230614 tempest-ProjectReaderTests-1403756841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2" returned: 0 in 0.385s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:39:18 devstack cinder-volume[89182]: DEBUG cinder.manager [None req-e72152a7-40b3-4fe3-8c32-4e1de3230614 tempest-ProjectReaderTests-1403756841 None] Notifying Schedulers of capabilities ... {{(pid=89182) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 12:39:18 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-e72152a7-40b3-4fe3-8c32-4e1de3230614 tempest-ProjectReaderTests-1403756841 None] Deleted volume successfully. Jul 31 12:39:18 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-42a8b29c-57e1-41e8-a267-7e845ee5b7a7 tempest-VolumeImageDependencyTests-1366750687 None] Created volume successfully. Jul 31 12:39:18 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-e72152a7-40b3-4fe3-8c32-4e1de3230614 tempest-ProjectReaderTests-1403756841 None] Lock "cinder-8f2e83e9-5dfd-4f64-bac6-8888922ee371-delete_volume" released by "delete_volume" :: held 1.530s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:39:19 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-0382fdea-8d02-4207-8073-d938b101f590 tempest-VolumeImageDependencyTests-1366750687 None] Acquiring lock "cinder-3781e7fb-be32-4ee7-87fd-e8a132f3d6ac-delete_snapshot" by "delete_snapshot" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:39:19 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-0382fdea-8d02-4207-8073-d938b101f590 tempest-VolumeImageDependencyTests-1366750687 None] Lock "cinder-3781e7fb-be32-4ee7-87fd-e8a132f3d6ac-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:39:19 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-0382fdea-8d02-4207-8073-d938b101f590 tempest-VolumeImageDependencyTests-1366750687 None] Acquiring lock "cinder-quobyte-7c968dbb-687c-450d-a061-fe29cb89c249" by "delete_snapshot" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:39:19 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-0382fdea-8d02-4207-8073-d938b101f590 tempest-VolumeImageDependencyTests-1366750687 None] Lock "cinder-quobyte-7c968dbb-687c-450d-a061-fe29cb89c249" acquired by "delete_snapshot" :: waited 0.036s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:39:19 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-0382fdea-8d02-4207-8073-d938b101f590 tempest-VolumeImageDependencyTests-1366750687 None] Acquiring lock "cinder-quobyte-3781e7fb-be32-4ee7-87fd-e8a132f3d6ac" by "_delete_snapshot" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:39:19 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-0382fdea-8d02-4207-8073-d938b101f590 tempest-VolumeImageDependencyTests-1366750687 None] Lock "cinder-quobyte-3781e7fb-be32-4ee7-87fd-e8a132f3d6ac" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:39:19 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-0382fdea-8d02-4207-8073-d938b101f590 tempest-VolumeImageDependencyTests-1366750687 None] Deleting offline snapshot 3781e7fb-be32-4ee7-87fd-e8a132f3d6ac of volume 7c968dbb-687c-450d-a061-fe29cb89c249 {{(pid=89182) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 31 12:39:19 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-0382fdea-8d02-4207-8073-d938b101f590 tempest-VolumeImageDependencyTests-1366750687 None] snapshot_file for this snap is: volume-7c968dbb-687c-450d-a061-fe29cb89c249.3781e7fb-be32-4ee7-87fd-e8a132f3d6ac {{(pid=89182) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 31 12:39:19 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed4c167d-c23e-43fa-939c-3db205531f80]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:39:19 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-0382fdea-8d02-4207-8073-d938b101f590 tempest-VolumeImageDependencyTests-1366750687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-7c968dbb-687c-450d-a061-fe29cb89c249.3781e7fb-be32-4ee7-87fd-e8a132f3d6ac {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:39:19 devstack sudo[114483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-7c968dbb-687c-450d-a061-fe29cb89c249.3781e7fb-be32-4ee7-87fd-e8a132f3d6ac Jul 31 12:39:19 devstack sudo[114483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:39:19 devstack sudo[114483]: pam_unix(sudo:session): session closed for user root Jul 31 12:39:19 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-0382fdea-8d02-4207-8073-d938b101f590 tempest-VolumeImageDependencyTests-1366750687 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-7c968dbb-687c-450d-a061-fe29cb89c249.3781e7fb-be32-4ee7-87fd-e8a132f3d6ac" returned: 0 in 0.525s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:39:19 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-0382fdea-8d02-4207-8073-d938b101f590 tempest-VolumeImageDependencyTests-1366750687 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7c968dbb-687c-450d-a061-fe29cb89c249(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89182) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 12:39:19 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4dfeecd-22d6-431d-8b07-39a21043c819]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:39:19 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-0382fdea-8d02-4207-8073-d938b101f590 tempest-VolumeImageDependencyTests-1366750687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-7c968dbb-687c-450d-a061-fe29cb89c249 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:39:19 devstack cinder-volume[89182]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a8f1913-29f3-41e3-8a06-1f99f040955f tempest-SnapshotDataIntegrityTests-898447071 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89182) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 12:39:20 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-3a8f1913-29f3-41e3-8a06-1f99f040955f tempest-SnapshotDataIntegrityTests-898447071 None] Flow 'volume_create_manager' (396a990f-89be-4724-a4bb-b3ddb9cc0b7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:39:20 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-3a8f1913-29f3-41e3-8a06-1f99f040955f tempest-SnapshotDataIntegrityTests-898447071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d2074d7-b0df-464f-a7b6-d79785bd6780) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:39:20 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-3a8f1913-29f3-41e3-8a06-1f99f040955f tempest-SnapshotDataIntegrityTests-898447071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d2074d7-b0df-464f-a7b6-d79785bd6780) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:39:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDataIntegrityTests-volume-1724589931',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=490ce77d-87a2-440b-a48f-e2d30d1405da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e47adc7d32b64078850d9d94d5cb10bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:39:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=629af985-2bb6-4b68-b00b-b49a9e715090,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:39:20Z,use_quota=True,user_id='6344cc57ebdb4e02aae72e7a719cd916',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:39:20 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-3a8f1913-29f3-41e3-8a06-1f99f040955f tempest-SnapshotDataIntegrityTests-898447071 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28482e9c-1441-47af-bd85-1f44de071abd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:39:20 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-3a8f1913-29f3-41e3-8a06-1f99f040955f tempest-SnapshotDataIntegrityTests-898447071 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28482e9c-1441-47af-bd85-1f44de071abd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:39:20 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-3a8f1913-29f3-41e3-8a06-1f99f040955f tempest-SnapshotDataIntegrityTests-898447071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67f87004-9a8c-469e-b100-3a4b87e83c90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:39:20 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-3a8f1913-29f3-41e3-8a06-1f99f040955f tempest-SnapshotDataIntegrityTests-898447071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67f87004-9a8c-469e-b100-3a4b87e83c90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '490ce77d-87a2-440b-a48f-e2d30d1405da', 'volume_name': 'volume-490ce77d-87a2-440b-a48f-e2d30d1405da', 'volume_size': 1, 'snapshot_id': '629af985-2bb6-4b68-b00b-b49a9e715090'}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:39:20 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-3a8f1913-29f3-41e3-8a06-1f99f040955f tempest-SnapshotDataIntegrityTests-898447071 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51ef79b9-73f7-4415-8caf-848456e9aa10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:39:20 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-3a8f1913-29f3-41e3-8a06-1f99f040955f tempest-SnapshotDataIntegrityTests-898447071 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51ef79b9-73f7-4415-8caf-848456e9aa10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:39:20 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-3a8f1913-29f3-41e3-8a06-1f99f040955f tempest-SnapshotDataIntegrityTests-898447071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d6f838c-ca61-4051-9d40-0f5436484d0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:39:20 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-3a8f1913-29f3-41e3-8a06-1f99f040955f tempest-SnapshotDataIntegrityTests-898447071 None] Volume 490ce77d-87a2-440b-a48f-e2d30d1405da: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-490ce77d-87a2-440b-a48f-e2d30d1405da', 'volume_size': 1, 'snapshot_id': '629af985-2bb6-4b68-b00b-b49a9e715090'} Jul 31 12:39:20 devstack sudo[114488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-7c968dbb-687c-450d-a061-fe29cb89c249 Jul 31 12:39:20 devstack sudo[114488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:39:20 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-3a8f1913-29f3-41e3-8a06-1f99f040955f tempest-SnapshotDataIntegrityTests-898447071 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:39:20 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-3a8f1913-29f3-41e3-8a06-1f99f040955f tempest-SnapshotDataIntegrityTests-898447071 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:39:20 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-3a8f1913-29f3-41e3-8a06-1f99f040955f tempest-SnapshotDataIntegrityTests-898447071 None] Acquiring lock "cinder-quobyte-629af985-2bb6-4b68-b00b-b49a9e715090-490ce77d-87a2-440b-a48f-e2d30d1405da" by "_create_volume_from_snapshot" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:39:20 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-3a8f1913-29f3-41e3-8a06-1f99f040955f tempest-SnapshotDataIntegrityTests-898447071 None] Lock "cinder-quobyte-629af985-2bb6-4b68-b00b-b49a9e715090-490ce77d-87a2-440b-a48f-e2d30d1405da" acquired by "_create_volume_from_snapshot" :: waited 0.022s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:39:20 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-3a8f1913-29f3-41e3-8a06-1f99f040955f tempest-SnapshotDataIntegrityTests-898447071 None] Creating volume 490ce77d-87a2-440b-a48f-e2d30d1405da from snapshot 629af985-2bb6-4b68-b00b-b49a9e715090 {{(pid=89182) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 31 12:39:20 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-3a8f1913-29f3-41e3-8a06-1f99f040955f tempest-SnapshotDataIntegrityTests-898447071 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:39:20 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-3a8f1913-29f3-41e3-8a06-1f99f040955f tempest-SnapshotDataIntegrityTests-898447071 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:39:20 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-3a8f1913-29f3-41e3-8a06-1f99f040955f tempest-SnapshotDataIntegrityTests-898447071 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:39:20 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-3a8f1913-29f3-41e3-8a06-1f99f040955f tempest-SnapshotDataIntegrityTests-898447071 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:39:20 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-3a8f1913-29f3-41e3-8a06-1f99f040955f tempest-SnapshotDataIntegrityTests-898447071 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:39:20 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-3a8f1913-29f3-41e3-8a06-1f99f040955f tempest-SnapshotDataIntegrityTests-898447071 None] Selected osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 as target Quobyte volume. {{(pid=89182) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 12:39:20 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-3a8f1913-29f3-41e3-8a06-1f99f040955f tempest-SnapshotDataIntegrityTests-898447071 None] Acquiring lock "cinder-quobyte-490ce77d-87a2-440b-a48f-e2d30d1405da" by "_copy_volume_from_snapshot" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:39:20 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-3a8f1913-29f3-41e3-8a06-1f99f040955f tempest-SnapshotDataIntegrityTests-898447071 None] Lock "cinder-quobyte-490ce77d-87a2-440b-a48f-e2d30d1405da" acquired by "_copy_volume_from_snapshot" :: waited 0.025s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:39:20 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-3a8f1913-29f3-41e3-8a06-1f99f040955f tempest-SnapshotDataIntegrityTests-898447071 None] snapshot: 629af985-2bb6-4b68-b00b-b49a9e715090, volume: 490ce77d-87a2-440b-a48f-e2d30d1405da, {{(pid=89182) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Jul 31 12:39:20 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-3a8f1913-29f3-41e3-8a06-1f99f040955f tempest-SnapshotDataIntegrityTests-898447071 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:39:20 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-3a8f1913-29f3-41e3-8a06-1f99f040955f tempest-SnapshotDataIntegrityTests-898447071 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:39:20 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-3a8f1913-29f3-41e3-8a06-1f99f040955f tempest-SnapshotDataIntegrityTests-898447071 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:39:20 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-3a8f1913-29f3-41e3-8a06-1f99f040955f tempest-SnapshotDataIntegrityTests-898447071 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:39:20 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-3a8f1913-29f3-41e3-8a06-1f99f040955f tempest-SnapshotDataIntegrityTests-898447071 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:39:20 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[1433dda3-14ff-4e23-a605-ea3166552a11]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:39:20 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-3a8f1913-29f3-41e3-8a06-1f99f040955f tempest-SnapshotDataIntegrityTests-898447071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e6acfb11-941d-450b-8d93-0e32240df94a.629af985-2bb6-4b68-b00b-b49a9e715090 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:39:20 devstack sudo[114490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e6acfb11-941d-450b-8d93-0e32240df94a.629af985-2bb6-4b68-b00b-b49a9e715090 Jul 31 12:39:20 devstack sudo[114490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:39:20 devstack sudo[114488]: pam_unix(sudo:session): session closed for user root Jul 31 12:39:20 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-0382fdea-8d02-4207-8073-d938b101f590 tempest-VolumeImageDependencyTests-1366750687 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-7c968dbb-687c-450d-a061-fe29cb89c249" returned: 0 in 0.508s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:39:20 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-0382fdea-8d02-4207-8073-d938b101f590 tempest-VolumeImageDependencyTests-1366750687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-7c968dbb-687c-450d-a061-fe29cb89c249.3781e7fb-be32-4ee7-87fd-e8a132f3d6ac {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:39:20 devstack sudo[114496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-7c968dbb-687c-450d-a061-fe29cb89c249.3781e7fb-be32-4ee7-87fd-e8a132f3d6ac Jul 31 12:39:20 devstack sudo[114496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:39:20 devstack sudo[114490]: pam_unix(sudo:session): session closed for user root Jul 31 12:39:20 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-3a8f1913-29f3-41e3-8a06-1f99f040955f tempest-SnapshotDataIntegrityTests-898447071 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e6acfb11-941d-450b-8d93-0e32240df94a.629af985-2bb6-4b68-b00b-b49a9e715090" returned: 0 in 0.466s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:39:20 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-3a8f1913-29f3-41e3-8a06-1f99f040955f tempest-SnapshotDataIntegrityTests-898447071 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e6acfb11-941d-450b-8d93-0e32240df94a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89182) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 12:39:20 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a76450e-38ee-49f1-9844-ef6df82c6c46]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:39:20 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-3a8f1913-29f3-41e3-8a06-1f99f040955f tempest-SnapshotDataIntegrityTests-898447071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e6acfb11-941d-450b-8d93-0e32240df94a.4a5c6e12-2302-44db-ab0e-eedae12ca53f {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:39:20 devstack sudo[114504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e6acfb11-941d-450b-8d93-0e32240df94a.4a5c6e12-2302-44db-ab0e-eedae12ca53f Jul 31 12:39:20 devstack sudo[114504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:39:20 devstack sudo[114496]: pam_unix(sudo:session): session closed for user root Jul 31 12:39:20 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-0382fdea-8d02-4207-8073-d938b101f590 tempest-VolumeImageDependencyTests-1366750687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-7c968dbb-687c-450d-a061-fe29cb89c249.3781e7fb-be32-4ee7-87fd-e8a132f3d6ac" returned: 0 in 0.530s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:39:20 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-0382fdea-8d02-4207-8073-d938b101f590 tempest-VolumeImageDependencyTests-1366750687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-7c968dbb-687c-450d-a061-fe29cb89c249.3781e7fb-be32-4ee7-87fd-e8a132f3d6ac {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:39:20 devstack cinder-volume[89182]: DEBUG dbcounter [-] [89182] Writing DB stats cinder:SELECT=112,cinder:UPDATE=99,cinder:DELETE=7,cinder:INSERT=37 {{(pid=89182) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 12:39:21 devstack sudo[114507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-7c968dbb-687c-450d-a061-fe29cb89c249.3781e7fb-be32-4ee7-87fd-e8a132f3d6ac Jul 31 12:39:21 devstack sudo[114507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:39:21 devstack cinder-volume[89182]: DEBUG cinder.volume.flows.manager.create_volume [None req-85be0cec-2b2c-46ae-a169-464d7a7b06a6 tempest-ProjectMemberTests-969865867 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89182) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 12:39:21 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-85be0cec-2b2c-46ae-a169-464d7a7b06a6 tempest-ProjectMemberTests-969865867 None] Flow 'volume_create_manager' (9d85bd7a-3521-4073-aed4-a6d3eb31abde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:39:21 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-85be0cec-2b2c-46ae-a169-464d7a7b06a6 tempest-ProjectMemberTests-969865867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (233b1f8b-5551-4473-8318-077c6dcee7c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:39:21 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-85be0cec-2b2c-46ae-a169-464d7a7b06a6 tempest-ProjectMemberTests-969865867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (233b1f8b-5551-4473-8318-077c6dcee7c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:39:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-198890315',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0fda83b4-57fa-4e15-9733-283aee0f62a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7618b523b3644b0aff23a331c24c373',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:39:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:39:21Z,use_quota=True,user_id='ef87d129d713438b8a1c61430735d914',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:39:21 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-85be0cec-2b2c-46ae-a169-464d7a7b06a6 tempest-ProjectMemberTests-969865867 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2919c71b-40cb-41d4-8a76-1c145e76ae88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:39:21 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-85be0cec-2b2c-46ae-a169-464d7a7b06a6 tempest-ProjectMemberTests-969865867 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2919c71b-40cb-41d4-8a76-1c145e76ae88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:39:21 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-85be0cec-2b2c-46ae-a169-464d7a7b06a6 tempest-ProjectMemberTests-969865867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aab7ca65-7740-44b9-817c-d821044cf862) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:39:21 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-85be0cec-2b2c-46ae-a169-464d7a7b06a6 tempest-ProjectMemberTests-969865867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aab7ca65-7740-44b9-817c-d821044cf862) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0fda83b4-57fa-4e15-9733-283aee0f62a8', 'volume_name': 'volume-0fda83b4-57fa-4e15-9733-283aee0f62a8', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:39:21 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-85be0cec-2b2c-46ae-a169-464d7a7b06a6 tempest-ProjectMemberTests-969865867 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a82970cc-38eb-411a-b69d-1a35959c06a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:39:21 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-85be0cec-2b2c-46ae-a169-464d7a7b06a6 tempest-ProjectMemberTests-969865867 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a82970cc-38eb-411a-b69d-1a35959c06a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:39:21 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-85be0cec-2b2c-46ae-a169-464d7a7b06a6 tempest-ProjectMemberTests-969865867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84c34402-b7c0-44cc-b62e-a709c9402f5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:39:21 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-85be0cec-2b2c-46ae-a169-464d7a7b06a6 tempest-ProjectMemberTests-969865867 None] Volume 0fda83b4-57fa-4e15-9733-283aee0f62a8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0fda83b4-57fa-4e15-9733-283aee0f62a8', 'volume_size': 1} Jul 31 12:39:21 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-85be0cec-2b2c-46ae-a169-464d7a7b06a6 tempest-ProjectMemberTests-969865867 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:39:21 devstack sudo[114504]: pam_unix(sudo:session): session closed for user root Jul 31 12:39:21 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-3a8f1913-29f3-41e3-8a06-1f99f040955f tempest-SnapshotDataIntegrityTests-898447071 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e6acfb11-941d-450b-8d93-0e32240df94a.4a5c6e12-2302-44db-ab0e-eedae12ca53f" returned: 0 in 0.485s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:39:21 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-3a8f1913-29f3-41e3-8a06-1f99f040955f tempest-SnapshotDataIntegrityTests-898447071 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e6acfb11-941d-450b-8d93-0e32240df94a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89182) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 12:39:21 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-3a8f1913-29f3-41e3-8a06-1f99f040955f tempest-SnapshotDataIntegrityTests-898447071 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e6acfb11-941d-450b-8d93-0e32240df94a.4a5c6e12-2302-44db-ab0e-eedae12ca53f {{(pid=89182) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Jul 31 12:39:21 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-3a8f1913-29f3-41e3-8a06-1f99f040955f tempest-SnapshotDataIntegrityTests-898447071 None] Creating direct copy from snapshot {{(pid=89182) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Jul 31 12:39:21 devstack cinder-volume[89182]: DEBUG cinder.utils [None req-3a8f1913-29f3-41e3-8a06-1f99f040955f tempest-SnapshotDataIntegrityTests-898447071 None] Path /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-490ce77d-87a2-440b-a48f-e2d30d1405da not found in is_blk_device check {{(pid=89182) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 31 12:39:21 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-3a8f1913-29f3-41e3-8a06-1f99f040955f tempest-SnapshotDataIntegrityTests-898447071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e6acfb11-941d-450b-8d93-0e32240df94a.4a5c6e12-2302-44db-ab0e-eedae12ca53f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-490ce77d-87a2-440b-a48f-e2d30d1405da {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:39:21 devstack sudo[114512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e6acfb11-941d-450b-8d93-0e32240df94a.4a5c6e12-2302-44db-ab0e-eedae12ca53f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-490ce77d-87a2-440b-a48f-e2d30d1405da Jul 31 12:39:21 devstack sudo[114512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:39:21 devstack sudo[114507]: pam_unix(sudo:session): session closed for user root Jul 31 12:39:21 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-0382fdea-8d02-4207-8073-d938b101f590 tempest-VolumeImageDependencyTests-1366750687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-7c968dbb-687c-450d-a061-fe29cb89c249.3781e7fb-be32-4ee7-87fd-e8a132f3d6ac" returned: 0 in 0.318s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:39:21 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-0382fdea-8d02-4207-8073-d938b101f590 tempest-VolumeImageDependencyTests-1366750687 None] Lock "cinder-quobyte-3781e7fb-be32-4ee7-87fd-e8a132f3d6ac" released by "_delete_snapshot" :: held 2.019s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:39:21 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-0382fdea-8d02-4207-8073-d938b101f590 tempest-VolumeImageDependencyTests-1366750687 None] Lock "cinder-quobyte-7c968dbb-687c-450d-a061-fe29cb89c249" released by "delete_snapshot" :: held 2.045s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:39:21 devstack cinder-volume[89182]: DEBUG dbcounter [-] [89182] Writing DB stats cinder:SELECT=99,cinder:UPDATE=99,cinder:INSERT=44,cinder:DELETE=13 {{(pid=89182) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 12:39:21 devstack cinder-volume[89182]: DEBUG cinder.quota [None req-0382fdea-8d02-4207-8073-d938b101f590 tempest-VolumeImageDependencyTests-1366750687 None] Created reservations ['00adb2ef-63a9-46bc-9982-91cf6c2676e2', 'a56c0b4e-b12e-4d88-b890-953261a91cd6', '3e56da88-551e-4561-a54e-ede94a1dfe15', '14a4f83d-f148-424b-8ab6-2c0a825a7b8f'] {{(pid=89182) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 12:39:21 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-0382fdea-8d02-4207-8073-d938b101f590 tempest-VolumeImageDependencyTests-1366750687 None] Delete snapshot completed successfully. Jul 31 12:39:21 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-0382fdea-8d02-4207-8073-d938b101f590 tempest-VolumeImageDependencyTests-1366750687 None] Lock "cinder-3781e7fb-be32-4ee7-87fd-e8a132f3d6ac-delete_snapshot" released by "delete_snapshot" :: held 2.234s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:39:21 devstack cinder-volume[89182]: DEBUG oslo_service.periodic_task [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89182) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 31 12:39:21 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:39:21 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:39:21 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:39:21 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:39:21 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:39:21 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:39:22 devstack sudo[114526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 Jul 31 12:39:22 devstack sudo[114526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:39:22 devstack sudo[114526]: pam_unix(sudo:session): session closed for user root Jul 31 12:39:22 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2" returned: 0 in 0.485s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:39:22 devstack cinder-volume[89182]: DEBUG cinder.manager [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] Notifying Schedulers of capabilities ... {{(pid=89182) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 12:39:22 devstack cinder-volume[89182]: DEBUG oslo_service.periodic_task [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] Running periodic task VolumeManager._thread_info {{(pid=89182) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 31 12:39:22 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] thread count: 28 {{(pid=89182) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 31 12:39:22 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] thread info: [<_MainThread(MainThread, started 136154603720832)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=89182) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 31 12:39:22 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-643c470e-70a5-491b-b8a5-5e85154adbeb tempest-VolumeImageDependencyTests-1366750687 None] Acquiring lock "cinder-bfea7fe4-52be-4067-a42c-56f645b6c545-delete_volume" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:39:22 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-643c470e-70a5-491b-b8a5-5e85154adbeb tempest-VolumeImageDependencyTests-1366750687 None] Lock "cinder-bfea7fe4-52be-4067-a42c-56f645b6c545-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:39:22 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-643c470e-70a5-491b-b8a5-5e85154adbeb tempest-VolumeImageDependencyTests-1366750687 None] Acquiring lock "cinder-quobyte-bfea7fe4-52be-4067-a42c-56f645b6c545" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:39:22 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-643c470e-70a5-491b-b8a5-5e85154adbeb tempest-VolumeImageDependencyTests-1366750687 None] Lock "cinder-quobyte-bfea7fe4-52be-4067-a42c-56f645b6c545" acquired by "delete_volume" :: waited 0.031s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:39:22 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[07a9aaec-ca61-488a-bf84-b61aefdbb9bd]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:39:22 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-643c470e-70a5-491b-b8a5-5e85154adbeb tempest-VolumeImageDependencyTests-1366750687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-bfea7fe4-52be-4067-a42c-56f645b6c545 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:39:23 devstack sudo[114529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-bfea7fe4-52be-4067-a42c-56f645b6c545 Jul 31 12:39:23 devstack sudo[114529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:39:23 devstack sudo[114529]: pam_unix(sudo:session): session closed for user root Jul 31 12:39:23 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-643c470e-70a5-491b-b8a5-5e85154adbeb tempest-VolumeImageDependencyTests-1366750687 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-bfea7fe4-52be-4067-a42c-56f645b6c545" returned: 0 in 1.025s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:39:23 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-643c470e-70a5-491b-b8a5-5e85154adbeb tempest-VolumeImageDependencyTests-1366750687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-bfea7fe4-52be-4067-a42c-56f645b6c545 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:39:24 devstack sudo[114534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-bfea7fe4-52be-4067-a42c-56f645b6c545 Jul 31 12:39:24 devstack sudo[114534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:39:24 devstack sudo[114534]: pam_unix(sudo:session): session closed for user root Jul 31 12:39:24 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-643c470e-70a5-491b-b8a5-5e85154adbeb tempest-VolumeImageDependencyTests-1366750687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-bfea7fe4-52be-4067-a42c-56f645b6c545" returned: 0 in 0.693s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:39:24 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-643c470e-70a5-491b-b8a5-5e85154adbeb tempest-VolumeImageDependencyTests-1366750687 None] Lock "cinder-quobyte-bfea7fe4-52be-4067-a42c-56f645b6c545" released by "delete_volume" :: held 1.836s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:39:24 devstack cinder-volume[89182]: DEBUG cinder.quota [None req-643c470e-70a5-491b-b8a5-5e85154adbeb tempest-VolumeImageDependencyTests-1366750687 None] Created reservations ['fb752463-4417-45a9-96d5-a5071ec9a79b', '20f38d5d-ed19-4027-a7ee-83578e588815', 'a9a162b3-6283-460d-ac03-c14a1f5b03c6', '68536216-f2b8-42d0-89da-234ba9acfca6'] {{(pid=89182) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 12:39:25 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-643c470e-70a5-491b-b8a5-5e85154adbeb tempest-VolumeImageDependencyTests-1366750687 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:39:25 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-643c470e-70a5-491b-b8a5-5e85154adbeb tempest-VolumeImageDependencyTests-1366750687 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:39:25 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-643c470e-70a5-491b-b8a5-5e85154adbeb tempest-VolumeImageDependencyTests-1366750687 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:39:25 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-643c470e-70a5-491b-b8a5-5e85154adbeb tempest-VolumeImageDependencyTests-1366750687 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:39:25 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-643c470e-70a5-491b-b8a5-5e85154adbeb tempest-VolumeImageDependencyTests-1366750687 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:39:25 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-643c470e-70a5-491b-b8a5-5e85154adbeb tempest-VolumeImageDependencyTests-1366750687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:39:25 devstack sudo[114537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 Jul 31 12:39:25 devstack sudo[114537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:39:25 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-e8a9d891-38e5-419d-bf8f-6f51fcc94028 tempest-VolumeImageDependencyTests-1366750687 None] Acquiring lock "cinder-7c968dbb-687c-450d-a061-fe29cb89c249-delete_volume" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:39:25 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-e8a9d891-38e5-419d-bf8f-6f51fcc94028 tempest-VolumeImageDependencyTests-1366750687 None] Lock "cinder-7c968dbb-687c-450d-a061-fe29cb89c249-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:39:25 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-e8a9d891-38e5-419d-bf8f-6f51fcc94028 tempest-VolumeImageDependencyTests-1366750687 None] Acquiring lock "cinder-quobyte-7c968dbb-687c-450d-a061-fe29cb89c249" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:39:25 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-e8a9d891-38e5-419d-bf8f-6f51fcc94028 tempest-VolumeImageDependencyTests-1366750687 None] Lock "cinder-quobyte-7c968dbb-687c-450d-a061-fe29cb89c249" acquired by "delete_volume" :: waited 0.060s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:39:26 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[31488504-b936-4b74-9927-3d7a52183447]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:39:26 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-e8a9d891-38e5-419d-bf8f-6f51fcc94028 tempest-VolumeImageDependencyTests-1366750687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-7c968dbb-687c-450d-a061-fe29cb89c249 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:39:26 devstack sudo[114537]: pam_unix(sudo:session): session closed for user root Jul 31 12:39:26 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-643c470e-70a5-491b-b8a5-5e85154adbeb tempest-VolumeImageDependencyTests-1366750687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2" returned: 0 in 0.955s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:39:26 devstack cinder-volume[89182]: DEBUG cinder.manager [None req-643c470e-70a5-491b-b8a5-5e85154adbeb tempest-VolumeImageDependencyTests-1366750687 None] Notifying Schedulers of capabilities ... {{(pid=89182) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 12:39:26 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-643c470e-70a5-491b-b8a5-5e85154adbeb tempest-VolumeImageDependencyTests-1366750687 None] Deleted volume successfully. Jul 31 12:39:26 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-643c470e-70a5-491b-b8a5-5e85154adbeb tempest-VolumeImageDependencyTests-1366750687 None] Lock "cinder-bfea7fe4-52be-4067-a42c-56f645b6c545-delete_volume" released by "delete_volume" :: held 3.392s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:39:26 devstack sudo[114540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-7c968dbb-687c-450d-a061-fe29cb89c249 Jul 31 12:39:26 devstack sudo[114540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:39:27 devstack sudo[114540]: pam_unix(sudo:session): session closed for user root Jul 31 12:39:27 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-e8a9d891-38e5-419d-bf8f-6f51fcc94028 tempest-VolumeImageDependencyTests-1366750687 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-7c968dbb-687c-450d-a061-fe29cb89c249" returned: 0 in 1.035s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:39:27 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-e8a9d891-38e5-419d-bf8f-6f51fcc94028 tempest-VolumeImageDependencyTests-1366750687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-7c968dbb-687c-450d-a061-fe29cb89c249 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:39:27 devstack sudo[114545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-7c968dbb-687c-450d-a061-fe29cb89c249 Jul 31 12:39:27 devstack sudo[114545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:39:27 devstack sudo[114512]: pam_unix(sudo:session): session closed for user root Jul 31 12:39:27 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-3a8f1913-29f3-41e3-8a06-1f99f040955f tempest-SnapshotDataIntegrityTests-898447071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e6acfb11-941d-450b-8d93-0e32240df94a.4a5c6e12-2302-44db-ab0e-eedae12ca53f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-490ce77d-87a2-440b-a48f-e2d30d1405da" returned: 0 in 6.136s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:39:27 devstack cinder-volume[89182]: DEBUG cinder.image.image_utils [None req-3a8f1913-29f3-41e3-8a06-1f99f040955f tempest-SnapshotDataIntegrityTests-898447071 None] Image conversion details: src /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e6acfb11-941d-450b-8d93-0e32240df94a.4a5c6e12-2302-44db-ab0e-eedae12ca53f, size 1024.00 MB, duration 6.14 sec, destination /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-490ce77d-87a2-440b-a48f-e2d30d1405da {{(pid=89182) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 31 12:39:27 devstack cinder-volume[89182]: INFO cinder.image.image_utils [None req-3a8f1913-29f3-41e3-8a06-1f99f040955f tempest-SnapshotDataIntegrityTests-898447071 None] Converted 1024.00 MB image at 166.85 MB/s Jul 31 12:39:27 devstack cinder-volume[89182]: WARNING cinder.volume.drivers.remotefs [None req-3a8f1913-29f3-41e3-8a06-1f99f040955f tempest-SnapshotDataIntegrityTests-898447071 None] /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-490ce77d-87a2-440b-a48f-e2d30d1405da is being set with open permissions: ugo+rw Jul 31 12:39:27 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-3a8f1913-29f3-41e3-8a06-1f99f040955f tempest-SnapshotDataIntegrityTests-898447071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-490ce77d-87a2-440b-a48f-e2d30d1405da {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:39:27 devstack sudo[114549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-490ce77d-87a2-440b-a48f-e2d30d1405da Jul 31 12:39:27 devstack sudo[114549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:39:27 devstack sudo[114545]: pam_unix(sudo:session): session closed for user root Jul 31 12:39:27 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-e8a9d891-38e5-419d-bf8f-6f51fcc94028 tempest-VolumeImageDependencyTests-1366750687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-7c968dbb-687c-450d-a061-fe29cb89c249" returned: 0 in 0.344s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:39:27 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-e8a9d891-38e5-419d-bf8f-6f51fcc94028 tempest-VolumeImageDependencyTests-1366750687 None] Lock "cinder-quobyte-7c968dbb-687c-450d-a061-fe29cb89c249" released by "delete_volume" :: held 1.532s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:39:27 devstack cinder-volume[89182]: DEBUG cinder.quota [None req-e8a9d891-38e5-419d-bf8f-6f51fcc94028 tempest-VolumeImageDependencyTests-1366750687 None] Created reservations ['8954ae54-659e-4297-b6cc-a18eeb6037ab', '06186203-4553-4850-83b5-a689947916b3', 'ef88962a-b56c-46af-b2bb-9d0b08bed951', '3e67fb20-9b70-48fc-bb95-4a432bf85ebd'] {{(pid=89182) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 12:39:27 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-e8a9d891-38e5-419d-bf8f-6f51fcc94028 tempest-VolumeImageDependencyTests-1366750687 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:39:27 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-e8a9d891-38e5-419d-bf8f-6f51fcc94028 tempest-VolumeImageDependencyTests-1366750687 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:39:27 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-e8a9d891-38e5-419d-bf8f-6f51fcc94028 tempest-VolumeImageDependencyTests-1366750687 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:39:27 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-e8a9d891-38e5-419d-bf8f-6f51fcc94028 tempest-VolumeImageDependencyTests-1366750687 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:39:27 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-e8a9d891-38e5-419d-bf8f-6f51fcc94028 tempest-VolumeImageDependencyTests-1366750687 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:39:27 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-e8a9d891-38e5-419d-bf8f-6f51fcc94028 tempest-VolumeImageDependencyTests-1366750687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:39:27 devstack sudo[114551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 Jul 31 12:39:27 devstack sudo[114551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:39:27 devstack sudo[114549]: pam_unix(sudo:session): session closed for user root Jul 31 12:39:27 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-3a8f1913-29f3-41e3-8a06-1f99f040955f tempest-SnapshotDataIntegrityTests-898447071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-490ce77d-87a2-440b-a48f-e2d30d1405da" returned: 0 in 0.265s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:39:27 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-3a8f1913-29f3-41e3-8a06-1f99f040955f tempest-SnapshotDataIntegrityTests-898447071 None] Lock "cinder-quobyte-490ce77d-87a2-440b-a48f-e2d30d1405da" released by "_copy_volume_from_snapshot" :: held 7.459s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:39:27 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-3a8f1913-29f3-41e3-8a06-1f99f040955f tempest-SnapshotDataIntegrityTests-898447071 None] Lock "cinder-quobyte-629af985-2bb6-4b68-b00b-b49a9e715090-490ce77d-87a2-440b-a48f-e2d30d1405da" released by "_create_volume_from_snapshot" :: held 7.541s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:39:27 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-3a8f1913-29f3-41e3-8a06-1f99f040955f tempest-SnapshotDataIntegrityTests-898447071 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.564s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:39:27 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-85be0cec-2b2c-46ae-a169-464d7a7b06a6 tempest-ProjectMemberTests-969865867 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.568s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:39:27 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-85be0cec-2b2c-46ae-a169-464d7a7b06a6 tempest-ProjectMemberTests-969865867 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:39:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-198890315',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0fda83b4-57fa-4e15-9733-283aee0f62a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7618b523b3644b0aff23a331c24c373',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:39:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:39:21Z,use_quota=True,user_id='ef87d129d713438b8a1c61430735d914',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)}" {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 12:39:27 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-85be0cec-2b2c-46ae-a169-464d7a7b06a6 tempest-ProjectMemberTests-969865867 None] Creating volume 0fda83b4-57fa-4e15-9733-283aee0f62a8 {{(pid=89182) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 12:39:27 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-85be0cec-2b2c-46ae-a169-464d7a7b06a6 tempest-ProjectMemberTests-969865867 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:39:27 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-85be0cec-2b2c-46ae-a169-464d7a7b06a6 tempest-ProjectMemberTests-969865867 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:39:27 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-85be0cec-2b2c-46ae-a169-464d7a7b06a6 tempest-ProjectMemberTests-969865867 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:39:27 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-85be0cec-2b2c-46ae-a169-464d7a7b06a6 tempest-ProjectMemberTests-969865867 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:39:27 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-85be0cec-2b2c-46ae-a169-464d7a7b06a6 tempest-ProjectMemberTests-969865867 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:39:27 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-85be0cec-2b2c-46ae-a169-464d7a7b06a6 tempest-ProjectMemberTests-969865867 None] Selected osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 as target Quobyte volume. {{(pid=89182) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 12:39:27 devstack cinder-volume[89182]: INFO cinder.volume.drivers.remotefs [None req-85be0cec-2b2c-46ae-a169-464d7a7b06a6 tempest-ProjectMemberTests-969865867 None] casted to osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 Jul 31 12:39:27 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-85be0cec-2b2c-46ae-a169-464d7a7b06a6 tempest-ProjectMemberTests-969865867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0fda83b4-57fa-4e15-9733-283aee0f62a8 1073741824 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:39:27 devstack sudo[114554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0fda83b4-57fa-4e15-9733-283aee0f62a8 1073741824 Jul 31 12:39:27 devstack sudo[114554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:39:27 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-3a8f1913-29f3-41e3-8a06-1f99f040955f tempest-SnapshotDataIntegrityTests-898447071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d6f838c-ca61-4051-9d40-0f5436484d0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-490ce77d-87a2-440b-a48f-e2d30d1405da', 'volume_size': 1, 'snapshot_id': '629af985-2bb6-4b68-b00b-b49a9e715090'}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:39:27 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-3a8f1913-29f3-41e3-8a06-1f99f040955f tempest-SnapshotDataIntegrityTests-898447071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bcd8ebad-172d-4e0c-91e0-6b7f9f7d1f21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:39:27 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-3a8f1913-29f3-41e3-8a06-1f99f040955f tempest-SnapshotDataIntegrityTests-898447071 None] Volume volume-490ce77d-87a2-440b-a48f-e2d30d1405da (490ce77d-87a2-440b-a48f-e2d30d1405da): created successfully Jul 31 12:39:27 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-3a8f1913-29f3-41e3-8a06-1f99f040955f tempest-SnapshotDataIntegrityTests-898447071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bcd8ebad-172d-4e0c-91e0-6b7f9f7d1f21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:39:27 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-3a8f1913-29f3-41e3-8a06-1f99f040955f tempest-SnapshotDataIntegrityTests-898447071 None] Flow 'volume_create_manager' (396a990f-89be-4724-a4bb-b3ddb9cc0b7a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:39:27 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-3a8f1913-29f3-41e3-8a06-1f99f040955f tempest-SnapshotDataIntegrityTests-898447071 None] Created volume successfully. Jul 31 12:39:27 devstack sudo[114551]: pam_unix(sudo:session): session closed for user root Jul 31 12:39:27 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-e8a9d891-38e5-419d-bf8f-6f51fcc94028 tempest-VolumeImageDependencyTests-1366750687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2" returned: 0 in 0.317s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:39:27 devstack cinder-volume[89182]: DEBUG cinder.manager [None req-e8a9d891-38e5-419d-bf8f-6f51fcc94028 tempest-VolumeImageDependencyTests-1366750687 None] Notifying Schedulers of capabilities ... {{(pid=89182) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 12:39:27 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-e8a9d891-38e5-419d-bf8f-6f51fcc94028 tempest-VolumeImageDependencyTests-1366750687 None] Deleted volume successfully. Jul 31 12:39:27 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-e8a9d891-38e5-419d-bf8f-6f51fcc94028 tempest-VolumeImageDependencyTests-1366750687 None] Lock "cinder-7c968dbb-687c-450d-a061-fe29cb89c249-delete_volume" released by "delete_volume" :: held 2.200s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:39:28 devstack sudo[114554]: pam_unix(sudo:session): session closed for user root Jul 31 12:39:28 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-85be0cec-2b2c-46ae-a169-464d7a7b06a6 tempest-ProjectMemberTests-969865867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0fda83b4-57fa-4e15-9733-283aee0f62a8 1073741824" returned: 0 in 0.606s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:39:28 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-5f63564f-2abe-4e19-9fcd-8068df6551c4 tempest-VolumeImageDependencyTests-1366750687 None] Acquiring lock "cinder-c5703b33-7a0d-4e4c-9dd1-fccc166c569d-delete_volume" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:39:28 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-5f63564f-2abe-4e19-9fcd-8068df6551c4 tempest-VolumeImageDependencyTests-1366750687 None] Lock "cinder-c5703b33-7a0d-4e4c-9dd1-fccc166c569d-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:39:28 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-85be0cec-2b2c-46ae-a169-464d7a7b06a6 tempest-ProjectMemberTests-969865867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0fda83b4-57fa-4e15-9733-283aee0f62a8 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:39:28 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-5f63564f-2abe-4e19-9fcd-8068df6551c4 tempest-VolumeImageDependencyTests-1366750687 None] Acquiring lock "cinder-quobyte-c5703b33-7a0d-4e4c-9dd1-fccc166c569d" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:39:28 devstack sudo[114561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0fda83b4-57fa-4e15-9733-283aee0f62a8 Jul 31 12:39:28 devstack sudo[114561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:39:28 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-5f63564f-2abe-4e19-9fcd-8068df6551c4 tempest-VolumeImageDependencyTests-1366750687 None] Lock "cinder-quobyte-c5703b33-7a0d-4e4c-9dd1-fccc166c569d" acquired by "delete_volume" :: waited 0.017s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:39:28 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[b099a362-d95d-42ec-82a7-6f0bf85d5769]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:39:28 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-5f63564f-2abe-4e19-9fcd-8068df6551c4 tempest-VolumeImageDependencyTests-1366750687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-c5703b33-7a0d-4e4c-9dd1-fccc166c569d {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:39:28 devstack sudo[114563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-c5703b33-7a0d-4e4c-9dd1-fccc166c569d Jul 31 12:39:28 devstack sudo[114563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:39:28 devstack sudo[114561]: pam_unix(sudo:session): session closed for user root Jul 31 12:39:28 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-85be0cec-2b2c-46ae-a169-464d7a7b06a6 tempest-ProjectMemberTests-969865867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0fda83b4-57fa-4e15-9733-283aee0f62a8" returned: 0 in 0.261s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:39:28 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-85be0cec-2b2c-46ae-a169-464d7a7b06a6 tempest-ProjectMemberTests-969865867 None] <== create_volume: return (935ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'} {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 12:39:28 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-85be0cec-2b2c-46ae-a169-464d7a7b06a6 tempest-ProjectMemberTests-969865867 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.937s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:39:28 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-85be0cec-2b2c-46ae-a169-464d7a7b06a6 tempest-ProjectMemberTests-969865867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84c34402-b7c0-44cc-b62e-a709c9402f5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0fda83b4-57fa-4e15-9733-283aee0f62a8', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:39:28 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-85be0cec-2b2c-46ae-a169-464d7a7b06a6 tempest-ProjectMemberTests-969865867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (125b741e-08f4-49e4-b486-c7694b719b87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:39:28 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-85be0cec-2b2c-46ae-a169-464d7a7b06a6 tempest-ProjectMemberTests-969865867 None] Volume volume-0fda83b4-57fa-4e15-9733-283aee0f62a8 (0fda83b4-57fa-4e15-9733-283aee0f62a8): created successfully Jul 31 12:39:28 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-85be0cec-2b2c-46ae-a169-464d7a7b06a6 tempest-ProjectMemberTests-969865867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (125b741e-08f4-49e4-b486-c7694b719b87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:39:28 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-85be0cec-2b2c-46ae-a169-464d7a7b06a6 tempest-ProjectMemberTests-969865867 None] Flow 'volume_create_manager' (9d85bd7a-3521-4073-aed4-a6d3eb31abde) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:39:28 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-85be0cec-2b2c-46ae-a169-464d7a7b06a6 tempest-ProjectMemberTests-969865867 None] Created volume successfully. Jul 31 12:39:28 devstack sudo[114563]: pam_unix(sudo:session): session closed for user root Jul 31 12:39:28 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-5f63564f-2abe-4e19-9fcd-8068df6551c4 tempest-VolumeImageDependencyTests-1366750687 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-c5703b33-7a0d-4e4c-9dd1-fccc166c569d" returned: 0 in 0.384s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:39:28 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-5f63564f-2abe-4e19-9fcd-8068df6551c4 tempest-VolumeImageDependencyTests-1366750687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-c5703b33-7a0d-4e4c-9dd1-fccc166c569d {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:39:28 devstack sudo[114569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-c5703b33-7a0d-4e4c-9dd1-fccc166c569d Jul 31 12:39:28 devstack sudo[114569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:39:29 devstack sudo[114569]: pam_unix(sudo:session): session closed for user root Jul 31 12:39:29 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-5f63564f-2abe-4e19-9fcd-8068df6551c4 tempest-VolumeImageDependencyTests-1366750687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-c5703b33-7a0d-4e4c-9dd1-fccc166c569d" returned: 0 in 0.339s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:39:29 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-5f63564f-2abe-4e19-9fcd-8068df6551c4 tempest-VolumeImageDependencyTests-1366750687 None] Lock "cinder-quobyte-c5703b33-7a0d-4e4c-9dd1-fccc166c569d" released by "delete_volume" :: held 0.769s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:39:29 devstack cinder-volume[89182]: DEBUG cinder.quota [None req-5f63564f-2abe-4e19-9fcd-8068df6551c4 tempest-VolumeImageDependencyTests-1366750687 None] Created reservations ['3dda00b9-5361-4251-9030-bd12ab75f2fd', '75a7946f-97cd-460e-938a-91f901933c72', '73fcdf79-817f-4121-82ba-81e88dd0f038', '1c65fb02-3589-4243-8a8d-594f07359235'] {{(pid=89182) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 12:39:29 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-5f63564f-2abe-4e19-9fcd-8068df6551c4 tempest-VolumeImageDependencyTests-1366750687 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:39:29 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-5f63564f-2abe-4e19-9fcd-8068df6551c4 tempest-VolumeImageDependencyTests-1366750687 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:39:29 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-5f63564f-2abe-4e19-9fcd-8068df6551c4 tempest-VolumeImageDependencyTests-1366750687 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:39:29 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-5f63564f-2abe-4e19-9fcd-8068df6551c4 tempest-VolumeImageDependencyTests-1366750687 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:39:29 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-5f63564f-2abe-4e19-9fcd-8068df6551c4 tempest-VolumeImageDependencyTests-1366750687 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:39:29 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-5f63564f-2abe-4e19-9fcd-8068df6551c4 tempest-VolumeImageDependencyTests-1366750687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:39:29 devstack sudo[114576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 Jul 31 12:39:29 devstack sudo[114576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:39:29 devstack sudo[114576]: pam_unix(sudo:session): session closed for user root Jul 31 12:39:29 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-5f63564f-2abe-4e19-9fcd-8068df6551c4 tempest-VolumeImageDependencyTests-1366750687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2" returned: 0 in 0.288s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:39:29 devstack cinder-volume[89182]: DEBUG cinder.manager [None req-5f63564f-2abe-4e19-9fcd-8068df6551c4 tempest-VolumeImageDependencyTests-1366750687 None] Notifying Schedulers of capabilities ... {{(pid=89182) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 12:39:29 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-5f63564f-2abe-4e19-9fcd-8068df6551c4 tempest-VolumeImageDependencyTests-1366750687 None] Deleted volume successfully. Jul 31 12:39:29 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-5f63564f-2abe-4e19-9fcd-8068df6551c4 tempest-VolumeImageDependencyTests-1366750687 None] Lock "cinder-c5703b33-7a0d-4e4c-9dd1-fccc166c569d-delete_volume" released by "delete_volume" :: held 1.399s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:39:29 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-84748ab6-3b3e-425c-8bcc-3521a36d30bf tempest-ProjectMemberTests-969865867 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:39:29 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-84748ab6-3b3e-425c-8bcc-3521a36d30bf tempest-ProjectMemberTests-969865867 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:39:29 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-84748ab6-3b3e-425c-8bcc-3521a36d30bf tempest-ProjectMemberTests-969865867 None] Creating offline snapshot 21fb37f4-84d2-4c27-a502-f3e4eb159bf1 of volume 0fda83b4-57fa-4e15-9733-283aee0f62a8 {{(pid=89182) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 31 12:39:29 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f6a858f-4533-478d-9bc9-4eac7a551e82]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:39:29 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-84748ab6-3b3e-425c-8bcc-3521a36d30bf tempest-ProjectMemberTests-969865867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0fda83b4-57fa-4e15-9733-283aee0f62a8 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:39:30 devstack sudo[114582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0fda83b4-57fa-4e15-9733-283aee0f62a8 Jul 31 12:39:30 devstack sudo[114582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:39:30 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [req-9529ba83-23f7-467a-abfe-3a533d1eb4d9 req-290317b0-334e-40d0-9565-601aafd00c86 tempest-SnapshotDataIntegrityTests-898447071 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:39:30 devstack sudo[114582]: pam_unix(sudo:session): session closed for user root Jul 31 12:39:30 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-84748ab6-3b3e-425c-8bcc-3521a36d30bf tempest-ProjectMemberTests-969865867 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0fda83b4-57fa-4e15-9733-283aee0f62a8" returned: 0 in 0.501s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:39:30 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-84748ab6-3b3e-425c-8bcc-3521a36d30bf tempest-ProjectMemberTests-969865867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0fda83b4-57fa-4e15-9733-283aee0f62a8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0fda83b4-57fa-4e15-9733-283aee0f62a8.21fb37f4-84d2-4c27-a502-f3e4eb159bf1 1G {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:39:30 devstack sudo[114595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0fda83b4-57fa-4e15-9733-283aee0f62a8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0fda83b4-57fa-4e15-9733-283aee0f62a8.21fb37f4-84d2-4c27-a502-f3e4eb159bf1 1G Jul 31 12:39:30 devstack sudo[114595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:39:30 devstack sudo[114595]: pam_unix(sudo:session): session closed for user root Jul 31 12:39:30 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-84748ab6-3b3e-425c-8bcc-3521a36d30bf tempest-ProjectMemberTests-969865867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0fda83b4-57fa-4e15-9733-283aee0f62a8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0fda83b4-57fa-4e15-9733-283aee0f62a8.21fb37f4-84d2-4c27-a502-f3e4eb159bf1 1G" returned: 0 in 0.567s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:39:30 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-84748ab6-3b3e-425c-8bcc-3521a36d30bf tempest-ProjectMemberTests-969865867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0fda83b4-57fa-4e15-9733-283aee0f62a8 -F qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0fda83b4-57fa-4e15-9733-283aee0f62a8.21fb37f4-84d2-4c27-a502-f3e4eb159bf1 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:39:30 devstack sudo[114601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0fda83b4-57fa-4e15-9733-283aee0f62a8 -F qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0fda83b4-57fa-4e15-9733-283aee0f62a8.21fb37f4-84d2-4c27-a502-f3e4eb159bf1 Jul 31 12:39:30 devstack sudo[114601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:39:31 devstack sudo[114601]: pam_unix(sudo:session): session closed for user root Jul 31 12:39:31 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-84748ab6-3b3e-425c-8bcc-3521a36d30bf tempest-ProjectMemberTests-969865867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0fda83b4-57fa-4e15-9733-283aee0f62a8 -F qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0fda83b4-57fa-4e15-9733-283aee0f62a8.21fb37f4-84d2-4c27-a502-f3e4eb159bf1" returned: 0 in 0.327s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:39:31 devstack cinder-volume[89182]: WARNING cinder.volume.drivers.remotefs [None req-84748ab6-3b3e-425c-8bcc-3521a36d30bf tempest-ProjectMemberTests-969865867 None] /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0fda83b4-57fa-4e15-9733-283aee0f62a8.21fb37f4-84d2-4c27-a502-f3e4eb159bf1 is being set with open permissions: ugo+rw Jul 31 12:39:31 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-84748ab6-3b3e-425c-8bcc-3521a36d30bf tempest-ProjectMemberTests-969865867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0fda83b4-57fa-4e15-9733-283aee0f62a8.21fb37f4-84d2-4c27-a502-f3e4eb159bf1 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:39:31 devstack sudo[114606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0fda83b4-57fa-4e15-9733-283aee0f62a8.21fb37f4-84d2-4c27-a502-f3e4eb159bf1 Jul 31 12:39:31 devstack sudo[114606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:39:31 devstack sudo[114606]: pam_unix(sudo:session): session closed for user root Jul 31 12:39:31 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-84748ab6-3b3e-425c-8bcc-3521a36d30bf tempest-ProjectMemberTests-969865867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0fda83b4-57fa-4e15-9733-283aee0f62a8.21fb37f4-84d2-4c27-a502-f3e4eb159bf1" returned: 0 in 0.278s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:39:31 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-84748ab6-3b3e-425c-8bcc-3521a36d30bf tempest-ProjectMemberTests-969865867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0fda83b4-57fa-4e15-9733-283aee0f62a8.info {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:39:31 devstack sudo[114609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0fda83b4-57fa-4e15-9733-283aee0f62a8.info Jul 31 12:39:31 devstack sudo[114609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:39:31 devstack sudo[114609]: pam_unix(sudo:session): session closed for user root Jul 31 12:39:31 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-84748ab6-3b3e-425c-8bcc-3521a36d30bf tempest-ProjectMemberTests-969865867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0fda83b4-57fa-4e15-9733-283aee0f62a8.info" returned: 0 in 0.300s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:39:31 devstack cinder-volume[89182]: WARNING cinder.volume.drivers.remotefs [None req-84748ab6-3b3e-425c-8bcc-3521a36d30bf tempest-ProjectMemberTests-969865867 None] /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0fda83b4-57fa-4e15-9733-283aee0f62a8.info is being set with open permissions: ugo+rw Jul 31 12:39:31 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-84748ab6-3b3e-425c-8bcc-3521a36d30bf tempest-ProjectMemberTests-969865867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0fda83b4-57fa-4e15-9733-283aee0f62a8.info {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:39:31 devstack sudo[114612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0fda83b4-57fa-4e15-9733-283aee0f62a8.info Jul 31 12:39:31 devstack sudo[114612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:39:32 devstack sudo[114612]: pam_unix(sudo:session): session closed for user root Jul 31 12:39:32 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-84748ab6-3b3e-425c-8bcc-3521a36d30bf tempest-ProjectMemberTests-969865867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0fda83b4-57fa-4e15-9733-283aee0f62a8.info" returned: 0 in 0.276s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:39:32 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-84748ab6-3b3e-425c-8bcc-3521a36d30bf tempest-ProjectMemberTests-969865867 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.372s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:39:32 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [req-9529ba83-23f7-467a-abfe-3a533d1eb4d9 req-290317b0-334e-40d0-9565-601aafd00c86 tempest-SnapshotDataIntegrityTests-898447071 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.849s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:39:32 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [req-9529ba83-23f7-467a-abfe-3a533d1eb4d9 req-290317b0-334e-40d0-9565-601aafd00c86 tempest-SnapshotDataIntegrityTests-898447071 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.024s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:39:32 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-84748ab6-3b3e-425c-8bcc-3521a36d30bf tempest-ProjectMemberTests-969865867 None] Create snapshot completed successfully Jul 31 12:39:32 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [req-9529ba83-23f7-467a-abfe-3a533d1eb4d9 req-290317b0-334e-40d0-9565-601aafd00c86 tempest-SnapshotDataIntegrityTests-898447071 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88', 'name': 'volume-490ce77d-87a2-440b-a48f-e2d30d1405da', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ecc3d92b-5a45-434f-b4ba-8d29aa2ad277', 'enforce_multipath': True} {{(pid=89182) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 31 12:39:32 devstack cinder-volume[89182]: INFO cinder.volume.manager [req-9529ba83-23f7-467a-abfe-3a533d1eb4d9 req-290317b0-334e-40d0-9565-601aafd00c86 tempest-SnapshotDataIntegrityTests-898447071 None] attachment_update completed successfully. Jul 31 12:39:33 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-e61b0eab-f870-495d-9a4f-815784246c7e tempest-ProjectMemberTests-969865867 None] Acquiring lock "cinder-21fb37f4-84d2-4c27-a502-f3e4eb159bf1-delete_snapshot" by "delete_snapshot" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:39:33 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-e61b0eab-f870-495d-9a4f-815784246c7e tempest-ProjectMemberTests-969865867 None] Lock "cinder-21fb37f4-84d2-4c27-a502-f3e4eb159bf1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:39:33 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-e61b0eab-f870-495d-9a4f-815784246c7e tempest-ProjectMemberTests-969865867 None] Acquiring lock "cinder-quobyte-0fda83b4-57fa-4e15-9733-283aee0f62a8" by "delete_snapshot" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:39:33 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-e61b0eab-f870-495d-9a4f-815784246c7e tempest-ProjectMemberTests-969865867 None] Lock "cinder-quobyte-0fda83b4-57fa-4e15-9733-283aee0f62a8" acquired by "delete_snapshot" :: waited 0.036s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:39:33 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-e61b0eab-f870-495d-9a4f-815784246c7e tempest-ProjectMemberTests-969865867 None] Acquiring lock "cinder-quobyte-21fb37f4-84d2-4c27-a502-f3e4eb159bf1" by "_delete_snapshot" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:39:33 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-e61b0eab-f870-495d-9a4f-815784246c7e tempest-ProjectMemberTests-969865867 None] Lock "cinder-quobyte-21fb37f4-84d2-4c27-a502-f3e4eb159bf1" acquired by "_delete_snapshot" :: waited 0.034s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:39:33 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-e61b0eab-f870-495d-9a4f-815784246c7e tempest-ProjectMemberTests-969865867 None] Deleting offline snapshot 21fb37f4-84d2-4c27-a502-f3e4eb159bf1 of volume 0fda83b4-57fa-4e15-9733-283aee0f62a8 {{(pid=89182) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 31 12:39:33 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-e61b0eab-f870-495d-9a4f-815784246c7e tempest-ProjectMemberTests-969865867 None] snapshot_file for this snap is: volume-0fda83b4-57fa-4e15-9733-283aee0f62a8.21fb37f4-84d2-4c27-a502-f3e4eb159bf1 {{(pid=89182) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 31 12:39:33 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3637479-dcf4-46c3-9395-3a71abab4b3e]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:39:33 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-e61b0eab-f870-495d-9a4f-815784246c7e tempest-ProjectMemberTests-969865867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0fda83b4-57fa-4e15-9733-283aee0f62a8.21fb37f4-84d2-4c27-a502-f3e4eb159bf1 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:39:33 devstack sudo[115001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0fda83b4-57fa-4e15-9733-283aee0f62a8.21fb37f4-84d2-4c27-a502-f3e4eb159bf1 Jul 31 12:39:33 devstack sudo[115001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:39:33 devstack sudo[115001]: pam_unix(sudo:session): session closed for user root Jul 31 12:39:33 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-e61b0eab-f870-495d-9a4f-815784246c7e tempest-ProjectMemberTests-969865867 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0fda83b4-57fa-4e15-9733-283aee0f62a8.21fb37f4-84d2-4c27-a502-f3e4eb159bf1" returned: 0 in 0.607s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:39:33 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-e61b0eab-f870-495d-9a4f-815784246c7e tempest-ProjectMemberTests-969865867 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0fda83b4-57fa-4e15-9733-283aee0f62a8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89182) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 12:39:33 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[03a58ab1-932b-48e5-9dbd-846f585e90ec]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:39:33 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-e61b0eab-f870-495d-9a4f-815784246c7e tempest-ProjectMemberTests-969865867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0fda83b4-57fa-4e15-9733-283aee0f62a8 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:39:34 devstack sudo[115006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0fda83b4-57fa-4e15-9733-283aee0f62a8 Jul 31 12:39:34 devstack sudo[115006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:39:34 devstack sudo[115006]: pam_unix(sudo:session): session closed for user root Jul 31 12:39:34 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-e61b0eab-f870-495d-9a4f-815784246c7e tempest-ProjectMemberTests-969865867 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0fda83b4-57fa-4e15-9733-283aee0f62a8" returned: 0 in 0.444s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:39:34 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-e61b0eab-f870-495d-9a4f-815784246c7e tempest-ProjectMemberTests-969865867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0fda83b4-57fa-4e15-9733-283aee0f62a8.21fb37f4-84d2-4c27-a502-f3e4eb159bf1 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:39:34 devstack sudo[115011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0fda83b4-57fa-4e15-9733-283aee0f62a8.21fb37f4-84d2-4c27-a502-f3e4eb159bf1 Jul 31 12:39:34 devstack sudo[115011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:39:34 devstack sudo[115011]: pam_unix(sudo:session): session closed for user root Jul 31 12:39:34 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-e61b0eab-f870-495d-9a4f-815784246c7e tempest-ProjectMemberTests-969865867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0fda83b4-57fa-4e15-9733-283aee0f62a8.21fb37f4-84d2-4c27-a502-f3e4eb159bf1" returned: 0 in 0.392s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:39:34 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-e61b0eab-f870-495d-9a4f-815784246c7e tempest-ProjectMemberTests-969865867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0fda83b4-57fa-4e15-9733-283aee0f62a8.21fb37f4-84d2-4c27-a502-f3e4eb159bf1 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:39:34 devstack sudo[115027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0fda83b4-57fa-4e15-9733-283aee0f62a8.21fb37f4-84d2-4c27-a502-f3e4eb159bf1 Jul 31 12:39:34 devstack sudo[115027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:39:35 devstack sudo[115027]: pam_unix(sudo:session): session closed for user root Jul 31 12:39:35 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-e61b0eab-f870-495d-9a4f-815784246c7e tempest-ProjectMemberTests-969865867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0fda83b4-57fa-4e15-9733-283aee0f62a8.21fb37f4-84d2-4c27-a502-f3e4eb159bf1" returned: 0 in 0.297s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:39:35 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-e61b0eab-f870-495d-9a4f-815784246c7e tempest-ProjectMemberTests-969865867 None] Lock "cinder-quobyte-21fb37f4-84d2-4c27-a502-f3e4eb159bf1" released by "_delete_snapshot" :: held 1.952s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:39:35 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-e61b0eab-f870-495d-9a4f-815784246c7e tempest-ProjectMemberTests-969865867 None] Lock "cinder-quobyte-0fda83b4-57fa-4e15-9733-283aee0f62a8" released by "delete_snapshot" :: held 1.999s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:39:35 devstack cinder-volume[89182]: DEBUG cinder.quota [None req-e61b0eab-f870-495d-9a4f-815784246c7e tempest-ProjectMemberTests-969865867 None] Created reservations ['e68efc58-47dd-4e8d-8367-97d3405f2a0f', '33ca28e5-a00b-4235-8b39-04cb519649ce', 'c42653d6-5eb1-4bca-9579-e39d841cfd0a', 'd80311ca-12cf-4f11-8ef5-fdf405ccf790'] {{(pid=89182) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 12:39:35 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-e61b0eab-f870-495d-9a4f-815784246c7e tempest-ProjectMemberTests-969865867 None] Delete snapshot completed successfully. Jul 31 12:39:35 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-e61b0eab-f870-495d-9a4f-815784246c7e tempest-ProjectMemberTests-969865867 None] Lock "cinder-21fb37f4-84d2-4c27-a502-f3e4eb159bf1-delete_snapshot" released by "delete_snapshot" :: held 2.227s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:39:36 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-42363eb3-1b02-47f0-96eb-141b1854841d tempest-ProjectMemberTests-969865867 None] Acquiring lock "cinder-0fda83b4-57fa-4e15-9733-283aee0f62a8-delete_volume" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:39:36 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-42363eb3-1b02-47f0-96eb-141b1854841d tempest-ProjectMemberTests-969865867 None] Lock "cinder-0fda83b4-57fa-4e15-9733-283aee0f62a8-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:39:36 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-42363eb3-1b02-47f0-96eb-141b1854841d tempest-ProjectMemberTests-969865867 None] Acquiring lock "cinder-quobyte-0fda83b4-57fa-4e15-9733-283aee0f62a8" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:39:36 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-42363eb3-1b02-47f0-96eb-141b1854841d tempest-ProjectMemberTests-969865867 None] Lock "cinder-quobyte-0fda83b4-57fa-4e15-9733-283aee0f62a8" acquired by "delete_volume" :: waited 0.026s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:39:36 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[9483e5a2-96b0-4805-ac1b-ecd3d501ff5f]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:39:36 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-42363eb3-1b02-47f0-96eb-141b1854841d tempest-ProjectMemberTests-969865867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0fda83b4-57fa-4e15-9733-283aee0f62a8 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:39:36 devstack cinder-volume[89182]: INFO cinder.volume.manager [req-0831cdf7-b4d5-495e-925b-65352fc5d23d req-9b4b7dee-68e4-4dd9-ac72-d3c687781a56 tempest-SnapshotDataIntegrityTests-898447071 None] Terminate volume connection completed successfully. Jul 31 12:39:36 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [req-0831cdf7-b4d5-495e-925b-65352fc5d23d req-9b4b7dee-68e4-4dd9-ac72-d3c687781a56 tempest-SnapshotDataIntegrityTests-898447071 None] Deleting attachment ecc3d92b-5a45-434f-b4ba-8d29aa2ad277. {{(pid=89182) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 31 12:39:36 devstack sudo[115046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0fda83b4-57fa-4e15-9733-283aee0f62a8 Jul 31 12:39:36 devstack sudo[115046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:39:37 devstack sudo[115046]: pam_unix(sudo:session): session closed for user root Jul 31 12:39:37 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-42363eb3-1b02-47f0-96eb-141b1854841d tempest-ProjectMemberTests-969865867 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0fda83b4-57fa-4e15-9733-283aee0f62a8" returned: 0 in 0.451s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:39:37 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-42363eb3-1b02-47f0-96eb-141b1854841d tempest-ProjectMemberTests-969865867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0fda83b4-57fa-4e15-9733-283aee0f62a8 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:39:37 devstack sudo[115077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0fda83b4-57fa-4e15-9733-283aee0f62a8 Jul 31 12:39:37 devstack sudo[115077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:39:37 devstack sudo[115077]: pam_unix(sudo:session): session closed for user root Jul 31 12:39:37 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-42363eb3-1b02-47f0-96eb-141b1854841d tempest-ProjectMemberTests-969865867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0fda83b4-57fa-4e15-9733-283aee0f62a8" returned: 0 in 0.396s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:39:37 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-42363eb3-1b02-47f0-96eb-141b1854841d tempest-ProjectMemberTests-969865867 None] Lock "cinder-quobyte-0fda83b4-57fa-4e15-9733-283aee0f62a8" released by "delete_volume" :: held 0.939s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:39:37 devstack cinder-volume[89182]: DEBUG cinder.quota [None req-42363eb3-1b02-47f0-96eb-141b1854841d tempest-ProjectMemberTests-969865867 None] Created reservations ['fdb07864-5f71-4761-9334-c5a0de7d98ec', '5e828d2f-0c94-44eb-b32c-07794242e977', 'a905c9d9-5495-49f0-8035-c5b599be60b0', '4845b48a-5bc6-4992-b8ac-7d4eccbb4fde'] {{(pid=89182) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 12:39:37 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-42363eb3-1b02-47f0-96eb-141b1854841d tempest-ProjectMemberTests-969865867 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:39:37 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-42363eb3-1b02-47f0-96eb-141b1854841d tempest-ProjectMemberTests-969865867 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:39:37 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-42363eb3-1b02-47f0-96eb-141b1854841d tempest-ProjectMemberTests-969865867 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:39:37 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-42363eb3-1b02-47f0-96eb-141b1854841d tempest-ProjectMemberTests-969865867 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:39:37 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-42363eb3-1b02-47f0-96eb-141b1854841d tempest-ProjectMemberTests-969865867 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:39:37 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-42363eb3-1b02-47f0-96eb-141b1854841d tempest-ProjectMemberTests-969865867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:39:37 devstack sudo[115081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 Jul 31 12:39:37 devstack sudo[115081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:39:38 devstack cinder-volume[89182]: DEBUG cinder.volume.flows.manager.create_volume [None req-e71413eb-40b8-43a7-9ab2-1e161d89da07 tempest-SnapshotDataIntegrityTests-898447071 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89182) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 12:39:38 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-e71413eb-40b8-43a7-9ab2-1e161d89da07 tempest-SnapshotDataIntegrityTests-898447071 None] Flow 'volume_create_manager' (4d9aa9da-b9ae-41c1-ab19-85342acee40d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:39:38 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-e71413eb-40b8-43a7-9ab2-1e161d89da07 tempest-SnapshotDataIntegrityTests-898447071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20625741-68e0-4f94-abb6-57777a94d170) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:39:38 devstack sudo[115081]: pam_unix(sudo:session): session closed for user root Jul 31 12:39:38 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-e71413eb-40b8-43a7-9ab2-1e161d89da07 tempest-SnapshotDataIntegrityTests-898447071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20625741-68e0-4f94-abb6-57777a94d170) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:39:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDataIntegrityTests-volume-1142575272',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1606dd1e-9b98-4d3c-81f6-f0dabda9a824,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e47adc7d32b64078850d9d94d5cb10bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:39:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=f5d7c5e3-8c41-42e0-b50d-8b1ebe936b3c,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:39:38Z,use_quota=True,user_id='6344cc57ebdb4e02aae72e7a719cd916',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:39:38 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-e71413eb-40b8-43a7-9ab2-1e161d89da07 tempest-SnapshotDataIntegrityTests-898447071 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35131fc9-2f43-442e-b001-cc1d0a4d2f18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:39:38 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-e71413eb-40b8-43a7-9ab2-1e161d89da07 tempest-SnapshotDataIntegrityTests-898447071 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35131fc9-2f43-442e-b001-cc1d0a4d2f18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:39:38 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-e71413eb-40b8-43a7-9ab2-1e161d89da07 tempest-SnapshotDataIntegrityTests-898447071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f3299ee-187a-4b93-8b7d-c2dcea37b5d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:39:38 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-e71413eb-40b8-43a7-9ab2-1e161d89da07 tempest-SnapshotDataIntegrityTests-898447071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f3299ee-187a-4b93-8b7d-c2dcea37b5d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '1606dd1e-9b98-4d3c-81f6-f0dabda9a824', 'volume_name': 'volume-1606dd1e-9b98-4d3c-81f6-f0dabda9a824', 'volume_size': 1, 'snapshot_id': 'f5d7c5e3-8c41-42e0-b50d-8b1ebe936b3c'}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:39:38 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-e71413eb-40b8-43a7-9ab2-1e161d89da07 tempest-SnapshotDataIntegrityTests-898447071 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa1fac6b-6a44-453f-bed7-eedc82ae4152) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:39:38 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-e71413eb-40b8-43a7-9ab2-1e161d89da07 tempest-SnapshotDataIntegrityTests-898447071 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa1fac6b-6a44-453f-bed7-eedc82ae4152) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:39:38 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-e71413eb-40b8-43a7-9ab2-1e161d89da07 tempest-SnapshotDataIntegrityTests-898447071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73746e24-e36e-4eb9-b7dd-66d625ca8cc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:39:38 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-e71413eb-40b8-43a7-9ab2-1e161d89da07 tempest-SnapshotDataIntegrityTests-898447071 None] Volume 1606dd1e-9b98-4d3c-81f6-f0dabda9a824: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-1606dd1e-9b98-4d3c-81f6-f0dabda9a824', 'volume_size': 1, 'snapshot_id': 'f5d7c5e3-8c41-42e0-b50d-8b1ebe936b3c'} Jul 31 12:39:38 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-42363eb3-1b02-47f0-96eb-141b1854841d tempest-ProjectMemberTests-969865867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2" returned: 0 in 0.503s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:39:38 devstack cinder-volume[89182]: DEBUG cinder.manager [None req-42363eb3-1b02-47f0-96eb-141b1854841d tempest-ProjectMemberTests-969865867 None] Notifying Schedulers of capabilities ... {{(pid=89182) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 12:39:38 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-42363eb3-1b02-47f0-96eb-141b1854841d tempest-ProjectMemberTests-969865867 None] Deleted volume successfully. Jul 31 12:39:38 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-e71413eb-40b8-43a7-9ab2-1e161d89da07 tempest-SnapshotDataIntegrityTests-898447071 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:39:38 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-e71413eb-40b8-43a7-9ab2-1e161d89da07 tempest-SnapshotDataIntegrityTests-898447071 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.000s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:39:38 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-e71413eb-40b8-43a7-9ab2-1e161d89da07 tempest-SnapshotDataIntegrityTests-898447071 None] Acquiring lock "cinder-quobyte-f5d7c5e3-8c41-42e0-b50d-8b1ebe936b3c-1606dd1e-9b98-4d3c-81f6-f0dabda9a824" by "_create_volume_from_snapshot" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:39:38 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-e71413eb-40b8-43a7-9ab2-1e161d89da07 tempest-SnapshotDataIntegrityTests-898447071 None] Lock "cinder-quobyte-f5d7c5e3-8c41-42e0-b50d-8b1ebe936b3c-1606dd1e-9b98-4d3c-81f6-f0dabda9a824" acquired by "_create_volume_from_snapshot" :: waited 0.021s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:39:38 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-e71413eb-40b8-43a7-9ab2-1e161d89da07 tempest-SnapshotDataIntegrityTests-898447071 None] Creating volume 1606dd1e-9b98-4d3c-81f6-f0dabda9a824 from snapshot f5d7c5e3-8c41-42e0-b50d-8b1ebe936b3c {{(pid=89182) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 31 12:39:38 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-e71413eb-40b8-43a7-9ab2-1e161d89da07 tempest-SnapshotDataIntegrityTests-898447071 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:39:38 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-e71413eb-40b8-43a7-9ab2-1e161d89da07 tempest-SnapshotDataIntegrityTests-898447071 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:39:38 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-e71413eb-40b8-43a7-9ab2-1e161d89da07 tempest-SnapshotDataIntegrityTests-898447071 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:39:38 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-e71413eb-40b8-43a7-9ab2-1e161d89da07 tempest-SnapshotDataIntegrityTests-898447071 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:39:38 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-e71413eb-40b8-43a7-9ab2-1e161d89da07 tempest-SnapshotDataIntegrityTests-898447071 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:39:38 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-e71413eb-40b8-43a7-9ab2-1e161d89da07 tempest-SnapshotDataIntegrityTests-898447071 None] Selected osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 as target Quobyte volume. {{(pid=89182) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 12:39:38 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-e71413eb-40b8-43a7-9ab2-1e161d89da07 tempest-SnapshotDataIntegrityTests-898447071 None] Acquiring lock "cinder-quobyte-1606dd1e-9b98-4d3c-81f6-f0dabda9a824" by "_copy_volume_from_snapshot" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:39:38 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-42363eb3-1b02-47f0-96eb-141b1854841d tempest-ProjectMemberTests-969865867 None] Lock "cinder-0fda83b4-57fa-4e15-9733-283aee0f62a8-delete_volume" released by "delete_volume" :: held 1.810s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:39:38 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-e71413eb-40b8-43a7-9ab2-1e161d89da07 tempest-SnapshotDataIntegrityTests-898447071 None] Lock "cinder-quobyte-1606dd1e-9b98-4d3c-81f6-f0dabda9a824" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:39:38 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-e71413eb-40b8-43a7-9ab2-1e161d89da07 tempest-SnapshotDataIntegrityTests-898447071 None] snapshot: f5d7c5e3-8c41-42e0-b50d-8b1ebe936b3c, volume: 1606dd1e-9b98-4d3c-81f6-f0dabda9a824, {{(pid=89182) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Jul 31 12:39:38 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-e71413eb-40b8-43a7-9ab2-1e161d89da07 tempest-SnapshotDataIntegrityTests-898447071 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:39:38 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-e71413eb-40b8-43a7-9ab2-1e161d89da07 tempest-SnapshotDataIntegrityTests-898447071 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:39:38 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-e71413eb-40b8-43a7-9ab2-1e161d89da07 tempest-SnapshotDataIntegrityTests-898447071 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:39:38 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-e71413eb-40b8-43a7-9ab2-1e161d89da07 tempest-SnapshotDataIntegrityTests-898447071 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:39:38 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-e71413eb-40b8-43a7-9ab2-1e161d89da07 tempest-SnapshotDataIntegrityTests-898447071 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:39:38 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[535e6ace-5f34-4673-8179-e02feb50f32f]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:39:38 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-e71413eb-40b8-43a7-9ab2-1e161d89da07 tempest-SnapshotDataIntegrityTests-898447071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e6acfb11-941d-450b-8d93-0e32240df94a.f5d7c5e3-8c41-42e0-b50d-8b1ebe936b3c {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:39:38 devstack sudo[115084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e6acfb11-941d-450b-8d93-0e32240df94a.f5d7c5e3-8c41-42e0-b50d-8b1ebe936b3c Jul 31 12:39:38 devstack sudo[115084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:39:38 devstack sudo[115084]: pam_unix(sudo:session): session closed for user root Jul 31 12:39:38 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-e71413eb-40b8-43a7-9ab2-1e161d89da07 tempest-SnapshotDataIntegrityTests-898447071 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e6acfb11-941d-450b-8d93-0e32240df94a.f5d7c5e3-8c41-42e0-b50d-8b1ebe936b3c" returned: 0 in 0.471s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:39:38 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-e71413eb-40b8-43a7-9ab2-1e161d89da07 tempest-SnapshotDataIntegrityTests-898447071 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e6acfb11-941d-450b-8d93-0e32240df94a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89182) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 12:39:38 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[eba7f37d-d6a9-4e8a-823a-c06e8e53a635]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:39:38 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-e71413eb-40b8-43a7-9ab2-1e161d89da07 tempest-SnapshotDataIntegrityTests-898447071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e6acfb11-941d-450b-8d93-0e32240df94a.629af985-2bb6-4b68-b00b-b49a9e715090 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:39:38 devstack sudo[115090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e6acfb11-941d-450b-8d93-0e32240df94a.629af985-2bb6-4b68-b00b-b49a9e715090 Jul 31 12:39:38 devstack sudo[115090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:39:39 devstack sudo[115090]: pam_unix(sudo:session): session closed for user root Jul 31 12:39:39 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-e71413eb-40b8-43a7-9ab2-1e161d89da07 tempest-SnapshotDataIntegrityTests-898447071 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e6acfb11-941d-450b-8d93-0e32240df94a.629af985-2bb6-4b68-b00b-b49a9e715090" returned: 0 in 0.418s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:39:39 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-e71413eb-40b8-43a7-9ab2-1e161d89da07 tempest-SnapshotDataIntegrityTests-898447071 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e6acfb11-941d-450b-8d93-0e32240df94a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89182) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 12:39:39 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-e71413eb-40b8-43a7-9ab2-1e161d89da07 tempest-SnapshotDataIntegrityTests-898447071 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e6acfb11-941d-450b-8d93-0e32240df94a.629af985-2bb6-4b68-b00b-b49a9e715090 {{(pid=89182) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Jul 31 12:39:39 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-e71413eb-40b8-43a7-9ab2-1e161d89da07 tempest-SnapshotDataIntegrityTests-898447071 None] Creating direct copy from snapshot {{(pid=89182) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Jul 31 12:39:39 devstack cinder-volume[89182]: DEBUG cinder.utils [None req-e71413eb-40b8-43a7-9ab2-1e161d89da07 tempest-SnapshotDataIntegrityTests-898447071 None] Path /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-1606dd1e-9b98-4d3c-81f6-f0dabda9a824 not found in is_blk_device check {{(pid=89182) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 31 12:39:39 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-e71413eb-40b8-43a7-9ab2-1e161d89da07 tempest-SnapshotDataIntegrityTests-898447071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e6acfb11-941d-450b-8d93-0e32240df94a.629af985-2bb6-4b68-b00b-b49a9e715090 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-1606dd1e-9b98-4d3c-81f6-f0dabda9a824 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:39:39 devstack sudo[115097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e6acfb11-941d-450b-8d93-0e32240df94a.629af985-2bb6-4b68-b00b-b49a9e715090 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-1606dd1e-9b98-4d3c-81f6-f0dabda9a824 Jul 31 12:39:39 devstack sudo[115097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:39:39 devstack cinder-volume[89182]: DEBUG cinder.volume.flows.manager.create_volume [None req-64c03400-159e-4333-a52a-6007aeb84e22 tempest-ProjectMemberTests-969865867 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89182) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 12:39:39 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-64c03400-159e-4333-a52a-6007aeb84e22 tempest-ProjectMemberTests-969865867 None] Flow 'volume_create_manager' (897db077-17d6-4b72-94b7-b781c54a6ae3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:39:39 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-64c03400-159e-4333-a52a-6007aeb84e22 tempest-ProjectMemberTests-969865867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60114d58-b91a-40bc-9474-0bbe2f075134) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:39:39 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-64c03400-159e-4333-a52a-6007aeb84e22 tempest-ProjectMemberTests-969865867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60114d58-b91a-40bc-9474-0bbe2f075134) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:39:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1890173683',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f5ad70b-9b79-463b-a8de-8b3efa6661a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7618b523b3644b0aff23a331c24c373',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:39:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:39:39Z,use_quota=True,user_id='ef87d129d713438b8a1c61430735d914',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:39:39 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-64c03400-159e-4333-a52a-6007aeb84e22 tempest-ProjectMemberTests-969865867 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ba62cd6-2c3e-44de-9f66-a5ddc01634be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:39:39 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-64c03400-159e-4333-a52a-6007aeb84e22 tempest-ProjectMemberTests-969865867 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ba62cd6-2c3e-44de-9f66-a5ddc01634be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:39:39 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-64c03400-159e-4333-a52a-6007aeb84e22 tempest-ProjectMemberTests-969865867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ab44647-dfee-4232-ba0d-170350eb25d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:39:39 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-64c03400-159e-4333-a52a-6007aeb84e22 tempest-ProjectMemberTests-969865867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ab44647-dfee-4232-ba0d-170350eb25d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9f5ad70b-9b79-463b-a8de-8b3efa6661a6', 'volume_name': 'volume-9f5ad70b-9b79-463b-a8de-8b3efa6661a6', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:39:39 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-64c03400-159e-4333-a52a-6007aeb84e22 tempest-ProjectMemberTests-969865867 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ef1ba04-3380-4136-ad38-c57c9d9b66a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:39:39 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-64c03400-159e-4333-a52a-6007aeb84e22 tempest-ProjectMemberTests-969865867 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ef1ba04-3380-4136-ad38-c57c9d9b66a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:39:39 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-64c03400-159e-4333-a52a-6007aeb84e22 tempest-ProjectMemberTests-969865867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f8e1f9a-98bd-40e0-b9db-f35e786bf88f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:39:39 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-64c03400-159e-4333-a52a-6007aeb84e22 tempest-ProjectMemberTests-969865867 None] Volume 9f5ad70b-9b79-463b-a8de-8b3efa6661a6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9f5ad70b-9b79-463b-a8de-8b3efa6661a6', 'volume_size': 1} Jul 31 12:39:39 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-64c03400-159e-4333-a52a-6007aeb84e22 tempest-ProjectMemberTests-969865867 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:39:45 devstack sudo[115097]: pam_unix(sudo:session): session closed for user root Jul 31 12:39:45 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-e71413eb-40b8-43a7-9ab2-1e161d89da07 tempest-SnapshotDataIntegrityTests-898447071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e6acfb11-941d-450b-8d93-0e32240df94a.629af985-2bb6-4b68-b00b-b49a9e715090 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-1606dd1e-9b98-4d3c-81f6-f0dabda9a824" returned: 0 in 5.850s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:39:45 devstack cinder-volume[89182]: DEBUG cinder.image.image_utils [None req-e71413eb-40b8-43a7-9ab2-1e161d89da07 tempest-SnapshotDataIntegrityTests-898447071 None] Image conversion details: src /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e6acfb11-941d-450b-8d93-0e32240df94a.629af985-2bb6-4b68-b00b-b49a9e715090, size 1024.00 MB, duration 5.85 sec, destination /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-1606dd1e-9b98-4d3c-81f6-f0dabda9a824 {{(pid=89182) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 31 12:39:45 devstack cinder-volume[89182]: INFO cinder.image.image_utils [None req-e71413eb-40b8-43a7-9ab2-1e161d89da07 tempest-SnapshotDataIntegrityTests-898447071 None] Converted 1024.00 MB image at 175.00 MB/s Jul 31 12:39:45 devstack cinder-volume[89182]: WARNING cinder.volume.drivers.remotefs [None req-e71413eb-40b8-43a7-9ab2-1e161d89da07 tempest-SnapshotDataIntegrityTests-898447071 None] /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-1606dd1e-9b98-4d3c-81f6-f0dabda9a824 is being set with open permissions: ugo+rw Jul 31 12:39:45 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-e71413eb-40b8-43a7-9ab2-1e161d89da07 tempest-SnapshotDataIntegrityTests-898447071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-1606dd1e-9b98-4d3c-81f6-f0dabda9a824 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:39:45 devstack sudo[115110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-1606dd1e-9b98-4d3c-81f6-f0dabda9a824 Jul 31 12:39:45 devstack sudo[115110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:39:45 devstack sudo[115110]: pam_unix(sudo:session): session closed for user root Jul 31 12:39:45 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-e71413eb-40b8-43a7-9ab2-1e161d89da07 tempest-SnapshotDataIntegrityTests-898447071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-1606dd1e-9b98-4d3c-81f6-f0dabda9a824" returned: 0 in 0.281s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:39:45 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-e71413eb-40b8-43a7-9ab2-1e161d89da07 tempest-SnapshotDataIntegrityTests-898447071 None] Lock "cinder-quobyte-1606dd1e-9b98-4d3c-81f6-f0dabda9a824" released by "_copy_volume_from_snapshot" :: held 7.134s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:39:45 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-e71413eb-40b8-43a7-9ab2-1e161d89da07 tempest-SnapshotDataIntegrityTests-898447071 None] Lock "cinder-quobyte-f5d7c5e3-8c41-42e0-b50d-8b1ebe936b3c-1606dd1e-9b98-4d3c-81f6-f0dabda9a824" released by "_create_volume_from_snapshot" :: held 7.210s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:39:45 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-e71413eb-40b8-43a7-9ab2-1e161d89da07 tempest-SnapshotDataIntegrityTests-898447071 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.233s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:39:45 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-64c03400-159e-4333-a52a-6007aeb84e22 tempest-ProjectMemberTests-969865867 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.039s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:39:45 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-64c03400-159e-4333-a52a-6007aeb84e22 tempest-ProjectMemberTests-969865867 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:39:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1890173683',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f5ad70b-9b79-463b-a8de-8b3efa6661a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7618b523b3644b0aff23a331c24c373',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:39:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:39:39Z,use_quota=True,user_id='ef87d129d713438b8a1c61430735d914',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)}" {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 12:39:45 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-64c03400-159e-4333-a52a-6007aeb84e22 tempest-ProjectMemberTests-969865867 None] Creating volume 9f5ad70b-9b79-463b-a8de-8b3efa6661a6 {{(pid=89182) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 12:39:45 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-64c03400-159e-4333-a52a-6007aeb84e22 tempest-ProjectMemberTests-969865867 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:39:45 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-64c03400-159e-4333-a52a-6007aeb84e22 tempest-ProjectMemberTests-969865867 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:39:45 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-64c03400-159e-4333-a52a-6007aeb84e22 tempest-ProjectMemberTests-969865867 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:39:45 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-64c03400-159e-4333-a52a-6007aeb84e22 tempest-ProjectMemberTests-969865867 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:39:45 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-64c03400-159e-4333-a52a-6007aeb84e22 tempest-ProjectMemberTests-969865867 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:39:45 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-64c03400-159e-4333-a52a-6007aeb84e22 tempest-ProjectMemberTests-969865867 None] Selected osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 as target Quobyte volume. {{(pid=89182) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 12:39:45 devstack cinder-volume[89182]: INFO cinder.volume.drivers.remotefs [None req-64c03400-159e-4333-a52a-6007aeb84e22 tempest-ProjectMemberTests-969865867 None] casted to osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 Jul 31 12:39:45 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-64c03400-159e-4333-a52a-6007aeb84e22 tempest-ProjectMemberTests-969865867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-9f5ad70b-9b79-463b-a8de-8b3efa6661a6 1073741824 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:39:45 devstack sudo[115113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-9f5ad70b-9b79-463b-a8de-8b3efa6661a6 1073741824 Jul 31 12:39:45 devstack sudo[115113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:39:45 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-e71413eb-40b8-43a7-9ab2-1e161d89da07 tempest-SnapshotDataIntegrityTests-898447071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73746e24-e36e-4eb9-b7dd-66d625ca8cc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1606dd1e-9b98-4d3c-81f6-f0dabda9a824', 'volume_size': 1, 'snapshot_id': 'f5d7c5e3-8c41-42e0-b50d-8b1ebe936b3c'}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:39:45 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-e71413eb-40b8-43a7-9ab2-1e161d89da07 tempest-SnapshotDataIntegrityTests-898447071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48c7bcae-aa76-44e0-a989-5bc63e17b454) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:39:45 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-e71413eb-40b8-43a7-9ab2-1e161d89da07 tempest-SnapshotDataIntegrityTests-898447071 None] Volume volume-1606dd1e-9b98-4d3c-81f6-f0dabda9a824 (1606dd1e-9b98-4d3c-81f6-f0dabda9a824): created successfully Jul 31 12:39:45 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-e71413eb-40b8-43a7-9ab2-1e161d89da07 tempest-SnapshotDataIntegrityTests-898447071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48c7bcae-aa76-44e0-a989-5bc63e17b454) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:39:45 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-e71413eb-40b8-43a7-9ab2-1e161d89da07 tempest-SnapshotDataIntegrityTests-898447071 None] Flow 'volume_create_manager' (4d9aa9da-b9ae-41c1-ab19-85342acee40d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:39:45 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-e71413eb-40b8-43a7-9ab2-1e161d89da07 tempest-SnapshotDataIntegrityTests-898447071 None] Created volume successfully. Jul 31 12:39:46 devstack sudo[115113]: pam_unix(sudo:session): session closed for user root Jul 31 12:39:46 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-64c03400-159e-4333-a52a-6007aeb84e22 tempest-ProjectMemberTests-969865867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-9f5ad70b-9b79-463b-a8de-8b3efa6661a6 1073741824" returned: 0 in 0.714s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:39:46 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-64c03400-159e-4333-a52a-6007aeb84e22 tempest-ProjectMemberTests-969865867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-9f5ad70b-9b79-463b-a8de-8b3efa6661a6 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:39:46 devstack sudo[115126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-9f5ad70b-9b79-463b-a8de-8b3efa6661a6 Jul 31 12:39:46 devstack sudo[115126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:39:46 devstack sudo[115126]: pam_unix(sudo:session): session closed for user root Jul 31 12:39:46 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-64c03400-159e-4333-a52a-6007aeb84e22 tempest-ProjectMemberTests-969865867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-9f5ad70b-9b79-463b-a8de-8b3efa6661a6" returned: 0 in 0.316s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:39:46 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-64c03400-159e-4333-a52a-6007aeb84e22 tempest-ProjectMemberTests-969865867 None] <== create_volume: return (1087ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'} {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 12:39:46 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-64c03400-159e-4333-a52a-6007aeb84e22 tempest-ProjectMemberTests-969865867 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.090s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:39:46 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-64c03400-159e-4333-a52a-6007aeb84e22 tempest-ProjectMemberTests-969865867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f8e1f9a-98bd-40e0-b9db-f35e786bf88f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9f5ad70b-9b79-463b-a8de-8b3efa6661a6', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:39:46 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-64c03400-159e-4333-a52a-6007aeb84e22 tempest-ProjectMemberTests-969865867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1a4ed7c-5008-49f4-a04b-3a30c3b24335) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:39:46 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-64c03400-159e-4333-a52a-6007aeb84e22 tempest-ProjectMemberTests-969865867 None] Volume volume-9f5ad70b-9b79-463b-a8de-8b3efa6661a6 (9f5ad70b-9b79-463b-a8de-8b3efa6661a6): created successfully Jul 31 12:39:46 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-64c03400-159e-4333-a52a-6007aeb84e22 tempest-ProjectMemberTests-969865867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1a4ed7c-5008-49f4-a04b-3a30c3b24335) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:39:46 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-64c03400-159e-4333-a52a-6007aeb84e22 tempest-ProjectMemberTests-969865867 None] Flow 'volume_create_manager' (897db077-17d6-4b72-94b7-b781c54a6ae3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:39:46 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-64c03400-159e-4333-a52a-6007aeb84e22 tempest-ProjectMemberTests-969865867 None] Created volume successfully. Jul 31 12:39:47 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [req-88c0a3f8-e221-41d9-9078-3f9943fa5ad6 req-322e33cd-d111-4efb-a1ee-3bc46ac52944 tempest-SnapshotDataIntegrityTests-898447071 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:39:47 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [req-88c0a3f8-e221-41d9-9078-3f9943fa5ad6 req-322e33cd-d111-4efb-a1ee-3bc46ac52944 tempest-SnapshotDataIntegrityTests-898447071 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:39:47 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [req-88c0a3f8-e221-41d9-9078-3f9943fa5ad6 req-322e33cd-d111-4efb-a1ee-3bc46ac52944 tempest-SnapshotDataIntegrityTests-898447071 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.032s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:39:47 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [req-88c0a3f8-e221-41d9-9078-3f9943fa5ad6 req-322e33cd-d111-4efb-a1ee-3bc46ac52944 tempest-SnapshotDataIntegrityTests-898447071 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88', 'name': 'volume-1606dd1e-9b98-4d3c-81f6-f0dabda9a824', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ca43cc1c-7599-469a-babf-31b5839b4c16', 'enforce_multipath': True} {{(pid=89182) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 31 12:39:47 devstack cinder-volume[89182]: INFO cinder.volume.manager [req-88c0a3f8-e221-41d9-9078-3f9943fa5ad6 req-322e33cd-d111-4efb-a1ee-3bc46ac52944 tempest-SnapshotDataIntegrityTests-898447071 None] attachment_update completed successfully. Jul 31 12:39:47 devstack cinder-volume[89182]: DEBUG cinder.volume.flows.manager.create_volume [None req-2da8600c-0e1d-4318-95fb-231e339c9a11 tempest-ProjectReaderTests-257919573 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89182) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 12:39:47 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-2da8600c-0e1d-4318-95fb-231e339c9a11 tempest-ProjectReaderTests-257919573 None] Flow 'volume_create_manager' (812271b0-6d0a-4e38-870a-281997dfe2ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:39:47 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-2da8600c-0e1d-4318-95fb-231e339c9a11 tempest-ProjectReaderTests-257919573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93cac98b-de1d-44fa-a5d6-30ff98c2e984) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:39:47 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-2da8600c-0e1d-4318-95fb-231e339c9a11 tempest-ProjectReaderTests-257919573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93cac98b-de1d-44fa-a5d6-30ff98c2e984) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:39:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1064186039',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30f539ea-9135-4a8b-a0b8-ec813b49081e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d483d0fbf5b8400c9644641a3998fc7a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:39:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:39:47Z,use_quota=True,user_id='a9b630b0f0734c209a501194c68cc014',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:39:47 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-2da8600c-0e1d-4318-95fb-231e339c9a11 tempest-ProjectReaderTests-257919573 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45a2f8a3-273a-453f-8afd-129d0b544045) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:39:47 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-2da8600c-0e1d-4318-95fb-231e339c9a11 tempest-ProjectReaderTests-257919573 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45a2f8a3-273a-453f-8afd-129d0b544045) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:39:47 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-2da8600c-0e1d-4318-95fb-231e339c9a11 tempest-ProjectReaderTests-257919573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (508f1274-f26b-44f3-bd15-e581c099d9db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:39:47 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-2da8600c-0e1d-4318-95fb-231e339c9a11 tempest-ProjectReaderTests-257919573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (508f1274-f26b-44f3-bd15-e581c099d9db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '30f539ea-9135-4a8b-a0b8-ec813b49081e', 'volume_name': 'volume-30f539ea-9135-4a8b-a0b8-ec813b49081e', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:39:47 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-2da8600c-0e1d-4318-95fb-231e339c9a11 tempest-ProjectReaderTests-257919573 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d8dce67-4ba4-4889-a4d5-9f2e726f8145) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:39:47 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-2da8600c-0e1d-4318-95fb-231e339c9a11 tempest-ProjectReaderTests-257919573 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d8dce67-4ba4-4889-a4d5-9f2e726f8145) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:39:47 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-2da8600c-0e1d-4318-95fb-231e339c9a11 tempest-ProjectReaderTests-257919573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c667d57-cb15-4961-8ac9-c0ee0d5ff546) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:39:47 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-2da8600c-0e1d-4318-95fb-231e339c9a11 tempest-ProjectReaderTests-257919573 None] Volume 30f539ea-9135-4a8b-a0b8-ec813b49081e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-30f539ea-9135-4a8b-a0b8-ec813b49081e', 'volume_size': 1} Jul 31 12:39:47 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-2da8600c-0e1d-4318-95fb-231e339c9a11 tempest-ProjectReaderTests-257919573 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:39:47 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-2da8600c-0e1d-4318-95fb-231e339c9a11 tempest-ProjectReaderTests-257919573 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:39:47 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-2da8600c-0e1d-4318-95fb-231e339c9a11 tempest-ProjectReaderTests-257919573 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:39:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1064186039',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30f539ea-9135-4a8b-a0b8-ec813b49081e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d483d0fbf5b8400c9644641a3998fc7a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:39:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:39:47Z,use_quota=True,user_id='a9b630b0f0734c209a501194c68cc014',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)}" {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 12:39:47 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-2da8600c-0e1d-4318-95fb-231e339c9a11 tempest-ProjectReaderTests-257919573 None] Creating volume 30f539ea-9135-4a8b-a0b8-ec813b49081e {{(pid=89182) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 12:39:47 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-2da8600c-0e1d-4318-95fb-231e339c9a11 tempest-ProjectReaderTests-257919573 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:39:47 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-2da8600c-0e1d-4318-95fb-231e339c9a11 tempest-ProjectReaderTests-257919573 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:39:47 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-2da8600c-0e1d-4318-95fb-231e339c9a11 tempest-ProjectReaderTests-257919573 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:39:47 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-2da8600c-0e1d-4318-95fb-231e339c9a11 tempest-ProjectReaderTests-257919573 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:39:47 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-2da8600c-0e1d-4318-95fb-231e339c9a11 tempest-ProjectReaderTests-257919573 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:39:47 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-2da8600c-0e1d-4318-95fb-231e339c9a11 tempest-ProjectReaderTests-257919573 None] Selected osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 as target Quobyte volume. {{(pid=89182) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 12:39:47 devstack cinder-volume[89182]: INFO cinder.volume.drivers.remotefs [None req-2da8600c-0e1d-4318-95fb-231e339c9a11 tempest-ProjectReaderTests-257919573 None] casted to osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 Jul 31 12:39:47 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-2da8600c-0e1d-4318-95fb-231e339c9a11 tempest-ProjectReaderTests-257919573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-30f539ea-9135-4a8b-a0b8-ec813b49081e 1073741824 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:39:47 devstack sudo[115209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-30f539ea-9135-4a8b-a0b8-ec813b49081e 1073741824 Jul 31 12:39:47 devstack sudo[115209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:39:47 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-7c1710d9-5645-4f1b-b628-0d5a9694b725 tempest-ProjectMemberTests-969865867 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:39:48 devstack sudo[115209]: pam_unix(sudo:session): session closed for user root Jul 31 12:39:48 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-2da8600c-0e1d-4318-95fb-231e339c9a11 tempest-ProjectReaderTests-257919573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-30f539ea-9135-4a8b-a0b8-ec813b49081e 1073741824" returned: 0 in 0.656s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:39:48 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-2da8600c-0e1d-4318-95fb-231e339c9a11 tempest-ProjectReaderTests-257919573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-30f539ea-9135-4a8b-a0b8-ec813b49081e {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:39:48 devstack sudo[115547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-30f539ea-9135-4a8b-a0b8-ec813b49081e Jul 31 12:39:48 devstack sudo[115547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:39:48 devstack sudo[115547]: pam_unix(sudo:session): session closed for user root Jul 31 12:39:48 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-2da8600c-0e1d-4318-95fb-231e339c9a11 tempest-ProjectReaderTests-257919573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-30f539ea-9135-4a8b-a0b8-ec813b49081e" returned: 0 in 0.452s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:39:48 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-2da8600c-0e1d-4318-95fb-231e339c9a11 tempest-ProjectReaderTests-257919573 None] <== create_volume: return (1177ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'} {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 12:39:48 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-2da8600c-0e1d-4318-95fb-231e339c9a11 tempest-ProjectReaderTests-257919573 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.185s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:39:48 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-7c1710d9-5645-4f1b-b628-0d5a9694b725 tempest-ProjectMemberTests-969865867 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.100s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:39:48 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-2da8600c-0e1d-4318-95fb-231e339c9a11 tempest-ProjectReaderTests-257919573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c667d57-cb15-4961-8ac9-c0ee0d5ff546) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-30f539ea-9135-4a8b-a0b8-ec813b49081e', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:39:48 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-2da8600c-0e1d-4318-95fb-231e339c9a11 tempest-ProjectReaderTests-257919573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0efa0f6-56a2-4969-b531-9796999f59ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:39:48 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-7c1710d9-5645-4f1b-b628-0d5a9694b725 tempest-ProjectMemberTests-969865867 None] Creating offline snapshot 20fe14af-99a9-41d6-8628-0f55767b9967 of volume 9f5ad70b-9b79-463b-a8de-8b3efa6661a6 {{(pid=89182) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 31 12:39:48 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-2da8600c-0e1d-4318-95fb-231e339c9a11 tempest-ProjectReaderTests-257919573 None] Volume volume-30f539ea-9135-4a8b-a0b8-ec813b49081e (30f539ea-9135-4a8b-a0b8-ec813b49081e): created successfully Jul 31 12:39:48 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-2da8600c-0e1d-4318-95fb-231e339c9a11 tempest-ProjectReaderTests-257919573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0efa0f6-56a2-4969-b531-9796999f59ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:39:48 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-2da8600c-0e1d-4318-95fb-231e339c9a11 tempest-ProjectReaderTests-257919573 None] Flow 'volume_create_manager' (812271b0-6d0a-4e38-870a-281997dfe2ac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:39:48 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cb3dab2-a3c9-45d6-9fa8-efb6c761da18]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:39:48 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-7c1710d9-5645-4f1b-b628-0d5a9694b725 tempest-ProjectMemberTests-969865867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-9f5ad70b-9b79-463b-a8de-8b3efa6661a6 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:39:48 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-2da8600c-0e1d-4318-95fb-231e339c9a11 tempest-ProjectReaderTests-257919573 None] Created volume successfully. Jul 31 12:39:49 devstack sudo[115572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-9f5ad70b-9b79-463b-a8de-8b3efa6661a6 Jul 31 12:39:49 devstack sudo[115572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:39:49 devstack sudo[115572]: pam_unix(sudo:session): session closed for user root Jul 31 12:39:49 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-7c1710d9-5645-4f1b-b628-0d5a9694b725 tempest-ProjectMemberTests-969865867 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-9f5ad70b-9b79-463b-a8de-8b3efa6661a6" returned: 0 in 0.498s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:39:49 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-7c1710d9-5645-4f1b-b628-0d5a9694b725 tempest-ProjectMemberTests-969865867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-9f5ad70b-9b79-463b-a8de-8b3efa6661a6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-9f5ad70b-9b79-463b-a8de-8b3efa6661a6.20fe14af-99a9-41d6-8628-0f55767b9967 1G {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:39:49 devstack sudo[115587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-9f5ad70b-9b79-463b-a8de-8b3efa6661a6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-9f5ad70b-9b79-463b-a8de-8b3efa6661a6.20fe14af-99a9-41d6-8628-0f55767b9967 1G Jul 31 12:39:49 devstack sudo[115587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:39:49 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-79f9dbac-d4b9-43f5-aab8-36f1faabaf30 tempest-ProjectReaderTests-257919573 None] Acquiring lock "cinder-30f539ea-9135-4a8b-a0b8-ec813b49081e-delete_volume" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:39:49 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-79f9dbac-d4b9-43f5-aab8-36f1faabaf30 tempest-ProjectReaderTests-257919573 None] Lock "cinder-30f539ea-9135-4a8b-a0b8-ec813b49081e-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:39:50 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-79f9dbac-d4b9-43f5-aab8-36f1faabaf30 tempest-ProjectReaderTests-257919573 None] Acquiring lock "cinder-quobyte-30f539ea-9135-4a8b-a0b8-ec813b49081e" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:39:50 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-79f9dbac-d4b9-43f5-aab8-36f1faabaf30 tempest-ProjectReaderTests-257919573 None] Lock "cinder-quobyte-30f539ea-9135-4a8b-a0b8-ec813b49081e" acquired by "delete_volume" :: waited 0.035s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:39:50 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c2f8ad6-e65f-416d-9d1f-af4b51c39213]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:39:50 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-79f9dbac-d4b9-43f5-aab8-36f1faabaf30 tempest-ProjectReaderTests-257919573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-30f539ea-9135-4a8b-a0b8-ec813b49081e {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:39:50 devstack sudo[115587]: pam_unix(sudo:session): session closed for user root Jul 31 12:39:50 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-7c1710d9-5645-4f1b-b628-0d5a9694b725 tempest-ProjectMemberTests-969865867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-9f5ad70b-9b79-463b-a8de-8b3efa6661a6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-9f5ad70b-9b79-463b-a8de-8b3efa6661a6.20fe14af-99a9-41d6-8628-0f55767b9967 1G" returned: 0 in 0.751s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:39:50 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-7c1710d9-5645-4f1b-b628-0d5a9694b725 tempest-ProjectMemberTests-969865867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9f5ad70b-9b79-463b-a8de-8b3efa6661a6 -F qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-9f5ad70b-9b79-463b-a8de-8b3efa6661a6.20fe14af-99a9-41d6-8628-0f55767b9967 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:39:50 devstack sudo[115606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9f5ad70b-9b79-463b-a8de-8b3efa6661a6 -F qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-9f5ad70b-9b79-463b-a8de-8b3efa6661a6.20fe14af-99a9-41d6-8628-0f55767b9967 Jul 31 12:39:50 devstack sudo[115606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:39:50 devstack sudo[115605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-30f539ea-9135-4a8b-a0b8-ec813b49081e Jul 31 12:39:50 devstack sudo[115605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:39:50 devstack sudo[115606]: pam_unix(sudo:session): session closed for user root Jul 31 12:39:50 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-7c1710d9-5645-4f1b-b628-0d5a9694b725 tempest-ProjectMemberTests-969865867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9f5ad70b-9b79-463b-a8de-8b3efa6661a6 -F qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-9f5ad70b-9b79-463b-a8de-8b3efa6661a6.20fe14af-99a9-41d6-8628-0f55767b9967" returned: 0 in 0.535s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:39:50 devstack cinder-volume[89182]: WARNING cinder.volume.drivers.remotefs [None req-7c1710d9-5645-4f1b-b628-0d5a9694b725 tempest-ProjectMemberTests-969865867 None] /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-9f5ad70b-9b79-463b-a8de-8b3efa6661a6.20fe14af-99a9-41d6-8628-0f55767b9967 is being set with open permissions: ugo+rw Jul 31 12:39:50 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-7c1710d9-5645-4f1b-b628-0d5a9694b725 tempest-ProjectMemberTests-969865867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-9f5ad70b-9b79-463b-a8de-8b3efa6661a6.20fe14af-99a9-41d6-8628-0f55767b9967 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:39:50 devstack sudo[115619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-9f5ad70b-9b79-463b-a8de-8b3efa6661a6.20fe14af-99a9-41d6-8628-0f55767b9967 Jul 31 12:39:50 devstack sudo[115619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:39:50 devstack sudo[115605]: pam_unix(sudo:session): session closed for user root Jul 31 12:39:50 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-79f9dbac-d4b9-43f5-aab8-36f1faabaf30 tempest-ProjectReaderTests-257919573 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-30f539ea-9135-4a8b-a0b8-ec813b49081e" returned: 0 in 0.791s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:39:50 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-79f9dbac-d4b9-43f5-aab8-36f1faabaf30 tempest-ProjectReaderTests-257919573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-30f539ea-9135-4a8b-a0b8-ec813b49081e {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:39:50 devstack sudo[115629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-30f539ea-9135-4a8b-a0b8-ec813b49081e Jul 31 12:39:50 devstack sudo[115629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:39:51 devstack sudo[115619]: pam_unix(sudo:session): session closed for user root Jul 31 12:39:51 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-7c1710d9-5645-4f1b-b628-0d5a9694b725 tempest-ProjectMemberTests-969865867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-9f5ad70b-9b79-463b-a8de-8b3efa6661a6.20fe14af-99a9-41d6-8628-0f55767b9967" returned: 0 in 0.335s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:39:51 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-7c1710d9-5645-4f1b-b628-0d5a9694b725 tempest-ProjectMemberTests-969865867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-9f5ad70b-9b79-463b-a8de-8b3efa6661a6.info {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:39:51 devstack sudo[115636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-9f5ad70b-9b79-463b-a8de-8b3efa6661a6.info Jul 31 12:39:51 devstack sudo[115636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:39:51 devstack sudo[115629]: pam_unix(sudo:session): session closed for user root Jul 31 12:39:51 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-79f9dbac-d4b9-43f5-aab8-36f1faabaf30 tempest-ProjectReaderTests-257919573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-30f539ea-9135-4a8b-a0b8-ec813b49081e" returned: 0 in 0.386s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:39:51 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-79f9dbac-d4b9-43f5-aab8-36f1faabaf30 tempest-ProjectReaderTests-257919573 None] Lock "cinder-quobyte-30f539ea-9135-4a8b-a0b8-ec813b49081e" released by "delete_volume" :: held 1.258s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:39:51 devstack cinder-volume[89182]: DEBUG cinder.quota [None req-79f9dbac-d4b9-43f5-aab8-36f1faabaf30 tempest-ProjectReaderTests-257919573 None] Created reservations ['01a1779f-5430-4d4a-bd2d-850ce020fe94', '4075cb97-7536-4e80-b8f3-a1c4e8354c6b', '79657dd1-72f2-4a6a-9bba-b1d6a6085cc5', '226cdd28-0eb0-491e-b33f-fb84ed98c77d'] {{(pid=89182) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 12:39:51 devstack sudo[115636]: pam_unix(sudo:session): session closed for user root Jul 31 12:39:51 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-7c1710d9-5645-4f1b-b628-0d5a9694b725 tempest-ProjectMemberTests-969865867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-9f5ad70b-9b79-463b-a8de-8b3efa6661a6.info" returned: 0 in 0.470s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:39:51 devstack cinder-volume[89182]: WARNING cinder.volume.drivers.remotefs [None req-7c1710d9-5645-4f1b-b628-0d5a9694b725 tempest-ProjectMemberTests-969865867 None] /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-9f5ad70b-9b79-463b-a8de-8b3efa6661a6.info is being set with open permissions: ugo+rw Jul 31 12:39:51 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-7c1710d9-5645-4f1b-b628-0d5a9694b725 tempest-ProjectMemberTests-969865867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-9f5ad70b-9b79-463b-a8de-8b3efa6661a6.info {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:39:51 devstack cinder-volume[89182]: INFO cinder.volume.manager [req-989e28ce-c387-429f-aefd-03b6463620b3 req-4c8008fb-62cc-4be8-b46f-c16c503ee685 tempest-SnapshotDataIntegrityTests-898447071 None] Terminate volume connection completed successfully. Jul 31 12:39:51 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [req-989e28ce-c387-429f-aefd-03b6463620b3 req-4c8008fb-62cc-4be8-b46f-c16c503ee685 tempest-SnapshotDataIntegrityTests-898447071 None] Deleting attachment ca43cc1c-7599-469a-babf-31b5839b4c16. {{(pid=89182) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 31 12:39:51 devstack sudo[115670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-9f5ad70b-9b79-463b-a8de-8b3efa6661a6.info Jul 31 12:39:51 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-79f9dbac-d4b9-43f5-aab8-36f1faabaf30 tempest-ProjectReaderTests-257919573 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:39:51 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-79f9dbac-d4b9-43f5-aab8-36f1faabaf30 tempest-ProjectReaderTests-257919573 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:39:51 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-79f9dbac-d4b9-43f5-aab8-36f1faabaf30 tempest-ProjectReaderTests-257919573 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:39:51 devstack sudo[115670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:39:51 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-79f9dbac-d4b9-43f5-aab8-36f1faabaf30 tempest-ProjectReaderTests-257919573 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:39:51 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-79f9dbac-d4b9-43f5-aab8-36f1faabaf30 tempest-ProjectReaderTests-257919573 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:39:51 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-79f9dbac-d4b9-43f5-aab8-36f1faabaf30 tempest-ProjectReaderTests-257919573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:39:51 devstack sudo[115672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 Jul 31 12:39:51 devstack sudo[115672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:39:51 devstack sudo[115670]: pam_unix(sudo:session): session closed for user root Jul 31 12:39:51 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-7c1710d9-5645-4f1b-b628-0d5a9694b725 tempest-ProjectMemberTests-969865867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-9f5ad70b-9b79-463b-a8de-8b3efa6661a6.info" returned: 0 in 0.341s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:39:51 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-7c1710d9-5645-4f1b-b628-0d5a9694b725 tempest-ProjectMemberTests-969865867 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.132s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:39:51 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-7c1710d9-5645-4f1b-b628-0d5a9694b725 tempest-ProjectMemberTests-969865867 None] Create snapshot completed successfully Jul 31 12:39:51 devstack sudo[115672]: pam_unix(sudo:session): session closed for user root Jul 31 12:39:51 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-79f9dbac-d4b9-43f5-aab8-36f1faabaf30 tempest-ProjectReaderTests-257919573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2" returned: 0 in 0.384s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:39:51 devstack cinder-volume[89182]: DEBUG cinder.manager [None req-79f9dbac-d4b9-43f5-aab8-36f1faabaf30 tempest-ProjectReaderTests-257919573 None] Notifying Schedulers of capabilities ... {{(pid=89182) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 12:39:51 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-79f9dbac-d4b9-43f5-aab8-36f1faabaf30 tempest-ProjectReaderTests-257919573 None] Deleted volume successfully. Jul 31 12:39:52 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-79f9dbac-d4b9-43f5-aab8-36f1faabaf30 tempest-ProjectReaderTests-257919573 None] Lock "cinder-30f539ea-9135-4a8b-a0b8-ec813b49081e-delete_volume" released by "delete_volume" :: held 2.045s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:39:52 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-9239fc5c-698b-4696-ba4b-511c7b64071a tempest-SnapshotDataIntegrityTests-898447071 None] Acquiring lock "cinder-1606dd1e-9b98-4d3c-81f6-f0dabda9a824-delete_volume" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:39:52 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-9239fc5c-698b-4696-ba4b-511c7b64071a tempest-SnapshotDataIntegrityTests-898447071 None] Lock "cinder-1606dd1e-9b98-4d3c-81f6-f0dabda9a824-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:39:52 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-9239fc5c-698b-4696-ba4b-511c7b64071a tempest-SnapshotDataIntegrityTests-898447071 None] Acquiring lock "cinder-quobyte-1606dd1e-9b98-4d3c-81f6-f0dabda9a824" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:39:52 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-9239fc5c-698b-4696-ba4b-511c7b64071a tempest-SnapshotDataIntegrityTests-898447071 None] Lock "cinder-quobyte-1606dd1e-9b98-4d3c-81f6-f0dabda9a824" acquired by "delete_volume" :: waited 0.029s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:39:52 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[10ba46a8-1841-4f25-9619-458341ac7de6]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:39:52 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-9239fc5c-698b-4696-ba4b-511c7b64071a tempest-SnapshotDataIntegrityTests-898447071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-1606dd1e-9b98-4d3c-81f6-f0dabda9a824 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:39:52 devstack sudo[115676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-1606dd1e-9b98-4d3c-81f6-f0dabda9a824 Jul 31 12:39:52 devstack sudo[115676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:39:52 devstack sudo[115676]: pam_unix(sudo:session): session closed for user root Jul 31 12:39:52 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-9239fc5c-698b-4696-ba4b-511c7b64071a tempest-SnapshotDataIntegrityTests-898447071 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-1606dd1e-9b98-4d3c-81f6-f0dabda9a824" returned: 0 in 0.459s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:39:52 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-9239fc5c-698b-4696-ba4b-511c7b64071a tempest-SnapshotDataIntegrityTests-898447071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-1606dd1e-9b98-4d3c-81f6-f0dabda9a824 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:39:52 devstack sudo[115681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-1606dd1e-9b98-4d3c-81f6-f0dabda9a824 Jul 31 12:39:52 devstack sudo[115681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:39:52 devstack cinder-volume[89182]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc06ab3c-8ef5-4a6f-b4ee-ed17c4703baa tempest-ProjectReaderTests-257919573 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89182) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 12:39:52 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-cc06ab3c-8ef5-4a6f-b4ee-ed17c4703baa tempest-ProjectReaderTests-257919573 None] Flow 'volume_create_manager' (0f89ef2d-c662-4ec2-8a9e-29995d703e98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:39:52 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-cc06ab3c-8ef5-4a6f-b4ee-ed17c4703baa tempest-ProjectReaderTests-257919573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2cb1e25d-7bda-45ca-ac6b-db13671d641d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:39:52 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-cc06ab3c-8ef5-4a6f-b4ee-ed17c4703baa tempest-ProjectReaderTests-257919573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2cb1e25d-7bda-45ca-ac6b-db13671d641d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:39:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1903051791',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ac23209-8792-4372-9931-09c178b877af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d483d0fbf5b8400c9644641a3998fc7a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:39:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:39:53Z,use_quota=True,user_id='a9b630b0f0734c209a501194c68cc014',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:39:52 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-cc06ab3c-8ef5-4a6f-b4ee-ed17c4703baa tempest-ProjectReaderTests-257919573 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d24a0b4-1c94-47e4-82c3-17e6e78f2e13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:39:52 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-cc06ab3c-8ef5-4a6f-b4ee-ed17c4703baa tempest-ProjectReaderTests-257919573 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d24a0b4-1c94-47e4-82c3-17e6e78f2e13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:39:52 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-cc06ab3c-8ef5-4a6f-b4ee-ed17c4703baa tempest-ProjectReaderTests-257919573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9960547-c379-4971-a268-0d1224e6d58e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:39:52 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-cc06ab3c-8ef5-4a6f-b4ee-ed17c4703baa tempest-ProjectReaderTests-257919573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9960547-c379-4971-a268-0d1224e6d58e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1ac23209-8792-4372-9931-09c178b877af', 'volume_name': 'volume-1ac23209-8792-4372-9931-09c178b877af', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:39:53 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-cc06ab3c-8ef5-4a6f-b4ee-ed17c4703baa tempest-ProjectReaderTests-257919573 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d60a870-f4a5-4e7c-8e35-04a464276bb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:39:53 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-cc06ab3c-8ef5-4a6f-b4ee-ed17c4703baa tempest-ProjectReaderTests-257919573 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d60a870-f4a5-4e7c-8e35-04a464276bb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:39:53 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-cc06ab3c-8ef5-4a6f-b4ee-ed17c4703baa tempest-ProjectReaderTests-257919573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (077853b0-51a4-4a4a-95d9-d9cf7b553ebf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:39:53 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-cc06ab3c-8ef5-4a6f-b4ee-ed17c4703baa tempest-ProjectReaderTests-257919573 None] Volume 1ac23209-8792-4372-9931-09c178b877af: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1ac23209-8792-4372-9931-09c178b877af', 'volume_size': 1} Jul 31 12:39:53 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-cc06ab3c-8ef5-4a6f-b4ee-ed17c4703baa tempest-ProjectReaderTests-257919573 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:39:53 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-cc06ab3c-8ef5-4a6f-b4ee-ed17c4703baa tempest-ProjectReaderTests-257919573 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:39:53 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-cc06ab3c-8ef5-4a6f-b4ee-ed17c4703baa tempest-ProjectReaderTests-257919573 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:39:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1903051791',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ac23209-8792-4372-9931-09c178b877af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d483d0fbf5b8400c9644641a3998fc7a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:39:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:39:53Z,use_quota=True,user_id='a9b630b0f0734c209a501194c68cc014',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)}" {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 12:39:53 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-cc06ab3c-8ef5-4a6f-b4ee-ed17c4703baa tempest-ProjectReaderTests-257919573 None] Creating volume 1ac23209-8792-4372-9931-09c178b877af {{(pid=89182) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 12:39:53 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-cc06ab3c-8ef5-4a6f-b4ee-ed17c4703baa tempest-ProjectReaderTests-257919573 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:39:53 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-cc06ab3c-8ef5-4a6f-b4ee-ed17c4703baa tempest-ProjectReaderTests-257919573 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:39:53 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-cc06ab3c-8ef5-4a6f-b4ee-ed17c4703baa tempest-ProjectReaderTests-257919573 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:39:53 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-cc06ab3c-8ef5-4a6f-b4ee-ed17c4703baa tempest-ProjectReaderTests-257919573 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:39:53 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-cc06ab3c-8ef5-4a6f-b4ee-ed17c4703baa tempest-ProjectReaderTests-257919573 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:39:53 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-cc06ab3c-8ef5-4a6f-b4ee-ed17c4703baa tempest-ProjectReaderTests-257919573 None] Selected osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 as target Quobyte volume. {{(pid=89182) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 12:39:53 devstack cinder-volume[89182]: INFO cinder.volume.drivers.remotefs [None req-cc06ab3c-8ef5-4a6f-b4ee-ed17c4703baa tempest-ProjectReaderTests-257919573 None] casted to osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 Jul 31 12:39:53 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-cc06ab3c-8ef5-4a6f-b4ee-ed17c4703baa tempest-ProjectReaderTests-257919573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-1ac23209-8792-4372-9931-09c178b877af 1073741824 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:39:53 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-2f65f736-b2fb-4f33-854a-506c777dd1e1 tempest-ProjectMemberTests-969865867 None] Acquiring lock "cinder-20fe14af-99a9-41d6-8628-0f55767b9967-delete_snapshot" by "delete_snapshot" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:39:53 devstack sudo[115684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-1ac23209-8792-4372-9931-09c178b877af 1073741824 Jul 31 12:39:53 devstack sudo[115684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:39:53 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-2f65f736-b2fb-4f33-854a-506c777dd1e1 tempest-ProjectMemberTests-969865867 None] Lock "cinder-20fe14af-99a9-41d6-8628-0f55767b9967-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:39:53 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-2f65f736-b2fb-4f33-854a-506c777dd1e1 tempest-ProjectMemberTests-969865867 None] Acquiring lock "cinder-quobyte-9f5ad70b-9b79-463b-a8de-8b3efa6661a6" by "delete_snapshot" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:39:53 devstack sudo[115681]: pam_unix(sudo:session): session closed for user root Jul 31 12:39:53 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-9239fc5c-698b-4696-ba4b-511c7b64071a tempest-SnapshotDataIntegrityTests-898447071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-1606dd1e-9b98-4d3c-81f6-f0dabda9a824" returned: 0 in 0.386s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:39:53 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-2f65f736-b2fb-4f33-854a-506c777dd1e1 tempest-ProjectMemberTests-969865867 None] Lock "cinder-quobyte-9f5ad70b-9b79-463b-a8de-8b3efa6661a6" acquired by "delete_snapshot" :: waited 0.022s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:39:53 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-2f65f736-b2fb-4f33-854a-506c777dd1e1 tempest-ProjectMemberTests-969865867 None] Acquiring lock "cinder-quobyte-20fe14af-99a9-41d6-8628-0f55767b9967" by "_delete_snapshot" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:39:53 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-9239fc5c-698b-4696-ba4b-511c7b64071a tempest-SnapshotDataIntegrityTests-898447071 None] Lock "cinder-quobyte-1606dd1e-9b98-4d3c-81f6-f0dabda9a824" released by "delete_volume" :: held 0.904s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:39:53 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-2f65f736-b2fb-4f33-854a-506c777dd1e1 tempest-ProjectMemberTests-969865867 None] Lock "cinder-quobyte-20fe14af-99a9-41d6-8628-0f55767b9967" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:39:53 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-2f65f736-b2fb-4f33-854a-506c777dd1e1 tempest-ProjectMemberTests-969865867 None] Deleting offline snapshot 20fe14af-99a9-41d6-8628-0f55767b9967 of volume 9f5ad70b-9b79-463b-a8de-8b3efa6661a6 {{(pid=89182) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 31 12:39:53 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-2f65f736-b2fb-4f33-854a-506c777dd1e1 tempest-ProjectMemberTests-969865867 None] snapshot_file for this snap is: volume-9f5ad70b-9b79-463b-a8de-8b3efa6661a6.20fe14af-99a9-41d6-8628-0f55767b9967 {{(pid=89182) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 31 12:39:53 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[51c9ab22-4e24-4a12-9dc5-a0f1998507e2]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:39:53 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-2f65f736-b2fb-4f33-854a-506c777dd1e1 tempest-ProjectMemberTests-969865867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-9f5ad70b-9b79-463b-a8de-8b3efa6661a6.20fe14af-99a9-41d6-8628-0f55767b9967 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:39:53 devstack cinder-volume[89182]: DEBUG cinder.quota [None req-9239fc5c-698b-4696-ba4b-511c7b64071a tempest-SnapshotDataIntegrityTests-898447071 None] Created reservations ['1e2abaeb-9020-44cf-8fc1-b686f7021fd7', '16aed0da-7a5b-49a1-a349-149b5df39f64', '5545cfbf-074d-44f7-9173-a36d7078e60e', '98f731bf-1a9a-403f-baa5-c3e4cf8a0961'] {{(pid=89182) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 12:39:53 devstack sudo[115686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-9f5ad70b-9b79-463b-a8de-8b3efa6661a6.20fe14af-99a9-41d6-8628-0f55767b9967 Jul 31 12:39:53 devstack sudo[115686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:39:53 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-9239fc5c-698b-4696-ba4b-511c7b64071a tempest-SnapshotDataIntegrityTests-898447071 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:39:53 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-9239fc5c-698b-4696-ba4b-511c7b64071a tempest-SnapshotDataIntegrityTests-898447071 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:39:53 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-9239fc5c-698b-4696-ba4b-511c7b64071a tempest-SnapshotDataIntegrityTests-898447071 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:39:53 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-9239fc5c-698b-4696-ba4b-511c7b64071a tempest-SnapshotDataIntegrityTests-898447071 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:39:53 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-9239fc5c-698b-4696-ba4b-511c7b64071a tempest-SnapshotDataIntegrityTests-898447071 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:39:53 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-9239fc5c-698b-4696-ba4b-511c7b64071a tempest-SnapshotDataIntegrityTests-898447071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:39:53 devstack sudo[115688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 Jul 31 12:39:53 devstack sudo[115688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:39:53 devstack sudo[115686]: pam_unix(sudo:session): session closed for user root Jul 31 12:39:53 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-2f65f736-b2fb-4f33-854a-506c777dd1e1 tempest-ProjectMemberTests-969865867 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-9f5ad70b-9b79-463b-a8de-8b3efa6661a6.20fe14af-99a9-41d6-8628-0f55767b9967" returned: 0 in 0.509s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:39:53 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-2f65f736-b2fb-4f33-854a-506c777dd1e1 tempest-ProjectMemberTests-969865867 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9f5ad70b-9b79-463b-a8de-8b3efa6661a6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89182) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 12:39:53 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae4f97a7-8108-45e9-92c5-059a8b5c8944]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:39:53 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-2f65f736-b2fb-4f33-854a-506c777dd1e1 tempest-ProjectMemberTests-969865867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-9f5ad70b-9b79-463b-a8de-8b3efa6661a6 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:39:53 devstack sudo[115684]: pam_unix(sudo:session): session closed for user root Jul 31 12:39:53 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-cc06ab3c-8ef5-4a6f-b4ee-ed17c4703baa tempest-ProjectReaderTests-257919573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-1ac23209-8792-4372-9931-09c178b877af 1073741824" returned: 0 in 0.777s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:39:53 devstack sudo[115688]: pam_unix(sudo:session): session closed for user root Jul 31 12:39:53 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-9239fc5c-698b-4696-ba4b-511c7b64071a tempest-SnapshotDataIntegrityTests-898447071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2" returned: 0 in 0.463s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:39:53 devstack cinder-volume[89182]: DEBUG cinder.manager [None req-9239fc5c-698b-4696-ba4b-511c7b64071a tempest-SnapshotDataIntegrityTests-898447071 None] Notifying Schedulers of capabilities ... {{(pid=89182) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 12:39:53 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-9239fc5c-698b-4696-ba4b-511c7b64071a tempest-SnapshotDataIntegrityTests-898447071 None] Deleted volume successfully. Jul 31 12:39:53 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-9239fc5c-698b-4696-ba4b-511c7b64071a tempest-SnapshotDataIntegrityTests-898447071 None] Lock "cinder-1606dd1e-9b98-4d3c-81f6-f0dabda9a824-delete_volume" released by "delete_volume" :: held 1.736s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:39:53 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-cc06ab3c-8ef5-4a6f-b4ee-ed17c4703baa tempest-ProjectReaderTests-257919573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-1ac23209-8792-4372-9931-09c178b877af {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:39:53 devstack sudo[115698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-9f5ad70b-9b79-463b-a8de-8b3efa6661a6 Jul 31 12:39:53 devstack sudo[115698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:39:53 devstack sudo[115699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-1ac23209-8792-4372-9931-09c178b877af Jul 31 12:39:53 devstack sudo[115699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:39:54 devstack sudo[115698]: pam_unix(sudo:session): session closed for user root Jul 31 12:39:54 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-2f65f736-b2fb-4f33-854a-506c777dd1e1 tempest-ProjectMemberTests-969865867 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-9f5ad70b-9b79-463b-a8de-8b3efa6661a6" returned: 0 in 0.438s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:39:54 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-2f65f736-b2fb-4f33-854a-506c777dd1e1 tempest-ProjectMemberTests-969865867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-9f5ad70b-9b79-463b-a8de-8b3efa6661a6.20fe14af-99a9-41d6-8628-0f55767b9967 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:39:54 devstack sudo[115699]: pam_unix(sudo:session): session closed for user root Jul 31 12:39:54 devstack sudo[115706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-9f5ad70b-9b79-463b-a8de-8b3efa6661a6.20fe14af-99a9-41d6-8628-0f55767b9967 Jul 31 12:39:54 devstack sudo[115706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:39:54 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-cc06ab3c-8ef5-4a6f-b4ee-ed17c4703baa tempest-ProjectReaderTests-257919573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-1ac23209-8792-4372-9931-09c178b877af" returned: 0 in 0.392s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:39:54 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-cc06ab3c-8ef5-4a6f-b4ee-ed17c4703baa tempest-ProjectReaderTests-257919573 None] <== create_volume: return (1255ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'} {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 12:39:54 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-cc06ab3c-8ef5-4a6f-b4ee-ed17c4703baa tempest-ProjectReaderTests-257919573 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.262s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:39:54 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-cc06ab3c-8ef5-4a6f-b4ee-ed17c4703baa tempest-ProjectReaderTests-257919573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (077853b0-51a4-4a4a-95d9-d9cf7b553ebf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1ac23209-8792-4372-9931-09c178b877af', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:39:54 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-cc06ab3c-8ef5-4a6f-b4ee-ed17c4703baa tempest-ProjectReaderTests-257919573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b9b3d93-84c5-4100-918e-24c7b0377eef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:39:54 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-cc06ab3c-8ef5-4a6f-b4ee-ed17c4703baa tempest-ProjectReaderTests-257919573 None] Volume volume-1ac23209-8792-4372-9931-09c178b877af (1ac23209-8792-4372-9931-09c178b877af): created successfully Jul 31 12:39:54 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-cc06ab3c-8ef5-4a6f-b4ee-ed17c4703baa tempest-ProjectReaderTests-257919573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b9b3d93-84c5-4100-918e-24c7b0377eef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:39:54 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-cc06ab3c-8ef5-4a6f-b4ee-ed17c4703baa tempest-ProjectReaderTests-257919573 None] Flow 'volume_create_manager' (0f89ef2d-c662-4ec2-8a9e-29995d703e98) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:39:54 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-cc06ab3c-8ef5-4a6f-b4ee-ed17c4703baa tempest-ProjectReaderTests-257919573 None] Created volume successfully. Jul 31 12:39:54 devstack cinder-volume[89182]: DEBUG cinder.volume.flows.manager.create_volume [None req-948b2b90-82bf-48d7-8678-875cf187dcc0 tempest-SnapshotDependencyTests-1140392806 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89182) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 12:39:54 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-948b2b90-82bf-48d7-8678-875cf187dcc0 tempest-SnapshotDependencyTests-1140392806 None] Flow 'volume_create_manager' (49de6508-bcfc-47ec-96c1-efef4eeb7e09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:39:54 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-948b2b90-82bf-48d7-8678-875cf187dcc0 tempest-SnapshotDependencyTests-1140392806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f4d0bfa-f318-4586-b66a-efb861104893) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:39:54 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-948b2b90-82bf-48d7-8678-875cf187dcc0 tempest-SnapshotDependencyTests-1140392806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f4d0bfa-f318-4586-b66a-efb861104893) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:39:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-889494750',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d526e0b0-c57b-4ed1-98bd-b7a67d6a8c3f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='401690a884644c91b96be0f10bb14fe1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:39:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:39:54Z,use_quota=True,user_id='c8fb4712b08e4c989107382444e1e171',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:39:54 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-948b2b90-82bf-48d7-8678-875cf187dcc0 tempest-SnapshotDependencyTests-1140392806 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00d76ab7-9d2e-4a5f-9e78-ee9afe488296) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:39:54 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-948b2b90-82bf-48d7-8678-875cf187dcc0 tempest-SnapshotDependencyTests-1140392806 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00d76ab7-9d2e-4a5f-9e78-ee9afe488296) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:39:54 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-948b2b90-82bf-48d7-8678-875cf187dcc0 tempest-SnapshotDependencyTests-1140392806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f80db95c-c13a-463a-b972-6ba86fe68439) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:39:54 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-948b2b90-82bf-48d7-8678-875cf187dcc0 tempest-SnapshotDependencyTests-1140392806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f80db95c-c13a-463a-b972-6ba86fe68439) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd526e0b0-c57b-4ed1-98bd-b7a67d6a8c3f', 'volume_name': 'volume-d526e0b0-c57b-4ed1-98bd-b7a67d6a8c3f', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:39:54 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-948b2b90-82bf-48d7-8678-875cf187dcc0 tempest-SnapshotDependencyTests-1140392806 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2529b9d-83df-45f5-ad2e-05454cc41e6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:39:54 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-948b2b90-82bf-48d7-8678-875cf187dcc0 tempest-SnapshotDependencyTests-1140392806 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2529b9d-83df-45f5-ad2e-05454cc41e6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:39:54 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-948b2b90-82bf-48d7-8678-875cf187dcc0 tempest-SnapshotDependencyTests-1140392806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3188c604-9db7-4d7a-a13a-9d647a6f1a1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:39:54 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-948b2b90-82bf-48d7-8678-875cf187dcc0 tempest-SnapshotDependencyTests-1140392806 None] Volume d526e0b0-c57b-4ed1-98bd-b7a67d6a8c3f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d526e0b0-c57b-4ed1-98bd-b7a67d6a8c3f', 'volume_size': 1} Jul 31 12:39:54 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-948b2b90-82bf-48d7-8678-875cf187dcc0 tempest-SnapshotDependencyTests-1140392806 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:39:54 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-948b2b90-82bf-48d7-8678-875cf187dcc0 tempest-SnapshotDependencyTests-1140392806 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:39:54 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-948b2b90-82bf-48d7-8678-875cf187dcc0 tempest-SnapshotDependencyTests-1140392806 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:39:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-889494750',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d526e0b0-c57b-4ed1-98bd-b7a67d6a8c3f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='401690a884644c91b96be0f10bb14fe1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:39:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:39:54Z,use_quota=True,user_id='c8fb4712b08e4c989107382444e1e171',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)}" {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 12:39:54 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-948b2b90-82bf-48d7-8678-875cf187dcc0 tempest-SnapshotDependencyTests-1140392806 None] Creating volume d526e0b0-c57b-4ed1-98bd-b7a67d6a8c3f {{(pid=89182) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 12:39:54 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-948b2b90-82bf-48d7-8678-875cf187dcc0 tempest-SnapshotDependencyTests-1140392806 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:39:54 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-948b2b90-82bf-48d7-8678-875cf187dcc0 tempest-SnapshotDependencyTests-1140392806 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:39:54 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-948b2b90-82bf-48d7-8678-875cf187dcc0 tempest-SnapshotDependencyTests-1140392806 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:39:54 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-948b2b90-82bf-48d7-8678-875cf187dcc0 tempest-SnapshotDependencyTests-1140392806 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:39:54 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-948b2b90-82bf-48d7-8678-875cf187dcc0 tempest-SnapshotDependencyTests-1140392806 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:39:54 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-948b2b90-82bf-48d7-8678-875cf187dcc0 tempest-SnapshotDependencyTests-1140392806 None] Selected osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 as target Quobyte volume. {{(pid=89182) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 12:39:54 devstack cinder-volume[89182]: INFO cinder.volume.drivers.remotefs [None req-948b2b90-82bf-48d7-8678-875cf187dcc0 tempest-SnapshotDependencyTests-1140392806 None] casted to osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 Jul 31 12:39:54 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-948b2b90-82bf-48d7-8678-875cf187dcc0 tempest-SnapshotDependencyTests-1140392806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-d526e0b0-c57b-4ed1-98bd-b7a67d6a8c3f 1073741824 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:39:54 devstack sudo[115711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-d526e0b0-c57b-4ed1-98bd-b7a67d6a8c3f 1073741824 Jul 31 12:39:54 devstack sudo[115711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:39:54 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-2d1b2882-ba96-41c9-acd3-03fc14926753 tempest-SnapshotDataIntegrityTests-898447071 None] Acquiring lock "cinder-490ce77d-87a2-440b-a48f-e2d30d1405da-delete_volume" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:39:54 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-2d1b2882-ba96-41c9-acd3-03fc14926753 tempest-SnapshotDataIntegrityTests-898447071 None] Lock "cinder-490ce77d-87a2-440b-a48f-e2d30d1405da-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:39:54 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-2d1b2882-ba96-41c9-acd3-03fc14926753 tempest-SnapshotDataIntegrityTests-898447071 None] Acquiring lock "cinder-quobyte-490ce77d-87a2-440b-a48f-e2d30d1405da" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:39:54 devstack sudo[115706]: pam_unix(sudo:session): session closed for user root Jul 31 12:39:54 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-2f65f736-b2fb-4f33-854a-506c777dd1e1 tempest-ProjectMemberTests-969865867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-9f5ad70b-9b79-463b-a8de-8b3efa6661a6.20fe14af-99a9-41d6-8628-0f55767b9967" returned: 0 in 0.473s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:39:54 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-2f65f736-b2fb-4f33-854a-506c777dd1e1 tempest-ProjectMemberTests-969865867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-9f5ad70b-9b79-463b-a8de-8b3efa6661a6.20fe14af-99a9-41d6-8628-0f55767b9967 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:39:54 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-2d1b2882-ba96-41c9-acd3-03fc14926753 tempest-SnapshotDataIntegrityTests-898447071 None] Lock "cinder-quobyte-490ce77d-87a2-440b-a48f-e2d30d1405da" acquired by "delete_volume" :: waited 0.038s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:39:54 devstack sudo[115713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-9f5ad70b-9b79-463b-a8de-8b3efa6661a6.20fe14af-99a9-41d6-8628-0f55767b9967 Jul 31 12:39:54 devstack sudo[115713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:39:54 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed7bfa98-75b5-4dae-8596-13a1ceae0619]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:39:54 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-2d1b2882-ba96-41c9-acd3-03fc14926753 tempest-SnapshotDataIntegrityTests-898447071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-490ce77d-87a2-440b-a48f-e2d30d1405da {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:39:54 devstack sudo[115715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-490ce77d-87a2-440b-a48f-e2d30d1405da Jul 31 12:39:54 devstack sudo[115715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:39:54 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-e7d761a5-0ba2-4e21-90fd-15be311b2fc5 tempest-ProjectReaderTests-257919573 None] Acquiring lock "cinder-1ac23209-8792-4372-9931-09c178b877af-delete_volume" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:39:55 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-e7d761a5-0ba2-4e21-90fd-15be311b2fc5 tempest-ProjectReaderTests-257919573 None] Lock "cinder-1ac23209-8792-4372-9931-09c178b877af-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:39:55 devstack sudo[115713]: pam_unix(sudo:session): session closed for user root Jul 31 12:39:55 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-2f65f736-b2fb-4f33-854a-506c777dd1e1 tempest-ProjectMemberTests-969865867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-9f5ad70b-9b79-463b-a8de-8b3efa6661a6.20fe14af-99a9-41d6-8628-0f55767b9967" returned: 0 in 0.331s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:39:55 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-2f65f736-b2fb-4f33-854a-506c777dd1e1 tempest-ProjectMemberTests-969865867 None] Lock "cinder-quobyte-20fe14af-99a9-41d6-8628-0f55767b9967" released by "_delete_snapshot" :: held 1.929s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:39:55 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-2f65f736-b2fb-4f33-854a-506c777dd1e1 tempest-ProjectMemberTests-969865867 None] Lock "cinder-quobyte-9f5ad70b-9b79-463b-a8de-8b3efa6661a6" released by "delete_snapshot" :: held 1.973s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:39:55 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-e7d761a5-0ba2-4e21-90fd-15be311b2fc5 tempest-ProjectReaderTests-257919573 None] Acquiring lock "cinder-quobyte-1ac23209-8792-4372-9931-09c178b877af" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:39:55 devstack sudo[115711]: pam_unix(sudo:session): session closed for user root Jul 31 12:39:55 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-948b2b90-82bf-48d7-8678-875cf187dcc0 tempest-SnapshotDependencyTests-1140392806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-d526e0b0-c57b-4ed1-98bd-b7a67d6a8c3f 1073741824" returned: 0 in 0.584s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:39:55 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-e7d761a5-0ba2-4e21-90fd-15be311b2fc5 tempest-ProjectReaderTests-257919573 None] Lock "cinder-quobyte-1ac23209-8792-4372-9931-09c178b877af" acquired by "delete_volume" :: waited 0.028s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:39:55 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[569fc35e-7f64-4da4-b875-7b1c5406f89f]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:39:55 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-e7d761a5-0ba2-4e21-90fd-15be311b2fc5 tempest-ProjectReaderTests-257919573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-1ac23209-8792-4372-9931-09c178b877af {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:39:55 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-948b2b90-82bf-48d7-8678-875cf187dcc0 tempest-SnapshotDependencyTests-1140392806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-d526e0b0-c57b-4ed1-98bd-b7a67d6a8c3f {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:39:55 devstack sudo[115725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-d526e0b0-c57b-4ed1-98bd-b7a67d6a8c3f Jul 31 12:39:55 devstack sudo[115725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:39:55 devstack cinder-volume[89182]: DEBUG cinder.quota [None req-2f65f736-b2fb-4f33-854a-506c777dd1e1 tempest-ProjectMemberTests-969865867 None] Created reservations ['7b7aa7b7-f2b1-43ed-bb3e-4d82bf0dcad4', '86568b05-8968-463a-a16b-983f94ee412a', '52799f9b-571b-4cb4-89e7-0167babfd75f', '1f113393-1079-4071-a1d5-f7d797164635'] {{(pid=89182) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 12:39:55 devstack sudo[115715]: pam_unix(sudo:session): session closed for user root Jul 31 12:39:55 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-2d1b2882-ba96-41c9-acd3-03fc14926753 tempest-SnapshotDataIntegrityTests-898447071 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-490ce77d-87a2-440b-a48f-e2d30d1405da" returned: 0 in 0.525s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:39:55 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-2d1b2882-ba96-41c9-acd3-03fc14926753 tempest-SnapshotDataIntegrityTests-898447071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-490ce77d-87a2-440b-a48f-e2d30d1405da {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:39:55 devstack sudo[115722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-1ac23209-8792-4372-9931-09c178b877af Jul 31 12:39:55 devstack sudo[115722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:39:55 devstack sudo[115728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-490ce77d-87a2-440b-a48f-e2d30d1405da Jul 31 12:39:55 devstack sudo[115728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:39:55 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-2f65f736-b2fb-4f33-854a-506c777dd1e1 tempest-ProjectMemberTests-969865867 None] Delete snapshot completed successfully. Jul 31 12:39:55 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-2f65f736-b2fb-4f33-854a-506c777dd1e1 tempest-ProjectMemberTests-969865867 None] Lock "cinder-20fe14af-99a9-41d6-8628-0f55767b9967-delete_snapshot" released by "delete_snapshot" :: held 2.252s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:39:55 devstack sudo[115725]: pam_unix(sudo:session): session closed for user root Jul 31 12:39:55 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-948b2b90-82bf-48d7-8678-875cf187dcc0 tempest-SnapshotDependencyTests-1140392806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-d526e0b0-c57b-4ed1-98bd-b7a67d6a8c3f" returned: 0 in 0.284s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:39:55 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-948b2b90-82bf-48d7-8678-875cf187dcc0 tempest-SnapshotDependencyTests-1140392806 None] <== create_volume: return (954ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'} {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 12:39:55 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-948b2b90-82bf-48d7-8678-875cf187dcc0 tempest-SnapshotDependencyTests-1140392806 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.957s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:39:55 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-948b2b90-82bf-48d7-8678-875cf187dcc0 tempest-SnapshotDependencyTests-1140392806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3188c604-9db7-4d7a-a13a-9d647a6f1a1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d526e0b0-c57b-4ed1-98bd-b7a67d6a8c3f', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:39:55 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-948b2b90-82bf-48d7-8678-875cf187dcc0 tempest-SnapshotDependencyTests-1140392806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6de0954c-a09e-4695-9501-4960f2450fab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:39:55 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-948b2b90-82bf-48d7-8678-875cf187dcc0 tempest-SnapshotDependencyTests-1140392806 None] Volume volume-d526e0b0-c57b-4ed1-98bd-b7a67d6a8c3f (d526e0b0-c57b-4ed1-98bd-b7a67d6a8c3f): created successfully Jul 31 12:39:55 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-948b2b90-82bf-48d7-8678-875cf187dcc0 tempest-SnapshotDependencyTests-1140392806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6de0954c-a09e-4695-9501-4960f2450fab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:39:55 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-948b2b90-82bf-48d7-8678-875cf187dcc0 tempest-SnapshotDependencyTests-1140392806 None] Flow 'volume_create_manager' (49de6508-bcfc-47ec-96c1-efef4eeb7e09) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:39:55 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-948b2b90-82bf-48d7-8678-875cf187dcc0 tempest-SnapshotDependencyTests-1140392806 None] Created volume successfully. Jul 31 12:39:55 devstack sudo[115728]: pam_unix(sudo:session): session closed for user root Jul 31 12:39:55 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-2d1b2882-ba96-41c9-acd3-03fc14926753 tempest-SnapshotDataIntegrityTests-898447071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-490ce77d-87a2-440b-a48f-e2d30d1405da" returned: 0 in 0.284s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:39:55 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-2d1b2882-ba96-41c9-acd3-03fc14926753 tempest-SnapshotDataIntegrityTests-898447071 None] Lock "cinder-quobyte-490ce77d-87a2-440b-a48f-e2d30d1405da" released by "delete_volume" :: held 0.864s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:39:55 devstack sudo[115722]: pam_unix(sudo:session): session closed for user root Jul 31 12:39:55 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-e7d761a5-0ba2-4e21-90fd-15be311b2fc5 tempest-ProjectReaderTests-257919573 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-1ac23209-8792-4372-9931-09c178b877af" returned: 0 in 0.450s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:39:55 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-e7d761a5-0ba2-4e21-90fd-15be311b2fc5 tempest-ProjectReaderTests-257919573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-1ac23209-8792-4372-9931-09c178b877af {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:39:55 devstack sudo[115736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-1ac23209-8792-4372-9931-09c178b877af Jul 31 12:39:55 devstack sudo[115736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:39:55 devstack cinder-volume[89182]: DEBUG cinder.quota [None req-2d1b2882-ba96-41c9-acd3-03fc14926753 tempest-SnapshotDataIntegrityTests-898447071 None] Created reservations ['840cbc4b-df97-4d4f-8a97-6e8ef37dc809', 'bd42aad1-244e-4615-90a6-31b528a7165c', '74fd8896-a525-4f39-8a04-276e3faca5b3', '451c1de5-631e-4dae-b890-141b8d0e9d17'] {{(pid=89182) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 12:39:55 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-2d1b2882-ba96-41c9-acd3-03fc14926753 tempest-SnapshotDataIntegrityTests-898447071 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:39:55 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-2d1b2882-ba96-41c9-acd3-03fc14926753 tempest-SnapshotDataIntegrityTests-898447071 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:39:55 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-2d1b2882-ba96-41c9-acd3-03fc14926753 tempest-SnapshotDataIntegrityTests-898447071 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:39:55 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-2d1b2882-ba96-41c9-acd3-03fc14926753 tempest-SnapshotDataIntegrityTests-898447071 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:39:55 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-2d1b2882-ba96-41c9-acd3-03fc14926753 tempest-SnapshotDataIntegrityTests-898447071 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:39:55 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-2d1b2882-ba96-41c9-acd3-03fc14926753 tempest-SnapshotDataIntegrityTests-898447071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:39:55 devstack sudo[115738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 Jul 31 12:39:55 devstack sudo[115738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:39:55 devstack sudo[115736]: pam_unix(sudo:session): session closed for user root Jul 31 12:39:55 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-e7d761a5-0ba2-4e21-90fd-15be311b2fc5 tempest-ProjectReaderTests-257919573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-1ac23209-8792-4372-9931-09c178b877af" returned: 0 in 0.258s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:39:55 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-e7d761a5-0ba2-4e21-90fd-15be311b2fc5 tempest-ProjectReaderTests-257919573 None] Lock "cinder-quobyte-1ac23209-8792-4372-9931-09c178b877af" released by "delete_volume" :: held 0.763s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:39:55 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-fb7922d3-f4e3-4e78-b20c-09f4847b29c0 tempest-SnapshotDataIntegrityTests-898447071 None] Acquiring lock "cinder-bfdefc1b-faed-41b9-ba29-9e1696a07089-delete_volume" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:39:55 devstack cinder-volume[89182]: DEBUG cinder.quota [None req-e7d761a5-0ba2-4e21-90fd-15be311b2fc5 tempest-ProjectReaderTests-257919573 None] Created reservations ['87e1dbaa-ed26-406a-a4e5-b1b74cccfd9c', '80619d2f-f243-4a76-9556-8e6c8d0e182a', '052e97cb-3da4-46f9-b30a-9f146c89100e', 'c1653921-70f9-4094-b45d-c191e5eeee0a'] {{(pid=89182) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 12:39:55 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-fb7922d3-f4e3-4e78-b20c-09f4847b29c0 tempest-SnapshotDataIntegrityTests-898447071 None] Lock "cinder-bfdefc1b-faed-41b9-ba29-9e1696a07089-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:39:56 devstack sudo[115738]: pam_unix(sudo:session): session closed for user root Jul 31 12:39:56 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-2d1b2882-ba96-41c9-acd3-03fc14926753 tempest-SnapshotDataIntegrityTests-898447071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2" returned: 0 in 0.317s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:39:56 devstack cinder-volume[89182]: DEBUG cinder.manager [None req-2d1b2882-ba96-41c9-acd3-03fc14926753 tempest-SnapshotDataIntegrityTests-898447071 None] Notifying Schedulers of capabilities ... {{(pid=89182) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 12:39:56 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-fb7922d3-f4e3-4e78-b20c-09f4847b29c0 tempest-SnapshotDataIntegrityTests-898447071 None] Acquiring lock "cinder-quobyte-bfdefc1b-faed-41b9-ba29-9e1696a07089" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:39:56 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-2d1b2882-ba96-41c9-acd3-03fc14926753 tempest-SnapshotDataIntegrityTests-898447071 None] Deleted volume successfully. Jul 31 12:39:56 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-fb7922d3-f4e3-4e78-b20c-09f4847b29c0 tempest-SnapshotDataIntegrityTests-898447071 None] Lock "cinder-quobyte-bfdefc1b-faed-41b9-ba29-9e1696a07089" acquired by "delete_volume" :: waited 0.024s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:39:56 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-e7d761a5-0ba2-4e21-90fd-15be311b2fc5 tempest-ProjectReaderTests-257919573 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:39:56 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-e7d761a5-0ba2-4e21-90fd-15be311b2fc5 tempest-ProjectReaderTests-257919573 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:39:56 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-e7d761a5-0ba2-4e21-90fd-15be311b2fc5 tempest-ProjectReaderTests-257919573 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:39:56 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-e7d761a5-0ba2-4e21-90fd-15be311b2fc5 tempest-ProjectReaderTests-257919573 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:39:56 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-e7d761a5-0ba2-4e21-90fd-15be311b2fc5 tempest-ProjectReaderTests-257919573 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:39:56 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-e7d761a5-0ba2-4e21-90fd-15be311b2fc5 tempest-ProjectReaderTests-257919573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:39:56 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[269d2bb4-0232-424a-a68e-e836bbd3dc85]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:39:56 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-fb7922d3-f4e3-4e78-b20c-09f4847b29c0 tempest-SnapshotDataIntegrityTests-898447071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-bfdefc1b-faed-41b9-ba29-9e1696a07089 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:39:56 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-2d1b2882-ba96-41c9-acd3-03fc14926753 tempest-SnapshotDataIntegrityTests-898447071 None] Lock "cinder-490ce77d-87a2-440b-a48f-e2d30d1405da-delete_volume" released by "delete_volume" :: held 1.493s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:39:56 devstack sudo[115742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 Jul 31 12:39:56 devstack sudo[115742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:39:56 devstack sudo[115743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-bfdefc1b-faed-41b9-ba29-9e1696a07089 Jul 31 12:39:56 devstack sudo[115743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:39:56 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-1c9d7a8f-628a-4393-8f66-4ecdc7dc73d4 tempest-ProjectMemberTests-969865867 None] Acquiring lock "cinder-9f5ad70b-9b79-463b-a8de-8b3efa6661a6-delete_volume" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:39:56 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-1c9d7a8f-628a-4393-8f66-4ecdc7dc73d4 tempest-ProjectMemberTests-969865867 None] Lock "cinder-9f5ad70b-9b79-463b-a8de-8b3efa6661a6-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:39:56 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-1c9d7a8f-628a-4393-8f66-4ecdc7dc73d4 tempest-ProjectMemberTests-969865867 None] Acquiring lock "cinder-quobyte-9f5ad70b-9b79-463b-a8de-8b3efa6661a6" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:39:56 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-1c9d7a8f-628a-4393-8f66-4ecdc7dc73d4 tempest-ProjectMemberTests-969865867 None] Lock "cinder-quobyte-9f5ad70b-9b79-463b-a8de-8b3efa6661a6" acquired by "delete_volume" :: waited 0.022s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:39:56 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[0965543e-f285-4275-94cb-cc3e414bc23b]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:39:56 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-1c9d7a8f-628a-4393-8f66-4ecdc7dc73d4 tempest-ProjectMemberTests-969865867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-9f5ad70b-9b79-463b-a8de-8b3efa6661a6 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:39:56 devstack sudo[115742]: pam_unix(sudo:session): session closed for user root Jul 31 12:39:56 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-e7d761a5-0ba2-4e21-90fd-15be311b2fc5 tempest-ProjectReaderTests-257919573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2" returned: 0 in 0.388s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:39:56 devstack cinder-volume[89182]: DEBUG cinder.manager [None req-e7d761a5-0ba2-4e21-90fd-15be311b2fc5 tempest-ProjectReaderTests-257919573 None] Notifying Schedulers of capabilities ... {{(pid=89182) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 12:39:56 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-e7d761a5-0ba2-4e21-90fd-15be311b2fc5 tempest-ProjectReaderTests-257919573 None] Deleted volume successfully. Jul 31 12:39:56 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-e7d761a5-0ba2-4e21-90fd-15be311b2fc5 tempest-ProjectReaderTests-257919573 None] Lock "cinder-1ac23209-8792-4372-9931-09c178b877af-delete_volume" released by "delete_volume" :: held 1.526s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:39:56 devstack sudo[115747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-9f5ad70b-9b79-463b-a8de-8b3efa6661a6 Jul 31 12:39:56 devstack sudo[115747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:39:56 devstack sudo[115743]: pam_unix(sudo:session): session closed for user root Jul 31 12:39:56 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-fb7922d3-f4e3-4e78-b20c-09f4847b29c0 tempest-SnapshotDataIntegrityTests-898447071 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-bfdefc1b-faed-41b9-ba29-9e1696a07089" returned: 0 in 0.586s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:39:56 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-fb7922d3-f4e3-4e78-b20c-09f4847b29c0 tempest-SnapshotDataIntegrityTests-898447071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-bfdefc1b-faed-41b9-ba29-9e1696a07089 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:39:56 devstack sudo[115752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-bfdefc1b-faed-41b9-ba29-9e1696a07089 Jul 31 12:39:56 devstack sudo[115752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:39:56 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-a52c5a1c-86c0-4134-9aa6-51136e81c0c0 tempest-SnapshotDependencyTests-1140392806 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:39:56 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-a52c5a1c-86c0-4134-9aa6-51136e81c0c0 tempest-SnapshotDependencyTests-1140392806 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:39:56 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-a52c5a1c-86c0-4134-9aa6-51136e81c0c0 tempest-SnapshotDependencyTests-1140392806 None] Creating offline snapshot a810f49f-e7b7-4168-8d65-06051ca7e87b of volume d526e0b0-c57b-4ed1-98bd-b7a67d6a8c3f {{(pid=89182) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 31 12:39:56 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[b09f502e-a228-4ae4-903d-f190bed769ed]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:39:56 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-a52c5a1c-86c0-4134-9aa6-51136e81c0c0 tempest-SnapshotDependencyTests-1140392806 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-d526e0b0-c57b-4ed1-98bd-b7a67d6a8c3f {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:39:56 devstack sudo[115747]: pam_unix(sudo:session): session closed for user root Jul 31 12:39:56 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-1c9d7a8f-628a-4393-8f66-4ecdc7dc73d4 tempest-ProjectMemberTests-969865867 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-9f5ad70b-9b79-463b-a8de-8b3efa6661a6" returned: 0 in 0.489s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:39:56 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-1c9d7a8f-628a-4393-8f66-4ecdc7dc73d4 tempest-ProjectMemberTests-969865867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-9f5ad70b-9b79-463b-a8de-8b3efa6661a6 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:39:56 devstack sudo[115759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-9f5ad70b-9b79-463b-a8de-8b3efa6661a6 Jul 31 12:39:56 devstack sudo[115759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:39:57 devstack sudo[115758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-d526e0b0-c57b-4ed1-98bd-b7a67d6a8c3f Jul 31 12:39:57 devstack sudo[115758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:39:57 devstack sudo[115752]: pam_unix(sudo:session): session closed for user root Jul 31 12:39:57 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-fb7922d3-f4e3-4e78-b20c-09f4847b29c0 tempest-SnapshotDataIntegrityTests-898447071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-bfdefc1b-faed-41b9-ba29-9e1696a07089" returned: 0 in 0.350s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:39:57 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-fb7922d3-f4e3-4e78-b20c-09f4847b29c0 tempest-SnapshotDataIntegrityTests-898447071 None] Lock "cinder-quobyte-bfdefc1b-faed-41b9-ba29-9e1696a07089" released by "delete_volume" :: held 1.026s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:39:57 devstack cinder-volume[89182]: DEBUG cinder.quota [None req-fb7922d3-f4e3-4e78-b20c-09f4847b29c0 tempest-SnapshotDataIntegrityTests-898447071 None] Created reservations ['e296e56d-776e-4a8a-8cea-1f0825a5a33d', 'b0826b0a-261a-4c52-be77-be5d14bf8155', '738caf9c-dd35-4a5b-bd92-cb06a3ec745a', 'd2d781f6-b198-4f5a-98b5-98a029c7f247'] {{(pid=89182) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 12:39:57 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-fb7922d3-f4e3-4e78-b20c-09f4847b29c0 tempest-SnapshotDataIntegrityTests-898447071 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:39:57 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-fb7922d3-f4e3-4e78-b20c-09f4847b29c0 tempest-SnapshotDataIntegrityTests-898447071 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:39:57 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-fb7922d3-f4e3-4e78-b20c-09f4847b29c0 tempest-SnapshotDataIntegrityTests-898447071 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:39:57 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-fb7922d3-f4e3-4e78-b20c-09f4847b29c0 tempest-SnapshotDataIntegrityTests-898447071 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:39:57 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-fb7922d3-f4e3-4e78-b20c-09f4847b29c0 tempest-SnapshotDataIntegrityTests-898447071 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:39:57 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-fb7922d3-f4e3-4e78-b20c-09f4847b29c0 tempest-SnapshotDataIntegrityTests-898447071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:39:57 devstack sudo[115759]: pam_unix(sudo:session): session closed for user root Jul 31 12:39:57 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-1c9d7a8f-628a-4393-8f66-4ecdc7dc73d4 tempest-ProjectMemberTests-969865867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-9f5ad70b-9b79-463b-a8de-8b3efa6661a6" returned: 0 in 0.318s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:39:57 devstack sudo[115765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 Jul 31 12:39:57 devstack sudo[115765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:39:57 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-1c9d7a8f-628a-4393-8f66-4ecdc7dc73d4 tempest-ProjectMemberTests-969865867 None] Lock "cinder-quobyte-9f5ad70b-9b79-463b-a8de-8b3efa6661a6" released by "delete_volume" :: held 0.893s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:39:57 devstack cinder-volume[89182]: DEBUG cinder.quota [None req-1c9d7a8f-628a-4393-8f66-4ecdc7dc73d4 tempest-ProjectMemberTests-969865867 None] Created reservations ['771e0c3a-c14f-4cb9-ba53-92a3ef72096c', '4e67441c-d5a4-4b96-bdea-45906f1cf289', '5cf37359-9d4e-4c17-8928-e35cf0319b25', '1fc37354-179c-4934-b9b7-34908c4df76b'] {{(pid=89182) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 12:39:57 devstack sudo[115758]: pam_unix(sudo:session): session closed for user root Jul 31 12:39:57 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-a52c5a1c-86c0-4134-9aa6-51136e81c0c0 tempest-SnapshotDependencyTests-1140392806 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-d526e0b0-c57b-4ed1-98bd-b7a67d6a8c3f" returned: 0 in 0.518s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:39:57 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-a52c5a1c-86c0-4134-9aa6-51136e81c0c0 tempest-SnapshotDependencyTests-1140392806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-d526e0b0-c57b-4ed1-98bd-b7a67d6a8c3f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-d526e0b0-c57b-4ed1-98bd-b7a67d6a8c3f.a810f49f-e7b7-4168-8d65-06051ca7e87b 1G {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:39:57 devstack sudo[115770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-d526e0b0-c57b-4ed1-98bd-b7a67d6a8c3f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-d526e0b0-c57b-4ed1-98bd-b7a67d6a8c3f.a810f49f-e7b7-4168-8d65-06051ca7e87b 1G Jul 31 12:39:57 devstack sudo[115770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:39:57 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-1c9d7a8f-628a-4393-8f66-4ecdc7dc73d4 tempest-ProjectMemberTests-969865867 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:39:57 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-1c9d7a8f-628a-4393-8f66-4ecdc7dc73d4 tempest-ProjectMemberTests-969865867 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:39:57 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-1c9d7a8f-628a-4393-8f66-4ecdc7dc73d4 tempest-ProjectMemberTests-969865867 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:39:57 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-1c9d7a8f-628a-4393-8f66-4ecdc7dc73d4 tempest-ProjectMemberTests-969865867 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:39:57 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-1c9d7a8f-628a-4393-8f66-4ecdc7dc73d4 tempest-ProjectMemberTests-969865867 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:39:57 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-1c9d7a8f-628a-4393-8f66-4ecdc7dc73d4 tempest-ProjectMemberTests-969865867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:39:57 devstack sudo[115765]: pam_unix(sudo:session): session closed for user root Jul 31 12:39:57 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-fb7922d3-f4e3-4e78-b20c-09f4847b29c0 tempest-SnapshotDataIntegrityTests-898447071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2" returned: 0 in 0.315s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:39:57 devstack cinder-volume[89182]: DEBUG cinder.manager [None req-fb7922d3-f4e3-4e78-b20c-09f4847b29c0 tempest-SnapshotDataIntegrityTests-898447071 None] Notifying Schedulers of capabilities ... {{(pid=89182) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 12:39:57 devstack sudo[115773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 Jul 31 12:39:57 devstack sudo[115773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:39:57 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-fb7922d3-f4e3-4e78-b20c-09f4847b29c0 tempest-SnapshotDataIntegrityTests-898447071 None] Deleted volume successfully. Jul 31 12:39:57 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-fb7922d3-f4e3-4e78-b20c-09f4847b29c0 tempest-SnapshotDataIntegrityTests-898447071 None] Lock "cinder-bfdefc1b-faed-41b9-ba29-9e1696a07089-delete_volume" released by "delete_volume" :: held 1.616s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:39:57 devstack sudo[115773]: pam_unix(sudo:session): session closed for user root Jul 31 12:39:57 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-1c9d7a8f-628a-4393-8f66-4ecdc7dc73d4 tempest-ProjectMemberTests-969865867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2" returned: 0 in 0.274s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:39:57 devstack cinder-volume[89182]: DEBUG cinder.manager [None req-1c9d7a8f-628a-4393-8f66-4ecdc7dc73d4 tempest-ProjectMemberTests-969865867 None] Notifying Schedulers of capabilities ... {{(pid=89182) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 12:39:57 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-1c9d7a8f-628a-4393-8f66-4ecdc7dc73d4 tempest-ProjectMemberTests-969865867 None] Deleted volume successfully. Jul 31 12:39:57 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-1c9d7a8f-628a-4393-8f66-4ecdc7dc73d4 tempest-ProjectMemberTests-969865867 None] Lock "cinder-9f5ad70b-9b79-463b-a8de-8b3efa6661a6-delete_volume" released by "delete_volume" :: held 1.514s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:39:57 devstack sudo[115770]: pam_unix(sudo:session): session closed for user root Jul 31 12:39:57 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-a52c5a1c-86c0-4134-9aa6-51136e81c0c0 tempest-SnapshotDependencyTests-1140392806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-d526e0b0-c57b-4ed1-98bd-b7a67d6a8c3f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-d526e0b0-c57b-4ed1-98bd-b7a67d6a8c3f.a810f49f-e7b7-4168-8d65-06051ca7e87b 1G" returned: 0 in 0.536s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:39:57 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-a52c5a1c-86c0-4134-9aa6-51136e81c0c0 tempest-SnapshotDependencyTests-1140392806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d526e0b0-c57b-4ed1-98bd-b7a67d6a8c3f -F qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-d526e0b0-c57b-4ed1-98bd-b7a67d6a8c3f.a810f49f-e7b7-4168-8d65-06051ca7e87b {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:39:57 devstack sudo[115779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d526e0b0-c57b-4ed1-98bd-b7a67d6a8c3f -F qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-d526e0b0-c57b-4ed1-98bd-b7a67d6a8c3f.a810f49f-e7b7-4168-8d65-06051ca7e87b Jul 31 12:39:57 devstack sudo[115779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:39:58 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-dee153fb-b716-4946-938b-45bfdb3de509 tempest-SnapshotDataIntegrityTests-898447071 None] Acquiring lock "cinder-f5d7c5e3-8c41-42e0-b50d-8b1ebe936b3c-delete_snapshot" by "delete_snapshot" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:39:58 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-dee153fb-b716-4946-938b-45bfdb3de509 tempest-SnapshotDataIntegrityTests-898447071 None] Lock "cinder-f5d7c5e3-8c41-42e0-b50d-8b1ebe936b3c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:39:58 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-dee153fb-b716-4946-938b-45bfdb3de509 tempest-SnapshotDataIntegrityTests-898447071 None] Acquiring lock "cinder-quobyte-e6acfb11-941d-450b-8d93-0e32240df94a" by "delete_snapshot" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:39:58 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-dee153fb-b716-4946-938b-45bfdb3de509 tempest-SnapshotDataIntegrityTests-898447071 None] Lock "cinder-quobyte-e6acfb11-941d-450b-8d93-0e32240df94a" acquired by "delete_snapshot" :: waited 0.023s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:39:58 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-dee153fb-b716-4946-938b-45bfdb3de509 tempest-SnapshotDataIntegrityTests-898447071 None] Acquiring lock "cinder-quobyte-f5d7c5e3-8c41-42e0-b50d-8b1ebe936b3c" by "_delete_snapshot" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:39:58 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-dee153fb-b716-4946-938b-45bfdb3de509 tempest-SnapshotDataIntegrityTests-898447071 None] Lock "cinder-quobyte-f5d7c5e3-8c41-42e0-b50d-8b1ebe936b3c" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:39:58 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-dee153fb-b716-4946-938b-45bfdb3de509 tempest-SnapshotDataIntegrityTests-898447071 None] Deleting offline snapshot f5d7c5e3-8c41-42e0-b50d-8b1ebe936b3c of volume e6acfb11-941d-450b-8d93-0e32240df94a {{(pid=89182) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 31 12:39:58 devstack sudo[115779]: pam_unix(sudo:session): session closed for user root Jul 31 12:39:58 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-dee153fb-b716-4946-938b-45bfdb3de509 tempest-SnapshotDataIntegrityTests-898447071 None] snapshot_file for this snap is: volume-e6acfb11-941d-450b-8d93-0e32240df94a.f5d7c5e3-8c41-42e0-b50d-8b1ebe936b3c {{(pid=89182) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 31 12:39:58 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-a52c5a1c-86c0-4134-9aa6-51136e81c0c0 tempest-SnapshotDependencyTests-1140392806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d526e0b0-c57b-4ed1-98bd-b7a67d6a8c3f -F qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-d526e0b0-c57b-4ed1-98bd-b7a67d6a8c3f.a810f49f-e7b7-4168-8d65-06051ca7e87b" returned: 0 in 0.346s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:39:58 devstack cinder-volume[89182]: WARNING cinder.volume.drivers.remotefs [None req-a52c5a1c-86c0-4134-9aa6-51136e81c0c0 tempest-SnapshotDependencyTests-1140392806 None] /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-d526e0b0-c57b-4ed1-98bd-b7a67d6a8c3f.a810f49f-e7b7-4168-8d65-06051ca7e87b is being set with open permissions: ugo+rw Jul 31 12:39:58 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-a52c5a1c-86c0-4134-9aa6-51136e81c0c0 tempest-SnapshotDependencyTests-1140392806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-d526e0b0-c57b-4ed1-98bd-b7a67d6a8c3f.a810f49f-e7b7-4168-8d65-06051ca7e87b {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:39:58 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[768f5d00-2749-477d-9f35-d644bed572cd]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:39:58 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-dee153fb-b716-4946-938b-45bfdb3de509 tempest-SnapshotDataIntegrityTests-898447071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e6acfb11-941d-450b-8d93-0e32240df94a.f5d7c5e3-8c41-42e0-b50d-8b1ebe936b3c {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:39:58 devstack sudo[115784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-d526e0b0-c57b-4ed1-98bd-b7a67d6a8c3f.a810f49f-e7b7-4168-8d65-06051ca7e87b Jul 31 12:39:58 devstack sudo[115784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:39:58 devstack sudo[115785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e6acfb11-941d-450b-8d93-0e32240df94a.f5d7c5e3-8c41-42e0-b50d-8b1ebe936b3c Jul 31 12:39:58 devstack sudo[115785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:39:58 devstack sudo[115784]: pam_unix(sudo:session): session closed for user root Jul 31 12:39:58 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-a52c5a1c-86c0-4134-9aa6-51136e81c0c0 tempest-SnapshotDependencyTests-1140392806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-d526e0b0-c57b-4ed1-98bd-b7a67d6a8c3f.a810f49f-e7b7-4168-8d65-06051ca7e87b" returned: 0 in 0.267s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:39:58 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-a52c5a1c-86c0-4134-9aa6-51136e81c0c0 tempest-SnapshotDependencyTests-1140392806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-d526e0b0-c57b-4ed1-98bd-b7a67d6a8c3f.info {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:39:58 devstack sudo[115789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-d526e0b0-c57b-4ed1-98bd-b7a67d6a8c3f.info Jul 31 12:39:58 devstack sudo[115789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:39:58 devstack sudo[115785]: pam_unix(sudo:session): session closed for user root Jul 31 12:39:58 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-dee153fb-b716-4946-938b-45bfdb3de509 tempest-SnapshotDataIntegrityTests-898447071 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e6acfb11-941d-450b-8d93-0e32240df94a.f5d7c5e3-8c41-42e0-b50d-8b1ebe936b3c" returned: 0 in 0.408s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:39:58 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-dee153fb-b716-4946-938b-45bfdb3de509 tempest-SnapshotDataIntegrityTests-898447071 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e6acfb11-941d-450b-8d93-0e32240df94a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89182) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 12:39:58 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f4deabf-9228-42ca-a48a-ee148db0dbc4]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:39:58 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-dee153fb-b716-4946-938b-45bfdb3de509 tempest-SnapshotDataIntegrityTests-898447071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e6acfb11-941d-450b-8d93-0e32240df94a.629af985-2bb6-4b68-b00b-b49a9e715090 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:39:58 devstack sudo[115789]: pam_unix(sudo:session): session closed for user root Jul 31 12:39:58 devstack sudo[115794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e6acfb11-941d-450b-8d93-0e32240df94a.629af985-2bb6-4b68-b00b-b49a9e715090 Jul 31 12:39:58 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-a52c5a1c-86c0-4134-9aa6-51136e81c0c0 tempest-SnapshotDependencyTests-1140392806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-d526e0b0-c57b-4ed1-98bd-b7a67d6a8c3f.info" returned: 0 in 0.292s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:39:58 devstack sudo[115794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:39:58 devstack cinder-volume[89182]: WARNING cinder.volume.drivers.remotefs [None req-a52c5a1c-86c0-4134-9aa6-51136e81c0c0 tempest-SnapshotDependencyTests-1140392806 None] /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-d526e0b0-c57b-4ed1-98bd-b7a67d6a8c3f.info is being set with open permissions: ugo+rw Jul 31 12:39:58 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-a52c5a1c-86c0-4134-9aa6-51136e81c0c0 tempest-SnapshotDependencyTests-1140392806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-d526e0b0-c57b-4ed1-98bd-b7a67d6a8c3f.info {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:39:58 devstack sudo[115797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-d526e0b0-c57b-4ed1-98bd-b7a67d6a8c3f.info Jul 31 12:39:58 devstack sudo[115797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:39:59 devstack cinder-volume[89182]: DEBUG cinder.volume.flows.manager.create_volume [None req-256447f2-6aba-4314-b84f-18714a6fa220 tempest-ProjectMemberTests-969865867 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89182) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 12:39:59 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-256447f2-6aba-4314-b84f-18714a6fa220 tempest-ProjectMemberTests-969865867 None] Flow 'volume_create_manager' (dc2ca8c7-c360-414c-ac64-fe3e973b1736) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:39:59 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-256447f2-6aba-4314-b84f-18714a6fa220 tempest-ProjectMemberTests-969865867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (afcf6122-4628-482c-80d5-5bb555cb24c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:39:59 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-256447f2-6aba-4314-b84f-18714a6fa220 tempest-ProjectMemberTests-969865867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (afcf6122-4628-482c-80d5-5bb555cb24c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:39:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-920809193',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=119f46b6-5baf-45e0-ad45-43022ab6f300,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7618b523b3644b0aff23a331c24c373',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:39:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:39:59Z,use_quota=True,user_id='ef87d129d713438b8a1c61430735d914',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:39:59 devstack sudo[115797]: pam_unix(sudo:session): session closed for user root Jul 31 12:39:59 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-256447f2-6aba-4314-b84f-18714a6fa220 tempest-ProjectMemberTests-969865867 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3ef53b9-b518-4a0c-9f0f-cf4a541da90e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:39:59 devstack sudo[115794]: pam_unix(sudo:session): session closed for user root Jul 31 12:39:59 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-256447f2-6aba-4314-b84f-18714a6fa220 tempest-ProjectMemberTests-969865867 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3ef53b9-b518-4a0c-9f0f-cf4a541da90e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:39:59 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-256447f2-6aba-4314-b84f-18714a6fa220 tempest-ProjectMemberTests-969865867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a0c1efe-869b-42d1-92bc-805c5468d66c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:39:59 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-256447f2-6aba-4314-b84f-18714a6fa220 tempest-ProjectMemberTests-969865867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a0c1efe-869b-42d1-92bc-805c5468d66c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '119f46b6-5baf-45e0-ad45-43022ab6f300', 'volume_name': 'volume-119f46b6-5baf-45e0-ad45-43022ab6f300', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:39:59 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-256447f2-6aba-4314-b84f-18714a6fa220 tempest-ProjectMemberTests-969865867 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e70dd347-2651-4920-a0c2-19d5fdeb90d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:39:59 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-256447f2-6aba-4314-b84f-18714a6fa220 tempest-ProjectMemberTests-969865867 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e70dd347-2651-4920-a0c2-19d5fdeb90d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:39:59 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-256447f2-6aba-4314-b84f-18714a6fa220 tempest-ProjectMemberTests-969865867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7e3d013-fbfa-4d3f-8711-f048c5ace34f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:39:59 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-256447f2-6aba-4314-b84f-18714a6fa220 tempest-ProjectMemberTests-969865867 None] Volume 119f46b6-5baf-45e0-ad45-43022ab6f300: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-119f46b6-5baf-45e0-ad45-43022ab6f300', 'volume_size': 1} Jul 31 12:39:59 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-256447f2-6aba-4314-b84f-18714a6fa220 tempest-ProjectMemberTests-969865867 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:39:59 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-a52c5a1c-86c0-4134-9aa6-51136e81c0c0 tempest-SnapshotDependencyTests-1140392806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-d526e0b0-c57b-4ed1-98bd-b7a67d6a8c3f.info" returned: 0 in 0.338s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:39:59 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-dee153fb-b716-4946-938b-45bfdb3de509 tempest-SnapshotDataIntegrityTests-898447071 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e6acfb11-941d-450b-8d93-0e32240df94a.629af985-2bb6-4b68-b00b-b49a9e715090" returned: 0 in 0.474s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:39:59 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-a52c5a1c-86c0-4134-9aa6-51136e81c0c0 tempest-SnapshotDependencyTests-1140392806 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.407s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:39:59 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-dee153fb-b716-4946-938b-45bfdb3de509 tempest-SnapshotDataIntegrityTests-898447071 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e6acfb11-941d-450b-8d93-0e32240df94a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89182) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 12:39:59 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-dee153fb-b716-4946-938b-45bfdb3de509 tempest-SnapshotDataIntegrityTests-898447071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e6acfb11-941d-450b-8d93-0e32240df94a.f5d7c5e3-8c41-42e0-b50d-8b1ebe936b3c {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:39:59 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-256447f2-6aba-4314-b84f-18714a6fa220 tempest-ProjectMemberTests-969865867 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.038s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:39:59 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-256447f2-6aba-4314-b84f-18714a6fa220 tempest-ProjectMemberTests-969865867 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:39:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-920809193',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=119f46b6-5baf-45e0-ad45-43022ab6f300,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7618b523b3644b0aff23a331c24c373',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:39:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:39:59Z,use_quota=True,user_id='ef87d129d713438b8a1c61430735d914',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)}" {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 12:39:59 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-256447f2-6aba-4314-b84f-18714a6fa220 tempest-ProjectMemberTests-969865867 None] Creating volume 119f46b6-5baf-45e0-ad45-43022ab6f300 {{(pid=89182) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 12:39:59 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-256447f2-6aba-4314-b84f-18714a6fa220 tempest-ProjectMemberTests-969865867 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:39:59 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-256447f2-6aba-4314-b84f-18714a6fa220 tempest-ProjectMemberTests-969865867 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:39:59 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-256447f2-6aba-4314-b84f-18714a6fa220 tempest-ProjectMemberTests-969865867 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:39:59 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-256447f2-6aba-4314-b84f-18714a6fa220 tempest-ProjectMemberTests-969865867 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:39:59 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-256447f2-6aba-4314-b84f-18714a6fa220 tempest-ProjectMemberTests-969865867 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:39:59 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-256447f2-6aba-4314-b84f-18714a6fa220 tempest-ProjectMemberTests-969865867 None] Selected osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 as target Quobyte volume. {{(pid=89182) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 12:39:59 devstack cinder-volume[89182]: INFO cinder.volume.drivers.remotefs [None req-256447f2-6aba-4314-b84f-18714a6fa220 tempest-ProjectMemberTests-969865867 None] casted to osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 Jul 31 12:39:59 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-256447f2-6aba-4314-b84f-18714a6fa220 tempest-ProjectMemberTests-969865867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-119f46b6-5baf-45e0-ad45-43022ab6f300 1073741824 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:39:59 devstack sudo[115804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e6acfb11-941d-450b-8d93-0e32240df94a.f5d7c5e3-8c41-42e0-b50d-8b1ebe936b3c Jul 31 12:39:59 devstack sudo[115804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:39:59 devstack sudo[115806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-119f46b6-5baf-45e0-ad45-43022ab6f300 1073741824 Jul 31 12:39:59 devstack sudo[115806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:39:59 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-a52c5a1c-86c0-4134-9aa6-51136e81c0c0 tempest-SnapshotDependencyTests-1140392806 None] Create snapshot completed successfully Jul 31 12:39:59 devstack sudo[115806]: pam_unix(sudo:session): session closed for user root Jul 31 12:39:59 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-256447f2-6aba-4314-b84f-18714a6fa220 tempest-ProjectMemberTests-969865867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-119f46b6-5baf-45e0-ad45-43022ab6f300 1073741824" returned: 0 in 0.411s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:39:59 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-256447f2-6aba-4314-b84f-18714a6fa220 tempest-ProjectMemberTests-969865867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-119f46b6-5baf-45e0-ad45-43022ab6f300 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:39:59 devstack sudo[115815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-119f46b6-5baf-45e0-ad45-43022ab6f300 Jul 31 12:39:59 devstack sudo[115815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:39:59 devstack sudo[115804]: pam_unix(sudo:session): session closed for user root Jul 31 12:39:59 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-dee153fb-b716-4946-938b-45bfdb3de509 tempest-SnapshotDataIntegrityTests-898447071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e6acfb11-941d-450b-8d93-0e32240df94a.f5d7c5e3-8c41-42e0-b50d-8b1ebe936b3c" returned: 0 in 0.593s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:39:59 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-dee153fb-b716-4946-938b-45bfdb3de509 tempest-SnapshotDataIntegrityTests-898447071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e6acfb11-941d-450b-8d93-0e32240df94a.f5d7c5e3-8c41-42e0-b50d-8b1ebe936b3c {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:39:59 devstack sudo[115817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e6acfb11-941d-450b-8d93-0e32240df94a.f5d7c5e3-8c41-42e0-b50d-8b1ebe936b3c Jul 31 12:39:59 devstack sudo[115817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:40:00 devstack sudo[115815]: pam_unix(sudo:session): session closed for user root Jul 31 12:40:00 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-256447f2-6aba-4314-b84f-18714a6fa220 tempest-ProjectMemberTests-969865867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-119f46b6-5baf-45e0-ad45-43022ab6f300" returned: 0 in 0.290s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:40:00 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-256447f2-6aba-4314-b84f-18714a6fa220 tempest-ProjectMemberTests-969865867 None] <== create_volume: return (736ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'} {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 12:40:00 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-256447f2-6aba-4314-b84f-18714a6fa220 tempest-ProjectMemberTests-969865867 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.740s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:40:00 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-256447f2-6aba-4314-b84f-18714a6fa220 tempest-ProjectMemberTests-969865867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7e3d013-fbfa-4d3f-8711-f048c5ace34f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-119f46b6-5baf-45e0-ad45-43022ab6f300', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:40:00 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-256447f2-6aba-4314-b84f-18714a6fa220 tempest-ProjectMemberTests-969865867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2cba419e-031e-49ba-b8de-2f4ec3be8389) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:40:00 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-256447f2-6aba-4314-b84f-18714a6fa220 tempest-ProjectMemberTests-969865867 None] Volume volume-119f46b6-5baf-45e0-ad45-43022ab6f300 (119f46b6-5baf-45e0-ad45-43022ab6f300): created successfully Jul 31 12:40:00 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-256447f2-6aba-4314-b84f-18714a6fa220 tempest-ProjectMemberTests-969865867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2cba419e-031e-49ba-b8de-2f4ec3be8389) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:40:00 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-256447f2-6aba-4314-b84f-18714a6fa220 tempest-ProjectMemberTests-969865867 None] Flow 'volume_create_manager' (dc2ca8c7-c360-414c-ac64-fe3e973b1736) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:40:00 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-256447f2-6aba-4314-b84f-18714a6fa220 tempest-ProjectMemberTests-969865867 None] Created volume successfully. Jul 31 12:40:00 devstack sudo[115817]: pam_unix(sudo:session): session closed for user root Jul 31 12:40:00 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-dee153fb-b716-4946-938b-45bfdb3de509 tempest-SnapshotDataIntegrityTests-898447071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e6acfb11-941d-450b-8d93-0e32240df94a.f5d7c5e3-8c41-42e0-b50d-8b1ebe936b3c" returned: 0 in 0.267s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:40:00 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-dee153fb-b716-4946-938b-45bfdb3de509 tempest-SnapshotDataIntegrityTests-898447071 None] Lock "cinder-quobyte-f5d7c5e3-8c41-42e0-b50d-8b1ebe936b3c" released by "_delete_snapshot" :: held 1.874s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:40:00 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-dee153fb-b716-4946-938b-45bfdb3de509 tempest-SnapshotDataIntegrityTests-898447071 None] Lock "cinder-quobyte-e6acfb11-941d-450b-8d93-0e32240df94a" released by "delete_snapshot" :: held 1.905s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:40:00 devstack cinder-volume[89182]: DEBUG cinder.quota [None req-dee153fb-b716-4946-938b-45bfdb3de509 tempest-SnapshotDataIntegrityTests-898447071 None] Created reservations ['0f8653bc-1771-43ec-a48e-8641dc954459', '27ecd891-aaa0-49de-a74d-fcc0d391b6f5', '56f5497b-20e6-4c0c-8334-d99e26812245', 'f3046575-a9cc-4b6f-aa7f-255450188a03'] {{(pid=89182) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 12:40:00 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-dee153fb-b716-4946-938b-45bfdb3de509 tempest-SnapshotDataIntegrityTests-898447071 None] Delete snapshot completed successfully. Jul 31 12:40:00 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-dee153fb-b716-4946-938b-45bfdb3de509 tempest-SnapshotDataIntegrityTests-898447071 None] Lock "cinder-f5d7c5e3-8c41-42e0-b50d-8b1ebe936b3c-delete_snapshot" released by "delete_snapshot" :: held 2.065s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:40:00 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-2227ab37-962c-44b4-8011-a99aa1e15255 tempest-SnapshotDataIntegrityTests-898447071 None] Acquiring lock "cinder-629af985-2bb6-4b68-b00b-b49a9e715090-delete_snapshot" by "delete_snapshot" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:40:00 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-2227ab37-962c-44b4-8011-a99aa1e15255 tempest-SnapshotDataIntegrityTests-898447071 None] Lock "cinder-629af985-2bb6-4b68-b00b-b49a9e715090-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:40:00 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-2227ab37-962c-44b4-8011-a99aa1e15255 tempest-SnapshotDataIntegrityTests-898447071 None] Acquiring lock "cinder-quobyte-e6acfb11-941d-450b-8d93-0e32240df94a" by "delete_snapshot" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:40:00 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-2227ab37-962c-44b4-8011-a99aa1e15255 tempest-SnapshotDataIntegrityTests-898447071 None] Lock "cinder-quobyte-e6acfb11-941d-450b-8d93-0e32240df94a" acquired by "delete_snapshot" :: waited 0.018s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:40:00 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-2227ab37-962c-44b4-8011-a99aa1e15255 tempest-SnapshotDataIntegrityTests-898447071 None] Acquiring lock "cinder-quobyte-629af985-2bb6-4b68-b00b-b49a9e715090" by "_delete_snapshot" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:40:00 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-2227ab37-962c-44b4-8011-a99aa1e15255 tempest-SnapshotDataIntegrityTests-898447071 None] Lock "cinder-quobyte-629af985-2bb6-4b68-b00b-b49a9e715090" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:40:00 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-2227ab37-962c-44b4-8011-a99aa1e15255 tempest-SnapshotDataIntegrityTests-898447071 None] Deleting offline snapshot 629af985-2bb6-4b68-b00b-b49a9e715090 of volume e6acfb11-941d-450b-8d93-0e32240df94a {{(pid=89182) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 31 12:40:00 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-2227ab37-962c-44b4-8011-a99aa1e15255 tempest-SnapshotDataIntegrityTests-898447071 None] snapshot_file for this snap is: volume-e6acfb11-941d-450b-8d93-0e32240df94a.629af985-2bb6-4b68-b00b-b49a9e715090 {{(pid=89182) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 31 12:40:00 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc8555c5-6d74-4664-9948-fc8713e85677]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:40:00 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-2227ab37-962c-44b4-8011-a99aa1e15255 tempest-SnapshotDataIntegrityTests-898447071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e6acfb11-941d-450b-8d93-0e32240df94a.629af985-2bb6-4b68-b00b-b49a9e715090 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:40:00 devstack sudo[115821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e6acfb11-941d-450b-8d93-0e32240df94a.629af985-2bb6-4b68-b00b-b49a9e715090 Jul 31 12:40:00 devstack sudo[115821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:40:00 devstack cinder-volume[89182]: DEBUG cinder.volume.flows.manager.create_volume [None req-1376463e-7c23-4b4e-ab97-d52ad7f3c9a4 tempest-SnapshotDependencyTests-1140392806 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89182) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 12:40:00 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-1376463e-7c23-4b4e-ab97-d52ad7f3c9a4 tempest-SnapshotDependencyTests-1140392806 None] Flow 'volume_create_manager' (59c9749c-e01a-4bc1-9fcc-67800d6e78de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:40:00 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-1376463e-7c23-4b4e-ab97-d52ad7f3c9a4 tempest-SnapshotDependencyTests-1140392806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31ad153e-c70e-49fb-a0d2-005b9d111915) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:40:00 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-1376463e-7c23-4b4e-ab97-d52ad7f3c9a4 tempest-SnapshotDependencyTests-1140392806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31ad153e-c70e-49fb-a0d2-005b9d111915) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:40:00Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed564ba6-1c81-4e11-9a7a-355f2f3425b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='401690a884644c91b96be0f10bb14fe1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:40:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=a810f49f-e7b7-4168-8d65-06051ca7e87b,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:40:01Z,use_quota=True,user_id='c8fb4712b08e4c989107382444e1e171',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:40:00 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-1376463e-7c23-4b4e-ab97-d52ad7f3c9a4 tempest-SnapshotDependencyTests-1140392806 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d29082d-881d-4d25-a938-70d9763f69b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:40:00 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-1376463e-7c23-4b4e-ab97-d52ad7f3c9a4 tempest-SnapshotDependencyTests-1140392806 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d29082d-881d-4d25-a938-70d9763f69b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:40:00 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-1376463e-7c23-4b4e-ab97-d52ad7f3c9a4 tempest-SnapshotDependencyTests-1140392806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2cff37b5-8f54-47e0-87ee-adf9bf8c886f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:40:00 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-1376463e-7c23-4b4e-ab97-d52ad7f3c9a4 tempest-SnapshotDependencyTests-1140392806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2cff37b5-8f54-47e0-87ee-adf9bf8c886f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'ed564ba6-1c81-4e11-9a7a-355f2f3425b8', 'volume_name': 'volume-ed564ba6-1c81-4e11-9a7a-355f2f3425b8', 'volume_size': 1, 'snapshot_id': 'a810f49f-e7b7-4168-8d65-06051ca7e87b'}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:40:00 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-1376463e-7c23-4b4e-ab97-d52ad7f3c9a4 tempest-SnapshotDependencyTests-1140392806 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2faa3ea-09c6-4765-a276-5f76a622f69d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:40:00 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-1376463e-7c23-4b4e-ab97-d52ad7f3c9a4 tempest-SnapshotDependencyTests-1140392806 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2faa3ea-09c6-4765-a276-5f76a622f69d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:40:00 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-1376463e-7c23-4b4e-ab97-d52ad7f3c9a4 tempest-SnapshotDependencyTests-1140392806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f854b2c-d320-4b44-acaa-d011e27ca0c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:40:00 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-1376463e-7c23-4b4e-ab97-d52ad7f3c9a4 tempest-SnapshotDependencyTests-1140392806 None] Volume ed564ba6-1c81-4e11-9a7a-355f2f3425b8: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-ed564ba6-1c81-4e11-9a7a-355f2f3425b8', 'volume_size': 1, 'snapshot_id': 'a810f49f-e7b7-4168-8d65-06051ca7e87b'} Jul 31 12:40:00 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-1376463e-7c23-4b4e-ab97-d52ad7f3c9a4 tempest-SnapshotDependencyTests-1140392806 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:40:00 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-1376463e-7c23-4b4e-ab97-d52ad7f3c9a4 tempest-SnapshotDependencyTests-1140392806 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:40:00 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-1376463e-7c23-4b4e-ab97-d52ad7f3c9a4 tempest-SnapshotDependencyTests-1140392806 None] Acquiring lock "cinder-quobyte-a810f49f-e7b7-4168-8d65-06051ca7e87b-ed564ba6-1c81-4e11-9a7a-355f2f3425b8" by "_create_volume_from_snapshot" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:40:00 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-1376463e-7c23-4b4e-ab97-d52ad7f3c9a4 tempest-SnapshotDependencyTests-1140392806 None] Lock "cinder-quobyte-a810f49f-e7b7-4168-8d65-06051ca7e87b-ed564ba6-1c81-4e11-9a7a-355f2f3425b8" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:40:00 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-1376463e-7c23-4b4e-ab97-d52ad7f3c9a4 tempest-SnapshotDependencyTests-1140392806 None] Creating volume ed564ba6-1c81-4e11-9a7a-355f2f3425b8 from snapshot a810f49f-e7b7-4168-8d65-06051ca7e87b {{(pid=89182) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 31 12:40:00 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-1376463e-7c23-4b4e-ab97-d52ad7f3c9a4 tempest-SnapshotDependencyTests-1140392806 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:40:00 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-1376463e-7c23-4b4e-ab97-d52ad7f3c9a4 tempest-SnapshotDependencyTests-1140392806 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:40:00 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-1376463e-7c23-4b4e-ab97-d52ad7f3c9a4 tempest-SnapshotDependencyTests-1140392806 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:40:00 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-1376463e-7c23-4b4e-ab97-d52ad7f3c9a4 tempest-SnapshotDependencyTests-1140392806 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:40:00 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-1376463e-7c23-4b4e-ab97-d52ad7f3c9a4 tempest-SnapshotDependencyTests-1140392806 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:40:00 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-1376463e-7c23-4b4e-ab97-d52ad7f3c9a4 tempest-SnapshotDependencyTests-1140392806 None] Selected osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 as target Quobyte volume. {{(pid=89182) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 12:40:00 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-1376463e-7c23-4b4e-ab97-d52ad7f3c9a4 tempest-SnapshotDependencyTests-1140392806 None] Acquiring lock "cinder-quobyte-ed564ba6-1c81-4e11-9a7a-355f2f3425b8" by "_copy_volume_from_snapshot" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:40:00 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-1376463e-7c23-4b4e-ab97-d52ad7f3c9a4 tempest-SnapshotDependencyTests-1140392806 None] Lock "cinder-quobyte-ed564ba6-1c81-4e11-9a7a-355f2f3425b8" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:40:00 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-1376463e-7c23-4b4e-ab97-d52ad7f3c9a4 tempest-SnapshotDependencyTests-1140392806 None] snapshot: a810f49f-e7b7-4168-8d65-06051ca7e87b, volume: ed564ba6-1c81-4e11-9a7a-355f2f3425b8, {{(pid=89182) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Jul 31 12:40:00 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-1376463e-7c23-4b4e-ab97-d52ad7f3c9a4 tempest-SnapshotDependencyTests-1140392806 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:40:00 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-1376463e-7c23-4b4e-ab97-d52ad7f3c9a4 tempest-SnapshotDependencyTests-1140392806 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:40:00 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-1376463e-7c23-4b4e-ab97-d52ad7f3c9a4 tempest-SnapshotDependencyTests-1140392806 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:40:00 devstack sudo[115821]: pam_unix(sudo:session): session closed for user root Jul 31 12:40:00 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-1376463e-7c23-4b4e-ab97-d52ad7f3c9a4 tempest-SnapshotDependencyTests-1140392806 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:40:00 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-1376463e-7c23-4b4e-ab97-d52ad7f3c9a4 tempest-SnapshotDependencyTests-1140392806 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:40:00 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-2227ab37-962c-44b4-8011-a99aa1e15255 tempest-SnapshotDataIntegrityTests-898447071 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e6acfb11-941d-450b-8d93-0e32240df94a.629af985-2bb6-4b68-b00b-b49a9e715090" returned: 0 in 0.389s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:40:00 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-2227ab37-962c-44b4-8011-a99aa1e15255 tempest-SnapshotDataIntegrityTests-898447071 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e6acfb11-941d-450b-8d93-0e32240df94a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89182) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 12:40:00 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[312217ed-1946-44e4-a46a-be73e87f802d]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:40:00 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-1376463e-7c23-4b4e-ab97-d52ad7f3c9a4 tempest-SnapshotDependencyTests-1140392806 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-d526e0b0-c57b-4ed1-98bd-b7a67d6a8c3f.a810f49f-e7b7-4168-8d65-06051ca7e87b {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:40:00 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[74e49f1b-8e2c-463f-ab49-fdb962f041cd]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:40:00 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-2227ab37-962c-44b4-8011-a99aa1e15255 tempest-SnapshotDataIntegrityTests-898447071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e6acfb11-941d-450b-8d93-0e32240df94a.4a5c6e12-2302-44db-ab0e-eedae12ca53f {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:40:01 devstack sudo[115826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-d526e0b0-c57b-4ed1-98bd-b7a67d6a8c3f.a810f49f-e7b7-4168-8d65-06051ca7e87b Jul 31 12:40:01 devstack sudo[115826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:40:01 devstack sudo[115827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e6acfb11-941d-450b-8d93-0e32240df94a.4a5c6e12-2302-44db-ab0e-eedae12ca53f Jul 31 12:40:01 devstack sudo[115827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:40:01 devstack sudo[115826]: pam_unix(sudo:session): session closed for user root Jul 31 12:40:01 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-1376463e-7c23-4b4e-ab97-d52ad7f3c9a4 tempest-SnapshotDependencyTests-1140392806 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-d526e0b0-c57b-4ed1-98bd-b7a67d6a8c3f.a810f49f-e7b7-4168-8d65-06051ca7e87b" returned: 0 in 0.379s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:40:01 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-1376463e-7c23-4b4e-ab97-d52ad7f3c9a4 tempest-SnapshotDependencyTests-1140392806 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d526e0b0-c57b-4ed1-98bd-b7a67d6a8c3f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89182) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 12:40:01 devstack sudo[115827]: pam_unix(sudo:session): session closed for user root Jul 31 12:40:01 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-2227ab37-962c-44b4-8011-a99aa1e15255 tempest-SnapshotDataIntegrityTests-898447071 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e6acfb11-941d-450b-8d93-0e32240df94a.4a5c6e12-2302-44db-ab0e-eedae12ca53f" returned: 0 in 0.370s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:40:01 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-2227ab37-962c-44b4-8011-a99aa1e15255 tempest-SnapshotDataIntegrityTests-898447071 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e6acfb11-941d-450b-8d93-0e32240df94a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89182) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 12:40:01 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-2227ab37-962c-44b4-8011-a99aa1e15255 tempest-SnapshotDataIntegrityTests-898447071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e6acfb11-941d-450b-8d93-0e32240df94a.629af985-2bb6-4b68-b00b-b49a9e715090 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:40:01 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2da1fbf-f840-4e34-a4f5-56bc78b3f68f]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:40:01 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-1376463e-7c23-4b4e-ab97-d52ad7f3c9a4 tempest-SnapshotDependencyTests-1140392806 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-d526e0b0-c57b-4ed1-98bd-b7a67d6a8c3f {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:40:01 devstack sudo[115837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e6acfb11-941d-450b-8d93-0e32240df94a.629af985-2bb6-4b68-b00b-b49a9e715090 Jul 31 12:40:01 devstack sudo[115837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:40:01 devstack sudo[115838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-d526e0b0-c57b-4ed1-98bd-b7a67d6a8c3f Jul 31 12:40:01 devstack sudo[115838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:40:01 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-645ea845-c1be-476b-afe0-d53989944148 tempest-ProjectMemberTests-969865867 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:40:01 devstack sudo[115838]: pam_unix(sudo:session): session closed for user root Jul 31 12:40:01 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-1376463e-7c23-4b4e-ab97-d52ad7f3c9a4 tempest-SnapshotDependencyTests-1140392806 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-d526e0b0-c57b-4ed1-98bd-b7a67d6a8c3f" returned: 0 in 0.399s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:40:01 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-1376463e-7c23-4b4e-ab97-d52ad7f3c9a4 tempest-SnapshotDependencyTests-1140392806 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-d526e0b0-c57b-4ed1-98bd-b7a67d6a8c3f {{(pid=89182) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Jul 31 12:40:01 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-1376463e-7c23-4b4e-ab97-d52ad7f3c9a4 tempest-SnapshotDependencyTests-1140392806 None] Creating direct copy from snapshot {{(pid=89182) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Jul 31 12:40:01 devstack cinder-volume[89182]: DEBUG cinder.utils [None req-1376463e-7c23-4b4e-ab97-d52ad7f3c9a4 tempest-SnapshotDependencyTests-1140392806 None] Path /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-ed564ba6-1c81-4e11-9a7a-355f2f3425b8 not found in is_blk_device check {{(pid=89182) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 31 12:40:01 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-1376463e-7c23-4b4e-ab97-d52ad7f3c9a4 tempest-SnapshotDependencyTests-1140392806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-d526e0b0-c57b-4ed1-98bd-b7a67d6a8c3f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-ed564ba6-1c81-4e11-9a7a-355f2f3425b8 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:40:01 devstack sudo[115851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-d526e0b0-c57b-4ed1-98bd-b7a67d6a8c3f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-ed564ba6-1c81-4e11-9a7a-355f2f3425b8 Jul 31 12:40:01 devstack sudo[115851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:40:01 devstack sudo[115837]: pam_unix(sudo:session): session closed for user root Jul 31 12:40:01 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-2227ab37-962c-44b4-8011-a99aa1e15255 tempest-SnapshotDataIntegrityTests-898447071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e6acfb11-941d-450b-8d93-0e32240df94a.629af985-2bb6-4b68-b00b-b49a9e715090" returned: 0 in 0.456s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:40:01 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-2227ab37-962c-44b4-8011-a99aa1e15255 tempest-SnapshotDataIntegrityTests-898447071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e6acfb11-941d-450b-8d93-0e32240df94a.629af985-2bb6-4b68-b00b-b49a9e715090 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:40:01 devstack sudo[115853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e6acfb11-941d-450b-8d93-0e32240df94a.629af985-2bb6-4b68-b00b-b49a9e715090 Jul 31 12:40:01 devstack sudo[115853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:40:02 devstack sudo[115853]: pam_unix(sudo:session): session closed for user root Jul 31 12:40:02 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-2227ab37-962c-44b4-8011-a99aa1e15255 tempest-SnapshotDataIntegrityTests-898447071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e6acfb11-941d-450b-8d93-0e32240df94a.629af985-2bb6-4b68-b00b-b49a9e715090" returned: 0 in 0.265s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:40:02 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-2227ab37-962c-44b4-8011-a99aa1e15255 tempest-SnapshotDataIntegrityTests-898447071 None] Lock "cinder-quobyte-629af985-2bb6-4b68-b00b-b49a9e715090" released by "_delete_snapshot" :: held 1.603s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:40:02 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-2227ab37-962c-44b4-8011-a99aa1e15255 tempest-SnapshotDataIntegrityTests-898447071 None] Lock "cinder-quobyte-e6acfb11-941d-450b-8d93-0e32240df94a" released by "delete_snapshot" :: held 1.629s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:40:02 devstack cinder-volume[89182]: DEBUG cinder.quota [None req-2227ab37-962c-44b4-8011-a99aa1e15255 tempest-SnapshotDataIntegrityTests-898447071 None] Created reservations ['f32f5381-9a71-49ee-b84d-d65de3141096', '1a9b6001-f55d-433a-8ca3-0babee3ca4cc', '57cb2dd5-a3fb-4073-984b-0dd93b029d3f', '27f0d37e-4098-4f00-b1e5-28f26967729f'] {{(pid=89182) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 12:40:02 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-2227ab37-962c-44b4-8011-a99aa1e15255 tempest-SnapshotDataIntegrityTests-898447071 None] Delete snapshot completed successfully. Jul 31 12:40:02 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-2227ab37-962c-44b4-8011-a99aa1e15255 tempest-SnapshotDataIntegrityTests-898447071 None] Lock "cinder-629af985-2bb6-4b68-b00b-b49a9e715090-delete_snapshot" released by "delete_snapshot" :: held 1.813s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:40:02 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-87d7aaac-5146-481b-bd0b-b4871a21ab75 tempest-SnapshotDataIntegrityTests-898447071 None] Acquiring lock "cinder-4a5c6e12-2302-44db-ab0e-eedae12ca53f-delete_snapshot" by "delete_snapshot" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:40:02 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-87d7aaac-5146-481b-bd0b-b4871a21ab75 tempest-SnapshotDataIntegrityTests-898447071 None] Lock "cinder-4a5c6e12-2302-44db-ab0e-eedae12ca53f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.043s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:40:02 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-87d7aaac-5146-481b-bd0b-b4871a21ab75 tempest-SnapshotDataIntegrityTests-898447071 None] Acquiring lock "cinder-quobyte-e6acfb11-941d-450b-8d93-0e32240df94a" by "delete_snapshot" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:40:02 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-87d7aaac-5146-481b-bd0b-b4871a21ab75 tempest-SnapshotDataIntegrityTests-898447071 None] Lock "cinder-quobyte-e6acfb11-941d-450b-8d93-0e32240df94a" acquired by "delete_snapshot" :: waited 0.023s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:40:02 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-87d7aaac-5146-481b-bd0b-b4871a21ab75 tempest-SnapshotDataIntegrityTests-898447071 None] Acquiring lock "cinder-quobyte-4a5c6e12-2302-44db-ab0e-eedae12ca53f" by "_delete_snapshot" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:40:02 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-87d7aaac-5146-481b-bd0b-b4871a21ab75 tempest-SnapshotDataIntegrityTests-898447071 None] Lock "cinder-quobyte-4a5c6e12-2302-44db-ab0e-eedae12ca53f" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:40:02 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-87d7aaac-5146-481b-bd0b-b4871a21ab75 tempest-SnapshotDataIntegrityTests-898447071 None] Deleting offline snapshot 4a5c6e12-2302-44db-ab0e-eedae12ca53f of volume e6acfb11-941d-450b-8d93-0e32240df94a {{(pid=89182) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 31 12:40:02 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-87d7aaac-5146-481b-bd0b-b4871a21ab75 tempest-SnapshotDataIntegrityTests-898447071 None] snapshot_file for this snap is: volume-e6acfb11-941d-450b-8d93-0e32240df94a.4a5c6e12-2302-44db-ab0e-eedae12ca53f {{(pid=89182) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 31 12:40:02 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[8373a8b0-dc00-478a-9537-7c0a74115735]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:40:02 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-87d7aaac-5146-481b-bd0b-b4871a21ab75 tempest-SnapshotDataIntegrityTests-898447071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e6acfb11-941d-450b-8d93-0e32240df94a.4a5c6e12-2302-44db-ab0e-eedae12ca53f {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:40:03 devstack sudo[115866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e6acfb11-941d-450b-8d93-0e32240df94a.4a5c6e12-2302-44db-ab0e-eedae12ca53f Jul 31 12:40:03 devstack sudo[115866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:40:03 devstack sudo[115866]: pam_unix(sudo:session): session closed for user root Jul 31 12:40:03 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-87d7aaac-5146-481b-bd0b-b4871a21ab75 tempest-SnapshotDataIntegrityTests-898447071 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e6acfb11-941d-450b-8d93-0e32240df94a.4a5c6e12-2302-44db-ab0e-eedae12ca53f" returned: 0 in 0.621s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:40:03 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-87d7aaac-5146-481b-bd0b-b4871a21ab75 tempest-SnapshotDataIntegrityTests-898447071 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e6acfb11-941d-450b-8d93-0e32240df94a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89182) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 12:40:03 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[51e2d8f6-cb18-4478-9bc8-8fb58ed27aaf]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:40:03 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-87d7aaac-5146-481b-bd0b-b4871a21ab75 tempest-SnapshotDataIntegrityTests-898447071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e6acfb11-941d-450b-8d93-0e32240df94a {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:40:04 devstack sudo[115873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e6acfb11-941d-450b-8d93-0e32240df94a Jul 31 12:40:04 devstack sudo[115873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:40:04 devstack sudo[115873]: pam_unix(sudo:session): session closed for user root Jul 31 12:40:04 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-87d7aaac-5146-481b-bd0b-b4871a21ab75 tempest-SnapshotDataIntegrityTests-898447071 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e6acfb11-941d-450b-8d93-0e32240df94a" returned: 0 in 1.007s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:40:04 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-87d7aaac-5146-481b-bd0b-b4871a21ab75 tempest-SnapshotDataIntegrityTests-898447071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e6acfb11-941d-450b-8d93-0e32240df94a.4a5c6e12-2302-44db-ab0e-eedae12ca53f {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:40:04 devstack sudo[115879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e6acfb11-941d-450b-8d93-0e32240df94a.4a5c6e12-2302-44db-ab0e-eedae12ca53f Jul 31 12:40:04 devstack sudo[115879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:40:05 devstack sudo[115879]: pam_unix(sudo:session): session closed for user root Jul 31 12:40:05 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-87d7aaac-5146-481b-bd0b-b4871a21ab75 tempest-SnapshotDataIntegrityTests-898447071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e6acfb11-941d-450b-8d93-0e32240df94a.4a5c6e12-2302-44db-ab0e-eedae12ca53f" returned: 0 in 0.819s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:40:05 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-87d7aaac-5146-481b-bd0b-b4871a21ab75 tempest-SnapshotDataIntegrityTests-898447071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e6acfb11-941d-450b-8d93-0e32240df94a.4a5c6e12-2302-44db-ab0e-eedae12ca53f {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:40:05 devstack sudo[115888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e6acfb11-941d-450b-8d93-0e32240df94a.4a5c6e12-2302-44db-ab0e-eedae12ca53f Jul 31 12:40:05 devstack sudo[115888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:40:05 devstack sudo[115888]: pam_unix(sudo:session): session closed for user root Jul 31 12:40:05 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-87d7aaac-5146-481b-bd0b-b4871a21ab75 tempest-SnapshotDataIntegrityTests-898447071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e6acfb11-941d-450b-8d93-0e32240df94a.4a5c6e12-2302-44db-ab0e-eedae12ca53f" returned: 0 in 0.496s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:40:05 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-87d7aaac-5146-481b-bd0b-b4871a21ab75 tempest-SnapshotDataIntegrityTests-898447071 None] Lock "cinder-quobyte-4a5c6e12-2302-44db-ab0e-eedae12ca53f" released by "_delete_snapshot" :: held 3.209s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:40:05 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-87d7aaac-5146-481b-bd0b-b4871a21ab75 tempest-SnapshotDataIntegrityTests-898447071 None] Lock "cinder-quobyte-e6acfb11-941d-450b-8d93-0e32240df94a" released by "delete_snapshot" :: held 3.258s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:40:06 devstack cinder-volume[89182]: DEBUG cinder.quota [None req-87d7aaac-5146-481b-bd0b-b4871a21ab75 tempest-SnapshotDataIntegrityTests-898447071 None] Created reservations ['18bf14c2-b610-40a5-b820-7b1a1a398f52', 'ee42b4fc-b0f1-4641-8c52-699e7d2afc45', 'e4d8c0df-414d-4780-b6e4-3541f6e83da3', '6a9af41b-94aa-450b-97e0-2b06d5bcbdeb'] {{(pid=89182) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 12:40:06 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-87d7aaac-5146-481b-bd0b-b4871a21ab75 tempest-SnapshotDataIntegrityTests-898447071 None] Delete snapshot completed successfully. Jul 31 12:40:06 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-87d7aaac-5146-481b-bd0b-b4871a21ab75 tempest-SnapshotDataIntegrityTests-898447071 None] Lock "cinder-4a5c6e12-2302-44db-ab0e-eedae12ca53f-delete_snapshot" released by "delete_snapshot" :: held 3.544s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:40:06 devstack sudo[115851]: pam_unix(sudo:session): session closed for user root Jul 31 12:40:06 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-1376463e-7c23-4b4e-ab97-d52ad7f3c9a4 tempest-SnapshotDependencyTests-1140392806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-d526e0b0-c57b-4ed1-98bd-b7a67d6a8c3f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-ed564ba6-1c81-4e11-9a7a-355f2f3425b8" returned: 0 in 4.559s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:40:06 devstack cinder-volume[89182]: DEBUG cinder.image.image_utils [None req-1376463e-7c23-4b4e-ab97-d52ad7f3c9a4 tempest-SnapshotDependencyTests-1140392806 None] Image conversion details: src /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-d526e0b0-c57b-4ed1-98bd-b7a67d6a8c3f, size 1024.00 MB, duration 4.56 sec, destination /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-ed564ba6-1c81-4e11-9a7a-355f2f3425b8 {{(pid=89182) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 31 12:40:06 devstack cinder-volume[89182]: INFO cinder.image.image_utils [None req-1376463e-7c23-4b4e-ab97-d52ad7f3c9a4 tempest-SnapshotDependencyTests-1140392806 None] Converted 1024.00 MB image at 224.55 MB/s Jul 31 12:40:06 devstack cinder-volume[89182]: WARNING cinder.volume.drivers.remotefs [None req-1376463e-7c23-4b4e-ab97-d52ad7f3c9a4 tempest-SnapshotDependencyTests-1140392806 None] /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-ed564ba6-1c81-4e11-9a7a-355f2f3425b8 is being set with open permissions: ugo+rw Jul 31 12:40:06 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-1376463e-7c23-4b4e-ab97-d52ad7f3c9a4 tempest-SnapshotDependencyTests-1140392806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-ed564ba6-1c81-4e11-9a7a-355f2f3425b8 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:40:06 devstack sudo[115895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-ed564ba6-1c81-4e11-9a7a-355f2f3425b8 Jul 31 12:40:06 devstack sudo[115895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:40:06 devstack sudo[115895]: pam_unix(sudo:session): session closed for user root Jul 31 12:40:06 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-1376463e-7c23-4b4e-ab97-d52ad7f3c9a4 tempest-SnapshotDependencyTests-1140392806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-ed564ba6-1c81-4e11-9a7a-355f2f3425b8" returned: 0 in 0.254s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:40:06 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-1376463e-7c23-4b4e-ab97-d52ad7f3c9a4 tempest-SnapshotDependencyTests-1140392806 None] Lock "cinder-quobyte-ed564ba6-1c81-4e11-9a7a-355f2f3425b8" released by "_copy_volume_from_snapshot" :: held 5.690s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:40:06 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-1376463e-7c23-4b4e-ab97-d52ad7f3c9a4 tempest-SnapshotDependencyTests-1140392806 None] Lock "cinder-quobyte-a810f49f-e7b7-4168-8d65-06051ca7e87b-ed564ba6-1c81-4e11-9a7a-355f2f3425b8" released by "_create_volume_from_snapshot" :: held 5.752s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:40:06 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-1376463e-7c23-4b4e-ab97-d52ad7f3c9a4 tempest-SnapshotDependencyTests-1140392806 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.769s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:40:06 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-645ea845-c1be-476b-afe0-d53989944148 tempest-ProjectMemberTests-969865867 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.109s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:40:06 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-645ea845-c1be-476b-afe0-d53989944148 tempest-ProjectMemberTests-969865867 None] Creating offline snapshot 3da55021-0162-4e17-b0eb-d01947f31b83 of volume 119f46b6-5baf-45e0-ad45-43022ab6f300 {{(pid=89182) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 31 12:40:06 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-1376463e-7c23-4b4e-ab97-d52ad7f3c9a4 tempest-SnapshotDependencyTests-1140392806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f854b2c-d320-4b44-acaa-d011e27ca0c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ed564ba6-1c81-4e11-9a7a-355f2f3425b8', 'volume_size': 1, 'snapshot_id': 'a810f49f-e7b7-4168-8d65-06051ca7e87b'}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:40:06 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-1376463e-7c23-4b4e-ab97-d52ad7f3c9a4 tempest-SnapshotDependencyTests-1140392806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9097a74-0034-44f5-a557-b1fe68b4f738) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:40:06 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bf24860-c385-43fd-a4e0-50235b8f3626]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:40:06 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-645ea845-c1be-476b-afe0-d53989944148 tempest-ProjectMemberTests-969865867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-119f46b6-5baf-45e0-ad45-43022ab6f300 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:40:06 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-1376463e-7c23-4b4e-ab97-d52ad7f3c9a4 tempest-SnapshotDependencyTests-1140392806 None] Volume volume-ed564ba6-1c81-4e11-9a7a-355f2f3425b8 (ed564ba6-1c81-4e11-9a7a-355f2f3425b8): created successfully Jul 31 12:40:06 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-1376463e-7c23-4b4e-ab97-d52ad7f3c9a4 tempest-SnapshotDependencyTests-1140392806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9097a74-0034-44f5-a557-b1fe68b4f738) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:40:06 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-1376463e-7c23-4b4e-ab97-d52ad7f3c9a4 tempest-SnapshotDependencyTests-1140392806 None] Flow 'volume_create_manager' (59c9749c-e01a-4bc1-9fcc-67800d6e78de) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:40:06 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-1376463e-7c23-4b4e-ab97-d52ad7f3c9a4 tempest-SnapshotDependencyTests-1140392806 None] Created volume successfully. Jul 31 12:40:06 devstack sudo[115898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-119f46b6-5baf-45e0-ad45-43022ab6f300 Jul 31 12:40:06 devstack sudo[115898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:40:06 devstack sudo[115898]: pam_unix(sudo:session): session closed for user root Jul 31 12:40:06 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-645ea845-c1be-476b-afe0-d53989944148 tempest-ProjectMemberTests-969865867 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-119f46b6-5baf-45e0-ad45-43022ab6f300" returned: 0 in 0.366s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:40:06 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-645ea845-c1be-476b-afe0-d53989944148 tempest-ProjectMemberTests-969865867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-119f46b6-5baf-45e0-ad45-43022ab6f300,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-119f46b6-5baf-45e0-ad45-43022ab6f300.3da55021-0162-4e17-b0eb-d01947f31b83 1G {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:40:07 devstack sudo[115903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-119f46b6-5baf-45e0-ad45-43022ab6f300,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-119f46b6-5baf-45e0-ad45-43022ab6f300.3da55021-0162-4e17-b0eb-d01947f31b83 1G Jul 31 12:40:07 devstack sudo[115903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:40:07 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-cbf9a8eb-a758-4716-bb26-410734a36433 tempest-SnapshotDataIntegrityTests-898447071 None] Acquiring lock "cinder-e6acfb11-941d-450b-8d93-0e32240df94a-delete_volume" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:40:07 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-cbf9a8eb-a758-4716-bb26-410734a36433 tempest-SnapshotDataIntegrityTests-898447071 None] Lock "cinder-e6acfb11-941d-450b-8d93-0e32240df94a-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:40:07 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-cbf9a8eb-a758-4716-bb26-410734a36433 tempest-SnapshotDataIntegrityTests-898447071 None] Acquiring lock "cinder-quobyte-e6acfb11-941d-450b-8d93-0e32240df94a" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:40:07 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-cbf9a8eb-a758-4716-bb26-410734a36433 tempest-SnapshotDataIntegrityTests-898447071 None] Lock "cinder-quobyte-e6acfb11-941d-450b-8d93-0e32240df94a" acquired by "delete_volume" :: waited 0.014s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:40:07 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[fba80ed9-dc99-44cf-81ab-fed3adfd63b9]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:40:07 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-cbf9a8eb-a758-4716-bb26-410734a36433 tempest-SnapshotDataIntegrityTests-898447071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e6acfb11-941d-450b-8d93-0e32240df94a {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:40:07 devstack sudo[115909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e6acfb11-941d-450b-8d93-0e32240df94a Jul 31 12:40:07 devstack sudo[115909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:40:07 devstack sudo[115903]: pam_unix(sudo:session): session closed for user root Jul 31 12:40:07 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-645ea845-c1be-476b-afe0-d53989944148 tempest-ProjectMemberTests-969865867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-119f46b6-5baf-45e0-ad45-43022ab6f300,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-119f46b6-5baf-45e0-ad45-43022ab6f300.3da55021-0162-4e17-b0eb-d01947f31b83 1G" returned: 0 in 0.466s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:40:07 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-645ea845-c1be-476b-afe0-d53989944148 tempest-ProjectMemberTests-969865867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-119f46b6-5baf-45e0-ad45-43022ab6f300 -F qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-119f46b6-5baf-45e0-ad45-43022ab6f300.3da55021-0162-4e17-b0eb-d01947f31b83 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:40:07 devstack sudo[115912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-119f46b6-5baf-45e0-ad45-43022ab6f300 -F qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-119f46b6-5baf-45e0-ad45-43022ab6f300.3da55021-0162-4e17-b0eb-d01947f31b83 Jul 31 12:40:07 devstack sudo[115912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:40:07 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-91ed56dc-d209-4610-9117-14face627678 tempest-SnapshotDependencyTests-1140392806 None] Acquiring lock "cinder-a810f49f-e7b7-4168-8d65-06051ca7e87b-delete_snapshot" by "delete_snapshot" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:40:07 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-91ed56dc-d209-4610-9117-14face627678 tempest-SnapshotDependencyTests-1140392806 None] Lock "cinder-a810f49f-e7b7-4168-8d65-06051ca7e87b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:40:07 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-91ed56dc-d209-4610-9117-14face627678 tempest-SnapshotDependencyTests-1140392806 None] Acquiring lock "cinder-quobyte-d526e0b0-c57b-4ed1-98bd-b7a67d6a8c3f" by "delete_snapshot" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:40:07 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-91ed56dc-d209-4610-9117-14face627678 tempest-SnapshotDependencyTests-1140392806 None] Lock "cinder-quobyte-d526e0b0-c57b-4ed1-98bd-b7a67d6a8c3f" acquired by "delete_snapshot" :: waited 0.022s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:40:07 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-91ed56dc-d209-4610-9117-14face627678 tempest-SnapshotDependencyTests-1140392806 None] Acquiring lock "cinder-quobyte-a810f49f-e7b7-4168-8d65-06051ca7e87b" by "_delete_snapshot" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:40:07 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-91ed56dc-d209-4610-9117-14face627678 tempest-SnapshotDependencyTests-1140392806 None] Lock "cinder-quobyte-a810f49f-e7b7-4168-8d65-06051ca7e87b" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:40:07 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-91ed56dc-d209-4610-9117-14face627678 tempest-SnapshotDependencyTests-1140392806 None] Deleting offline snapshot a810f49f-e7b7-4168-8d65-06051ca7e87b of volume d526e0b0-c57b-4ed1-98bd-b7a67d6a8c3f {{(pid=89182) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 31 12:40:07 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-91ed56dc-d209-4610-9117-14face627678 tempest-SnapshotDependencyTests-1140392806 None] snapshot_file for this snap is: volume-d526e0b0-c57b-4ed1-98bd-b7a67d6a8c3f.a810f49f-e7b7-4168-8d65-06051ca7e87b {{(pid=89182) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 31 12:40:07 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec398678-e294-447c-8010-1fa5dca2e814]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:40:07 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-91ed56dc-d209-4610-9117-14face627678 tempest-SnapshotDependencyTests-1140392806 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-d526e0b0-c57b-4ed1-98bd-b7a67d6a8c3f.a810f49f-e7b7-4168-8d65-06051ca7e87b {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:40:07 devstack sudo[115909]: pam_unix(sudo:session): session closed for user root Jul 31 12:40:07 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-cbf9a8eb-a758-4716-bb26-410734a36433 tempest-SnapshotDataIntegrityTests-898447071 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e6acfb11-941d-450b-8d93-0e32240df94a" returned: 0 in 0.394s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:40:07 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-cbf9a8eb-a758-4716-bb26-410734a36433 tempest-SnapshotDataIntegrityTests-898447071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e6acfb11-941d-450b-8d93-0e32240df94a {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:40:07 devstack sudo[115920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e6acfb11-941d-450b-8d93-0e32240df94a Jul 31 12:40:07 devstack sudo[115920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:40:07 devstack sudo[115916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-d526e0b0-c57b-4ed1-98bd-b7a67d6a8c3f.a810f49f-e7b7-4168-8d65-06051ca7e87b Jul 31 12:40:07 devstack sudo[115916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:40:07 devstack sudo[115912]: pam_unix(sudo:session): session closed for user root Jul 31 12:40:07 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-645ea845-c1be-476b-afe0-d53989944148 tempest-ProjectMemberTests-969865867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-119f46b6-5baf-45e0-ad45-43022ab6f300 -F qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-119f46b6-5baf-45e0-ad45-43022ab6f300.3da55021-0162-4e17-b0eb-d01947f31b83" returned: 0 in 0.340s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:40:07 devstack cinder-volume[89182]: WARNING cinder.volume.drivers.remotefs [None req-645ea845-c1be-476b-afe0-d53989944148 tempest-ProjectMemberTests-969865867 None] /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-119f46b6-5baf-45e0-ad45-43022ab6f300.3da55021-0162-4e17-b0eb-d01947f31b83 is being set with open permissions: ugo+rw Jul 31 12:40:07 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-645ea845-c1be-476b-afe0-d53989944148 tempest-ProjectMemberTests-969865867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-119f46b6-5baf-45e0-ad45-43022ab6f300.3da55021-0162-4e17-b0eb-d01947f31b83 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:40:07 devstack sudo[115924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-119f46b6-5baf-45e0-ad45-43022ab6f300.3da55021-0162-4e17-b0eb-d01947f31b83 Jul 31 12:40:07 devstack sudo[115924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:40:07 devstack sudo[115920]: pam_unix(sudo:session): session closed for user root Jul 31 12:40:07 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-cbf9a8eb-a758-4716-bb26-410734a36433 tempest-SnapshotDataIntegrityTests-898447071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-e6acfb11-941d-450b-8d93-0e32240df94a" returned: 0 in 0.273s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:40:07 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-cbf9a8eb-a758-4716-bb26-410734a36433 tempest-SnapshotDataIntegrityTests-898447071 None] Lock "cinder-quobyte-e6acfb11-941d-450b-8d93-0e32240df94a" released by "delete_volume" :: held 0.729s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:40:07 devstack sudo[115916]: pam_unix(sudo:session): session closed for user root Jul 31 12:40:07 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-91ed56dc-d209-4610-9117-14face627678 tempest-SnapshotDependencyTests-1140392806 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-d526e0b0-c57b-4ed1-98bd-b7a67d6a8c3f.a810f49f-e7b7-4168-8d65-06051ca7e87b" returned: 0 in 0.398s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:40:07 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-91ed56dc-d209-4610-9117-14face627678 tempest-SnapshotDependencyTests-1140392806 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d526e0b0-c57b-4ed1-98bd-b7a67d6a8c3f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89182) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 12:40:08 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[fba29e78-552e-44c3-8108-bb1d0de71ac7]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:40:08 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-91ed56dc-d209-4610-9117-14face627678 tempest-SnapshotDependencyTests-1140392806 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-d526e0b0-c57b-4ed1-98bd-b7a67d6a8c3f {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:40:08 devstack sudo[115924]: pam_unix(sudo:session): session closed for user root Jul 31 12:40:08 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-645ea845-c1be-476b-afe0-d53989944148 tempest-ProjectMemberTests-969865867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-119f46b6-5baf-45e0-ad45-43022ab6f300.3da55021-0162-4e17-b0eb-d01947f31b83" returned: 0 in 0.256s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:40:08 devstack cinder-volume[89182]: DEBUG cinder.quota [None req-cbf9a8eb-a758-4716-bb26-410734a36433 tempest-SnapshotDataIntegrityTests-898447071 None] Created reservations ['5d92c3c3-462f-4953-929d-356906ec893b', '114d3aec-203c-4db5-b7ee-758cd07ada95', 'ea16c6e7-1d5d-4f6f-8676-461510a00dde', '24156ee2-1d40-4bc2-b809-49edaa8b69ad'] {{(pid=89182) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 12:40:08 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-645ea845-c1be-476b-afe0-d53989944148 tempest-ProjectMemberTests-969865867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-119f46b6-5baf-45e0-ad45-43022ab6f300.info {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:40:08 devstack sudo[115932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-119f46b6-5baf-45e0-ad45-43022ab6f300.info Jul 31 12:40:08 devstack sudo[115932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:40:08 devstack sudo[115931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-d526e0b0-c57b-4ed1-98bd-b7a67d6a8c3f Jul 31 12:40:08 devstack sudo[115931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:40:08 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-cbf9a8eb-a758-4716-bb26-410734a36433 tempest-SnapshotDataIntegrityTests-898447071 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:40:08 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-cbf9a8eb-a758-4716-bb26-410734a36433 tempest-SnapshotDataIntegrityTests-898447071 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:40:08 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-cbf9a8eb-a758-4716-bb26-410734a36433 tempest-SnapshotDataIntegrityTests-898447071 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:40:08 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-cbf9a8eb-a758-4716-bb26-410734a36433 tempest-SnapshotDataIntegrityTests-898447071 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:40:08 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-cbf9a8eb-a758-4716-bb26-410734a36433 tempest-SnapshotDataIntegrityTests-898447071 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:40:08 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-cbf9a8eb-a758-4716-bb26-410734a36433 tempest-SnapshotDataIntegrityTests-898447071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:40:08 devstack sudo[115935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 Jul 31 12:40:08 devstack sudo[115935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:40:08 devstack sudo[115932]: pam_unix(sudo:session): session closed for user root Jul 31 12:40:08 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-645ea845-c1be-476b-afe0-d53989944148 tempest-ProjectMemberTests-969865867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-119f46b6-5baf-45e0-ad45-43022ab6f300.info" returned: 0 in 0.290s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:40:08 devstack cinder-volume[89182]: WARNING cinder.volume.drivers.remotefs [None req-645ea845-c1be-476b-afe0-d53989944148 tempest-ProjectMemberTests-969865867 None] /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-119f46b6-5baf-45e0-ad45-43022ab6f300.info is being set with open permissions: ugo+rw Jul 31 12:40:08 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-645ea845-c1be-476b-afe0-d53989944148 tempest-ProjectMemberTests-969865867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-119f46b6-5baf-45e0-ad45-43022ab6f300.info {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:40:08 devstack sudo[115940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-119f46b6-5baf-45e0-ad45-43022ab6f300.info Jul 31 12:40:08 devstack sudo[115940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:40:08 devstack sudo[115935]: pam_unix(sudo:session): session closed for user root Jul 31 12:40:08 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-cbf9a8eb-a758-4716-bb26-410734a36433 tempest-SnapshotDataIntegrityTests-898447071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2" returned: 0 in 0.302s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:40:08 devstack cinder-volume[89182]: DEBUG cinder.manager [None req-cbf9a8eb-a758-4716-bb26-410734a36433 tempest-SnapshotDataIntegrityTests-898447071 None] Notifying Schedulers of capabilities ... {{(pid=89182) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 12:40:08 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-cbf9a8eb-a758-4716-bb26-410734a36433 tempest-SnapshotDataIntegrityTests-898447071 None] Deleted volume successfully. Jul 31 12:40:08 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-cbf9a8eb-a758-4716-bb26-410734a36433 tempest-SnapshotDataIntegrityTests-898447071 None] Lock "cinder-e6acfb11-941d-450b-8d93-0e32240df94a-delete_volume" released by "delete_volume" :: held 1.316s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:40:08 devstack sudo[115940]: pam_unix(sudo:session): session closed for user root Jul 31 12:40:08 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-645ea845-c1be-476b-afe0-d53989944148 tempest-ProjectMemberTests-969865867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-119f46b6-5baf-45e0-ad45-43022ab6f300.info" returned: 0 in 0.316s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:40:08 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-645ea845-c1be-476b-afe0-d53989944148 tempest-ProjectMemberTests-969865867 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.134s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:40:08 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-645ea845-c1be-476b-afe0-d53989944148 tempest-ProjectMemberTests-969865867 None] Create snapshot completed successfully Jul 31 12:40:08 devstack sudo[115931]: pam_unix(sudo:session): session closed for user root Jul 31 12:40:08 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-91ed56dc-d209-4610-9117-14face627678 tempest-SnapshotDependencyTests-1140392806 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-d526e0b0-c57b-4ed1-98bd-b7a67d6a8c3f" returned: 0 in 0.717s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:40:08 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-91ed56dc-d209-4610-9117-14face627678 tempest-SnapshotDependencyTests-1140392806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-d526e0b0-c57b-4ed1-98bd-b7a67d6a8c3f.a810f49f-e7b7-4168-8d65-06051ca7e87b {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:40:08 devstack sudo[115947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-d526e0b0-c57b-4ed1-98bd-b7a67d6a8c3f.a810f49f-e7b7-4168-8d65-06051ca7e87b Jul 31 12:40:08 devstack sudo[115947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:40:08 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-c23bc169-127b-4232-8864-9ccc6a6b1d4f tempest-ProjectMemberTests-969865867 None] Acquiring lock "cinder-3da55021-0162-4e17-b0eb-d01947f31b83-delete_snapshot" by "delete_snapshot" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:40:08 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-c23bc169-127b-4232-8864-9ccc6a6b1d4f tempest-ProjectMemberTests-969865867 None] Lock "cinder-3da55021-0162-4e17-b0eb-d01947f31b83-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:40:08 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-c23bc169-127b-4232-8864-9ccc6a6b1d4f tempest-ProjectMemberTests-969865867 None] Acquiring lock "cinder-quobyte-119f46b6-5baf-45e0-ad45-43022ab6f300" by "delete_snapshot" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:40:08 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-c23bc169-127b-4232-8864-9ccc6a6b1d4f tempest-ProjectMemberTests-969865867 None] Lock "cinder-quobyte-119f46b6-5baf-45e0-ad45-43022ab6f300" acquired by "delete_snapshot" :: waited 0.016s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:40:08 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-c23bc169-127b-4232-8864-9ccc6a6b1d4f tempest-ProjectMemberTests-969865867 None] Acquiring lock "cinder-quobyte-3da55021-0162-4e17-b0eb-d01947f31b83" by "_delete_snapshot" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:40:08 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-c23bc169-127b-4232-8864-9ccc6a6b1d4f tempest-ProjectMemberTests-969865867 None] Lock "cinder-quobyte-3da55021-0162-4e17-b0eb-d01947f31b83" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:40:08 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-c23bc169-127b-4232-8864-9ccc6a6b1d4f tempest-ProjectMemberTests-969865867 None] Deleting offline snapshot 3da55021-0162-4e17-b0eb-d01947f31b83 of volume 119f46b6-5baf-45e0-ad45-43022ab6f300 {{(pid=89182) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 31 12:40:09 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-c23bc169-127b-4232-8864-9ccc6a6b1d4f tempest-ProjectMemberTests-969865867 None] snapshot_file for this snap is: volume-119f46b6-5baf-45e0-ad45-43022ab6f300.3da55021-0162-4e17-b0eb-d01947f31b83 {{(pid=89182) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 31 12:40:09 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[718bb72e-0b5e-40bd-b607-3f4226cf5f2a]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:40:09 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-c23bc169-127b-4232-8864-9ccc6a6b1d4f tempest-ProjectMemberTests-969865867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-119f46b6-5baf-45e0-ad45-43022ab6f300.3da55021-0162-4e17-b0eb-d01947f31b83 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:40:09 devstack sudo[115964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-119f46b6-5baf-45e0-ad45-43022ab6f300.3da55021-0162-4e17-b0eb-d01947f31b83 Jul 31 12:40:09 devstack sudo[115964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:40:09 devstack sudo[115947]: pam_unix(sudo:session): session closed for user root Jul 31 12:40:09 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-91ed56dc-d209-4610-9117-14face627678 tempest-SnapshotDependencyTests-1140392806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-d526e0b0-c57b-4ed1-98bd-b7a67d6a8c3f.a810f49f-e7b7-4168-8d65-06051ca7e87b" returned: 0 in 0.581s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:40:09 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-91ed56dc-d209-4610-9117-14face627678 tempest-SnapshotDependencyTests-1140392806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-d526e0b0-c57b-4ed1-98bd-b7a67d6a8c3f.a810f49f-e7b7-4168-8d65-06051ca7e87b {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:40:09 devstack sudo[115977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-d526e0b0-c57b-4ed1-98bd-b7a67d6a8c3f.a810f49f-e7b7-4168-8d65-06051ca7e87b Jul 31 12:40:09 devstack sudo[115977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:40:09 devstack sudo[115964]: pam_unix(sudo:session): session closed for user root Jul 31 12:40:09 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-c23bc169-127b-4232-8864-9ccc6a6b1d4f tempest-ProjectMemberTests-969865867 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-119f46b6-5baf-45e0-ad45-43022ab6f300.3da55021-0162-4e17-b0eb-d01947f31b83" returned: 0 in 0.489s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:40:09 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-c23bc169-127b-4232-8864-9ccc6a6b1d4f tempest-ProjectMemberTests-969865867 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-119f46b6-5baf-45e0-ad45-43022ab6f300(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89182) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 12:40:09 devstack sudo[115977]: pam_unix(sudo:session): session closed for user root Jul 31 12:40:09 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-91ed56dc-d209-4610-9117-14face627678 tempest-SnapshotDependencyTests-1140392806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-d526e0b0-c57b-4ed1-98bd-b7a67d6a8c3f.a810f49f-e7b7-4168-8d65-06051ca7e87b" returned: 0 in 0.290s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:40:09 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[23cb13f0-3745-430d-8e99-922a5e8c4871]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:40:09 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-c23bc169-127b-4232-8864-9ccc6a6b1d4f tempest-ProjectMemberTests-969865867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-119f46b6-5baf-45e0-ad45-43022ab6f300 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:40:09 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-91ed56dc-d209-4610-9117-14face627678 tempest-SnapshotDependencyTests-1140392806 None] Lock "cinder-quobyte-a810f49f-e7b7-4168-8d65-06051ca7e87b" released by "_delete_snapshot" :: held 2.106s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:40:09 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-91ed56dc-d209-4610-9117-14face627678 tempest-SnapshotDependencyTests-1140392806 None] Lock "cinder-quobyte-d526e0b0-c57b-4ed1-98bd-b7a67d6a8c3f" released by "delete_snapshot" :: held 2.137s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:40:09 devstack cinder-volume[89182]: DEBUG cinder.quota [None req-91ed56dc-d209-4610-9117-14face627678 tempest-SnapshotDependencyTests-1140392806 None] Created reservations ['e04f9a71-8ecc-4e19-af7e-cd71c45bc517', '371891b2-409b-43ac-8d7f-8b179771effe', '9905602b-2178-460e-9ec6-07c63c5476ea', '033f0c51-6ab4-499f-bd73-6a5c493ff454'] {{(pid=89182) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 12:40:09 devstack sudo[115984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-119f46b6-5baf-45e0-ad45-43022ab6f300 Jul 31 12:40:09 devstack sudo[115984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:40:09 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-91ed56dc-d209-4610-9117-14face627678 tempest-SnapshotDependencyTests-1140392806 None] Delete snapshot completed successfully. Jul 31 12:40:09 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-91ed56dc-d209-4610-9117-14face627678 tempest-SnapshotDependencyTests-1140392806 None] Lock "cinder-a810f49f-e7b7-4168-8d65-06051ca7e87b-delete_snapshot" released by "delete_snapshot" :: held 2.317s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:40:10 devstack sudo[115984]: pam_unix(sudo:session): session closed for user root Jul 31 12:40:10 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-c23bc169-127b-4232-8864-9ccc6a6b1d4f tempest-ProjectMemberTests-969865867 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-119f46b6-5baf-45e0-ad45-43022ab6f300" returned: 0 in 0.456s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:40:10 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-c23bc169-127b-4232-8864-9ccc6a6b1d4f tempest-ProjectMemberTests-969865867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-119f46b6-5baf-45e0-ad45-43022ab6f300.3da55021-0162-4e17-b0eb-d01947f31b83 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:40:10 devstack sudo[115989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-119f46b6-5baf-45e0-ad45-43022ab6f300.3da55021-0162-4e17-b0eb-d01947f31b83 Jul 31 12:40:10 devstack sudo[115989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:40:10 devstack sudo[115989]: pam_unix(sudo:session): session closed for user root Jul 31 12:40:10 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-c23bc169-127b-4232-8864-9ccc6a6b1d4f tempest-ProjectMemberTests-969865867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-119f46b6-5baf-45e0-ad45-43022ab6f300.3da55021-0162-4e17-b0eb-d01947f31b83" returned: 0 in 0.375s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:40:10 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-c23bc169-127b-4232-8864-9ccc6a6b1d4f tempest-ProjectMemberTests-969865867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-119f46b6-5baf-45e0-ad45-43022ab6f300.3da55021-0162-4e17-b0eb-d01947f31b83 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:40:10 devstack sudo[115996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-119f46b6-5baf-45e0-ad45-43022ab6f300.3da55021-0162-4e17-b0eb-d01947f31b83 Jul 31 12:40:10 devstack sudo[115996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:40:10 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-b35f48a1-db2c-41b1-8e1c-568d0e4017aa tempest-SnapshotDependencyTests-1140392806 None] Acquiring lock "cinder-d526e0b0-c57b-4ed1-98bd-b7a67d6a8c3f-delete_volume" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:40:10 devstack sudo[115996]: pam_unix(sudo:session): session closed for user root Jul 31 12:40:10 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-c23bc169-127b-4232-8864-9ccc6a6b1d4f tempest-ProjectMemberTests-969865867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-119f46b6-5baf-45e0-ad45-43022ab6f300.3da55021-0162-4e17-b0eb-d01947f31b83" returned: 0 in 0.307s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:40:10 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-b35f48a1-db2c-41b1-8e1c-568d0e4017aa tempest-SnapshotDependencyTests-1140392806 None] Lock "cinder-d526e0b0-c57b-4ed1-98bd-b7a67d6a8c3f-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:40:10 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-c23bc169-127b-4232-8864-9ccc6a6b1d4f tempest-ProjectMemberTests-969865867 None] Lock "cinder-quobyte-3da55021-0162-4e17-b0eb-d01947f31b83" released by "_delete_snapshot" :: held 1.854s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:40:10 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-c23bc169-127b-4232-8864-9ccc6a6b1d4f tempest-ProjectMemberTests-969865867 None] Lock "cinder-quobyte-119f46b6-5baf-45e0-ad45-43022ab6f300" released by "delete_snapshot" :: held 1.882s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:40:10 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-b35f48a1-db2c-41b1-8e1c-568d0e4017aa tempest-SnapshotDependencyTests-1140392806 None] Acquiring lock "cinder-quobyte-d526e0b0-c57b-4ed1-98bd-b7a67d6a8c3f" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:40:10 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-b35f48a1-db2c-41b1-8e1c-568d0e4017aa tempest-SnapshotDependencyTests-1140392806 None] Lock "cinder-quobyte-d526e0b0-c57b-4ed1-98bd-b7a67d6a8c3f" acquired by "delete_volume" :: waited 0.021s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:40:10 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[fafbff00-5dae-4509-a8f4-41c05f1bda91]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:40:10 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-b35f48a1-db2c-41b1-8e1c-568d0e4017aa tempest-SnapshotDependencyTests-1140392806 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-d526e0b0-c57b-4ed1-98bd-b7a67d6a8c3f {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:40:10 devstack cinder-volume[89182]: DEBUG cinder.quota [None req-c23bc169-127b-4232-8864-9ccc6a6b1d4f tempest-ProjectMemberTests-969865867 None] Created reservations ['64d3dbe8-172b-464e-aa65-65e7146cf4d2', '792acab1-0bae-4b90-9628-78810d01ce36', '044821e7-6a38-4ddf-98d2-ac1685b3b5b9', '9e97e858-6b03-4167-a821-c41598d3e8ea'] {{(pid=89182) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 12:40:11 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-c23bc169-127b-4232-8864-9ccc6a6b1d4f tempest-ProjectMemberTests-969865867 None] Delete snapshot completed successfully. Jul 31 12:40:11 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-c23bc169-127b-4232-8864-9ccc6a6b1d4f tempest-ProjectMemberTests-969865867 None] Lock "cinder-3da55021-0162-4e17-b0eb-d01947f31b83-delete_snapshot" released by "delete_snapshot" :: held 2.144s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:40:11 devstack sudo[116000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-d526e0b0-c57b-4ed1-98bd-b7a67d6a8c3f Jul 31 12:40:11 devstack sudo[116000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:40:11 devstack sudo[116000]: pam_unix(sudo:session): session closed for user root Jul 31 12:40:11 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-b35f48a1-db2c-41b1-8e1c-568d0e4017aa tempest-SnapshotDependencyTests-1140392806 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-d526e0b0-c57b-4ed1-98bd-b7a67d6a8c3f" returned: 0 in 0.437s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:40:11 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-b35f48a1-db2c-41b1-8e1c-568d0e4017aa tempest-SnapshotDependencyTests-1140392806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-d526e0b0-c57b-4ed1-98bd-b7a67d6a8c3f {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:40:11 devstack sudo[116005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-d526e0b0-c57b-4ed1-98bd-b7a67d6a8c3f Jul 31 12:40:11 devstack sudo[116005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:40:11 devstack sudo[116005]: pam_unix(sudo:session): session closed for user root Jul 31 12:40:11 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-b35f48a1-db2c-41b1-8e1c-568d0e4017aa tempest-SnapshotDependencyTests-1140392806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-d526e0b0-c57b-4ed1-98bd-b7a67d6a8c3f" returned: 0 in 0.243s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:40:11 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-b35f48a1-db2c-41b1-8e1c-568d0e4017aa tempest-SnapshotDependencyTests-1140392806 None] Lock "cinder-quobyte-d526e0b0-c57b-4ed1-98bd-b7a67d6a8c3f" released by "delete_volume" :: held 0.755s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:40:11 devstack cinder-volume[89182]: DEBUG cinder.quota [None req-b35f48a1-db2c-41b1-8e1c-568d0e4017aa tempest-SnapshotDependencyTests-1140392806 None] Created reservations ['c500a473-0139-46ee-a85d-3b0401c43efb', 'deb05fe6-8f02-4bbe-8e42-4af80eb844af', '90f4ff8b-b177-480b-abce-851dec2f8400', '103bb7e3-0725-4d0d-a415-8afca3136124'] {{(pid=89182) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 12:40:11 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-b35f48a1-db2c-41b1-8e1c-568d0e4017aa tempest-SnapshotDependencyTests-1140392806 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:40:11 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-b35f48a1-db2c-41b1-8e1c-568d0e4017aa tempest-SnapshotDependencyTests-1140392806 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:40:11 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-b35f48a1-db2c-41b1-8e1c-568d0e4017aa tempest-SnapshotDependencyTests-1140392806 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:40:11 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-b35f48a1-db2c-41b1-8e1c-568d0e4017aa tempest-SnapshotDependencyTests-1140392806 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:40:11 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-b35f48a1-db2c-41b1-8e1c-568d0e4017aa tempest-SnapshotDependencyTests-1140392806 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:40:11 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-b35f48a1-db2c-41b1-8e1c-568d0e4017aa tempest-SnapshotDependencyTests-1140392806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:40:11 devstack sudo[116008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 Jul 31 12:40:11 devstack sudo[116008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:40:11 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-dc448260-d6fc-44f3-bb9b-bcf68a795468 tempest-SnapshotDependencyTests-1140392806 None] Acquiring lock "cinder-ed564ba6-1c81-4e11-9a7a-355f2f3425b8-delete_volume" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:40:11 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-dc448260-d6fc-44f3-bb9b-bcf68a795468 tempest-SnapshotDependencyTests-1140392806 None] Lock "cinder-ed564ba6-1c81-4e11-9a7a-355f2f3425b8-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:40:12 devstack sudo[116008]: pam_unix(sudo:session): session closed for user root Jul 31 12:40:12 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-b35f48a1-db2c-41b1-8e1c-568d0e4017aa tempest-SnapshotDependencyTests-1140392806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2" returned: 0 in 0.259s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:40:12 devstack cinder-volume[89182]: DEBUG cinder.manager [None req-b35f48a1-db2c-41b1-8e1c-568d0e4017aa tempest-SnapshotDependencyTests-1140392806 None] Notifying Schedulers of capabilities ... {{(pid=89182) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 12:40:12 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-dc448260-d6fc-44f3-bb9b-bcf68a795468 tempest-SnapshotDependencyTests-1140392806 None] Acquiring lock "cinder-quobyte-ed564ba6-1c81-4e11-9a7a-355f2f3425b8" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:40:12 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-b35f48a1-db2c-41b1-8e1c-568d0e4017aa tempest-SnapshotDependencyTests-1140392806 None] Deleted volume successfully. Jul 31 12:40:12 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-dc448260-d6fc-44f3-bb9b-bcf68a795468 tempest-SnapshotDependencyTests-1140392806 None] Lock "cinder-quobyte-ed564ba6-1c81-4e11-9a7a-355f2f3425b8" acquired by "delete_volume" :: waited 0.021s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:40:12 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-b35f48a1-db2c-41b1-8e1c-568d0e4017aa tempest-SnapshotDependencyTests-1140392806 None] Lock "cinder-d526e0b0-c57b-4ed1-98bd-b7a67d6a8c3f-delete_volume" released by "delete_volume" :: held 1.232s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:40:12 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e73fd4d-6a44-4dd0-b73a-bd6ab677794e]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:40:12 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-dc448260-d6fc-44f3-bb9b-bcf68a795468 tempest-SnapshotDependencyTests-1140392806 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-ed564ba6-1c81-4e11-9a7a-355f2f3425b8 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:40:12 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-948313d3-58a5-470e-9dde-2876042afe91 tempest-ProjectMemberTests-969865867 None] Acquiring lock "cinder-119f46b6-5baf-45e0-ad45-43022ab6f300-delete_volume" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:40:12 devstack sudo[116011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-ed564ba6-1c81-4e11-9a7a-355f2f3425b8 Jul 31 12:40:12 devstack sudo[116011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:40:12 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-948313d3-58a5-470e-9dde-2876042afe91 tempest-ProjectMemberTests-969865867 None] Lock "cinder-119f46b6-5baf-45e0-ad45-43022ab6f300-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:40:12 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-948313d3-58a5-470e-9dde-2876042afe91 tempest-ProjectMemberTests-969865867 None] Acquiring lock "cinder-quobyte-119f46b6-5baf-45e0-ad45-43022ab6f300" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:40:12 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-948313d3-58a5-470e-9dde-2876042afe91 tempest-ProjectMemberTests-969865867 None] Lock "cinder-quobyte-119f46b6-5baf-45e0-ad45-43022ab6f300" acquired by "delete_volume" :: waited 0.018s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:40:12 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cd28a3f-a544-4b1e-af92-205bcd0bbebe]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:40:12 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-948313d3-58a5-470e-9dde-2876042afe91 tempest-ProjectMemberTests-969865867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-119f46b6-5baf-45e0-ad45-43022ab6f300 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:40:12 devstack sudo[116013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-119f46b6-5baf-45e0-ad45-43022ab6f300 Jul 31 12:40:12 devstack sudo[116013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:40:12 devstack sudo[116011]: pam_unix(sudo:session): session closed for user root Jul 31 12:40:12 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-dc448260-d6fc-44f3-bb9b-bcf68a795468 tempest-SnapshotDependencyTests-1140392806 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-ed564ba6-1c81-4e11-9a7a-355f2f3425b8" returned: 0 in 0.388s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:40:12 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-dc448260-d6fc-44f3-bb9b-bcf68a795468 tempest-SnapshotDependencyTests-1140392806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-ed564ba6-1c81-4e11-9a7a-355f2f3425b8 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:40:12 devstack sudo[116019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-ed564ba6-1c81-4e11-9a7a-355f2f3425b8 Jul 31 12:40:12 devstack sudo[116019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:40:12 devstack sudo[116013]: pam_unix(sudo:session): session closed for user root Jul 31 12:40:12 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-948313d3-58a5-470e-9dde-2876042afe91 tempest-ProjectMemberTests-969865867 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-119f46b6-5baf-45e0-ad45-43022ab6f300" returned: 0 in 0.409s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:40:12 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-948313d3-58a5-470e-9dde-2876042afe91 tempest-ProjectMemberTests-969865867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-119f46b6-5baf-45e0-ad45-43022ab6f300 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:40:12 devstack sudo[116026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-119f46b6-5baf-45e0-ad45-43022ab6f300 Jul 31 12:40:12 devstack sudo[116026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:40:12 devstack sudo[116019]: pam_unix(sudo:session): session closed for user root Jul 31 12:40:12 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-dc448260-d6fc-44f3-bb9b-bcf68a795468 tempest-SnapshotDependencyTests-1140392806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-ed564ba6-1c81-4e11-9a7a-355f2f3425b8" returned: 0 in 0.295s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:40:12 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-dc448260-d6fc-44f3-bb9b-bcf68a795468 tempest-SnapshotDependencyTests-1140392806 None] Lock "cinder-quobyte-ed564ba6-1c81-4e11-9a7a-355f2f3425b8" released by "delete_volume" :: held 0.730s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:40:12 devstack cinder-volume[89182]: DEBUG cinder.quota [None req-dc448260-d6fc-44f3-bb9b-bcf68a795468 tempest-SnapshotDependencyTests-1140392806 None] Created reservations ['67f6c64e-abc6-4d04-9916-8f96aeef69f6', 'b07b06a6-3cf8-44ea-a308-dd8c9997300e', '39263349-92b6-444d-9002-597c0237a632', '76896139-5966-4879-ad2d-7788e2e63f25'] {{(pid=89182) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 12:40:12 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-dc448260-d6fc-44f3-bb9b-bcf68a795468 tempest-SnapshotDependencyTests-1140392806 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:40:12 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-dc448260-d6fc-44f3-bb9b-bcf68a795468 tempest-SnapshotDependencyTests-1140392806 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:40:12 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-dc448260-d6fc-44f3-bb9b-bcf68a795468 tempest-SnapshotDependencyTests-1140392806 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:40:12 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-dc448260-d6fc-44f3-bb9b-bcf68a795468 tempest-SnapshotDependencyTests-1140392806 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:40:12 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-dc448260-d6fc-44f3-bb9b-bcf68a795468 tempest-SnapshotDependencyTests-1140392806 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:40:12 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-dc448260-d6fc-44f3-bb9b-bcf68a795468 tempest-SnapshotDependencyTests-1140392806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:40:12 devstack sudo[116028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 Jul 31 12:40:12 devstack sudo[116028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:40:12 devstack sudo[116026]: pam_unix(sudo:session): session closed for user root Jul 31 12:40:12 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-948313d3-58a5-470e-9dde-2876042afe91 tempest-ProjectMemberTests-969865867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-119f46b6-5baf-45e0-ad45-43022ab6f300" returned: 0 in 0.303s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:40:13 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-948313d3-58a5-470e-9dde-2876042afe91 tempest-ProjectMemberTests-969865867 None] Lock "cinder-quobyte-119f46b6-5baf-45e0-ad45-43022ab6f300" released by "delete_volume" :: held 0.780s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:40:13 devstack cinder-volume[89182]: DEBUG cinder.quota [None req-948313d3-58a5-470e-9dde-2876042afe91 tempest-ProjectMemberTests-969865867 None] Created reservations ['b84ded15-7c37-401d-964a-693a621c7398', '7f122d9e-e591-487f-b229-85e2a4a3077f', 'f6b1b494-a54c-49ef-9130-84d5cf7cc224', '7eb5fd51-6f88-42f4-a2a9-7aba14f57edd'] {{(pid=89182) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 12:40:13 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-948313d3-58a5-470e-9dde-2876042afe91 tempest-ProjectMemberTests-969865867 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:40:13 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-948313d3-58a5-470e-9dde-2876042afe91 tempest-ProjectMemberTests-969865867 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:40:13 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-948313d3-58a5-470e-9dde-2876042afe91 tempest-ProjectMemberTests-969865867 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:40:13 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-948313d3-58a5-470e-9dde-2876042afe91 tempest-ProjectMemberTests-969865867 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:40:13 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-948313d3-58a5-470e-9dde-2876042afe91 tempest-ProjectMemberTests-969865867 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:40:13 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-948313d3-58a5-470e-9dde-2876042afe91 tempest-ProjectMemberTests-969865867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:40:13 devstack sudo[116028]: pam_unix(sudo:session): session closed for user root Jul 31 12:40:13 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-dc448260-d6fc-44f3-bb9b-bcf68a795468 tempest-SnapshotDependencyTests-1140392806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2" returned: 0 in 0.329s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:40:13 devstack cinder-volume[89182]: DEBUG cinder.manager [None req-dc448260-d6fc-44f3-bb9b-bcf68a795468 tempest-SnapshotDependencyTests-1140392806 None] Notifying Schedulers of capabilities ... {{(pid=89182) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 12:40:13 devstack sudo[116032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 Jul 31 12:40:13 devstack sudo[116032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:40:13 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-dc448260-d6fc-44f3-bb9b-bcf68a795468 tempest-SnapshotDependencyTests-1140392806 None] Deleted volume successfully. Jul 31 12:40:13 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-dc448260-d6fc-44f3-bb9b-bcf68a795468 tempest-SnapshotDependencyTests-1140392806 None] Lock "cinder-ed564ba6-1c81-4e11-9a7a-355f2f3425b8-delete_volume" released by "delete_volume" :: held 1.310s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:40:13 devstack sudo[116032]: pam_unix(sudo:session): session closed for user root Jul 31 12:40:13 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-948313d3-58a5-470e-9dde-2876042afe91 tempest-ProjectMemberTests-969865867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2" returned: 0 in 0.331s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:40:13 devstack cinder-volume[89182]: DEBUG cinder.manager [None req-948313d3-58a5-470e-9dde-2876042afe91 tempest-ProjectMemberTests-969865867 None] Notifying Schedulers of capabilities ... {{(pid=89182) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 12:40:13 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-948313d3-58a5-470e-9dde-2876042afe91 tempest-ProjectMemberTests-969865867 None] Deleted volume successfully. Jul 31 12:40:13 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-948313d3-58a5-470e-9dde-2876042afe91 tempest-ProjectMemberTests-969865867 None] Lock "cinder-119f46b6-5baf-45e0-ad45-43022ab6f300-delete_volume" released by "delete_volume" :: held 1.391s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:40:13 devstack cinder-volume[89182]: DEBUG cinder.volume.flows.manager.create_volume [None req-0eed283c-ad30-4452-a91e-5674952c31be tempest-ProjectMemberTests-969865867 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89182) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 12:40:13 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-0eed283c-ad30-4452-a91e-5674952c31be tempest-ProjectMemberTests-969865867 None] Flow 'volume_create_manager' (1eaa27d3-16f3-4ac8-9928-48f66507b92d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:40:13 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-0eed283c-ad30-4452-a91e-5674952c31be tempest-ProjectMemberTests-969865867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf54359b-eecb-4077-8db4-361cb767874f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:40:13 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-0eed283c-ad30-4452-a91e-5674952c31be tempest-ProjectMemberTests-969865867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf54359b-eecb-4077-8db4-361cb767874f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:40:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-892069957',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40227ec7-b004-411b-9462-247dce2ae1c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7618b523b3644b0aff23a331c24c373',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:40:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:40:14Z,use_quota=True,user_id='ef87d129d713438b8a1c61430735d914',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:40:13 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-0eed283c-ad30-4452-a91e-5674952c31be tempest-ProjectMemberTests-969865867 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99142540-3767-46d2-95bf-2ef713c0fa80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:40:13 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-0eed283c-ad30-4452-a91e-5674952c31be tempest-ProjectMemberTests-969865867 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99142540-3767-46d2-95bf-2ef713c0fa80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:40:13 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-0eed283c-ad30-4452-a91e-5674952c31be tempest-ProjectMemberTests-969865867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66751572-d6a6-4c34-ad9a-2a029103e56f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:40:13 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-0eed283c-ad30-4452-a91e-5674952c31be tempest-ProjectMemberTests-969865867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66751572-d6a6-4c34-ad9a-2a029103e56f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '40227ec7-b004-411b-9462-247dce2ae1c6', 'volume_name': 'volume-40227ec7-b004-411b-9462-247dce2ae1c6', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:40:13 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-0eed283c-ad30-4452-a91e-5674952c31be tempest-ProjectMemberTests-969865867 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b81e87a-c87d-4a70-a978-53aea48dc849) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:40:13 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-0eed283c-ad30-4452-a91e-5674952c31be tempest-ProjectMemberTests-969865867 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b81e87a-c87d-4a70-a978-53aea48dc849) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:40:13 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-0eed283c-ad30-4452-a91e-5674952c31be tempest-ProjectMemberTests-969865867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4877731-c534-42c7-9fa5-6e14d375753a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:40:13 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-0eed283c-ad30-4452-a91e-5674952c31be tempest-ProjectMemberTests-969865867 None] Volume 40227ec7-b004-411b-9462-247dce2ae1c6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-40227ec7-b004-411b-9462-247dce2ae1c6', 'volume_size': 1} Jul 31 12:40:13 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-0eed283c-ad30-4452-a91e-5674952c31be tempest-ProjectMemberTests-969865867 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:40:13 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-0eed283c-ad30-4452-a91e-5674952c31be tempest-ProjectMemberTests-969865867 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:40:13 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-0eed283c-ad30-4452-a91e-5674952c31be tempest-ProjectMemberTests-969865867 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:40:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-892069957',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40227ec7-b004-411b-9462-247dce2ae1c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7618b523b3644b0aff23a331c24c373',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:40:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:40:14Z,use_quota=True,user_id='ef87d129d713438b8a1c61430735d914',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)}" {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 12:40:13 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-0eed283c-ad30-4452-a91e-5674952c31be tempest-ProjectMemberTests-969865867 None] Creating volume 40227ec7-b004-411b-9462-247dce2ae1c6 {{(pid=89182) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 12:40:13 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-0eed283c-ad30-4452-a91e-5674952c31be tempest-ProjectMemberTests-969865867 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:40:13 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-0eed283c-ad30-4452-a91e-5674952c31be tempest-ProjectMemberTests-969865867 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:40:13 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-0eed283c-ad30-4452-a91e-5674952c31be tempest-ProjectMemberTests-969865867 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:40:13 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-0eed283c-ad30-4452-a91e-5674952c31be tempest-ProjectMemberTests-969865867 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:40:13 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-0eed283c-ad30-4452-a91e-5674952c31be tempest-ProjectMemberTests-969865867 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:40:13 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-0eed283c-ad30-4452-a91e-5674952c31be tempest-ProjectMemberTests-969865867 None] Selected osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 as target Quobyte volume. {{(pid=89182) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 12:40:13 devstack cinder-volume[89182]: INFO cinder.volume.drivers.remotefs [None req-0eed283c-ad30-4452-a91e-5674952c31be tempest-ProjectMemberTests-969865867 None] casted to osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 Jul 31 12:40:13 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-0eed283c-ad30-4452-a91e-5674952c31be tempest-ProjectMemberTests-969865867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-40227ec7-b004-411b-9462-247dce2ae1c6 1073741824 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:40:14 devstack sudo[116035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-40227ec7-b004-411b-9462-247dce2ae1c6 1073741824 Jul 31 12:40:14 devstack sudo[116035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:40:14 devstack sudo[116035]: pam_unix(sudo:session): session closed for user root Jul 31 12:40:14 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-0eed283c-ad30-4452-a91e-5674952c31be tempest-ProjectMemberTests-969865867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-40227ec7-b004-411b-9462-247dce2ae1c6 1073741824" returned: 0 in 0.495s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:40:14 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-0eed283c-ad30-4452-a91e-5674952c31be tempest-ProjectMemberTests-969865867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-40227ec7-b004-411b-9462-247dce2ae1c6 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:40:14 devstack sudo[116042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-40227ec7-b004-411b-9462-247dce2ae1c6 Jul 31 12:40:14 devstack sudo[116042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:40:14 devstack sudo[116042]: pam_unix(sudo:session): session closed for user root Jul 31 12:40:14 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-0eed283c-ad30-4452-a91e-5674952c31be tempest-ProjectMemberTests-969865867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-40227ec7-b004-411b-9462-247dce2ae1c6" returned: 0 in 0.279s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:40:14 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-0eed283c-ad30-4452-a91e-5674952c31be tempest-ProjectMemberTests-969865867 None] <== create_volume: return (822ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'} {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 12:40:14 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-0eed283c-ad30-4452-a91e-5674952c31be tempest-ProjectMemberTests-969865867 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.827s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:40:14 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-0eed283c-ad30-4452-a91e-5674952c31be tempest-ProjectMemberTests-969865867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4877731-c534-42c7-9fa5-6e14d375753a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-40227ec7-b004-411b-9462-247dce2ae1c6', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:40:14 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-0eed283c-ad30-4452-a91e-5674952c31be tempest-ProjectMemberTests-969865867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c90ba674-13af-4e41-ba14-fd9cf854c2be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:40:14 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-0eed283c-ad30-4452-a91e-5674952c31be tempest-ProjectMemberTests-969865867 None] Volume volume-40227ec7-b004-411b-9462-247dce2ae1c6 (40227ec7-b004-411b-9462-247dce2ae1c6): created successfully Jul 31 12:40:14 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-0eed283c-ad30-4452-a91e-5674952c31be tempest-ProjectMemberTests-969865867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c90ba674-13af-4e41-ba14-fd9cf854c2be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:40:14 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-0eed283c-ad30-4452-a91e-5674952c31be tempest-ProjectMemberTests-969865867 None] Flow 'volume_create_manager' (1eaa27d3-16f3-4ac8-9928-48f66507b92d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:40:14 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-0eed283c-ad30-4452-a91e-5674952c31be tempest-ProjectMemberTests-969865867 None] Created volume successfully. Jul 31 12:40:16 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-002463b4-7081-4ad3-97a0-553fdcf4360a tempest-ProjectMemberTests-969865867 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:40:16 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-002463b4-7081-4ad3-97a0-553fdcf4360a tempest-ProjectMemberTests-969865867 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:40:16 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-002463b4-7081-4ad3-97a0-553fdcf4360a tempest-ProjectMemberTests-969865867 None] Creating offline snapshot 75684ff2-51cf-48b5-bef7-3f890551eed9 of volume 40227ec7-b004-411b-9462-247dce2ae1c6 {{(pid=89182) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 31 12:40:16 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[396742b2-9e01-4111-b066-fcdbb452159e]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:40:16 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-002463b4-7081-4ad3-97a0-553fdcf4360a tempest-ProjectMemberTests-969865867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-40227ec7-b004-411b-9462-247dce2ae1c6 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:40:16 devstack sudo[116047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-40227ec7-b004-411b-9462-247dce2ae1c6 Jul 31 12:40:16 devstack sudo[116047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:40:16 devstack sudo[116047]: pam_unix(sudo:session): session closed for user root Jul 31 12:40:16 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-002463b4-7081-4ad3-97a0-553fdcf4360a tempest-ProjectMemberTests-969865867 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-40227ec7-b004-411b-9462-247dce2ae1c6" returned: 0 in 0.449s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:40:16 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-002463b4-7081-4ad3-97a0-553fdcf4360a tempest-ProjectMemberTests-969865867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-40227ec7-b004-411b-9462-247dce2ae1c6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-40227ec7-b004-411b-9462-247dce2ae1c6.75684ff2-51cf-48b5-bef7-3f890551eed9 1G {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:40:16 devstack sudo[116053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-40227ec7-b004-411b-9462-247dce2ae1c6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-40227ec7-b004-411b-9462-247dce2ae1c6.75684ff2-51cf-48b5-bef7-3f890551eed9 1G Jul 31 12:40:16 devstack sudo[116053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:40:17 devstack sudo[116053]: pam_unix(sudo:session): session closed for user root Jul 31 12:40:17 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-002463b4-7081-4ad3-97a0-553fdcf4360a tempest-ProjectMemberTests-969865867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-40227ec7-b004-411b-9462-247dce2ae1c6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-40227ec7-b004-411b-9462-247dce2ae1c6.75684ff2-51cf-48b5-bef7-3f890551eed9 1G" returned: 0 in 0.558s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:40:17 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-002463b4-7081-4ad3-97a0-553fdcf4360a tempest-ProjectMemberTests-969865867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-40227ec7-b004-411b-9462-247dce2ae1c6 -F qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-40227ec7-b004-411b-9462-247dce2ae1c6.75684ff2-51cf-48b5-bef7-3f890551eed9 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:40:17 devstack sudo[116061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-40227ec7-b004-411b-9462-247dce2ae1c6 -F qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-40227ec7-b004-411b-9462-247dce2ae1c6.75684ff2-51cf-48b5-bef7-3f890551eed9 Jul 31 12:40:17 devstack sudo[116061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:40:17 devstack sudo[116061]: pam_unix(sudo:session): session closed for user root Jul 31 12:40:17 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-002463b4-7081-4ad3-97a0-553fdcf4360a tempest-ProjectMemberTests-969865867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-40227ec7-b004-411b-9462-247dce2ae1c6 -F qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-40227ec7-b004-411b-9462-247dce2ae1c6.75684ff2-51cf-48b5-bef7-3f890551eed9" returned: 0 in 0.377s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:40:17 devstack cinder-volume[89182]: WARNING cinder.volume.drivers.remotefs [None req-002463b4-7081-4ad3-97a0-553fdcf4360a tempest-ProjectMemberTests-969865867 None] /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-40227ec7-b004-411b-9462-247dce2ae1c6.75684ff2-51cf-48b5-bef7-3f890551eed9 is being set with open permissions: ugo+rw Jul 31 12:40:17 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-002463b4-7081-4ad3-97a0-553fdcf4360a tempest-ProjectMemberTests-969865867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-40227ec7-b004-411b-9462-247dce2ae1c6.75684ff2-51cf-48b5-bef7-3f890551eed9 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:40:17 devstack sudo[116067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-40227ec7-b004-411b-9462-247dce2ae1c6.75684ff2-51cf-48b5-bef7-3f890551eed9 Jul 31 12:40:17 devstack sudo[116067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:40:18 devstack sudo[116067]: pam_unix(sudo:session): session closed for user root Jul 31 12:40:18 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-002463b4-7081-4ad3-97a0-553fdcf4360a tempest-ProjectMemberTests-969865867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-40227ec7-b004-411b-9462-247dce2ae1c6.75684ff2-51cf-48b5-bef7-3f890551eed9" returned: 0 in 0.298s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:40:18 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-002463b4-7081-4ad3-97a0-553fdcf4360a tempest-ProjectMemberTests-969865867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-40227ec7-b004-411b-9462-247dce2ae1c6.info {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:40:18 devstack sudo[116070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-40227ec7-b004-411b-9462-247dce2ae1c6.info Jul 31 12:40:18 devstack sudo[116070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:40:18 devstack sudo[116070]: pam_unix(sudo:session): session closed for user root Jul 31 12:40:18 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-002463b4-7081-4ad3-97a0-553fdcf4360a tempest-ProjectMemberTests-969865867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-40227ec7-b004-411b-9462-247dce2ae1c6.info" returned: 0 in 0.287s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:40:18 devstack cinder-volume[89182]: WARNING cinder.volume.drivers.remotefs [None req-002463b4-7081-4ad3-97a0-553fdcf4360a tempest-ProjectMemberTests-969865867 None] /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-40227ec7-b004-411b-9462-247dce2ae1c6.info is being set with open permissions: ugo+rw Jul 31 12:40:18 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-002463b4-7081-4ad3-97a0-553fdcf4360a tempest-ProjectMemberTests-969865867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-40227ec7-b004-411b-9462-247dce2ae1c6.info {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:40:18 devstack sudo[116073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-40227ec7-b004-411b-9462-247dce2ae1c6.info Jul 31 12:40:18 devstack sudo[116073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:40:18 devstack sudo[116073]: pam_unix(sudo:session): session closed for user root Jul 31 12:40:18 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-002463b4-7081-4ad3-97a0-553fdcf4360a tempest-ProjectMemberTests-969865867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-40227ec7-b004-411b-9462-247dce2ae1c6.info" returned: 0 in 0.280s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:40:18 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-002463b4-7081-4ad3-97a0-553fdcf4360a tempest-ProjectMemberTests-969865867 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.383s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:40:18 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-002463b4-7081-4ad3-97a0-553fdcf4360a tempest-ProjectMemberTests-969865867 None] Create snapshot completed successfully Jul 31 12:40:19 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-c7e7ff5c-6333-4bdf-8997-bf347fc686e5 tempest-ProjectMemberTests-969865867 None] Acquiring lock "cinder-75684ff2-51cf-48b5-bef7-3f890551eed9-delete_snapshot" by "delete_snapshot" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:40:19 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-c7e7ff5c-6333-4bdf-8997-bf347fc686e5 tempest-ProjectMemberTests-969865867 None] Lock "cinder-75684ff2-51cf-48b5-bef7-3f890551eed9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:40:19 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-c7e7ff5c-6333-4bdf-8997-bf347fc686e5 tempest-ProjectMemberTests-969865867 None] Acquiring lock "cinder-quobyte-40227ec7-b004-411b-9462-247dce2ae1c6" by "delete_snapshot" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:40:19 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-c7e7ff5c-6333-4bdf-8997-bf347fc686e5 tempest-ProjectMemberTests-969865867 None] Lock "cinder-quobyte-40227ec7-b004-411b-9462-247dce2ae1c6" acquired by "delete_snapshot" :: waited 0.018s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:40:19 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-c7e7ff5c-6333-4bdf-8997-bf347fc686e5 tempest-ProjectMemberTests-969865867 None] Acquiring lock "cinder-quobyte-75684ff2-51cf-48b5-bef7-3f890551eed9" by "_delete_snapshot" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:40:19 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-c7e7ff5c-6333-4bdf-8997-bf347fc686e5 tempest-ProjectMemberTests-969865867 None] Lock "cinder-quobyte-75684ff2-51cf-48b5-bef7-3f890551eed9" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:40:19 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-c7e7ff5c-6333-4bdf-8997-bf347fc686e5 tempest-ProjectMemberTests-969865867 None] Deleting offline snapshot 75684ff2-51cf-48b5-bef7-3f890551eed9 of volume 40227ec7-b004-411b-9462-247dce2ae1c6 {{(pid=89182) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 31 12:40:19 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-c7e7ff5c-6333-4bdf-8997-bf347fc686e5 tempest-ProjectMemberTests-969865867 None] snapshot_file for this snap is: volume-40227ec7-b004-411b-9462-247dce2ae1c6.75684ff2-51cf-48b5-bef7-3f890551eed9 {{(pid=89182) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 31 12:40:19 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[9687c87c-1379-489a-9278-f859d1663dea]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:40:19 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-c7e7ff5c-6333-4bdf-8997-bf347fc686e5 tempest-ProjectMemberTests-969865867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-40227ec7-b004-411b-9462-247dce2ae1c6.75684ff2-51cf-48b5-bef7-3f890551eed9 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:40:19 devstack sudo[116078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-40227ec7-b004-411b-9462-247dce2ae1c6.75684ff2-51cf-48b5-bef7-3f890551eed9 Jul 31 12:40:19 devstack sudo[116078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:40:19 devstack sudo[116078]: pam_unix(sudo:session): session closed for user root Jul 31 12:40:19 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-c7e7ff5c-6333-4bdf-8997-bf347fc686e5 tempest-ProjectMemberTests-969865867 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-40227ec7-b004-411b-9462-247dce2ae1c6.75684ff2-51cf-48b5-bef7-3f890551eed9" returned: 0 in 0.468s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:40:19 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-c7e7ff5c-6333-4bdf-8997-bf347fc686e5 tempest-ProjectMemberTests-969865867 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-40227ec7-b004-411b-9462-247dce2ae1c6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89182) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 12:40:20 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bbbf418-6781-4460-9789-3197115deace]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:40:20 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-c7e7ff5c-6333-4bdf-8997-bf347fc686e5 tempest-ProjectMemberTests-969865867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-40227ec7-b004-411b-9462-247dce2ae1c6 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:40:20 devstack sudo[116084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-40227ec7-b004-411b-9462-247dce2ae1c6 Jul 31 12:40:20 devstack sudo[116084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:40:20 devstack sudo[116084]: pam_unix(sudo:session): session closed for user root Jul 31 12:40:20 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-c7e7ff5c-6333-4bdf-8997-bf347fc686e5 tempest-ProjectMemberTests-969865867 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-40227ec7-b004-411b-9462-247dce2ae1c6" returned: 0 in 0.499s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:40:20 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-c7e7ff5c-6333-4bdf-8997-bf347fc686e5 tempest-ProjectMemberTests-969865867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-40227ec7-b004-411b-9462-247dce2ae1c6.75684ff2-51cf-48b5-bef7-3f890551eed9 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:40:20 devstack sudo[116090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-40227ec7-b004-411b-9462-247dce2ae1c6.75684ff2-51cf-48b5-bef7-3f890551eed9 Jul 31 12:40:20 devstack sudo[116090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:40:20 devstack sudo[116090]: pam_unix(sudo:session): session closed for user root Jul 31 12:40:20 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-c7e7ff5c-6333-4bdf-8997-bf347fc686e5 tempest-ProjectMemberTests-969865867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-40227ec7-b004-411b-9462-247dce2ae1c6.75684ff2-51cf-48b5-bef7-3f890551eed9" returned: 0 in 0.470s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:40:20 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-c7e7ff5c-6333-4bdf-8997-bf347fc686e5 tempest-ProjectMemberTests-969865867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-40227ec7-b004-411b-9462-247dce2ae1c6.75684ff2-51cf-48b5-bef7-3f890551eed9 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:40:21 devstack sudo[116096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-40227ec7-b004-411b-9462-247dce2ae1c6.75684ff2-51cf-48b5-bef7-3f890551eed9 Jul 31 12:40:21 devstack sudo[116096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:40:21 devstack sudo[116096]: pam_unix(sudo:session): session closed for user root Jul 31 12:40:21 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-c7e7ff5c-6333-4bdf-8997-bf347fc686e5 tempest-ProjectMemberTests-969865867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-40227ec7-b004-411b-9462-247dce2ae1c6.75684ff2-51cf-48b5-bef7-3f890551eed9" returned: 0 in 0.284s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:40:21 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-c7e7ff5c-6333-4bdf-8997-bf347fc686e5 tempest-ProjectMemberTests-969865867 None] Lock "cinder-quobyte-75684ff2-51cf-48b5-bef7-3f890551eed9" released by "_delete_snapshot" :: held 1.861s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:40:21 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-c7e7ff5c-6333-4bdf-8997-bf347fc686e5 tempest-ProjectMemberTests-969865867 None] Lock "cinder-quobyte-40227ec7-b004-411b-9462-247dce2ae1c6" released by "delete_snapshot" :: held 1.889s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:40:21 devstack cinder-volume[89182]: DEBUG dbcounter [-] [89182] Writing DB stats cinder:SELECT=156,cinder:INSERT=51,cinder:UPDATE=206,cinder:DELETE=13 {{(pid=89182) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 12:40:21 devstack cinder-volume[89182]: DEBUG dbcounter [-] [89182] Writing DB stats cinder:INSERT=53,cinder:SELECT=174,cinder:UPDATE=186,cinder:DELETE=16 {{(pid=89182) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 12:40:21 devstack cinder-volume[89182]: DEBUG cinder.quota [None req-c7e7ff5c-6333-4bdf-8997-bf347fc686e5 tempest-ProjectMemberTests-969865867 None] Created reservations ['275637e4-1467-4a29-a422-6b8a098b178b', 'c58c45db-adb8-4f5f-bbba-01fc574a39b4', '7163473e-ca93-405c-946f-0e6867893d7b', '1a622db9-1e89-4201-b71d-67c91a95bab5'] {{(pid=89182) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 12:40:21 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-c7e7ff5c-6333-4bdf-8997-bf347fc686e5 tempest-ProjectMemberTests-969865867 None] Delete snapshot completed successfully. Jul 31 12:40:21 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-c7e7ff5c-6333-4bdf-8997-bf347fc686e5 tempest-ProjectMemberTests-969865867 None] Lock "cinder-75684ff2-51cf-48b5-bef7-3f890551eed9-delete_snapshot" released by "delete_snapshot" :: held 2.119s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:40:21 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-b4efc711-d145-4e16-9fe3-aa50558ed274 tempest-ProjectMemberTests-969865867 None] Acquiring lock "cinder-40227ec7-b004-411b-9462-247dce2ae1c6-delete_volume" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:40:21 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-b4efc711-d145-4e16-9fe3-aa50558ed274 tempest-ProjectMemberTests-969865867 None] Lock "cinder-40227ec7-b004-411b-9462-247dce2ae1c6-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:40:21 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-b4efc711-d145-4e16-9fe3-aa50558ed274 tempest-ProjectMemberTests-969865867 None] Acquiring lock "cinder-quobyte-40227ec7-b004-411b-9462-247dce2ae1c6" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:40:21 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-b4efc711-d145-4e16-9fe3-aa50558ed274 tempest-ProjectMemberTests-969865867 None] Lock "cinder-quobyte-40227ec7-b004-411b-9462-247dce2ae1c6" acquired by "delete_volume" :: waited 0.029s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:40:21 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[b30970b2-0343-41d7-ac80-f601cf472630]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:40:21 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-b4efc711-d145-4e16-9fe3-aa50558ed274 tempest-ProjectMemberTests-969865867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-40227ec7-b004-411b-9462-247dce2ae1c6 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:40:21 devstack sudo[116100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-40227ec7-b004-411b-9462-247dce2ae1c6 Jul 31 12:40:21 devstack sudo[116100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:40:21 devstack cinder-volume[89182]: DEBUG oslo_service.periodic_task [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89182) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 31 12:40:21 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:40:21 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:40:21 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:40:21 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:40:21 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:40:21 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:40:22 devstack sudo[116102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 Jul 31 12:40:22 devstack sudo[116102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:40:22 devstack sudo[116100]: pam_unix(sudo:session): session closed for user root Jul 31 12:40:22 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-b4efc711-d145-4e16-9fe3-aa50558ed274 tempest-ProjectMemberTests-969865867 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-40227ec7-b004-411b-9462-247dce2ae1c6" returned: 0 in 0.503s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:40:22 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-b4efc711-d145-4e16-9fe3-aa50558ed274 tempest-ProjectMemberTests-969865867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-40227ec7-b004-411b-9462-247dce2ae1c6 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:40:22 devstack sudo[116108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-40227ec7-b004-411b-9462-247dce2ae1c6 Jul 31 12:40:22 devstack sudo[116108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:40:22 devstack sudo[116102]: pam_unix(sudo:session): session closed for user root Jul 31 12:40:22 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2" returned: 0 in 0.329s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:40:22 devstack cinder-volume[89182]: DEBUG cinder.manager [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] Notifying Schedulers of capabilities ... {{(pid=89182) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 12:40:22 devstack cinder-volume[89182]: DEBUG oslo_service.periodic_task [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] Running periodic task VolumeManager._thread_info {{(pid=89182) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 31 12:40:22 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] thread count: 28 {{(pid=89182) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 31 12:40:22 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] thread info: [<_MainThread(MainThread, started 136154603720832)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=89182) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 31 12:40:22 devstack sudo[116108]: pam_unix(sudo:session): session closed for user root Jul 31 12:40:22 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-b4efc711-d145-4e16-9fe3-aa50558ed274 tempest-ProjectMemberTests-969865867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-40227ec7-b004-411b-9462-247dce2ae1c6" returned: 0 in 0.299s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:40:22 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-b4efc711-d145-4e16-9fe3-aa50558ed274 tempest-ProjectMemberTests-969865867 None] Lock "cinder-quobyte-40227ec7-b004-411b-9462-247dce2ae1c6" released by "delete_volume" :: held 0.879s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:40:22 devstack cinder-volume[89182]: DEBUG cinder.quota [None req-b4efc711-d145-4e16-9fe3-aa50558ed274 tempest-ProjectMemberTests-969865867 None] Created reservations ['dc951d02-72f1-4c14-ba74-9c55acd7e2b5', 'efc2df2a-995d-416c-9c0d-88c02098600d', '16cb095a-e05f-4ee1-a27d-7cea9944213f', '4c879a45-6f1c-493b-885f-9bbb8989e512'] {{(pid=89182) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 12:40:22 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-b4efc711-d145-4e16-9fe3-aa50558ed274 tempest-ProjectMemberTests-969865867 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:40:22 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-b4efc711-d145-4e16-9fe3-aa50558ed274 tempest-ProjectMemberTests-969865867 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:40:22 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-b4efc711-d145-4e16-9fe3-aa50558ed274 tempest-ProjectMemberTests-969865867 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:40:22 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-b4efc711-d145-4e16-9fe3-aa50558ed274 tempest-ProjectMemberTests-969865867 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:40:22 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-b4efc711-d145-4e16-9fe3-aa50558ed274 tempest-ProjectMemberTests-969865867 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:40:22 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-b4efc711-d145-4e16-9fe3-aa50558ed274 tempest-ProjectMemberTests-969865867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:40:22 devstack sudo[116111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 Jul 31 12:40:22 devstack sudo[116111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:40:23 devstack sudo[116111]: pam_unix(sudo:session): session closed for user root Jul 31 12:40:23 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-b4efc711-d145-4e16-9fe3-aa50558ed274 tempest-ProjectMemberTests-969865867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2" returned: 0 in 0.389s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:40:23 devstack cinder-volume[89182]: DEBUG cinder.manager [None req-b4efc711-d145-4e16-9fe3-aa50558ed274 tempest-ProjectMemberTests-969865867 None] Notifying Schedulers of capabilities ... {{(pid=89182) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 12:40:23 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-b4efc711-d145-4e16-9fe3-aa50558ed274 tempest-ProjectMemberTests-969865867 None] Deleted volume successfully. Jul 31 12:40:23 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-b4efc711-d145-4e16-9fe3-aa50558ed274 tempest-ProjectMemberTests-969865867 None] Lock "cinder-40227ec7-b004-411b-9462-247dce2ae1c6-delete_volume" released by "delete_volume" :: held 1.529s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:40:23 devstack cinder-volume[89182]: DEBUG cinder.volume.flows.manager.create_volume [None req-82ecec10-10fc-42d0-9e74-1258e49d36e0 tempest-ProjectMemberTests-969865867 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89182) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 12:40:23 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-82ecec10-10fc-42d0-9e74-1258e49d36e0 tempest-ProjectMemberTests-969865867 None] Flow 'volume_create_manager' (62cf4baa-6cde-49aa-93fc-2b503bcef611) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:40:23 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-82ecec10-10fc-42d0-9e74-1258e49d36e0 tempest-ProjectMemberTests-969865867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dddd99aa-2ac3-4f1a-8d71-1766d8cf81a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:40:23 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-82ecec10-10fc-42d0-9e74-1258e49d36e0 tempest-ProjectMemberTests-969865867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dddd99aa-2ac3-4f1a-8d71-1766d8cf81a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:40:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-336000796',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f738e64-e21a-47a6-9e8c-7d54182fcab6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7618b523b3644b0aff23a331c24c373',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:40:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:40:23Z,use_quota=True,user_id='ef87d129d713438b8a1c61430735d914',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:40:23 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-82ecec10-10fc-42d0-9e74-1258e49d36e0 tempest-ProjectMemberTests-969865867 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29e50a1c-24f1-403a-a242-6f7b4baede80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:40:23 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-82ecec10-10fc-42d0-9e74-1258e49d36e0 tempest-ProjectMemberTests-969865867 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29e50a1c-24f1-403a-a242-6f7b4baede80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:40:23 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-82ecec10-10fc-42d0-9e74-1258e49d36e0 tempest-ProjectMemberTests-969865867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (801d13f4-b0a7-44e8-88c3-5a240ddc0371) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:40:23 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-82ecec10-10fc-42d0-9e74-1258e49d36e0 tempest-ProjectMemberTests-969865867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (801d13f4-b0a7-44e8-88c3-5a240ddc0371) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9f738e64-e21a-47a6-9e8c-7d54182fcab6', 'volume_name': 'volume-9f738e64-e21a-47a6-9e8c-7d54182fcab6', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:40:23 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-82ecec10-10fc-42d0-9e74-1258e49d36e0 tempest-ProjectMemberTests-969865867 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af9fe69b-ca4d-47d1-b467-c298fb86ad2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:40:23 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-82ecec10-10fc-42d0-9e74-1258e49d36e0 tempest-ProjectMemberTests-969865867 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af9fe69b-ca4d-47d1-b467-c298fb86ad2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:40:23 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-82ecec10-10fc-42d0-9e74-1258e49d36e0 tempest-ProjectMemberTests-969865867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63287e64-f1ad-4728-8c25-79f7a37d855d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:40:23 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-82ecec10-10fc-42d0-9e74-1258e49d36e0 tempest-ProjectMemberTests-969865867 None] Volume 9f738e64-e21a-47a6-9e8c-7d54182fcab6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9f738e64-e21a-47a6-9e8c-7d54182fcab6', 'volume_size': 1} Jul 31 12:40:23 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-82ecec10-10fc-42d0-9e74-1258e49d36e0 tempest-ProjectMemberTests-969865867 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:40:23 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-82ecec10-10fc-42d0-9e74-1258e49d36e0 tempest-ProjectMemberTests-969865867 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:40:23 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-82ecec10-10fc-42d0-9e74-1258e49d36e0 tempest-ProjectMemberTests-969865867 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:40:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-336000796',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f738e64-e21a-47a6-9e8c-7d54182fcab6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7618b523b3644b0aff23a331c24c373',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:40:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:40:23Z,use_quota=True,user_id='ef87d129d713438b8a1c61430735d914',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)}" {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 12:40:23 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-82ecec10-10fc-42d0-9e74-1258e49d36e0 tempest-ProjectMemberTests-969865867 None] Creating volume 9f738e64-e21a-47a6-9e8c-7d54182fcab6 {{(pid=89182) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 12:40:23 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-82ecec10-10fc-42d0-9e74-1258e49d36e0 tempest-ProjectMemberTests-969865867 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:40:23 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-82ecec10-10fc-42d0-9e74-1258e49d36e0 tempest-ProjectMemberTests-969865867 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:40:23 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-82ecec10-10fc-42d0-9e74-1258e49d36e0 tempest-ProjectMemberTests-969865867 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:40:23 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-82ecec10-10fc-42d0-9e74-1258e49d36e0 tempest-ProjectMemberTests-969865867 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:40:23 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-82ecec10-10fc-42d0-9e74-1258e49d36e0 tempest-ProjectMemberTests-969865867 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:40:23 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-82ecec10-10fc-42d0-9e74-1258e49d36e0 tempest-ProjectMemberTests-969865867 None] Selected osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 as target Quobyte volume. {{(pid=89182) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 12:40:23 devstack cinder-volume[89182]: INFO cinder.volume.drivers.remotefs [None req-82ecec10-10fc-42d0-9e74-1258e49d36e0 tempest-ProjectMemberTests-969865867 None] casted to osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 Jul 31 12:40:23 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-82ecec10-10fc-42d0-9e74-1258e49d36e0 tempest-ProjectMemberTests-969865867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-9f738e64-e21a-47a6-9e8c-7d54182fcab6 1073741824 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:40:23 devstack sudo[116114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-9f738e64-e21a-47a6-9e8c-7d54182fcab6 1073741824 Jul 31 12:40:23 devstack sudo[116114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:40:23 devstack sudo[116114]: pam_unix(sudo:session): session closed for user root Jul 31 12:40:23 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-82ecec10-10fc-42d0-9e74-1258e49d36e0 tempest-ProjectMemberTests-969865867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-9f738e64-e21a-47a6-9e8c-7d54182fcab6 1073741824" returned: 0 in 0.452s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:40:23 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-82ecec10-10fc-42d0-9e74-1258e49d36e0 tempest-ProjectMemberTests-969865867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-9f738e64-e21a-47a6-9e8c-7d54182fcab6 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:40:23 devstack sudo[116119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-9f738e64-e21a-47a6-9e8c-7d54182fcab6 Jul 31 12:40:23 devstack sudo[116119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:40:24 devstack sudo[116119]: pam_unix(sudo:session): session closed for user root Jul 31 12:40:24 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-82ecec10-10fc-42d0-9e74-1258e49d36e0 tempest-ProjectMemberTests-969865867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-9f738e64-e21a-47a6-9e8c-7d54182fcab6" returned: 0 in 0.243s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:40:24 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-82ecec10-10fc-42d0-9e74-1258e49d36e0 tempest-ProjectMemberTests-969865867 None] <== create_volume: return (737ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'} {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 12:40:24 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-82ecec10-10fc-42d0-9e74-1258e49d36e0 tempest-ProjectMemberTests-969865867 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.740s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:40:24 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-82ecec10-10fc-42d0-9e74-1258e49d36e0 tempest-ProjectMemberTests-969865867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63287e64-f1ad-4728-8c25-79f7a37d855d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9f738e64-e21a-47a6-9e8c-7d54182fcab6', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:40:24 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-82ecec10-10fc-42d0-9e74-1258e49d36e0 tempest-ProjectMemberTests-969865867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2798631-09a5-49ad-befc-921a39ab54df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:40:24 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-82ecec10-10fc-42d0-9e74-1258e49d36e0 tempest-ProjectMemberTests-969865867 None] Volume volume-9f738e64-e21a-47a6-9e8c-7d54182fcab6 (9f738e64-e21a-47a6-9e8c-7d54182fcab6): created successfully Jul 31 12:40:24 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-82ecec10-10fc-42d0-9e74-1258e49d36e0 tempest-ProjectMemberTests-969865867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2798631-09a5-49ad-befc-921a39ab54df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:40:24 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-82ecec10-10fc-42d0-9e74-1258e49d36e0 tempest-ProjectMemberTests-969865867 None] Flow 'volume_create_manager' (62cf4baa-6cde-49aa-93fc-2b503bcef611) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:40:24 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-82ecec10-10fc-42d0-9e74-1258e49d36e0 tempest-ProjectMemberTests-969865867 None] Created volume successfully. Jul 31 12:40:24 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-39339adc-0973-47e1-b9a4-293b7d2b876e tempest-ProjectMemberTests-969865867 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:40:24 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-39339adc-0973-47e1-b9a4-293b7d2b876e tempest-ProjectMemberTests-969865867 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:40:24 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-39339adc-0973-47e1-b9a4-293b7d2b876e tempest-ProjectMemberTests-969865867 None] Creating offline snapshot f1524ec5-c39c-49b7-aece-75bc76e95c71 of volume 9f738e64-e21a-47a6-9e8c-7d54182fcab6 {{(pid=89182) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 31 12:40:24 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb97007c-d5e1-4dc6-be6b-dd73f8dcaea9]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:40:24 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-39339adc-0973-47e1-b9a4-293b7d2b876e tempest-ProjectMemberTests-969865867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-9f738e64-e21a-47a6-9e8c-7d54182fcab6 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:40:24 devstack sudo[116122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-9f738e64-e21a-47a6-9e8c-7d54182fcab6 Jul 31 12:40:24 devstack sudo[116122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:40:24 devstack sudo[116122]: pam_unix(sudo:session): session closed for user root Jul 31 12:40:24 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-39339adc-0973-47e1-b9a4-293b7d2b876e tempest-ProjectMemberTests-969865867 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-9f738e64-e21a-47a6-9e8c-7d54182fcab6" returned: 0 in 0.344s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:40:24 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-39339adc-0973-47e1-b9a4-293b7d2b876e tempest-ProjectMemberTests-969865867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-9f738e64-e21a-47a6-9e8c-7d54182fcab6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-9f738e64-e21a-47a6-9e8c-7d54182fcab6.f1524ec5-c39c-49b7-aece-75bc76e95c71 1G {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:40:24 devstack sudo[116127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-9f738e64-e21a-47a6-9e8c-7d54182fcab6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-9f738e64-e21a-47a6-9e8c-7d54182fcab6.f1524ec5-c39c-49b7-aece-75bc76e95c71 1G Jul 31 12:40:24 devstack sudo[116127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:40:25 devstack sudo[116127]: pam_unix(sudo:session): session closed for user root Jul 31 12:40:25 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-39339adc-0973-47e1-b9a4-293b7d2b876e tempest-ProjectMemberTests-969865867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-9f738e64-e21a-47a6-9e8c-7d54182fcab6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-9f738e64-e21a-47a6-9e8c-7d54182fcab6.f1524ec5-c39c-49b7-aece-75bc76e95c71 1G" returned: 0 in 0.391s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:40:25 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-39339adc-0973-47e1-b9a4-293b7d2b876e tempest-ProjectMemberTests-969865867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9f738e64-e21a-47a6-9e8c-7d54182fcab6 -F qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-9f738e64-e21a-47a6-9e8c-7d54182fcab6.f1524ec5-c39c-49b7-aece-75bc76e95c71 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:40:25 devstack sudo[116133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9f738e64-e21a-47a6-9e8c-7d54182fcab6 -F qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-9f738e64-e21a-47a6-9e8c-7d54182fcab6.f1524ec5-c39c-49b7-aece-75bc76e95c71 Jul 31 12:40:25 devstack sudo[116133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:40:25 devstack sudo[116133]: pam_unix(sudo:session): session closed for user root Jul 31 12:40:25 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-39339adc-0973-47e1-b9a4-293b7d2b876e tempest-ProjectMemberTests-969865867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9f738e64-e21a-47a6-9e8c-7d54182fcab6 -F qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-9f738e64-e21a-47a6-9e8c-7d54182fcab6.f1524ec5-c39c-49b7-aece-75bc76e95c71" returned: 0 in 0.299s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:40:25 devstack cinder-volume[89182]: WARNING cinder.volume.drivers.remotefs [None req-39339adc-0973-47e1-b9a4-293b7d2b876e tempest-ProjectMemberTests-969865867 None] /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-9f738e64-e21a-47a6-9e8c-7d54182fcab6.f1524ec5-c39c-49b7-aece-75bc76e95c71 is being set with open permissions: ugo+rw Jul 31 12:40:25 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-39339adc-0973-47e1-b9a4-293b7d2b876e tempest-ProjectMemberTests-969865867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-9f738e64-e21a-47a6-9e8c-7d54182fcab6.f1524ec5-c39c-49b7-aece-75bc76e95c71 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:40:25 devstack sudo[116138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-9f738e64-e21a-47a6-9e8c-7d54182fcab6.f1524ec5-c39c-49b7-aece-75bc76e95c71 Jul 31 12:40:25 devstack sudo[116138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:40:25 devstack sudo[116138]: pam_unix(sudo:session): session closed for user root Jul 31 12:40:25 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-39339adc-0973-47e1-b9a4-293b7d2b876e tempest-ProjectMemberTests-969865867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-9f738e64-e21a-47a6-9e8c-7d54182fcab6.f1524ec5-c39c-49b7-aece-75bc76e95c71" returned: 0 in 0.241s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:40:25 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-39339adc-0973-47e1-b9a4-293b7d2b876e tempest-ProjectMemberTests-969865867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-9f738e64-e21a-47a6-9e8c-7d54182fcab6.info {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:40:25 devstack sudo[116141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-9f738e64-e21a-47a6-9e8c-7d54182fcab6.info Jul 31 12:40:25 devstack sudo[116141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:40:26 devstack sudo[116141]: pam_unix(sudo:session): session closed for user root Jul 31 12:40:26 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-39339adc-0973-47e1-b9a4-293b7d2b876e tempest-ProjectMemberTests-969865867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-9f738e64-e21a-47a6-9e8c-7d54182fcab6.info" returned: 0 in 0.259s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:40:26 devstack cinder-volume[89182]: WARNING cinder.volume.drivers.remotefs [None req-39339adc-0973-47e1-b9a4-293b7d2b876e tempest-ProjectMemberTests-969865867 None] /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-9f738e64-e21a-47a6-9e8c-7d54182fcab6.info is being set with open permissions: ugo+rw Jul 31 12:40:26 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-39339adc-0973-47e1-b9a4-293b7d2b876e tempest-ProjectMemberTests-969865867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-9f738e64-e21a-47a6-9e8c-7d54182fcab6.info {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:40:26 devstack sudo[116144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-9f738e64-e21a-47a6-9e8c-7d54182fcab6.info Jul 31 12:40:26 devstack sudo[116144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:40:26 devstack sudo[116144]: pam_unix(sudo:session): session closed for user root Jul 31 12:40:26 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-39339adc-0973-47e1-b9a4-293b7d2b876e tempest-ProjectMemberTests-969865867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-9f738e64-e21a-47a6-9e8c-7d54182fcab6.info" returned: 0 in 0.247s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:40:26 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-39339adc-0973-47e1-b9a4-293b7d2b876e tempest-ProjectMemberTests-969865867 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.857s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:40:26 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-39339adc-0973-47e1-b9a4-293b7d2b876e tempest-ProjectMemberTests-969865867 None] Create snapshot completed successfully Jul 31 12:40:26 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-b76a04c4-2360-4f6c-96ea-1708999fe8bb tempest-ProjectMemberTests-969865867 None] Acquiring lock "cinder-f1524ec5-c39c-49b7-aece-75bc76e95c71-delete_snapshot" by "delete_snapshot" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:40:26 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-b76a04c4-2360-4f6c-96ea-1708999fe8bb tempest-ProjectMemberTests-969865867 None] Lock "cinder-f1524ec5-c39c-49b7-aece-75bc76e95c71-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:40:26 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-b76a04c4-2360-4f6c-96ea-1708999fe8bb tempest-ProjectMemberTests-969865867 None] Acquiring lock "cinder-quobyte-9f738e64-e21a-47a6-9e8c-7d54182fcab6" by "delete_snapshot" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:40:26 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-b76a04c4-2360-4f6c-96ea-1708999fe8bb tempest-ProjectMemberTests-969865867 None] Lock "cinder-quobyte-9f738e64-e21a-47a6-9e8c-7d54182fcab6" acquired by "delete_snapshot" :: waited 0.016s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:40:26 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-b76a04c4-2360-4f6c-96ea-1708999fe8bb tempest-ProjectMemberTests-969865867 None] Acquiring lock "cinder-quobyte-f1524ec5-c39c-49b7-aece-75bc76e95c71" by "_delete_snapshot" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:40:26 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-b76a04c4-2360-4f6c-96ea-1708999fe8bb tempest-ProjectMemberTests-969865867 None] Lock "cinder-quobyte-f1524ec5-c39c-49b7-aece-75bc76e95c71" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:40:26 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-b76a04c4-2360-4f6c-96ea-1708999fe8bb tempest-ProjectMemberTests-969865867 None] Deleting offline snapshot f1524ec5-c39c-49b7-aece-75bc76e95c71 of volume 9f738e64-e21a-47a6-9e8c-7d54182fcab6 {{(pid=89182) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 31 12:40:26 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-b76a04c4-2360-4f6c-96ea-1708999fe8bb tempest-ProjectMemberTests-969865867 None] snapshot_file for this snap is: volume-9f738e64-e21a-47a6-9e8c-7d54182fcab6.f1524ec5-c39c-49b7-aece-75bc76e95c71 {{(pid=89182) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 31 12:40:26 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c22e659-59e7-4c09-95ee-000fbb43c8a6]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:40:26 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-b76a04c4-2360-4f6c-96ea-1708999fe8bb tempest-ProjectMemberTests-969865867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-9f738e64-e21a-47a6-9e8c-7d54182fcab6.f1524ec5-c39c-49b7-aece-75bc76e95c71 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:40:26 devstack sudo[116147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-9f738e64-e21a-47a6-9e8c-7d54182fcab6.f1524ec5-c39c-49b7-aece-75bc76e95c71 Jul 31 12:40:26 devstack sudo[116147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:40:27 devstack sudo[116147]: pam_unix(sudo:session): session closed for user root Jul 31 12:40:27 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-b76a04c4-2360-4f6c-96ea-1708999fe8bb tempest-ProjectMemberTests-969865867 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-9f738e64-e21a-47a6-9e8c-7d54182fcab6.f1524ec5-c39c-49b7-aece-75bc76e95c71" returned: 0 in 0.359s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:40:27 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-b76a04c4-2360-4f6c-96ea-1708999fe8bb tempest-ProjectMemberTests-969865867 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9f738e64-e21a-47a6-9e8c-7d54182fcab6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89182) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 12:40:27 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[541f554b-abfb-4dca-94e5-ac710101919d]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:40:27 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-b76a04c4-2360-4f6c-96ea-1708999fe8bb tempest-ProjectMemberTests-969865867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-9f738e64-e21a-47a6-9e8c-7d54182fcab6 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:40:27 devstack sudo[116152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-9f738e64-e21a-47a6-9e8c-7d54182fcab6 Jul 31 12:40:27 devstack sudo[116152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:40:27 devstack sudo[116152]: pam_unix(sudo:session): session closed for user root Jul 31 12:40:27 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-b76a04c4-2360-4f6c-96ea-1708999fe8bb tempest-ProjectMemberTests-969865867 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-9f738e64-e21a-47a6-9e8c-7d54182fcab6" returned: 0 in 0.353s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:40:27 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-b76a04c4-2360-4f6c-96ea-1708999fe8bb tempest-ProjectMemberTests-969865867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-9f738e64-e21a-47a6-9e8c-7d54182fcab6.f1524ec5-c39c-49b7-aece-75bc76e95c71 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:40:27 devstack sudo[116158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-9f738e64-e21a-47a6-9e8c-7d54182fcab6.f1524ec5-c39c-49b7-aece-75bc76e95c71 Jul 31 12:40:27 devstack sudo[116158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:40:27 devstack sudo[116158]: pam_unix(sudo:session): session closed for user root Jul 31 12:40:27 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-b76a04c4-2360-4f6c-96ea-1708999fe8bb tempest-ProjectMemberTests-969865867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-9f738e64-e21a-47a6-9e8c-7d54182fcab6.f1524ec5-c39c-49b7-aece-75bc76e95c71" returned: 0 in 0.334s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:40:27 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-b76a04c4-2360-4f6c-96ea-1708999fe8bb tempest-ProjectMemberTests-969865867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-9f738e64-e21a-47a6-9e8c-7d54182fcab6.f1524ec5-c39c-49b7-aece-75bc76e95c71 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:40:27 devstack sudo[116163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-9f738e64-e21a-47a6-9e8c-7d54182fcab6.f1524ec5-c39c-49b7-aece-75bc76e95c71 Jul 31 12:40:27 devstack sudo[116163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:40:28 devstack sudo[116163]: pam_unix(sudo:session): session closed for user root Jul 31 12:40:28 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-b76a04c4-2360-4f6c-96ea-1708999fe8bb tempest-ProjectMemberTests-969865867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-9f738e64-e21a-47a6-9e8c-7d54182fcab6.f1524ec5-c39c-49b7-aece-75bc76e95c71" returned: 0 in 0.255s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:40:28 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-b76a04c4-2360-4f6c-96ea-1708999fe8bb tempest-ProjectMemberTests-969865867 None] Lock "cinder-quobyte-f1524ec5-c39c-49b7-aece-75bc76e95c71" released by "_delete_snapshot" :: held 1.385s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:40:28 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-b76a04c4-2360-4f6c-96ea-1708999fe8bb tempest-ProjectMemberTests-969865867 None] Lock "cinder-quobyte-9f738e64-e21a-47a6-9e8c-7d54182fcab6" released by "delete_snapshot" :: held 1.407s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:40:28 devstack cinder-volume[89182]: DEBUG cinder.quota [None req-b76a04c4-2360-4f6c-96ea-1708999fe8bb tempest-ProjectMemberTests-969865867 None] Created reservations ['2e436f67-abf4-46cc-ac9a-6c50a57de516', 'fe4cc18d-6101-42f0-b8e7-4025a82499d0', '9c84d9f9-0a56-49e9-a497-400bb52cecb8', '2dc42a0e-7f15-4f73-8aaf-124fd71e4bd9'] {{(pid=89182) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 12:40:28 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-b76a04c4-2360-4f6c-96ea-1708999fe8bb tempest-ProjectMemberTests-969865867 None] Delete snapshot completed successfully. Jul 31 12:40:28 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-b76a04c4-2360-4f6c-96ea-1708999fe8bb tempest-ProjectMemberTests-969865867 None] Lock "cinder-f1524ec5-c39c-49b7-aece-75bc76e95c71-delete_snapshot" released by "delete_snapshot" :: held 1.542s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:40:28 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-19d35ba9-b4ff-4b16-8a2a-df2ef5527a10 tempest-ProjectMemberTests-969865867 None] Acquiring lock "cinder-9f738e64-e21a-47a6-9e8c-7d54182fcab6-delete_volume" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:40:28 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-19d35ba9-b4ff-4b16-8a2a-df2ef5527a10 tempest-ProjectMemberTests-969865867 None] Lock "cinder-9f738e64-e21a-47a6-9e8c-7d54182fcab6-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:40:28 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-19d35ba9-b4ff-4b16-8a2a-df2ef5527a10 tempest-ProjectMemberTests-969865867 None] Acquiring lock "cinder-quobyte-9f738e64-e21a-47a6-9e8c-7d54182fcab6" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:40:28 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-19d35ba9-b4ff-4b16-8a2a-df2ef5527a10 tempest-ProjectMemberTests-969865867 None] Lock "cinder-quobyte-9f738e64-e21a-47a6-9e8c-7d54182fcab6" acquired by "delete_volume" :: waited 0.019s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:40:28 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f9f8b05-0718-492f-9e73-f8e41b762e84]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:40:28 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-19d35ba9-b4ff-4b16-8a2a-df2ef5527a10 tempest-ProjectMemberTests-969865867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-9f738e64-e21a-47a6-9e8c-7d54182fcab6 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:40:29 devstack sudo[116167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-9f738e64-e21a-47a6-9e8c-7d54182fcab6 Jul 31 12:40:29 devstack sudo[116167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:40:29 devstack sudo[116167]: pam_unix(sudo:session): session closed for user root Jul 31 12:40:29 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-19d35ba9-b4ff-4b16-8a2a-df2ef5527a10 tempest-ProjectMemberTests-969865867 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-9f738e64-e21a-47a6-9e8c-7d54182fcab6" returned: 0 in 0.355s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:40:29 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-19d35ba9-b4ff-4b16-8a2a-df2ef5527a10 tempest-ProjectMemberTests-969865867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-9f738e64-e21a-47a6-9e8c-7d54182fcab6 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:40:29 devstack sudo[116172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-9f738e64-e21a-47a6-9e8c-7d54182fcab6 Jul 31 12:40:29 devstack sudo[116172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:40:29 devstack sudo[116172]: pam_unix(sudo:session): session closed for user root Jul 31 12:40:29 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-19d35ba9-b4ff-4b16-8a2a-df2ef5527a10 tempest-ProjectMemberTests-969865867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-9f738e64-e21a-47a6-9e8c-7d54182fcab6" returned: 0 in 0.242s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:40:29 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-19d35ba9-b4ff-4b16-8a2a-df2ef5527a10 tempest-ProjectMemberTests-969865867 None] Lock "cinder-quobyte-9f738e64-e21a-47a6-9e8c-7d54182fcab6" released by "delete_volume" :: held 0.656s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:40:29 devstack cinder-volume[89182]: DEBUG cinder.quota [None req-19d35ba9-b4ff-4b16-8a2a-df2ef5527a10 tempest-ProjectMemberTests-969865867 None] Created reservations ['86698415-5e1c-4896-93b7-0472d3a71641', '68b2b04a-457f-494a-8228-125a0e7f5acc', '7caa082c-794b-416e-8876-02719bb8cb44', '12d4e1a6-b952-4516-aa11-337154ac78fe'] {{(pid=89182) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 12:40:29 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-19d35ba9-b4ff-4b16-8a2a-df2ef5527a10 tempest-ProjectMemberTests-969865867 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:40:29 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-19d35ba9-b4ff-4b16-8a2a-df2ef5527a10 tempest-ProjectMemberTests-969865867 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:40:29 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-19d35ba9-b4ff-4b16-8a2a-df2ef5527a10 tempest-ProjectMemberTests-969865867 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:40:29 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-19d35ba9-b4ff-4b16-8a2a-df2ef5527a10 tempest-ProjectMemberTests-969865867 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:40:29 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-19d35ba9-b4ff-4b16-8a2a-df2ef5527a10 tempest-ProjectMemberTests-969865867 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:40:29 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-19d35ba9-b4ff-4b16-8a2a-df2ef5527a10 tempest-ProjectMemberTests-969865867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:40:29 devstack sudo[116175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 Jul 31 12:40:29 devstack sudo[116175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:40:29 devstack sudo[116175]: pam_unix(sudo:session): session closed for user root Jul 31 12:40:29 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-19d35ba9-b4ff-4b16-8a2a-df2ef5527a10 tempest-ProjectMemberTests-969865867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2" returned: 0 in 0.245s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:40:29 devstack cinder-volume[89182]: DEBUG cinder.manager [None req-19d35ba9-b4ff-4b16-8a2a-df2ef5527a10 tempest-ProjectMemberTests-969865867 None] Notifying Schedulers of capabilities ... {{(pid=89182) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 12:40:29 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-19d35ba9-b4ff-4b16-8a2a-df2ef5527a10 tempest-ProjectMemberTests-969865867 None] Deleted volume successfully. Jul 31 12:40:29 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-19d35ba9-b4ff-4b16-8a2a-df2ef5527a10 tempest-ProjectMemberTests-969865867 None] Lock "cinder-9f738e64-e21a-47a6-9e8c-7d54182fcab6-delete_volume" released by "delete_volume" :: held 1.100s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:40:30 devstack cinder-volume[89182]: DEBUG cinder.volume.flows.manager.create_volume [None req-e374210c-bd27-40f3-8cf1-69bb241e0f55 tempest-ProjectMemberTests-969865867 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89182) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 12:40:30 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-e374210c-bd27-40f3-8cf1-69bb241e0f55 tempest-ProjectMemberTests-969865867 None] Flow 'volume_create_manager' (a95a24c5-4aef-4488-8cf5-731c4f361b9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:40:30 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-e374210c-bd27-40f3-8cf1-69bb241e0f55 tempest-ProjectMemberTests-969865867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f09c3dbb-e0f4-4e3c-86bd-e07ea0a8656d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:40:30 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-e374210c-bd27-40f3-8cf1-69bb241e0f55 tempest-ProjectMemberTests-969865867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f09c3dbb-e0f4-4e3c-86bd-e07ea0a8656d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:40:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2021716330',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c12477e-4e14-49f7-84fc-efd2a011f238,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7618b523b3644b0aff23a331c24c373',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:40:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:40:30Z,use_quota=True,user_id='ef87d129d713438b8a1c61430735d914',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:40:30 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-e374210c-bd27-40f3-8cf1-69bb241e0f55 tempest-ProjectMemberTests-969865867 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33cd7e57-2ce1-4053-a7ac-3ea3b28e6eba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:40:30 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-e374210c-bd27-40f3-8cf1-69bb241e0f55 tempest-ProjectMemberTests-969865867 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33cd7e57-2ce1-4053-a7ac-3ea3b28e6eba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:40:30 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-e374210c-bd27-40f3-8cf1-69bb241e0f55 tempest-ProjectMemberTests-969865867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e953e8f-5ed3-49e1-837e-8c260d19f341) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:40:30 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-e374210c-bd27-40f3-8cf1-69bb241e0f55 tempest-ProjectMemberTests-969865867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e953e8f-5ed3-49e1-837e-8c260d19f341) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3c12477e-4e14-49f7-84fc-efd2a011f238', 'volume_name': 'volume-3c12477e-4e14-49f7-84fc-efd2a011f238', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:40:30 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-e374210c-bd27-40f3-8cf1-69bb241e0f55 tempest-ProjectMemberTests-969865867 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf5df305-1274-4b21-b30e-11df63b79a67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:40:30 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-e374210c-bd27-40f3-8cf1-69bb241e0f55 tempest-ProjectMemberTests-969865867 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf5df305-1274-4b21-b30e-11df63b79a67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:40:30 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-e374210c-bd27-40f3-8cf1-69bb241e0f55 tempest-ProjectMemberTests-969865867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d50d44ee-172c-447a-ab52-f0a9a6dbeac0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:40:30 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-e374210c-bd27-40f3-8cf1-69bb241e0f55 tempest-ProjectMemberTests-969865867 None] Volume 3c12477e-4e14-49f7-84fc-efd2a011f238: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3c12477e-4e14-49f7-84fc-efd2a011f238', 'volume_size': 1} Jul 31 12:40:30 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-e374210c-bd27-40f3-8cf1-69bb241e0f55 tempest-ProjectMemberTests-969865867 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:40:30 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-e374210c-bd27-40f3-8cf1-69bb241e0f55 tempest-ProjectMemberTests-969865867 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:40:30 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-e374210c-bd27-40f3-8cf1-69bb241e0f55 tempest-ProjectMemberTests-969865867 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:40:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2021716330',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c12477e-4e14-49f7-84fc-efd2a011f238,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7618b523b3644b0aff23a331c24c373',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:40:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:40:30Z,use_quota=True,user_id='ef87d129d713438b8a1c61430735d914',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)}" {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 12:40:30 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-e374210c-bd27-40f3-8cf1-69bb241e0f55 tempest-ProjectMemberTests-969865867 None] Creating volume 3c12477e-4e14-49f7-84fc-efd2a011f238 {{(pid=89182) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 12:40:30 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-e374210c-bd27-40f3-8cf1-69bb241e0f55 tempest-ProjectMemberTests-969865867 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:40:30 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-e374210c-bd27-40f3-8cf1-69bb241e0f55 tempest-ProjectMemberTests-969865867 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:40:30 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-e374210c-bd27-40f3-8cf1-69bb241e0f55 tempest-ProjectMemberTests-969865867 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:40:30 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-e374210c-bd27-40f3-8cf1-69bb241e0f55 tempest-ProjectMemberTests-969865867 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:40:30 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-e374210c-bd27-40f3-8cf1-69bb241e0f55 tempest-ProjectMemberTests-969865867 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:40:30 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-e374210c-bd27-40f3-8cf1-69bb241e0f55 tempest-ProjectMemberTests-969865867 None] Selected osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 as target Quobyte volume. {{(pid=89182) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 12:40:30 devstack cinder-volume[89182]: INFO cinder.volume.drivers.remotefs [None req-e374210c-bd27-40f3-8cf1-69bb241e0f55 tempest-ProjectMemberTests-969865867 None] casted to osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 Jul 31 12:40:30 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-e374210c-bd27-40f3-8cf1-69bb241e0f55 tempest-ProjectMemberTests-969865867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-3c12477e-4e14-49f7-84fc-efd2a011f238 1073741824 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:40:30 devstack sudo[116178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-3c12477e-4e14-49f7-84fc-efd2a011f238 1073741824 Jul 31 12:40:30 devstack sudo[116178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:40:30 devstack sudo[116178]: pam_unix(sudo:session): session closed for user root Jul 31 12:40:30 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-e374210c-bd27-40f3-8cf1-69bb241e0f55 tempest-ProjectMemberTests-969865867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-3c12477e-4e14-49f7-84fc-efd2a011f238 1073741824" returned: 0 in 0.430s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:40:30 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-e374210c-bd27-40f3-8cf1-69bb241e0f55 tempest-ProjectMemberTests-969865867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-3c12477e-4e14-49f7-84fc-efd2a011f238 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:40:31 devstack sudo[116183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-3c12477e-4e14-49f7-84fc-efd2a011f238 Jul 31 12:40:31 devstack sudo[116183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:40:31 devstack sudo[116183]: pam_unix(sudo:session): session closed for user root Jul 31 12:40:31 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-e374210c-bd27-40f3-8cf1-69bb241e0f55 tempest-ProjectMemberTests-969865867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-3c12477e-4e14-49f7-84fc-efd2a011f238" returned: 0 in 0.253s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:40:31 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-e374210c-bd27-40f3-8cf1-69bb241e0f55 tempest-ProjectMemberTests-969865867 None] <== create_volume: return (726ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'} {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 12:40:31 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-e374210c-bd27-40f3-8cf1-69bb241e0f55 tempest-ProjectMemberTests-969865867 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.729s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:40:31 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-e374210c-bd27-40f3-8cf1-69bb241e0f55 tempest-ProjectMemberTests-969865867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d50d44ee-172c-447a-ab52-f0a9a6dbeac0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3c12477e-4e14-49f7-84fc-efd2a011f238', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:40:31 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-e374210c-bd27-40f3-8cf1-69bb241e0f55 tempest-ProjectMemberTests-969865867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10de3805-8a4b-4b16-b7fb-c81071fe8e9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:40:31 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-e374210c-bd27-40f3-8cf1-69bb241e0f55 tempest-ProjectMemberTests-969865867 None] Volume volume-3c12477e-4e14-49f7-84fc-efd2a011f238 (3c12477e-4e14-49f7-84fc-efd2a011f238): created successfully Jul 31 12:40:31 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-e374210c-bd27-40f3-8cf1-69bb241e0f55 tempest-ProjectMemberTests-969865867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10de3805-8a4b-4b16-b7fb-c81071fe8e9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:40:31 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-e374210c-bd27-40f3-8cf1-69bb241e0f55 tempest-ProjectMemberTests-969865867 None] Flow 'volume_create_manager' (a95a24c5-4aef-4488-8cf5-731c4f361b9a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:40:31 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-e374210c-bd27-40f3-8cf1-69bb241e0f55 tempest-ProjectMemberTests-969865867 None] Created volume successfully. Jul 31 12:40:31 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-4644044f-5ff6-4f59-9507-b607852f9848 tempest-ProjectMemberTests-969865867 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:40:31 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-4644044f-5ff6-4f59-9507-b607852f9848 tempest-ProjectMemberTests-969865867 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:40:31 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-4644044f-5ff6-4f59-9507-b607852f9848 tempest-ProjectMemberTests-969865867 None] Creating offline snapshot edce9e21-f291-4c24-a0aa-fb459e40e667 of volume 3c12477e-4e14-49f7-84fc-efd2a011f238 {{(pid=89182) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 31 12:40:31 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7a3b009-6be8-4467-8256-a6e362c2937c]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:40:31 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-4644044f-5ff6-4f59-9507-b607852f9848 tempest-ProjectMemberTests-969865867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-3c12477e-4e14-49f7-84fc-efd2a011f238 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:40:31 devstack sudo[116186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-3c12477e-4e14-49f7-84fc-efd2a011f238 Jul 31 12:40:31 devstack sudo[116186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:40:31 devstack sudo[116186]: pam_unix(sudo:session): session closed for user root Jul 31 12:40:31 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-4644044f-5ff6-4f59-9507-b607852f9848 tempest-ProjectMemberTests-969865867 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-3c12477e-4e14-49f7-84fc-efd2a011f238" returned: 0 in 0.386s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:40:31 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-4644044f-5ff6-4f59-9507-b607852f9848 tempest-ProjectMemberTests-969865867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-3c12477e-4e14-49f7-84fc-efd2a011f238,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-3c12477e-4e14-49f7-84fc-efd2a011f238.edce9e21-f291-4c24-a0aa-fb459e40e667 1G {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:40:32 devstack sudo[116191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-3c12477e-4e14-49f7-84fc-efd2a011f238,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-3c12477e-4e14-49f7-84fc-efd2a011f238.edce9e21-f291-4c24-a0aa-fb459e40e667 1G Jul 31 12:40:32 devstack sudo[116191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:40:32 devstack sudo[116191]: pam_unix(sudo:session): session closed for user root Jul 31 12:40:32 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-4644044f-5ff6-4f59-9507-b607852f9848 tempest-ProjectMemberTests-969865867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-3c12477e-4e14-49f7-84fc-efd2a011f238,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-3c12477e-4e14-49f7-84fc-efd2a011f238.edce9e21-f291-4c24-a0aa-fb459e40e667 1G" returned: 0 in 0.401s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:40:32 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-4644044f-5ff6-4f59-9507-b607852f9848 tempest-ProjectMemberTests-969865867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3c12477e-4e14-49f7-84fc-efd2a011f238 -F qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-3c12477e-4e14-49f7-84fc-efd2a011f238.edce9e21-f291-4c24-a0aa-fb459e40e667 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:40:32 devstack sudo[116196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3c12477e-4e14-49f7-84fc-efd2a011f238 -F qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-3c12477e-4e14-49f7-84fc-efd2a011f238.edce9e21-f291-4c24-a0aa-fb459e40e667 Jul 31 12:40:32 devstack sudo[116196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:40:32 devstack sudo[116196]: pam_unix(sudo:session): session closed for user root Jul 31 12:40:32 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-4644044f-5ff6-4f59-9507-b607852f9848 tempest-ProjectMemberTests-969865867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3c12477e-4e14-49f7-84fc-efd2a011f238 -F qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-3c12477e-4e14-49f7-84fc-efd2a011f238.edce9e21-f291-4c24-a0aa-fb459e40e667" returned: 0 in 0.281s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:40:32 devstack cinder-volume[89182]: WARNING cinder.volume.drivers.remotefs [None req-4644044f-5ff6-4f59-9507-b607852f9848 tempest-ProjectMemberTests-969865867 None] /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-3c12477e-4e14-49f7-84fc-efd2a011f238.edce9e21-f291-4c24-a0aa-fb459e40e667 is being set with open permissions: ugo+rw Jul 31 12:40:32 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-4644044f-5ff6-4f59-9507-b607852f9848 tempest-ProjectMemberTests-969865867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-3c12477e-4e14-49f7-84fc-efd2a011f238.edce9e21-f291-4c24-a0aa-fb459e40e667 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:40:32 devstack sudo[116201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-3c12477e-4e14-49f7-84fc-efd2a011f238.edce9e21-f291-4c24-a0aa-fb459e40e667 Jul 31 12:40:32 devstack sudo[116201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:40:32 devstack sudo[116201]: pam_unix(sudo:session): session closed for user root Jul 31 12:40:32 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-4644044f-5ff6-4f59-9507-b607852f9848 tempest-ProjectMemberTests-969865867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-3c12477e-4e14-49f7-84fc-efd2a011f238.edce9e21-f291-4c24-a0aa-fb459e40e667" returned: 0 in 0.243s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:40:32 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-4644044f-5ff6-4f59-9507-b607852f9848 tempest-ProjectMemberTests-969865867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-3c12477e-4e14-49f7-84fc-efd2a011f238.info {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:40:32 devstack sudo[116204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-3c12477e-4e14-49f7-84fc-efd2a011f238.info Jul 31 12:40:32 devstack sudo[116204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:40:33 devstack sudo[116204]: pam_unix(sudo:session): session closed for user root Jul 31 12:40:33 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-4644044f-5ff6-4f59-9507-b607852f9848 tempest-ProjectMemberTests-969865867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-3c12477e-4e14-49f7-84fc-efd2a011f238.info" returned: 0 in 0.253s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:40:33 devstack cinder-volume[89182]: WARNING cinder.volume.drivers.remotefs [None req-4644044f-5ff6-4f59-9507-b607852f9848 tempest-ProjectMemberTests-969865867 None] /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-3c12477e-4e14-49f7-84fc-efd2a011f238.info is being set with open permissions: ugo+rw Jul 31 12:40:33 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-4644044f-5ff6-4f59-9507-b607852f9848 tempest-ProjectMemberTests-969865867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-3c12477e-4e14-49f7-84fc-efd2a011f238.info {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:40:33 devstack sudo[116207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-3c12477e-4e14-49f7-84fc-efd2a011f238.info Jul 31 12:40:33 devstack sudo[116207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:40:33 devstack sudo[116207]: pam_unix(sudo:session): session closed for user root Jul 31 12:40:33 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-4644044f-5ff6-4f59-9507-b607852f9848 tempest-ProjectMemberTests-969865867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-3c12477e-4e14-49f7-84fc-efd2a011f238.info" returned: 0 in 0.242s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:40:33 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-4644044f-5ff6-4f59-9507-b607852f9848 tempest-ProjectMemberTests-969865867 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.888s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:40:33 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-4644044f-5ff6-4f59-9507-b607852f9848 tempest-ProjectMemberTests-969865867 None] Create snapshot completed successfully Jul 31 12:40:33 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-36669215-2bf9-44eb-8b90-93534d27ffce tempest-ProjectMemberTests-969865867 None] Acquiring lock "cinder-edce9e21-f291-4c24-a0aa-fb459e40e667-delete_snapshot" by "delete_snapshot" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:40:33 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-36669215-2bf9-44eb-8b90-93534d27ffce tempest-ProjectMemberTests-969865867 None] Lock "cinder-edce9e21-f291-4c24-a0aa-fb459e40e667-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:40:33 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-36669215-2bf9-44eb-8b90-93534d27ffce tempest-ProjectMemberTests-969865867 None] Acquiring lock "cinder-quobyte-3c12477e-4e14-49f7-84fc-efd2a011f238" by "delete_snapshot" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:40:33 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-36669215-2bf9-44eb-8b90-93534d27ffce tempest-ProjectMemberTests-969865867 None] Lock "cinder-quobyte-3c12477e-4e14-49f7-84fc-efd2a011f238" acquired by "delete_snapshot" :: waited 0.015s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:40:33 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-36669215-2bf9-44eb-8b90-93534d27ffce tempest-ProjectMemberTests-969865867 None] Acquiring lock "cinder-quobyte-edce9e21-f291-4c24-a0aa-fb459e40e667" by "_delete_snapshot" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:40:33 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-36669215-2bf9-44eb-8b90-93534d27ffce tempest-ProjectMemberTests-969865867 None] Lock "cinder-quobyte-edce9e21-f291-4c24-a0aa-fb459e40e667" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:40:33 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-36669215-2bf9-44eb-8b90-93534d27ffce tempest-ProjectMemberTests-969865867 None] Deleting offline snapshot edce9e21-f291-4c24-a0aa-fb459e40e667 of volume 3c12477e-4e14-49f7-84fc-efd2a011f238 {{(pid=89182) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 31 12:40:33 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-36669215-2bf9-44eb-8b90-93534d27ffce tempest-ProjectMemberTests-969865867 None] snapshot_file for this snap is: volume-3c12477e-4e14-49f7-84fc-efd2a011f238.edce9e21-f291-4c24-a0aa-fb459e40e667 {{(pid=89182) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 31 12:40:33 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[9167e325-e434-4d31-9054-c400190f77df]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:40:33 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-36669215-2bf9-44eb-8b90-93534d27ffce tempest-ProjectMemberTests-969865867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-3c12477e-4e14-49f7-84fc-efd2a011f238.edce9e21-f291-4c24-a0aa-fb459e40e667 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:40:33 devstack sudo[116210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-3c12477e-4e14-49f7-84fc-efd2a011f238.edce9e21-f291-4c24-a0aa-fb459e40e667 Jul 31 12:40:33 devstack sudo[116210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:40:34 devstack sudo[116210]: pam_unix(sudo:session): session closed for user root Jul 31 12:40:34 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-36669215-2bf9-44eb-8b90-93534d27ffce tempest-ProjectMemberTests-969865867 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-3c12477e-4e14-49f7-84fc-efd2a011f238.edce9e21-f291-4c24-a0aa-fb459e40e667" returned: 0 in 0.373s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:40:34 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-36669215-2bf9-44eb-8b90-93534d27ffce tempest-ProjectMemberTests-969865867 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3c12477e-4e14-49f7-84fc-efd2a011f238(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89182) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 12:40:34 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[bef133ca-b2ac-4f60-9872-7785d5c712c1]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:40:34 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-36669215-2bf9-44eb-8b90-93534d27ffce tempest-ProjectMemberTests-969865867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-3c12477e-4e14-49f7-84fc-efd2a011f238 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:40:34 devstack sudo[116215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-3c12477e-4e14-49f7-84fc-efd2a011f238 Jul 31 12:40:34 devstack sudo[116215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:40:34 devstack sudo[116215]: pam_unix(sudo:session): session closed for user root Jul 31 12:40:34 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-36669215-2bf9-44eb-8b90-93534d27ffce tempest-ProjectMemberTests-969865867 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-3c12477e-4e14-49f7-84fc-efd2a011f238" returned: 0 in 0.344s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:40:34 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-36669215-2bf9-44eb-8b90-93534d27ffce tempest-ProjectMemberTests-969865867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-3c12477e-4e14-49f7-84fc-efd2a011f238.edce9e21-f291-4c24-a0aa-fb459e40e667 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:40:34 devstack sudo[116220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-3c12477e-4e14-49f7-84fc-efd2a011f238.edce9e21-f291-4c24-a0aa-fb459e40e667 Jul 31 12:40:34 devstack sudo[116220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:40:34 devstack sudo[116220]: pam_unix(sudo:session): session closed for user root Jul 31 12:40:34 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-36669215-2bf9-44eb-8b90-93534d27ffce tempest-ProjectMemberTests-969865867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-3c12477e-4e14-49f7-84fc-efd2a011f238.edce9e21-f291-4c24-a0aa-fb459e40e667" returned: 0 in 0.322s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:40:34 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-36669215-2bf9-44eb-8b90-93534d27ffce tempest-ProjectMemberTests-969865867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-3c12477e-4e14-49f7-84fc-efd2a011f238.edce9e21-f291-4c24-a0aa-fb459e40e667 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:40:34 devstack sudo[116225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-3c12477e-4e14-49f7-84fc-efd2a011f238.edce9e21-f291-4c24-a0aa-fb459e40e667 Jul 31 12:40:34 devstack sudo[116225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:40:35 devstack sudo[116225]: pam_unix(sudo:session): session closed for user root Jul 31 12:40:35 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-36669215-2bf9-44eb-8b90-93534d27ffce tempest-ProjectMemberTests-969865867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-3c12477e-4e14-49f7-84fc-efd2a011f238.edce9e21-f291-4c24-a0aa-fb459e40e667" returned: 0 in 0.244s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:40:35 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-36669215-2bf9-44eb-8b90-93534d27ffce tempest-ProjectMemberTests-969865867 None] Lock "cinder-quobyte-edce9e21-f291-4c24-a0aa-fb459e40e667" released by "_delete_snapshot" :: held 1.362s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:40:35 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-36669215-2bf9-44eb-8b90-93534d27ffce tempest-ProjectMemberTests-969865867 None] Lock "cinder-quobyte-3c12477e-4e14-49f7-84fc-efd2a011f238" released by "delete_snapshot" :: held 1.383s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:40:35 devstack cinder-volume[89182]: DEBUG cinder.quota [None req-36669215-2bf9-44eb-8b90-93534d27ffce tempest-ProjectMemberTests-969865867 None] Created reservations ['ee3981c5-27ef-4b7c-92d2-159e102926b0', '77774793-1195-4acb-b459-e79b485763f2', 'de6d5343-97b0-4380-b824-849c1001b2a2', '116eb8a5-57bd-49c9-a940-8b201db4d230'] {{(pid=89182) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 12:40:35 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-36669215-2bf9-44eb-8b90-93534d27ffce tempest-ProjectMemberTests-969865867 None] Delete snapshot completed successfully. Jul 31 12:40:35 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-36669215-2bf9-44eb-8b90-93534d27ffce tempest-ProjectMemberTests-969865867 None] Lock "cinder-edce9e21-f291-4c24-a0aa-fb459e40e667-delete_snapshot" released by "delete_snapshot" :: held 1.524s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:40:35 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-ceea5f6e-4b61-4632-9820-deb936b7a47f tempest-ProjectMemberTests-969865867 None] Acquiring lock "cinder-3c12477e-4e14-49f7-84fc-efd2a011f238-delete_volume" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:40:35 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-ceea5f6e-4b61-4632-9820-deb936b7a47f tempest-ProjectMemberTests-969865867 None] Lock "cinder-3c12477e-4e14-49f7-84fc-efd2a011f238-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:40:35 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-ceea5f6e-4b61-4632-9820-deb936b7a47f tempest-ProjectMemberTests-969865867 None] Acquiring lock "cinder-quobyte-3c12477e-4e14-49f7-84fc-efd2a011f238" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:40:35 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-ceea5f6e-4b61-4632-9820-deb936b7a47f tempest-ProjectMemberTests-969865867 None] Lock "cinder-quobyte-3c12477e-4e14-49f7-84fc-efd2a011f238" acquired by "delete_volume" :: waited 0.015s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:40:35 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd107109-9a0a-4c63-83fe-14669d596ae9]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:40:35 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-ceea5f6e-4b61-4632-9820-deb936b7a47f tempest-ProjectMemberTests-969865867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-3c12477e-4e14-49f7-84fc-efd2a011f238 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:40:36 devstack sudo[116229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-3c12477e-4e14-49f7-84fc-efd2a011f238 Jul 31 12:40:36 devstack sudo[116229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:40:36 devstack sudo[116229]: pam_unix(sudo:session): session closed for user root Jul 31 12:40:36 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-ceea5f6e-4b61-4632-9820-deb936b7a47f tempest-ProjectMemberTests-969865867 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-3c12477e-4e14-49f7-84fc-efd2a011f238" returned: 0 in 0.351s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:40:36 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-ceea5f6e-4b61-4632-9820-deb936b7a47f tempest-ProjectMemberTests-969865867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-3c12477e-4e14-49f7-84fc-efd2a011f238 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:40:36 devstack sudo[116234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-3c12477e-4e14-49f7-84fc-efd2a011f238 Jul 31 12:40:36 devstack sudo[116234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:40:36 devstack sudo[116234]: pam_unix(sudo:session): session closed for user root Jul 31 12:40:36 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-ceea5f6e-4b61-4632-9820-deb936b7a47f tempest-ProjectMemberTests-969865867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-3c12477e-4e14-49f7-84fc-efd2a011f238" returned: 0 in 0.242s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:40:36 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-ceea5f6e-4b61-4632-9820-deb936b7a47f tempest-ProjectMemberTests-969865867 None] Lock "cinder-quobyte-3c12477e-4e14-49f7-84fc-efd2a011f238" released by "delete_volume" :: held 0.657s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:40:36 devstack cinder-volume[89182]: DEBUG cinder.quota [None req-ceea5f6e-4b61-4632-9820-deb936b7a47f tempest-ProjectMemberTests-969865867 None] Created reservations ['5c19385f-6cc8-42fb-ae7b-034160f9240c', 'a4fb4e2a-fcfb-4b40-9e72-2e9638e16fb8', 'aa48a1dc-d7b9-4ce3-8b66-60822eee1d6e', 'ad040b45-9a3a-4b6a-a6ef-9aceb06baebd'] {{(pid=89182) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 12:40:36 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-ceea5f6e-4b61-4632-9820-deb936b7a47f tempest-ProjectMemberTests-969865867 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:40:36 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-ceea5f6e-4b61-4632-9820-deb936b7a47f tempest-ProjectMemberTests-969865867 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:40:36 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-ceea5f6e-4b61-4632-9820-deb936b7a47f tempest-ProjectMemberTests-969865867 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:40:36 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-ceea5f6e-4b61-4632-9820-deb936b7a47f tempest-ProjectMemberTests-969865867 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:40:36 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-ceea5f6e-4b61-4632-9820-deb936b7a47f tempest-ProjectMemberTests-969865867 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:40:36 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-ceea5f6e-4b61-4632-9820-deb936b7a47f tempest-ProjectMemberTests-969865867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:40:36 devstack sudo[116237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 Jul 31 12:40:36 devstack sudo[116237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:40:36 devstack sudo[116237]: pam_unix(sudo:session): session closed for user root Jul 31 12:40:36 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-ceea5f6e-4b61-4632-9820-deb936b7a47f tempest-ProjectMemberTests-969865867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2" returned: 0 in 0.260s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:40:36 devstack cinder-volume[89182]: DEBUG cinder.manager [None req-ceea5f6e-4b61-4632-9820-deb936b7a47f tempest-ProjectMemberTests-969865867 None] Notifying Schedulers of capabilities ... {{(pid=89182) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 12:40:36 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-ceea5f6e-4b61-4632-9820-deb936b7a47f tempest-ProjectMemberTests-969865867 None] Deleted volume successfully. Jul 31 12:40:37 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-ceea5f6e-4b61-4632-9820-deb936b7a47f tempest-ProjectMemberTests-969865867 None] Lock "cinder-3c12477e-4e14-49f7-84fc-efd2a011f238-delete_volume" released by "delete_volume" :: held 1.111s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:40:37 devstack cinder-volume[89182]: DEBUG cinder.volume.flows.manager.create_volume [None req-16a2500f-e3a9-46e2-a783-f961b64d3361 tempest-ProjectMemberTests-969865867 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89182) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 12:40:37 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-16a2500f-e3a9-46e2-a783-f961b64d3361 tempest-ProjectMemberTests-969865867 None] Flow 'volume_create_manager' (671365d1-6fc1-4683-8282-4130d533ce99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:40:37 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-16a2500f-e3a9-46e2-a783-f961b64d3361 tempest-ProjectMemberTests-969865867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ddc1a71d-9855-45c8-a664-f8bb7994c924) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:40:37 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-16a2500f-e3a9-46e2-a783-f961b64d3361 tempest-ProjectMemberTests-969865867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ddc1a71d-9855-45c8-a664-f8bb7994c924) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:40:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-128243253',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c55e370f-ac60-48a0-981d-505f58711159,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7618b523b3644b0aff23a331c24c373',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:40:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:40:37Z,use_quota=True,user_id='ef87d129d713438b8a1c61430735d914',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:40:37 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-16a2500f-e3a9-46e2-a783-f961b64d3361 tempest-ProjectMemberTests-969865867 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e13e19e3-1c8f-46fa-b677-96274eccff83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:40:37 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-16a2500f-e3a9-46e2-a783-f961b64d3361 tempest-ProjectMemberTests-969865867 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e13e19e3-1c8f-46fa-b677-96274eccff83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:40:37 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-16a2500f-e3a9-46e2-a783-f961b64d3361 tempest-ProjectMemberTests-969865867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a62b855c-a31e-4a50-b3f6-101e71e50ae7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:40:37 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-16a2500f-e3a9-46e2-a783-f961b64d3361 tempest-ProjectMemberTests-969865867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a62b855c-a31e-4a50-b3f6-101e71e50ae7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c55e370f-ac60-48a0-981d-505f58711159', 'volume_name': 'volume-c55e370f-ac60-48a0-981d-505f58711159', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:40:37 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-16a2500f-e3a9-46e2-a783-f961b64d3361 tempest-ProjectMemberTests-969865867 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2f4c267-e6a3-4d71-89cd-a9e56e3e1beb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:40:37 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-16a2500f-e3a9-46e2-a783-f961b64d3361 tempest-ProjectMemberTests-969865867 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2f4c267-e6a3-4d71-89cd-a9e56e3e1beb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:40:37 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-16a2500f-e3a9-46e2-a783-f961b64d3361 tempest-ProjectMemberTests-969865867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4feef8aa-34d3-4ff6-b3eb-95437ab2b167) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:40:37 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-16a2500f-e3a9-46e2-a783-f961b64d3361 tempest-ProjectMemberTests-969865867 None] Volume c55e370f-ac60-48a0-981d-505f58711159: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c55e370f-ac60-48a0-981d-505f58711159', 'volume_size': 1} Jul 31 12:40:37 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-16a2500f-e3a9-46e2-a783-f961b64d3361 tempest-ProjectMemberTests-969865867 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:40:37 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-16a2500f-e3a9-46e2-a783-f961b64d3361 tempest-ProjectMemberTests-969865867 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:40:37 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-16a2500f-e3a9-46e2-a783-f961b64d3361 tempest-ProjectMemberTests-969865867 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:40:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-128243253',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c55e370f-ac60-48a0-981d-505f58711159,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7618b523b3644b0aff23a331c24c373',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:40:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:40:37Z,use_quota=True,user_id='ef87d129d713438b8a1c61430735d914',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)}" {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 12:40:37 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-16a2500f-e3a9-46e2-a783-f961b64d3361 tempest-ProjectMemberTests-969865867 None] Creating volume c55e370f-ac60-48a0-981d-505f58711159 {{(pid=89182) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 12:40:37 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-16a2500f-e3a9-46e2-a783-f961b64d3361 tempest-ProjectMemberTests-969865867 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:40:37 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-16a2500f-e3a9-46e2-a783-f961b64d3361 tempest-ProjectMemberTests-969865867 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:40:37 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-16a2500f-e3a9-46e2-a783-f961b64d3361 tempest-ProjectMemberTests-969865867 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:40:37 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-16a2500f-e3a9-46e2-a783-f961b64d3361 tempest-ProjectMemberTests-969865867 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:40:37 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-16a2500f-e3a9-46e2-a783-f961b64d3361 tempest-ProjectMemberTests-969865867 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:40:37 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-16a2500f-e3a9-46e2-a783-f961b64d3361 tempest-ProjectMemberTests-969865867 None] Selected osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 as target Quobyte volume. {{(pid=89182) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 12:40:37 devstack cinder-volume[89182]: INFO cinder.volume.drivers.remotefs [None req-16a2500f-e3a9-46e2-a783-f961b64d3361 tempest-ProjectMemberTests-969865867 None] casted to osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 Jul 31 12:40:37 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-16a2500f-e3a9-46e2-a783-f961b64d3361 tempest-ProjectMemberTests-969865867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-c55e370f-ac60-48a0-981d-505f58711159 1073741824 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:40:37 devstack sudo[116241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-c55e370f-ac60-48a0-981d-505f58711159 1073741824 Jul 31 12:40:37 devstack sudo[116241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:40:37 devstack sudo[116241]: pam_unix(sudo:session): session closed for user root Jul 31 12:40:37 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-16a2500f-e3a9-46e2-a783-f961b64d3361 tempest-ProjectMemberTests-969865867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-c55e370f-ac60-48a0-981d-505f58711159 1073741824" returned: 0 in 0.406s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:40:37 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-16a2500f-e3a9-46e2-a783-f961b64d3361 tempest-ProjectMemberTests-969865867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-c55e370f-ac60-48a0-981d-505f58711159 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:40:37 devstack sudo[116247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-c55e370f-ac60-48a0-981d-505f58711159 Jul 31 12:40:37 devstack sudo[116247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:40:38 devstack sudo[116247]: pam_unix(sudo:session): session closed for user root Jul 31 12:40:38 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-16a2500f-e3a9-46e2-a783-f961b64d3361 tempest-ProjectMemberTests-969865867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-c55e370f-ac60-48a0-981d-505f58711159" returned: 0 in 0.242s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:40:38 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-16a2500f-e3a9-46e2-a783-f961b64d3361 tempest-ProjectMemberTests-969865867 None] <== create_volume: return (686ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'} {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 12:40:38 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-16a2500f-e3a9-46e2-a783-f961b64d3361 tempest-ProjectMemberTests-969865867 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.688s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:40:38 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-16a2500f-e3a9-46e2-a783-f961b64d3361 tempest-ProjectMemberTests-969865867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4feef8aa-34d3-4ff6-b3eb-95437ab2b167) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c55e370f-ac60-48a0-981d-505f58711159', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:40:38 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-16a2500f-e3a9-46e2-a783-f961b64d3361 tempest-ProjectMemberTests-969865867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc6083fa-01ee-40af-94b7-70a9b54ac5e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:40:38 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-16a2500f-e3a9-46e2-a783-f961b64d3361 tempest-ProjectMemberTests-969865867 None] Volume volume-c55e370f-ac60-48a0-981d-505f58711159 (c55e370f-ac60-48a0-981d-505f58711159): created successfully Jul 31 12:40:38 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-16a2500f-e3a9-46e2-a783-f961b64d3361 tempest-ProjectMemberTests-969865867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc6083fa-01ee-40af-94b7-70a9b54ac5e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:40:38 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-16a2500f-e3a9-46e2-a783-f961b64d3361 tempest-ProjectMemberTests-969865867 None] Flow 'volume_create_manager' (671365d1-6fc1-4683-8282-4130d533ce99) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:40:38 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-16a2500f-e3a9-46e2-a783-f961b64d3361 tempest-ProjectMemberTests-969865867 None] Created volume successfully. Jul 31 12:40:38 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-6f7deac0-dc8f-40b0-9fde-3e5d05e883af tempest-ProjectMemberTests-969865867 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:40:38 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-6f7deac0-dc8f-40b0-9fde-3e5d05e883af tempest-ProjectMemberTests-969865867 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:40:38 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-6f7deac0-dc8f-40b0-9fde-3e5d05e883af tempest-ProjectMemberTests-969865867 None] Creating offline snapshot dd90cf28-588e-44f2-ae49-2140ae13f077 of volume c55e370f-ac60-48a0-981d-505f58711159 {{(pid=89182) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 31 12:40:38 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[56f837e6-b37f-4a4f-b8f4-d18171c024db]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:40:38 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-6f7deac0-dc8f-40b0-9fde-3e5d05e883af tempest-ProjectMemberTests-969865867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-c55e370f-ac60-48a0-981d-505f58711159 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:40:38 devstack sudo[116250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-c55e370f-ac60-48a0-981d-505f58711159 Jul 31 12:40:38 devstack sudo[116250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:40:38 devstack sudo[116250]: pam_unix(sudo:session): session closed for user root Jul 31 12:40:39 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-6f7deac0-dc8f-40b0-9fde-3e5d05e883af tempest-ProjectMemberTests-969865867 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-c55e370f-ac60-48a0-981d-505f58711159" returned: 0 in 0.355s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:40:39 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-6f7deac0-dc8f-40b0-9fde-3e5d05e883af tempest-ProjectMemberTests-969865867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-c55e370f-ac60-48a0-981d-505f58711159,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-c55e370f-ac60-48a0-981d-505f58711159.dd90cf28-588e-44f2-ae49-2140ae13f077 1G {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:40:39 devstack sudo[116255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-c55e370f-ac60-48a0-981d-505f58711159,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-c55e370f-ac60-48a0-981d-505f58711159.dd90cf28-588e-44f2-ae49-2140ae13f077 1G Jul 31 12:40:39 devstack sudo[116255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:40:39 devstack sudo[116255]: pam_unix(sudo:session): session closed for user root Jul 31 12:40:39 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-6f7deac0-dc8f-40b0-9fde-3e5d05e883af tempest-ProjectMemberTests-969865867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-c55e370f-ac60-48a0-981d-505f58711159,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-c55e370f-ac60-48a0-981d-505f58711159.dd90cf28-588e-44f2-ae49-2140ae13f077 1G" returned: 0 in 0.377s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:40:39 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-6f7deac0-dc8f-40b0-9fde-3e5d05e883af tempest-ProjectMemberTests-969865867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c55e370f-ac60-48a0-981d-505f58711159 -F qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-c55e370f-ac60-48a0-981d-505f58711159.dd90cf28-588e-44f2-ae49-2140ae13f077 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:40:39 devstack sudo[116261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c55e370f-ac60-48a0-981d-505f58711159 -F qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-c55e370f-ac60-48a0-981d-505f58711159.dd90cf28-588e-44f2-ae49-2140ae13f077 Jul 31 12:40:39 devstack sudo[116261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:40:39 devstack sudo[116261]: pam_unix(sudo:session): session closed for user root Jul 31 12:40:39 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-6f7deac0-dc8f-40b0-9fde-3e5d05e883af tempest-ProjectMemberTests-969865867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c55e370f-ac60-48a0-981d-505f58711159 -F qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-c55e370f-ac60-48a0-981d-505f58711159.dd90cf28-588e-44f2-ae49-2140ae13f077" returned: 0 in 0.283s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:40:39 devstack cinder-volume[89182]: WARNING cinder.volume.drivers.remotefs [None req-6f7deac0-dc8f-40b0-9fde-3e5d05e883af tempest-ProjectMemberTests-969865867 None] /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-c55e370f-ac60-48a0-981d-505f58711159.dd90cf28-588e-44f2-ae49-2140ae13f077 is being set with open permissions: ugo+rw Jul 31 12:40:39 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-6f7deac0-dc8f-40b0-9fde-3e5d05e883af tempest-ProjectMemberTests-969865867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-c55e370f-ac60-48a0-981d-505f58711159.dd90cf28-588e-44f2-ae49-2140ae13f077 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:40:39 devstack sudo[116266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-c55e370f-ac60-48a0-981d-505f58711159.dd90cf28-588e-44f2-ae49-2140ae13f077 Jul 31 12:40:39 devstack sudo[116266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:40:39 devstack sudo[116266]: pam_unix(sudo:session): session closed for user root Jul 31 12:40:39 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-6f7deac0-dc8f-40b0-9fde-3e5d05e883af tempest-ProjectMemberTests-969865867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-c55e370f-ac60-48a0-981d-505f58711159.dd90cf28-588e-44f2-ae49-2140ae13f077" returned: 0 in 0.233s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:40:39 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-6f7deac0-dc8f-40b0-9fde-3e5d05e883af tempest-ProjectMemberTests-969865867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-c55e370f-ac60-48a0-981d-505f58711159.info {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:40:39 devstack sudo[116269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-c55e370f-ac60-48a0-981d-505f58711159.info Jul 31 12:40:39 devstack sudo[116269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:40:40 devstack sudo[116269]: pam_unix(sudo:session): session closed for user root Jul 31 12:40:40 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-6f7deac0-dc8f-40b0-9fde-3e5d05e883af tempest-ProjectMemberTests-969865867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-c55e370f-ac60-48a0-981d-505f58711159.info" returned: 0 in 0.240s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:40:40 devstack cinder-volume[89182]: WARNING cinder.volume.drivers.remotefs [None req-6f7deac0-dc8f-40b0-9fde-3e5d05e883af tempest-ProjectMemberTests-969865867 None] /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-c55e370f-ac60-48a0-981d-505f58711159.info is being set with open permissions: ugo+rw Jul 31 12:40:40 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-6f7deac0-dc8f-40b0-9fde-3e5d05e883af tempest-ProjectMemberTests-969865867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-c55e370f-ac60-48a0-981d-505f58711159.info {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:40:40 devstack sudo[116272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-c55e370f-ac60-48a0-981d-505f58711159.info Jul 31 12:40:40 devstack sudo[116272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:40:40 devstack sudo[116272]: pam_unix(sudo:session): session closed for user root Jul 31 12:40:40 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-6f7deac0-dc8f-40b0-9fde-3e5d05e883af tempest-ProjectMemberTests-969865867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-c55e370f-ac60-48a0-981d-505f58711159.info" returned: 0 in 0.245s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:40:40 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-6f7deac0-dc8f-40b0-9fde-3e5d05e883af tempest-ProjectMemberTests-969865867 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.808s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:40:40 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-6f7deac0-dc8f-40b0-9fde-3e5d05e883af tempest-ProjectMemberTests-969865867 None] Create snapshot completed successfully Jul 31 12:40:40 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-1a8bb340-f246-4358-8a62-16cc123d689b tempest-ProjectMemberTests-969865867 None] Acquiring lock "cinder-dd90cf28-588e-44f2-ae49-2140ae13f077-delete_snapshot" by "delete_snapshot" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:40:40 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-1a8bb340-f246-4358-8a62-16cc123d689b tempest-ProjectMemberTests-969865867 None] Lock "cinder-dd90cf28-588e-44f2-ae49-2140ae13f077-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:40:40 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-1a8bb340-f246-4358-8a62-16cc123d689b tempest-ProjectMemberTests-969865867 None] Acquiring lock "cinder-quobyte-c55e370f-ac60-48a0-981d-505f58711159" by "delete_snapshot" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:40:40 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-1a8bb340-f246-4358-8a62-16cc123d689b tempest-ProjectMemberTests-969865867 None] Lock "cinder-quobyte-c55e370f-ac60-48a0-981d-505f58711159" acquired by "delete_snapshot" :: waited 0.017s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:40:40 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-1a8bb340-f246-4358-8a62-16cc123d689b tempest-ProjectMemberTests-969865867 None] Acquiring lock "cinder-quobyte-dd90cf28-588e-44f2-ae49-2140ae13f077" by "_delete_snapshot" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:40:40 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-1a8bb340-f246-4358-8a62-16cc123d689b tempest-ProjectMemberTests-969865867 None] Lock "cinder-quobyte-dd90cf28-588e-44f2-ae49-2140ae13f077" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:40:40 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-1a8bb340-f246-4358-8a62-16cc123d689b tempest-ProjectMemberTests-969865867 None] Deleting offline snapshot dd90cf28-588e-44f2-ae49-2140ae13f077 of volume c55e370f-ac60-48a0-981d-505f58711159 {{(pid=89182) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 31 12:40:40 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-1a8bb340-f246-4358-8a62-16cc123d689b tempest-ProjectMemberTests-969865867 None] snapshot_file for this snap is: volume-c55e370f-ac60-48a0-981d-505f58711159.dd90cf28-588e-44f2-ae49-2140ae13f077 {{(pid=89182) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 31 12:40:40 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[189b6539-2430-4205-91f1-bf161a6ad523]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:40:40 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-1a8bb340-f246-4358-8a62-16cc123d689b tempest-ProjectMemberTests-969865867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-c55e370f-ac60-48a0-981d-505f58711159.dd90cf28-588e-44f2-ae49-2140ae13f077 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:40:40 devstack sudo[116275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-c55e370f-ac60-48a0-981d-505f58711159.dd90cf28-588e-44f2-ae49-2140ae13f077 Jul 31 12:40:40 devstack sudo[116275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:40:41 devstack sudo[116275]: pam_unix(sudo:session): session closed for user root Jul 31 12:40:41 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-1a8bb340-f246-4358-8a62-16cc123d689b tempest-ProjectMemberTests-969865867 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-c55e370f-ac60-48a0-981d-505f58711159.dd90cf28-588e-44f2-ae49-2140ae13f077" returned: 0 in 0.343s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:40:41 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-1a8bb340-f246-4358-8a62-16cc123d689b tempest-ProjectMemberTests-969865867 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c55e370f-ac60-48a0-981d-505f58711159(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89182) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 12:40:41 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[b69b862d-1e4b-4193-b700-a7122f792bbf]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:40:41 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-1a8bb340-f246-4358-8a62-16cc123d689b tempest-ProjectMemberTests-969865867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-c55e370f-ac60-48a0-981d-505f58711159 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:40:41 devstack sudo[116280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-c55e370f-ac60-48a0-981d-505f58711159 Jul 31 12:40:41 devstack sudo[116280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:40:41 devstack sudo[116280]: pam_unix(sudo:session): session closed for user root Jul 31 12:40:41 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-1a8bb340-f246-4358-8a62-16cc123d689b tempest-ProjectMemberTests-969865867 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-c55e370f-ac60-48a0-981d-505f58711159" returned: 0 in 0.343s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:40:41 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-1a8bb340-f246-4358-8a62-16cc123d689b tempest-ProjectMemberTests-969865867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-c55e370f-ac60-48a0-981d-505f58711159.dd90cf28-588e-44f2-ae49-2140ae13f077 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:40:41 devstack sudo[116285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-c55e370f-ac60-48a0-981d-505f58711159.dd90cf28-588e-44f2-ae49-2140ae13f077 Jul 31 12:40:41 devstack sudo[116285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:40:41 devstack sudo[116285]: pam_unix(sudo:session): session closed for user root Jul 31 12:40:41 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-1a8bb340-f246-4358-8a62-16cc123d689b tempest-ProjectMemberTests-969865867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-c55e370f-ac60-48a0-981d-505f58711159.dd90cf28-588e-44f2-ae49-2140ae13f077" returned: 0 in 0.315s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:40:41 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-1a8bb340-f246-4358-8a62-16cc123d689b tempest-ProjectMemberTests-969865867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-c55e370f-ac60-48a0-981d-505f58711159.dd90cf28-588e-44f2-ae49-2140ae13f077 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:40:41 devstack sudo[116290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-c55e370f-ac60-48a0-981d-505f58711159.dd90cf28-588e-44f2-ae49-2140ae13f077 Jul 31 12:40:41 devstack sudo[116290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:40:42 devstack sudo[116290]: pam_unix(sudo:session): session closed for user root Jul 31 12:40:42 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-1a8bb340-f246-4358-8a62-16cc123d689b tempest-ProjectMemberTests-969865867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-c55e370f-ac60-48a0-981d-505f58711159.dd90cf28-588e-44f2-ae49-2140ae13f077" returned: 0 in 0.242s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:40:42 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-1a8bb340-f246-4358-8a62-16cc123d689b tempest-ProjectMemberTests-969865867 None] Lock "cinder-quobyte-dd90cf28-588e-44f2-ae49-2140ae13f077" released by "_delete_snapshot" :: held 1.327s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:40:42 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-1a8bb340-f246-4358-8a62-16cc123d689b tempest-ProjectMemberTests-969865867 None] Lock "cinder-quobyte-c55e370f-ac60-48a0-981d-505f58711159" released by "delete_snapshot" :: held 1.346s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:40:42 devstack cinder-volume[89182]: DEBUG cinder.quota [None req-1a8bb340-f246-4358-8a62-16cc123d689b tempest-ProjectMemberTests-969865867 None] Created reservations ['004bee24-8d36-4526-9d41-9c66334dd12b', 'dfdc2dc6-8b82-4779-9b5b-5cf130a9a43a', 'a679d852-d30c-468c-a284-469c18970ae7', '7584ea93-8151-49d6-a3cd-c5ec94c24f44'] {{(pid=89182) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 12:40:42 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-1a8bb340-f246-4358-8a62-16cc123d689b tempest-ProjectMemberTests-969865867 None] Delete snapshot completed successfully. Jul 31 12:40:42 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-1a8bb340-f246-4358-8a62-16cc123d689b tempest-ProjectMemberTests-969865867 None] Lock "cinder-dd90cf28-588e-44f2-ae49-2140ae13f077-delete_snapshot" released by "delete_snapshot" :: held 1.483s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:40:42 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-62cc1e18-efad-48c1-be4d-79735225532f tempest-ProjectMemberTests-969865867 None] Acquiring lock "cinder-c55e370f-ac60-48a0-981d-505f58711159-delete_volume" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:40:42 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-62cc1e18-efad-48c1-be4d-79735225532f tempest-ProjectMemberTests-969865867 None] Lock "cinder-c55e370f-ac60-48a0-981d-505f58711159-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:40:42 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-62cc1e18-efad-48c1-be4d-79735225532f tempest-ProjectMemberTests-969865867 None] Acquiring lock "cinder-quobyte-c55e370f-ac60-48a0-981d-505f58711159" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:40:42 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-62cc1e18-efad-48c1-be4d-79735225532f tempest-ProjectMemberTests-969865867 None] Lock "cinder-quobyte-c55e370f-ac60-48a0-981d-505f58711159" acquired by "delete_volume" :: waited 0.017s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:40:42 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2070031-812c-4a69-a69c-67ad267330c2]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:40:42 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-62cc1e18-efad-48c1-be4d-79735225532f tempest-ProjectMemberTests-969865867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-c55e370f-ac60-48a0-981d-505f58711159 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:40:43 devstack sudo[116293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-c55e370f-ac60-48a0-981d-505f58711159 Jul 31 12:40:43 devstack sudo[116293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:40:43 devstack sudo[116293]: pam_unix(sudo:session): session closed for user root Jul 31 12:40:43 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-62cc1e18-efad-48c1-be4d-79735225532f tempest-ProjectMemberTests-969865867 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-c55e370f-ac60-48a0-981d-505f58711159" returned: 0 in 0.343s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:40:43 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-62cc1e18-efad-48c1-be4d-79735225532f tempest-ProjectMemberTests-969865867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-c55e370f-ac60-48a0-981d-505f58711159 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:40:43 devstack sudo[116298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-c55e370f-ac60-48a0-981d-505f58711159 Jul 31 12:40:43 devstack sudo[116298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:40:43 devstack sudo[116298]: pam_unix(sudo:session): session closed for user root Jul 31 12:40:43 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-62cc1e18-efad-48c1-be4d-79735225532f tempest-ProjectMemberTests-969865867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-c55e370f-ac60-48a0-981d-505f58711159" returned: 0 in 0.239s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:40:43 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-62cc1e18-efad-48c1-be4d-79735225532f tempest-ProjectMemberTests-969865867 None] Lock "cinder-quobyte-c55e370f-ac60-48a0-981d-505f58711159" released by "delete_volume" :: held 0.636s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:40:43 devstack cinder-volume[89182]: DEBUG cinder.quota [None req-62cc1e18-efad-48c1-be4d-79735225532f tempest-ProjectMemberTests-969865867 None] Created reservations ['9941102c-ab37-407f-9719-1c92c108ba99', '4745966d-d16c-457c-809a-3e0dacebee38', '1787f112-e0c8-46a4-b593-ec104059372d', 'bfc001d1-b582-495f-bfb6-36ae8857efc4'] {{(pid=89182) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 12:40:43 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-62cc1e18-efad-48c1-be4d-79735225532f tempest-ProjectMemberTests-969865867 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:40:43 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-62cc1e18-efad-48c1-be4d-79735225532f tempest-ProjectMemberTests-969865867 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:40:43 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-62cc1e18-efad-48c1-be4d-79735225532f tempest-ProjectMemberTests-969865867 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:40:43 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-62cc1e18-efad-48c1-be4d-79735225532f tempest-ProjectMemberTests-969865867 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:40:43 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-62cc1e18-efad-48c1-be4d-79735225532f tempest-ProjectMemberTests-969865867 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:40:43 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-62cc1e18-efad-48c1-be4d-79735225532f tempest-ProjectMemberTests-969865867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:40:43 devstack sudo[116301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 Jul 31 12:40:43 devstack sudo[116301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:40:43 devstack sudo[116301]: pam_unix(sudo:session): session closed for user root Jul 31 12:40:43 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-62cc1e18-efad-48c1-be4d-79735225532f tempest-ProjectMemberTests-969865867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2" returned: 0 in 0.233s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:40:43 devstack cinder-volume[89182]: DEBUG cinder.manager [None req-62cc1e18-efad-48c1-be4d-79735225532f tempest-ProjectMemberTests-969865867 None] Notifying Schedulers of capabilities ... {{(pid=89182) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 12:40:43 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-62cc1e18-efad-48c1-be4d-79735225532f tempest-ProjectMemberTests-969865867 None] Deleted volume successfully. Jul 31 12:40:43 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-62cc1e18-efad-48c1-be4d-79735225532f tempest-ProjectMemberTests-969865867 None] Lock "cinder-c55e370f-ac60-48a0-981d-505f58711159-delete_volume" released by "delete_volume" :: held 1.045s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:40:44 devstack cinder-volume[89182]: DEBUG cinder.volume.flows.manager.create_volume [None req-33a549d4-54e4-46c1-bc3b-141f66a9750d tempest-ProjectMemberTests-969865867 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89182) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 12:40:44 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-33a549d4-54e4-46c1-bc3b-141f66a9750d tempest-ProjectMemberTests-969865867 None] Flow 'volume_create_manager' (4ebe2ef9-420e-4c2e-948e-4bdcc5cf4dd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:40:44 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-33a549d4-54e4-46c1-bc3b-141f66a9750d tempest-ProjectMemberTests-969865867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36d282be-7187-4112-baf9-e4355a6723aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:40:44 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-33a549d4-54e4-46c1-bc3b-141f66a9750d tempest-ProjectMemberTests-969865867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36d282be-7187-4112-baf9-e4355a6723aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:40:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2075779626',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06811bef-505c-481d-a331-033c087ee4b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7618b523b3644b0aff23a331c24c373',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:40:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:40:44Z,use_quota=True,user_id='ef87d129d713438b8a1c61430735d914',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:40:44 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-33a549d4-54e4-46c1-bc3b-141f66a9750d tempest-ProjectMemberTests-969865867 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cfcb9467-e493-432e-9854-22cd1bd96fec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:40:44 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-33a549d4-54e4-46c1-bc3b-141f66a9750d tempest-ProjectMemberTests-969865867 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cfcb9467-e493-432e-9854-22cd1bd96fec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:40:44 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-33a549d4-54e4-46c1-bc3b-141f66a9750d tempest-ProjectMemberTests-969865867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d899e7da-284d-46cd-b949-11bef83bd98d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:40:44 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-33a549d4-54e4-46c1-bc3b-141f66a9750d tempest-ProjectMemberTests-969865867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d899e7da-284d-46cd-b949-11bef83bd98d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '06811bef-505c-481d-a331-033c087ee4b3', 'volume_name': 'volume-06811bef-505c-481d-a331-033c087ee4b3', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:40:44 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-33a549d4-54e4-46c1-bc3b-141f66a9750d tempest-ProjectMemberTests-969865867 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08c048b7-c612-4a90-9fe1-ea2a571d32a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:40:44 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-33a549d4-54e4-46c1-bc3b-141f66a9750d tempest-ProjectMemberTests-969865867 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08c048b7-c612-4a90-9fe1-ea2a571d32a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:40:44 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-33a549d4-54e4-46c1-bc3b-141f66a9750d tempest-ProjectMemberTests-969865867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7320f9e5-0daf-4379-ae28-b44cfcb8f382) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:40:44 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-33a549d4-54e4-46c1-bc3b-141f66a9750d tempest-ProjectMemberTests-969865867 None] Volume 06811bef-505c-481d-a331-033c087ee4b3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-06811bef-505c-481d-a331-033c087ee4b3', 'volume_size': 1} Jul 31 12:40:44 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-33a549d4-54e4-46c1-bc3b-141f66a9750d tempest-ProjectMemberTests-969865867 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:40:44 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-33a549d4-54e4-46c1-bc3b-141f66a9750d tempest-ProjectMemberTests-969865867 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:40:44 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-33a549d4-54e4-46c1-bc3b-141f66a9750d tempest-ProjectMemberTests-969865867 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:40:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2075779626',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06811bef-505c-481d-a331-033c087ee4b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7618b523b3644b0aff23a331c24c373',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:40:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:40:44Z,use_quota=True,user_id='ef87d129d713438b8a1c61430735d914',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)}" {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 12:40:44 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-33a549d4-54e4-46c1-bc3b-141f66a9750d tempest-ProjectMemberTests-969865867 None] Creating volume 06811bef-505c-481d-a331-033c087ee4b3 {{(pid=89182) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 12:40:44 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-33a549d4-54e4-46c1-bc3b-141f66a9750d tempest-ProjectMemberTests-969865867 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:40:44 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-33a549d4-54e4-46c1-bc3b-141f66a9750d tempest-ProjectMemberTests-969865867 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:40:44 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-33a549d4-54e4-46c1-bc3b-141f66a9750d tempest-ProjectMemberTests-969865867 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:40:44 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-33a549d4-54e4-46c1-bc3b-141f66a9750d tempest-ProjectMemberTests-969865867 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:40:44 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-33a549d4-54e4-46c1-bc3b-141f66a9750d tempest-ProjectMemberTests-969865867 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:40:44 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-33a549d4-54e4-46c1-bc3b-141f66a9750d tempest-ProjectMemberTests-969865867 None] Selected osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 as target Quobyte volume. {{(pid=89182) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 12:40:44 devstack cinder-volume[89182]: INFO cinder.volume.drivers.remotefs [None req-33a549d4-54e4-46c1-bc3b-141f66a9750d tempest-ProjectMemberTests-969865867 None] casted to osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 Jul 31 12:40:44 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-33a549d4-54e4-46c1-bc3b-141f66a9750d tempest-ProjectMemberTests-969865867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-06811bef-505c-481d-a331-033c087ee4b3 1073741824 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:40:44 devstack sudo[116304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-06811bef-505c-481d-a331-033c087ee4b3 1073741824 Jul 31 12:40:44 devstack sudo[116304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:40:44 devstack sudo[116304]: pam_unix(sudo:session): session closed for user root Jul 31 12:40:44 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-33a549d4-54e4-46c1-bc3b-141f66a9750d tempest-ProjectMemberTests-969865867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-06811bef-505c-481d-a331-033c087ee4b3 1073741824" returned: 0 in 0.399s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:40:44 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-33a549d4-54e4-46c1-bc3b-141f66a9750d tempest-ProjectMemberTests-969865867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-06811bef-505c-481d-a331-033c087ee4b3 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:40:45 devstack sudo[116309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-06811bef-505c-481d-a331-033c087ee4b3 Jul 31 12:40:45 devstack sudo[116309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:40:45 devstack sudo[116309]: pam_unix(sudo:session): session closed for user root Jul 31 12:40:45 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-33a549d4-54e4-46c1-bc3b-141f66a9750d tempest-ProjectMemberTests-969865867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-06811bef-505c-481d-a331-033c087ee4b3" returned: 0 in 0.249s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:40:45 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-33a549d4-54e4-46c1-bc3b-141f66a9750d tempest-ProjectMemberTests-969865867 None] <== create_volume: return (704ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'} {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 12:40:45 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-33a549d4-54e4-46c1-bc3b-141f66a9750d tempest-ProjectMemberTests-969865867 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.707s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:40:45 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-33a549d4-54e4-46c1-bc3b-141f66a9750d tempest-ProjectMemberTests-969865867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7320f9e5-0daf-4379-ae28-b44cfcb8f382) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-06811bef-505c-481d-a331-033c087ee4b3', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:40:45 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-33a549d4-54e4-46c1-bc3b-141f66a9750d tempest-ProjectMemberTests-969865867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8105c9c7-940f-45a8-96ad-f0bd23493389) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:40:45 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-33a549d4-54e4-46c1-bc3b-141f66a9750d tempest-ProjectMemberTests-969865867 None] Volume volume-06811bef-505c-481d-a331-033c087ee4b3 (06811bef-505c-481d-a331-033c087ee4b3): created successfully Jul 31 12:40:45 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-33a549d4-54e4-46c1-bc3b-141f66a9750d tempest-ProjectMemberTests-969865867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8105c9c7-940f-45a8-96ad-f0bd23493389) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:40:45 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-33a549d4-54e4-46c1-bc3b-141f66a9750d tempest-ProjectMemberTests-969865867 None] Flow 'volume_create_manager' (4ebe2ef9-420e-4c2e-948e-4bdcc5cf4dd1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:40:45 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-33a549d4-54e4-46c1-bc3b-141f66a9750d tempest-ProjectMemberTests-969865867 None] Created volume successfully. Jul 31 12:40:45 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-228ed183-a088-4cf6-a1e6-c76e5e0d0164 tempest-ProjectMemberTests-969865867 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:40:45 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-228ed183-a088-4cf6-a1e6-c76e5e0d0164 tempest-ProjectMemberTests-969865867 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:40:45 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-228ed183-a088-4cf6-a1e6-c76e5e0d0164 tempest-ProjectMemberTests-969865867 None] Creating offline snapshot 283de313-54a1-403e-a40f-249c642c34f5 of volume 06811bef-505c-481d-a331-033c087ee4b3 {{(pid=89182) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 31 12:40:45 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e66149a-aa86-442b-bce2-bcff0b74dd50]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:40:45 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-228ed183-a088-4cf6-a1e6-c76e5e0d0164 tempest-ProjectMemberTests-969865867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-06811bef-505c-481d-a331-033c087ee4b3 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:40:45 devstack sudo[116312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-06811bef-505c-481d-a331-033c087ee4b3 Jul 31 12:40:45 devstack sudo[116312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:40:45 devstack sudo[116312]: pam_unix(sudo:session): session closed for user root Jul 31 12:40:45 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-228ed183-a088-4cf6-a1e6-c76e5e0d0164 tempest-ProjectMemberTests-969865867 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-06811bef-505c-481d-a331-033c087ee4b3" returned: 0 in 0.343s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:40:45 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-228ed183-a088-4cf6-a1e6-c76e5e0d0164 tempest-ProjectMemberTests-969865867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-06811bef-505c-481d-a331-033c087ee4b3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-06811bef-505c-481d-a331-033c087ee4b3.283de313-54a1-403e-a40f-249c642c34f5 1G {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:40:46 devstack sudo[116317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-06811bef-505c-481d-a331-033c087ee4b3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-06811bef-505c-481d-a331-033c087ee4b3.283de313-54a1-403e-a40f-249c642c34f5 1G Jul 31 12:40:46 devstack sudo[116317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:40:46 devstack sudo[116317]: pam_unix(sudo:session): session closed for user root Jul 31 12:40:46 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-228ed183-a088-4cf6-a1e6-c76e5e0d0164 tempest-ProjectMemberTests-969865867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-06811bef-505c-481d-a331-033c087ee4b3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-06811bef-505c-481d-a331-033c087ee4b3.283de313-54a1-403e-a40f-249c642c34f5 1G" returned: 0 in 0.372s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:40:46 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-228ed183-a088-4cf6-a1e6-c76e5e0d0164 tempest-ProjectMemberTests-969865867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-06811bef-505c-481d-a331-033c087ee4b3 -F qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-06811bef-505c-481d-a331-033c087ee4b3.283de313-54a1-403e-a40f-249c642c34f5 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:40:46 devstack sudo[116322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-06811bef-505c-481d-a331-033c087ee4b3 -F qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-06811bef-505c-481d-a331-033c087ee4b3.283de313-54a1-403e-a40f-249c642c34f5 Jul 31 12:40:46 devstack sudo[116322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:40:46 devstack sudo[116322]: pam_unix(sudo:session): session closed for user root Jul 31 12:40:46 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-228ed183-a088-4cf6-a1e6-c76e5e0d0164 tempest-ProjectMemberTests-969865867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-06811bef-505c-481d-a331-033c087ee4b3 -F qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-06811bef-505c-481d-a331-033c087ee4b3.283de313-54a1-403e-a40f-249c642c34f5" returned: 0 in 0.286s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:40:46 devstack cinder-volume[89182]: WARNING cinder.volume.drivers.remotefs [None req-228ed183-a088-4cf6-a1e6-c76e5e0d0164 tempest-ProjectMemberTests-969865867 None] /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-06811bef-505c-481d-a331-033c087ee4b3.283de313-54a1-403e-a40f-249c642c34f5 is being set with open permissions: ugo+rw Jul 31 12:40:46 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-228ed183-a088-4cf6-a1e6-c76e5e0d0164 tempest-ProjectMemberTests-969865867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-06811bef-505c-481d-a331-033c087ee4b3.283de313-54a1-403e-a40f-249c642c34f5 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:40:46 devstack sudo[116328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-06811bef-505c-481d-a331-033c087ee4b3.283de313-54a1-403e-a40f-249c642c34f5 Jul 31 12:40:46 devstack sudo[116328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:40:46 devstack sudo[116328]: pam_unix(sudo:session): session closed for user root Jul 31 12:40:46 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-228ed183-a088-4cf6-a1e6-c76e5e0d0164 tempest-ProjectMemberTests-969865867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-06811bef-505c-481d-a331-033c087ee4b3.283de313-54a1-403e-a40f-249c642c34f5" returned: 0 in 0.230s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:40:46 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-228ed183-a088-4cf6-a1e6-c76e5e0d0164 tempest-ProjectMemberTests-969865867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-06811bef-505c-481d-a331-033c087ee4b3.info {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:40:46 devstack sudo[116331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-06811bef-505c-481d-a331-033c087ee4b3.info Jul 31 12:40:46 devstack sudo[116331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:40:47 devstack sudo[116331]: pam_unix(sudo:session): session closed for user root Jul 31 12:40:47 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-228ed183-a088-4cf6-a1e6-c76e5e0d0164 tempest-ProjectMemberTests-969865867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-06811bef-505c-481d-a331-033c087ee4b3.info" returned: 0 in 0.248s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:40:47 devstack cinder-volume[89182]: WARNING cinder.volume.drivers.remotefs [None req-228ed183-a088-4cf6-a1e6-c76e5e0d0164 tempest-ProjectMemberTests-969865867 None] /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-06811bef-505c-481d-a331-033c087ee4b3.info is being set with open permissions: ugo+rw Jul 31 12:40:47 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-228ed183-a088-4cf6-a1e6-c76e5e0d0164 tempest-ProjectMemberTests-969865867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-06811bef-505c-481d-a331-033c087ee4b3.info {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:40:47 devstack sudo[116334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-06811bef-505c-481d-a331-033c087ee4b3.info Jul 31 12:40:47 devstack sudo[116334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:40:47 devstack sudo[116334]: pam_unix(sudo:session): session closed for user root Jul 31 12:40:47 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-228ed183-a088-4cf6-a1e6-c76e5e0d0164 tempest-ProjectMemberTests-969865867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-06811bef-505c-481d-a331-033c087ee4b3.info" returned: 0 in 0.237s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:40:47 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-228ed183-a088-4cf6-a1e6-c76e5e0d0164 tempest-ProjectMemberTests-969865867 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.802s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:40:47 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-228ed183-a088-4cf6-a1e6-c76e5e0d0164 tempest-ProjectMemberTests-969865867 None] Create snapshot completed successfully Jul 31 12:40:47 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-c8bdf8e1-dec5-42ea-8ac0-3d78e2a56450 tempest-ProjectMemberTests-969865867 None] Acquiring lock "cinder-283de313-54a1-403e-a40f-249c642c34f5-delete_snapshot" by "delete_snapshot" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:40:47 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-c8bdf8e1-dec5-42ea-8ac0-3d78e2a56450 tempest-ProjectMemberTests-969865867 None] Lock "cinder-283de313-54a1-403e-a40f-249c642c34f5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:40:47 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-c8bdf8e1-dec5-42ea-8ac0-3d78e2a56450 tempest-ProjectMemberTests-969865867 None] Acquiring lock "cinder-quobyte-06811bef-505c-481d-a331-033c087ee4b3" by "delete_snapshot" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:40:47 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-c8bdf8e1-dec5-42ea-8ac0-3d78e2a56450 tempest-ProjectMemberTests-969865867 None] Lock "cinder-quobyte-06811bef-505c-481d-a331-033c087ee4b3" acquired by "delete_snapshot" :: waited 0.015s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:40:47 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-c8bdf8e1-dec5-42ea-8ac0-3d78e2a56450 tempest-ProjectMemberTests-969865867 None] Acquiring lock "cinder-quobyte-283de313-54a1-403e-a40f-249c642c34f5" by "_delete_snapshot" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:40:47 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-c8bdf8e1-dec5-42ea-8ac0-3d78e2a56450 tempest-ProjectMemberTests-969865867 None] Lock "cinder-quobyte-283de313-54a1-403e-a40f-249c642c34f5" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:40:47 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-c8bdf8e1-dec5-42ea-8ac0-3d78e2a56450 tempest-ProjectMemberTests-969865867 None] Deleting offline snapshot 283de313-54a1-403e-a40f-249c642c34f5 of volume 06811bef-505c-481d-a331-033c087ee4b3 {{(pid=89182) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 31 12:40:47 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-c8bdf8e1-dec5-42ea-8ac0-3d78e2a56450 tempest-ProjectMemberTests-969865867 None] snapshot_file for this snap is: volume-06811bef-505c-481d-a331-033c087ee4b3.283de313-54a1-403e-a40f-249c642c34f5 {{(pid=89182) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 31 12:40:47 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c1bd9ac-9ac7-4f8f-a671-76dd88bf7f66]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:40:47 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-c8bdf8e1-dec5-42ea-8ac0-3d78e2a56450 tempest-ProjectMemberTests-969865867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-06811bef-505c-481d-a331-033c087ee4b3.283de313-54a1-403e-a40f-249c642c34f5 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:40:47 devstack sudo[116338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-06811bef-505c-481d-a331-033c087ee4b3.283de313-54a1-403e-a40f-249c642c34f5 Jul 31 12:40:47 devstack sudo[116338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:40:48 devstack sudo[116338]: pam_unix(sudo:session): session closed for user root Jul 31 12:40:48 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-c8bdf8e1-dec5-42ea-8ac0-3d78e2a56450 tempest-ProjectMemberTests-969865867 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-06811bef-505c-481d-a331-033c087ee4b3.283de313-54a1-403e-a40f-249c642c34f5" returned: 0 in 0.352s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:40:48 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-c8bdf8e1-dec5-42ea-8ac0-3d78e2a56450 tempest-ProjectMemberTests-969865867 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-06811bef-505c-481d-a331-033c087ee4b3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89182) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 12:40:48 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b154af1-a078-46e5-8eb3-1f8d9b8fd9a4]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:40:48 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-c8bdf8e1-dec5-42ea-8ac0-3d78e2a56450 tempest-ProjectMemberTests-969865867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-06811bef-505c-481d-a331-033c087ee4b3 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:40:48 devstack sudo[116343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-06811bef-505c-481d-a331-033c087ee4b3 Jul 31 12:40:48 devstack sudo[116343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:40:48 devstack sudo[116343]: pam_unix(sudo:session): session closed for user root Jul 31 12:40:48 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-c8bdf8e1-dec5-42ea-8ac0-3d78e2a56450 tempest-ProjectMemberTests-969865867 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-06811bef-505c-481d-a331-033c087ee4b3" returned: 0 in 0.344s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:40:48 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-c8bdf8e1-dec5-42ea-8ac0-3d78e2a56450 tempest-ProjectMemberTests-969865867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-06811bef-505c-481d-a331-033c087ee4b3.283de313-54a1-403e-a40f-249c642c34f5 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:40:48 devstack sudo[116348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-06811bef-505c-481d-a331-033c087ee4b3.283de313-54a1-403e-a40f-249c642c34f5 Jul 31 12:40:48 devstack sudo[116348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:40:48 devstack sudo[116348]: pam_unix(sudo:session): session closed for user root Jul 31 12:40:48 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-c8bdf8e1-dec5-42ea-8ac0-3d78e2a56450 tempest-ProjectMemberTests-969865867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-06811bef-505c-481d-a331-033c087ee4b3.283de313-54a1-403e-a40f-249c642c34f5" returned: 0 in 0.319s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:40:48 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-c8bdf8e1-dec5-42ea-8ac0-3d78e2a56450 tempest-ProjectMemberTests-969865867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-06811bef-505c-481d-a331-033c087ee4b3.283de313-54a1-403e-a40f-249c642c34f5 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:40:48 devstack sudo[116353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-06811bef-505c-481d-a331-033c087ee4b3.283de313-54a1-403e-a40f-249c642c34f5 Jul 31 12:40:48 devstack sudo[116353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:40:49 devstack sudo[116353]: pam_unix(sudo:session): session closed for user root Jul 31 12:40:49 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-c8bdf8e1-dec5-42ea-8ac0-3d78e2a56450 tempest-ProjectMemberTests-969865867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-06811bef-505c-481d-a331-033c087ee4b3.283de313-54a1-403e-a40f-249c642c34f5" returned: 0 in 0.241s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:40:49 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-c8bdf8e1-dec5-42ea-8ac0-3d78e2a56450 tempest-ProjectMemberTests-969865867 None] Lock "cinder-quobyte-283de313-54a1-403e-a40f-249c642c34f5" released by "_delete_snapshot" :: held 1.346s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:40:49 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-c8bdf8e1-dec5-42ea-8ac0-3d78e2a56450 tempest-ProjectMemberTests-969865867 None] Lock "cinder-quobyte-06811bef-505c-481d-a331-033c087ee4b3" released by "delete_snapshot" :: held 1.364s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:40:49 devstack cinder-volume[89182]: DEBUG cinder.quota [None req-c8bdf8e1-dec5-42ea-8ac0-3d78e2a56450 tempest-ProjectMemberTests-969865867 None] Created reservations ['06a511c3-4aa0-419e-b9c4-986ee77ade8d', 'dcf19258-3599-44a9-a252-a1e013e54d60', '7cccf595-b7ea-4bbf-ab75-f09399209ec8', 'dbf7a485-e790-41fd-abba-be9f90dff66c'] {{(pid=89182) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 12:40:49 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-c8bdf8e1-dec5-42ea-8ac0-3d78e2a56450 tempest-ProjectMemberTests-969865867 None] Delete snapshot completed successfully. Jul 31 12:40:49 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-c8bdf8e1-dec5-42ea-8ac0-3d78e2a56450 tempest-ProjectMemberTests-969865867 None] Lock "cinder-283de313-54a1-403e-a40f-249c642c34f5-delete_snapshot" released by "delete_snapshot" :: held 1.509s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:40:49 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-5c626678-1572-47ae-8e9e-3f3608111bef tempest-ProjectMemberTests-969865867 None] Acquiring lock "cinder-06811bef-505c-481d-a331-033c087ee4b3-delete_volume" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:40:49 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-5c626678-1572-47ae-8e9e-3f3608111bef tempest-ProjectMemberTests-969865867 None] Lock "cinder-06811bef-505c-481d-a331-033c087ee4b3-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:40:49 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-5c626678-1572-47ae-8e9e-3f3608111bef tempest-ProjectMemberTests-969865867 None] Acquiring lock "cinder-quobyte-06811bef-505c-481d-a331-033c087ee4b3" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:40:49 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-5c626678-1572-47ae-8e9e-3f3608111bef tempest-ProjectMemberTests-969865867 None] Lock "cinder-quobyte-06811bef-505c-481d-a331-033c087ee4b3" acquired by "delete_volume" :: waited 0.014s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:40:49 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[798b7ec2-e5aa-4286-a4d6-fd057bd3e5ee]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:40:49 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-5c626678-1572-47ae-8e9e-3f3608111bef tempest-ProjectMemberTests-969865867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-06811bef-505c-481d-a331-033c087ee4b3 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:40:50 devstack sudo[116392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-06811bef-505c-481d-a331-033c087ee4b3 Jul 31 12:40:50 devstack sudo[116392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:40:50 devstack sudo[116392]: pam_unix(sudo:session): session closed for user root Jul 31 12:40:50 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-5c626678-1572-47ae-8e9e-3f3608111bef tempest-ProjectMemberTests-969865867 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-06811bef-505c-481d-a331-033c087ee4b3" returned: 0 in 0.354s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:40:50 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-5c626678-1572-47ae-8e9e-3f3608111bef tempest-ProjectMemberTests-969865867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-06811bef-505c-481d-a331-033c087ee4b3 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:40:50 devstack sudo[116400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-06811bef-505c-481d-a331-033c087ee4b3 Jul 31 12:40:50 devstack sudo[116400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:40:50 devstack sudo[116400]: pam_unix(sudo:session): session closed for user root Jul 31 12:40:50 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-5c626678-1572-47ae-8e9e-3f3608111bef tempest-ProjectMemberTests-969865867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-06811bef-505c-481d-a331-033c087ee4b3" returned: 0 in 0.241s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:40:50 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-5c626678-1572-47ae-8e9e-3f3608111bef tempest-ProjectMemberTests-969865867 None] Lock "cinder-quobyte-06811bef-505c-481d-a331-033c087ee4b3" released by "delete_volume" :: held 0.651s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:40:50 devstack cinder-volume[89182]: DEBUG cinder.quota [None req-5c626678-1572-47ae-8e9e-3f3608111bef tempest-ProjectMemberTests-969865867 None] Created reservations ['8f00cd68-c3fd-4dce-881f-acb038d780b6', 'b732105d-42e7-4a28-9c28-41dba8c3efc4', 'c4b3f444-b4f3-465a-a60f-631909077983', '27ecf805-04c4-4611-8367-181c33fa6bb3'] {{(pid=89182) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 12:40:50 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-5c626678-1572-47ae-8e9e-3f3608111bef tempest-ProjectMemberTests-969865867 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:40:50 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-5c626678-1572-47ae-8e9e-3f3608111bef tempest-ProjectMemberTests-969865867 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:40:50 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-5c626678-1572-47ae-8e9e-3f3608111bef tempest-ProjectMemberTests-969865867 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:40:50 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-5c626678-1572-47ae-8e9e-3f3608111bef tempest-ProjectMemberTests-969865867 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:40:50 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-5c626678-1572-47ae-8e9e-3f3608111bef tempest-ProjectMemberTests-969865867 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:40:50 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-5c626678-1572-47ae-8e9e-3f3608111bef tempest-ProjectMemberTests-969865867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:40:50 devstack sudo[116406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 Jul 31 12:40:50 devstack sudo[116406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:40:50 devstack sudo[116406]: pam_unix(sudo:session): session closed for user root Jul 31 12:40:50 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-5c626678-1572-47ae-8e9e-3f3608111bef tempest-ProjectMemberTests-969865867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2" returned: 0 in 0.235s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:40:50 devstack cinder-volume[89182]: DEBUG cinder.manager [None req-5c626678-1572-47ae-8e9e-3f3608111bef tempest-ProjectMemberTests-969865867 None] Notifying Schedulers of capabilities ... {{(pid=89182) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 12:40:50 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-5c626678-1572-47ae-8e9e-3f3608111bef tempest-ProjectMemberTests-969865867 None] Deleted volume successfully. Jul 31 12:40:50 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-5c626678-1572-47ae-8e9e-3f3608111bef tempest-ProjectMemberTests-969865867 None] Lock "cinder-06811bef-505c-481d-a331-033c087ee4b3-delete_volume" released by "delete_volume" :: held 1.086s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:40:51 devstack cinder-volume[89182]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac82f7fc-6b85-422c-871c-e91b0aea7af9 tempest-ProjectMemberTests-969865867 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89182) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 12:40:51 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-ac82f7fc-6b85-422c-871c-e91b0aea7af9 tempest-ProjectMemberTests-969865867 None] Flow 'volume_create_manager' (33c833c1-bec5-4472-8f0d-b866b526a796) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:40:51 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-ac82f7fc-6b85-422c-871c-e91b0aea7af9 tempest-ProjectMemberTests-969865867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a31adf92-8a7f-4ba1-9dd4-1a1ea885f565) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:40:51 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-ac82f7fc-6b85-422c-871c-e91b0aea7af9 tempest-ProjectMemberTests-969865867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a31adf92-8a7f-4ba1-9dd4-1a1ea885f565) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:40:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1075389684',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ccdbc3cb-f248-49cb-981e-17b3580d382a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7618b523b3644b0aff23a331c24c373',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:40:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:40:51Z,use_quota=True,user_id='ef87d129d713438b8a1c61430735d914',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:40:51 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-ac82f7fc-6b85-422c-871c-e91b0aea7af9 tempest-ProjectMemberTests-969865867 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d78d77f-ab1d-431a-ae71-66905940e584) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:40:51 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-ac82f7fc-6b85-422c-871c-e91b0aea7af9 tempest-ProjectMemberTests-969865867 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d78d77f-ab1d-431a-ae71-66905940e584) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:40:51 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-ac82f7fc-6b85-422c-871c-e91b0aea7af9 tempest-ProjectMemberTests-969865867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (981f346f-696e-4edb-a5ab-0ab1b44bed79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:40:51 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-ac82f7fc-6b85-422c-871c-e91b0aea7af9 tempest-ProjectMemberTests-969865867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (981f346f-696e-4edb-a5ab-0ab1b44bed79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ccdbc3cb-f248-49cb-981e-17b3580d382a', 'volume_name': 'volume-ccdbc3cb-f248-49cb-981e-17b3580d382a', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:40:51 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-ac82f7fc-6b85-422c-871c-e91b0aea7af9 tempest-ProjectMemberTests-969865867 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7e903ba-745b-45bb-b76b-809aae4b76ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:40:51 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-ac82f7fc-6b85-422c-871c-e91b0aea7af9 tempest-ProjectMemberTests-969865867 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7e903ba-745b-45bb-b76b-809aae4b76ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:40:51 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-ac82f7fc-6b85-422c-871c-e91b0aea7af9 tempest-ProjectMemberTests-969865867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ac592da-b1ab-46be-a941-7b61ddbb27d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:40:51 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-ac82f7fc-6b85-422c-871c-e91b0aea7af9 tempest-ProjectMemberTests-969865867 None] Volume ccdbc3cb-f248-49cb-981e-17b3580d382a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ccdbc3cb-f248-49cb-981e-17b3580d382a', 'volume_size': 1} Jul 31 12:40:51 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-ac82f7fc-6b85-422c-871c-e91b0aea7af9 tempest-ProjectMemberTests-969865867 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:40:51 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-ac82f7fc-6b85-422c-871c-e91b0aea7af9 tempest-ProjectMemberTests-969865867 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:40:51 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-ac82f7fc-6b85-422c-871c-e91b0aea7af9 tempest-ProjectMemberTests-969865867 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:40:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1075389684',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ccdbc3cb-f248-49cb-981e-17b3580d382a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7618b523b3644b0aff23a331c24c373',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:40:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:40:51Z,use_quota=True,user_id='ef87d129d713438b8a1c61430735d914',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)}" {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 12:40:51 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-ac82f7fc-6b85-422c-871c-e91b0aea7af9 tempest-ProjectMemberTests-969865867 None] Creating volume ccdbc3cb-f248-49cb-981e-17b3580d382a {{(pid=89182) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 12:40:51 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-ac82f7fc-6b85-422c-871c-e91b0aea7af9 tempest-ProjectMemberTests-969865867 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:40:51 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-ac82f7fc-6b85-422c-871c-e91b0aea7af9 tempest-ProjectMemberTests-969865867 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:40:51 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-ac82f7fc-6b85-422c-871c-e91b0aea7af9 tempest-ProjectMemberTests-969865867 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:40:51 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-ac82f7fc-6b85-422c-871c-e91b0aea7af9 tempest-ProjectMemberTests-969865867 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:40:51 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-ac82f7fc-6b85-422c-871c-e91b0aea7af9 tempest-ProjectMemberTests-969865867 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:40:51 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-ac82f7fc-6b85-422c-871c-e91b0aea7af9 tempest-ProjectMemberTests-969865867 None] Selected osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 as target Quobyte volume. {{(pid=89182) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 12:40:51 devstack cinder-volume[89182]: INFO cinder.volume.drivers.remotefs [None req-ac82f7fc-6b85-422c-871c-e91b0aea7af9 tempest-ProjectMemberTests-969865867 None] casted to osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 Jul 31 12:40:51 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-ac82f7fc-6b85-422c-871c-e91b0aea7af9 tempest-ProjectMemberTests-969865867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-ccdbc3cb-f248-49cb-981e-17b3580d382a 1073741824 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:40:51 devstack sudo[116409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-ccdbc3cb-f248-49cb-981e-17b3580d382a 1073741824 Jul 31 12:40:51 devstack sudo[116409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:40:51 devstack sudo[116409]: pam_unix(sudo:session): session closed for user root Jul 31 12:40:51 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-ac82f7fc-6b85-422c-871c-e91b0aea7af9 tempest-ProjectMemberTests-969865867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-ccdbc3cb-f248-49cb-981e-17b3580d382a 1073741824" returned: 0 in 0.413s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:40:51 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-ac82f7fc-6b85-422c-871c-e91b0aea7af9 tempest-ProjectMemberTests-969865867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-ccdbc3cb-f248-49cb-981e-17b3580d382a {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:40:52 devstack sudo[116415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-ccdbc3cb-f248-49cb-981e-17b3580d382a Jul 31 12:40:52 devstack sudo[116415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:40:52 devstack sudo[116415]: pam_unix(sudo:session): session closed for user root Jul 31 12:40:52 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-ac82f7fc-6b85-422c-871c-e91b0aea7af9 tempest-ProjectMemberTests-969865867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-ccdbc3cb-f248-49cb-981e-17b3580d382a" returned: 0 in 0.264s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:40:52 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-ac82f7fc-6b85-422c-871c-e91b0aea7af9 tempest-ProjectMemberTests-969865867 None] <== create_volume: return (722ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'} {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 12:40:52 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-ac82f7fc-6b85-422c-871c-e91b0aea7af9 tempest-ProjectMemberTests-969865867 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.725s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:40:52 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-ac82f7fc-6b85-422c-871c-e91b0aea7af9 tempest-ProjectMemberTests-969865867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ac592da-b1ab-46be-a941-7b61ddbb27d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ccdbc3cb-f248-49cb-981e-17b3580d382a', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:40:52 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-ac82f7fc-6b85-422c-871c-e91b0aea7af9 tempest-ProjectMemberTests-969865867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (baf7a412-7c73-44cd-a1dc-63176b7c59e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:40:52 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-ac82f7fc-6b85-422c-871c-e91b0aea7af9 tempest-ProjectMemberTests-969865867 None] Volume volume-ccdbc3cb-f248-49cb-981e-17b3580d382a (ccdbc3cb-f248-49cb-981e-17b3580d382a): created successfully Jul 31 12:40:52 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-ac82f7fc-6b85-422c-871c-e91b0aea7af9 tempest-ProjectMemberTests-969865867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (baf7a412-7c73-44cd-a1dc-63176b7c59e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:40:52 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-ac82f7fc-6b85-422c-871c-e91b0aea7af9 tempest-ProjectMemberTests-969865867 None] Flow 'volume_create_manager' (33c833c1-bec5-4472-8f0d-b866b526a796) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:40:52 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-ac82f7fc-6b85-422c-871c-e91b0aea7af9 tempest-ProjectMemberTests-969865867 None] Created volume successfully. Jul 31 12:40:52 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-e87501e7-ebd7-4237-986e-b87b20cf7d66 tempest-ProjectMemberTests-969865867 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:40:52 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-e87501e7-ebd7-4237-986e-b87b20cf7d66 tempest-ProjectMemberTests-969865867 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:40:52 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-e87501e7-ebd7-4237-986e-b87b20cf7d66 tempest-ProjectMemberTests-969865867 None] Creating offline snapshot f67811de-3148-4a8f-90be-28638ed6232f of volume ccdbc3cb-f248-49cb-981e-17b3580d382a {{(pid=89182) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 31 12:40:52 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[923f43c2-191e-46da-a115-716cb9779ecb]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:40:52 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-e87501e7-ebd7-4237-986e-b87b20cf7d66 tempest-ProjectMemberTests-969865867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-ccdbc3cb-f248-49cb-981e-17b3580d382a {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:40:52 devstack sudo[116420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-ccdbc3cb-f248-49cb-981e-17b3580d382a Jul 31 12:40:52 devstack sudo[116420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:40:52 devstack sudo[116420]: pam_unix(sudo:session): session closed for user root Jul 31 12:40:52 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-e87501e7-ebd7-4237-986e-b87b20cf7d66 tempest-ProjectMemberTests-969865867 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-ccdbc3cb-f248-49cb-981e-17b3580d382a" returned: 0 in 0.349s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:40:53 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-e87501e7-ebd7-4237-986e-b87b20cf7d66 tempest-ProjectMemberTests-969865867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-ccdbc3cb-f248-49cb-981e-17b3580d382a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-ccdbc3cb-f248-49cb-981e-17b3580d382a.f67811de-3148-4a8f-90be-28638ed6232f 1G {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:40:53 devstack sudo[116425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-ccdbc3cb-f248-49cb-981e-17b3580d382a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-ccdbc3cb-f248-49cb-981e-17b3580d382a.f67811de-3148-4a8f-90be-28638ed6232f 1G Jul 31 12:40:53 devstack sudo[116425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:40:53 devstack sudo[116425]: pam_unix(sudo:session): session closed for user root Jul 31 12:40:53 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-e87501e7-ebd7-4237-986e-b87b20cf7d66 tempest-ProjectMemberTests-969865867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-ccdbc3cb-f248-49cb-981e-17b3580d382a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-ccdbc3cb-f248-49cb-981e-17b3580d382a.f67811de-3148-4a8f-90be-28638ed6232f 1G" returned: 0 in 0.380s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:40:53 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-e87501e7-ebd7-4237-986e-b87b20cf7d66 tempest-ProjectMemberTests-969865867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ccdbc3cb-f248-49cb-981e-17b3580d382a -F qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-ccdbc3cb-f248-49cb-981e-17b3580d382a.f67811de-3148-4a8f-90be-28638ed6232f {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:40:53 devstack sudo[116431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ccdbc3cb-f248-49cb-981e-17b3580d382a -F qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-ccdbc3cb-f248-49cb-981e-17b3580d382a.f67811de-3148-4a8f-90be-28638ed6232f Jul 31 12:40:53 devstack sudo[116431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:40:53 devstack sudo[116431]: pam_unix(sudo:session): session closed for user root Jul 31 12:40:53 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-e87501e7-ebd7-4237-986e-b87b20cf7d66 tempest-ProjectMemberTests-969865867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ccdbc3cb-f248-49cb-981e-17b3580d382a -F qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-ccdbc3cb-f248-49cb-981e-17b3580d382a.f67811de-3148-4a8f-90be-28638ed6232f" returned: 0 in 0.286s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:40:53 devstack cinder-volume[89182]: WARNING cinder.volume.drivers.remotefs [None req-e87501e7-ebd7-4237-986e-b87b20cf7d66 tempest-ProjectMemberTests-969865867 None] /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-ccdbc3cb-f248-49cb-981e-17b3580d382a.f67811de-3148-4a8f-90be-28638ed6232f is being set with open permissions: ugo+rw Jul 31 12:40:53 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-e87501e7-ebd7-4237-986e-b87b20cf7d66 tempest-ProjectMemberTests-969865867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-ccdbc3cb-f248-49cb-981e-17b3580d382a.f67811de-3148-4a8f-90be-28638ed6232f {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:40:53 devstack sudo[116437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-ccdbc3cb-f248-49cb-981e-17b3580d382a.f67811de-3148-4a8f-90be-28638ed6232f Jul 31 12:40:53 devstack sudo[116437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:40:53 devstack sudo[116437]: pam_unix(sudo:session): session closed for user root Jul 31 12:40:53 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-e87501e7-ebd7-4237-986e-b87b20cf7d66 tempest-ProjectMemberTests-969865867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-ccdbc3cb-f248-49cb-981e-17b3580d382a.f67811de-3148-4a8f-90be-28638ed6232f" returned: 0 in 0.263s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:40:53 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-e87501e7-ebd7-4237-986e-b87b20cf7d66 tempest-ProjectMemberTests-969865867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-ccdbc3cb-f248-49cb-981e-17b3580d382a.info {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:40:53 devstack sudo[116440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-ccdbc3cb-f248-49cb-981e-17b3580d382a.info Jul 31 12:40:53 devstack sudo[116440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:40:54 devstack sudo[116440]: pam_unix(sudo:session): session closed for user root Jul 31 12:40:54 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-e87501e7-ebd7-4237-986e-b87b20cf7d66 tempest-ProjectMemberTests-969865867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-ccdbc3cb-f248-49cb-981e-17b3580d382a.info" returned: 0 in 0.239s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:40:54 devstack cinder-volume[89182]: WARNING cinder.volume.drivers.remotefs [None req-e87501e7-ebd7-4237-986e-b87b20cf7d66 tempest-ProjectMemberTests-969865867 None] /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-ccdbc3cb-f248-49cb-981e-17b3580d382a.info is being set with open permissions: ugo+rw Jul 31 12:40:54 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-e87501e7-ebd7-4237-986e-b87b20cf7d66 tempest-ProjectMemberTests-969865867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-ccdbc3cb-f248-49cb-981e-17b3580d382a.info {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:40:54 devstack sudo[116443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-ccdbc3cb-f248-49cb-981e-17b3580d382a.info Jul 31 12:40:54 devstack sudo[116443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:40:54 devstack sudo[116443]: pam_unix(sudo:session): session closed for user root Jul 31 12:40:54 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-e87501e7-ebd7-4237-986e-b87b20cf7d66 tempest-ProjectMemberTests-969865867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-ccdbc3cb-f248-49cb-981e-17b3580d382a.info" returned: 0 in 0.235s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:40:54 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-e87501e7-ebd7-4237-986e-b87b20cf7d66 tempest-ProjectMemberTests-969865867 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.830s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:40:54 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-e87501e7-ebd7-4237-986e-b87b20cf7d66 tempest-ProjectMemberTests-969865867 None] Create snapshot completed successfully Jul 31 12:40:54 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-a382d221-3480-4537-a04c-f8336782ebbf tempest-ProjectMemberTests-969865867 None] Acquiring lock "cinder-f67811de-3148-4a8f-90be-28638ed6232f-delete_snapshot" by "delete_snapshot" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:40:54 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-a382d221-3480-4537-a04c-f8336782ebbf tempest-ProjectMemberTests-969865867 None] Lock "cinder-f67811de-3148-4a8f-90be-28638ed6232f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:40:54 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-a382d221-3480-4537-a04c-f8336782ebbf tempest-ProjectMemberTests-969865867 None] Acquiring lock "cinder-quobyte-ccdbc3cb-f248-49cb-981e-17b3580d382a" by "delete_snapshot" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:40:54 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-a382d221-3480-4537-a04c-f8336782ebbf tempest-ProjectMemberTests-969865867 None] Lock "cinder-quobyte-ccdbc3cb-f248-49cb-981e-17b3580d382a" acquired by "delete_snapshot" :: waited 0.016s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:40:54 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-a382d221-3480-4537-a04c-f8336782ebbf tempest-ProjectMemberTests-969865867 None] Acquiring lock "cinder-quobyte-f67811de-3148-4a8f-90be-28638ed6232f" by "_delete_snapshot" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:40:54 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-a382d221-3480-4537-a04c-f8336782ebbf tempest-ProjectMemberTests-969865867 None] Lock "cinder-quobyte-f67811de-3148-4a8f-90be-28638ed6232f" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:40:54 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-a382d221-3480-4537-a04c-f8336782ebbf tempest-ProjectMemberTests-969865867 None] Deleting offline snapshot f67811de-3148-4a8f-90be-28638ed6232f of volume ccdbc3cb-f248-49cb-981e-17b3580d382a {{(pid=89182) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 31 12:40:54 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-a382d221-3480-4537-a04c-f8336782ebbf tempest-ProjectMemberTests-969865867 None] snapshot_file for this snap is: volume-ccdbc3cb-f248-49cb-981e-17b3580d382a.f67811de-3148-4a8f-90be-28638ed6232f {{(pid=89182) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 31 12:40:54 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[d968cdac-708d-4dcb-adb6-1d2422742db3]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:40:54 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-a382d221-3480-4537-a04c-f8336782ebbf tempest-ProjectMemberTests-969865867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-ccdbc3cb-f248-49cb-981e-17b3580d382a.f67811de-3148-4a8f-90be-28638ed6232f {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:40:55 devstack sudo[116446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-ccdbc3cb-f248-49cb-981e-17b3580d382a.f67811de-3148-4a8f-90be-28638ed6232f Jul 31 12:40:55 devstack sudo[116446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:40:55 devstack sudo[116446]: pam_unix(sudo:session): session closed for user root Jul 31 12:40:55 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-a382d221-3480-4537-a04c-f8336782ebbf tempest-ProjectMemberTests-969865867 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-ccdbc3cb-f248-49cb-981e-17b3580d382a.f67811de-3148-4a8f-90be-28638ed6232f" returned: 0 in 0.333s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:40:55 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-a382d221-3480-4537-a04c-f8336782ebbf tempest-ProjectMemberTests-969865867 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ccdbc3cb-f248-49cb-981e-17b3580d382a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89182) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 12:40:55 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d946194-7c19-4aa0-9fd8-550a27f62b38]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:40:55 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-a382d221-3480-4537-a04c-f8336782ebbf tempest-ProjectMemberTests-969865867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-ccdbc3cb-f248-49cb-981e-17b3580d382a {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:40:55 devstack sudo[116451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-ccdbc3cb-f248-49cb-981e-17b3580d382a Jul 31 12:40:55 devstack sudo[116451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:40:55 devstack sudo[116451]: pam_unix(sudo:session): session closed for user root Jul 31 12:40:55 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-a382d221-3480-4537-a04c-f8336782ebbf tempest-ProjectMemberTests-969865867 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-ccdbc3cb-f248-49cb-981e-17b3580d382a" returned: 0 in 0.331s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:40:55 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-a382d221-3480-4537-a04c-f8336782ebbf tempest-ProjectMemberTests-969865867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-ccdbc3cb-f248-49cb-981e-17b3580d382a.f67811de-3148-4a8f-90be-28638ed6232f {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:40:55 devstack sudo[116456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-ccdbc3cb-f248-49cb-981e-17b3580d382a.f67811de-3148-4a8f-90be-28638ed6232f Jul 31 12:40:55 devstack sudo[116456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:40:55 devstack sudo[116456]: pam_unix(sudo:session): session closed for user root Jul 31 12:40:55 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-a382d221-3480-4537-a04c-f8336782ebbf tempest-ProjectMemberTests-969865867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-ccdbc3cb-f248-49cb-981e-17b3580d382a.f67811de-3148-4a8f-90be-28638ed6232f" returned: 0 in 0.320s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:40:55 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-a382d221-3480-4537-a04c-f8336782ebbf tempest-ProjectMemberTests-969865867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-ccdbc3cb-f248-49cb-981e-17b3580d382a.f67811de-3148-4a8f-90be-28638ed6232f {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:40:55 devstack sudo[116462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-ccdbc3cb-f248-49cb-981e-17b3580d382a.f67811de-3148-4a8f-90be-28638ed6232f Jul 31 12:40:55 devstack sudo[116462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:40:56 devstack sudo[116462]: pam_unix(sudo:session): session closed for user root Jul 31 12:40:56 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-a382d221-3480-4537-a04c-f8336782ebbf tempest-ProjectMemberTests-969865867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-ccdbc3cb-f248-49cb-981e-17b3580d382a.f67811de-3148-4a8f-90be-28638ed6232f" returned: 0 in 0.243s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:40:56 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-a382d221-3480-4537-a04c-f8336782ebbf tempest-ProjectMemberTests-969865867 None] Lock "cinder-quobyte-f67811de-3148-4a8f-90be-28638ed6232f" released by "_delete_snapshot" :: held 1.311s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:40:56 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-a382d221-3480-4537-a04c-f8336782ebbf tempest-ProjectMemberTests-969865867 None] Lock "cinder-quobyte-ccdbc3cb-f248-49cb-981e-17b3580d382a" released by "delete_snapshot" :: held 1.338s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:40:56 devstack cinder-volume[89182]: DEBUG cinder.quota [None req-a382d221-3480-4537-a04c-f8336782ebbf tempest-ProjectMemberTests-969865867 None] Created reservations ['7fe9e515-7b1e-4577-a110-a063bde768d2', '8c0364db-3a0e-4d5a-89f0-bfdfb0ffcf24', 'c0a3042e-6573-4c1e-a80d-74ecd593f018', '21da4c2c-c848-487f-847e-6ac9f2c12fe5'] {{(pid=89182) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 12:40:56 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-a382d221-3480-4537-a04c-f8336782ebbf tempest-ProjectMemberTests-969865867 None] Delete snapshot completed successfully. Jul 31 12:40:56 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-a382d221-3480-4537-a04c-f8336782ebbf tempest-ProjectMemberTests-969865867 None] Lock "cinder-f67811de-3148-4a8f-90be-28638ed6232f-delete_snapshot" released by "delete_snapshot" :: held 1.464s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:40:57 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-f942c369-92e7-4e2a-9a87-c7a7677df3be tempest-ProjectMemberTests-969865867 None] Acquiring lock "cinder-ccdbc3cb-f248-49cb-981e-17b3580d382a-delete_volume" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:40:57 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-f942c369-92e7-4e2a-9a87-c7a7677df3be tempest-ProjectMemberTests-969865867 None] Lock "cinder-ccdbc3cb-f248-49cb-981e-17b3580d382a-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:40:57 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-f942c369-92e7-4e2a-9a87-c7a7677df3be tempest-ProjectMemberTests-969865867 None] Acquiring lock "cinder-quobyte-ccdbc3cb-f248-49cb-981e-17b3580d382a" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:40:57 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-f942c369-92e7-4e2a-9a87-c7a7677df3be tempest-ProjectMemberTests-969865867 None] Lock "cinder-quobyte-ccdbc3cb-f248-49cb-981e-17b3580d382a" acquired by "delete_volume" :: waited 0.016s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:40:57 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[af849fb1-411a-4ca8-b3ad-ee64d1c815ac]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:40:57 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-f942c369-92e7-4e2a-9a87-c7a7677df3be tempest-ProjectMemberTests-969865867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-ccdbc3cb-f248-49cb-981e-17b3580d382a {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:40:57 devstack sudo[116465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-ccdbc3cb-f248-49cb-981e-17b3580d382a Jul 31 12:40:57 devstack sudo[116465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:40:57 devstack sudo[116465]: pam_unix(sudo:session): session closed for user root Jul 31 12:40:57 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-f942c369-92e7-4e2a-9a87-c7a7677df3be tempest-ProjectMemberTests-969865867 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-ccdbc3cb-f248-49cb-981e-17b3580d382a" returned: 0 in 0.349s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:40:57 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-f942c369-92e7-4e2a-9a87-c7a7677df3be tempest-ProjectMemberTests-969865867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-ccdbc3cb-f248-49cb-981e-17b3580d382a {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:40:57 devstack sudo[116471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-ccdbc3cb-f248-49cb-981e-17b3580d382a Jul 31 12:40:57 devstack sudo[116471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:40:57 devstack sudo[116471]: pam_unix(sudo:session): session closed for user root Jul 31 12:40:57 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-f942c369-92e7-4e2a-9a87-c7a7677df3be tempest-ProjectMemberTests-969865867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-ccdbc3cb-f248-49cb-981e-17b3580d382a" returned: 0 in 0.231s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:40:57 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-f942c369-92e7-4e2a-9a87-c7a7677df3be tempest-ProjectMemberTests-969865867 None] Lock "cinder-quobyte-ccdbc3cb-f248-49cb-981e-17b3580d382a" released by "delete_volume" :: held 0.634s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:40:57 devstack cinder-volume[89182]: DEBUG cinder.quota [None req-f942c369-92e7-4e2a-9a87-c7a7677df3be tempest-ProjectMemberTests-969865867 None] Created reservations ['3ddefdbc-5c7b-440c-88d3-2d05f64c5def', 'b765013a-e49c-47cd-b4d4-6f00a3f0ae3d', 'f63fcbab-508f-419d-8dd8-601f90bddba4', '1e42ac79-60e3-4c9c-8e8e-72ad1157f4c9'] {{(pid=89182) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 12:40:57 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-f942c369-92e7-4e2a-9a87-c7a7677df3be tempest-ProjectMemberTests-969865867 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:40:57 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-f942c369-92e7-4e2a-9a87-c7a7677df3be tempest-ProjectMemberTests-969865867 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:40:57 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-f942c369-92e7-4e2a-9a87-c7a7677df3be tempest-ProjectMemberTests-969865867 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:40:57 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-f942c369-92e7-4e2a-9a87-c7a7677df3be tempest-ProjectMemberTests-969865867 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:40:57 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-f942c369-92e7-4e2a-9a87-c7a7677df3be tempest-ProjectMemberTests-969865867 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:40:57 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-f942c369-92e7-4e2a-9a87-c7a7677df3be tempest-ProjectMemberTests-969865867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:40:57 devstack sudo[116474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 Jul 31 12:40:57 devstack sudo[116474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:40:58 devstack sudo[116474]: pam_unix(sudo:session): session closed for user root Jul 31 12:40:58 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-f942c369-92e7-4e2a-9a87-c7a7677df3be tempest-ProjectMemberTests-969865867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2" returned: 0 in 0.238s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:40:58 devstack cinder-volume[89182]: DEBUG cinder.manager [None req-f942c369-92e7-4e2a-9a87-c7a7677df3be tempest-ProjectMemberTests-969865867 None] Notifying Schedulers of capabilities ... {{(pid=89182) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 12:40:58 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-f942c369-92e7-4e2a-9a87-c7a7677df3be tempest-ProjectMemberTests-969865867 None] Deleted volume successfully. Jul 31 12:40:58 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-f942c369-92e7-4e2a-9a87-c7a7677df3be tempest-ProjectMemberTests-969865867 None] Lock "cinder-ccdbc3cb-f248-49cb-981e-17b3580d382a-delete_volume" released by "delete_volume" :: held 1.051s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:41:01 devstack cinder-volume[89182]: DEBUG cinder.volume.flows.manager.create_volume [None req-b27d307c-5a9b-43e3-a2d5-4616cc48ffb1 tempest-ProjectReaderTests-1967638373 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89182) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 12:41:01 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-b27d307c-5a9b-43e3-a2d5-4616cc48ffb1 tempest-ProjectReaderTests-1967638373 None] Flow 'volume_create_manager' (3c1d21c8-d608-4256-89b0-3114c2ada18a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:41:01 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-b27d307c-5a9b-43e3-a2d5-4616cc48ffb1 tempest-ProjectReaderTests-1967638373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (180612dc-444f-4802-ae26-fa789dbc2ec0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:41:01 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-b27d307c-5a9b-43e3-a2d5-4616cc48ffb1 tempest-ProjectReaderTests-1967638373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (180612dc-444f-4802-ae26-fa789dbc2ec0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:41:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1839650638',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a24f751-4d28-4647-9cce-1f4f2d0ef313,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd5661a0bda34bab890473ed45a80ef5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:41:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:41:02Z,use_quota=True,user_id='d5216f552f4e478898bafd6f2643b0e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:41:01 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-b27d307c-5a9b-43e3-a2d5-4616cc48ffb1 tempest-ProjectReaderTests-1967638373 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16de4d98-2c90-4f2f-b46c-10bbafc08777) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:41:01 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-b27d307c-5a9b-43e3-a2d5-4616cc48ffb1 tempest-ProjectReaderTests-1967638373 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16de4d98-2c90-4f2f-b46c-10bbafc08777) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:41:01 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-b27d307c-5a9b-43e3-a2d5-4616cc48ffb1 tempest-ProjectReaderTests-1967638373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b34841e9-7be5-46e8-857c-f6f89a89e3c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:41:01 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-b27d307c-5a9b-43e3-a2d5-4616cc48ffb1 tempest-ProjectReaderTests-1967638373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b34841e9-7be5-46e8-857c-f6f89a89e3c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5a24f751-4d28-4647-9cce-1f4f2d0ef313', 'volume_name': 'volume-5a24f751-4d28-4647-9cce-1f4f2d0ef313', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:41:01 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-b27d307c-5a9b-43e3-a2d5-4616cc48ffb1 tempest-ProjectReaderTests-1967638373 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e115683d-7122-40db-83f9-cd0e8fe157a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:41:01 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-b27d307c-5a9b-43e3-a2d5-4616cc48ffb1 tempest-ProjectReaderTests-1967638373 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e115683d-7122-40db-83f9-cd0e8fe157a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:41:01 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-b27d307c-5a9b-43e3-a2d5-4616cc48ffb1 tempest-ProjectReaderTests-1967638373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc737594-f7cd-46b2-89b0-b28dca413a30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:41:01 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-b27d307c-5a9b-43e3-a2d5-4616cc48ffb1 tempest-ProjectReaderTests-1967638373 None] Volume 5a24f751-4d28-4647-9cce-1f4f2d0ef313: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5a24f751-4d28-4647-9cce-1f4f2d0ef313', 'volume_size': 1} Jul 31 12:41:01 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-b27d307c-5a9b-43e3-a2d5-4616cc48ffb1 tempest-ProjectReaderTests-1967638373 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:41:01 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-b27d307c-5a9b-43e3-a2d5-4616cc48ffb1 tempest-ProjectReaderTests-1967638373 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:41:01 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-b27d307c-5a9b-43e3-a2d5-4616cc48ffb1 tempest-ProjectReaderTests-1967638373 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:41:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1839650638',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a24f751-4d28-4647-9cce-1f4f2d0ef313,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd5661a0bda34bab890473ed45a80ef5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:41:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:41:02Z,use_quota=True,user_id='d5216f552f4e478898bafd6f2643b0e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)}" {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 12:41:01 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-b27d307c-5a9b-43e3-a2d5-4616cc48ffb1 tempest-ProjectReaderTests-1967638373 None] Creating volume 5a24f751-4d28-4647-9cce-1f4f2d0ef313 {{(pid=89182) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 12:41:01 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-b27d307c-5a9b-43e3-a2d5-4616cc48ffb1 tempest-ProjectReaderTests-1967638373 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:41:01 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-b27d307c-5a9b-43e3-a2d5-4616cc48ffb1 tempest-ProjectReaderTests-1967638373 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:41:01 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-b27d307c-5a9b-43e3-a2d5-4616cc48ffb1 tempest-ProjectReaderTests-1967638373 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:41:01 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-b27d307c-5a9b-43e3-a2d5-4616cc48ffb1 tempest-ProjectReaderTests-1967638373 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:41:01 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-b27d307c-5a9b-43e3-a2d5-4616cc48ffb1 tempest-ProjectReaderTests-1967638373 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:41:01 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-b27d307c-5a9b-43e3-a2d5-4616cc48ffb1 tempest-ProjectReaderTests-1967638373 None] Selected osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 as target Quobyte volume. {{(pid=89182) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 12:41:01 devstack cinder-volume[89182]: INFO cinder.volume.drivers.remotefs [None req-b27d307c-5a9b-43e3-a2d5-4616cc48ffb1 tempest-ProjectReaderTests-1967638373 None] casted to osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 Jul 31 12:41:01 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-b27d307c-5a9b-43e3-a2d5-4616cc48ffb1 tempest-ProjectReaderTests-1967638373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-5a24f751-4d28-4647-9cce-1f4f2d0ef313 1073741824 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:41:01 devstack sudo[116478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-5a24f751-4d28-4647-9cce-1f4f2d0ef313 1073741824 Jul 31 12:41:01 devstack sudo[116478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:41:02 devstack sudo[116478]: pam_unix(sudo:session): session closed for user root Jul 31 12:41:02 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-b27d307c-5a9b-43e3-a2d5-4616cc48ffb1 tempest-ProjectReaderTests-1967638373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-5a24f751-4d28-4647-9cce-1f4f2d0ef313 1073741824" returned: 0 in 0.460s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:41:02 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-b27d307c-5a9b-43e3-a2d5-4616cc48ffb1 tempest-ProjectReaderTests-1967638373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-5a24f751-4d28-4647-9cce-1f4f2d0ef313 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:41:02 devstack sudo[116484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-5a24f751-4d28-4647-9cce-1f4f2d0ef313 Jul 31 12:41:02 devstack sudo[116484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:41:02 devstack sudo[116484]: pam_unix(sudo:session): session closed for user root Jul 31 12:41:02 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-b27d307c-5a9b-43e3-a2d5-4616cc48ffb1 tempest-ProjectReaderTests-1967638373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-5a24f751-4d28-4647-9cce-1f4f2d0ef313" returned: 0 in 0.251s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:41:02 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-b27d307c-5a9b-43e3-a2d5-4616cc48ffb1 tempest-ProjectReaderTests-1967638373 None] <== create_volume: return (755ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'} {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 12:41:02 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-b27d307c-5a9b-43e3-a2d5-4616cc48ffb1 tempest-ProjectReaderTests-1967638373 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.758s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:41:02 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-b27d307c-5a9b-43e3-a2d5-4616cc48ffb1 tempest-ProjectReaderTests-1967638373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc737594-f7cd-46b2-89b0-b28dca413a30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5a24f751-4d28-4647-9cce-1f4f2d0ef313', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:41:02 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-b27d307c-5a9b-43e3-a2d5-4616cc48ffb1 tempest-ProjectReaderTests-1967638373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fcff0a97-6ca1-436d-b0d9-0eb754446d06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:41:02 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-b27d307c-5a9b-43e3-a2d5-4616cc48ffb1 tempest-ProjectReaderTests-1967638373 None] Volume volume-5a24f751-4d28-4647-9cce-1f4f2d0ef313 (5a24f751-4d28-4647-9cce-1f4f2d0ef313): created successfully Jul 31 12:41:02 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-b27d307c-5a9b-43e3-a2d5-4616cc48ffb1 tempest-ProjectReaderTests-1967638373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fcff0a97-6ca1-436d-b0d9-0eb754446d06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:41:02 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-b27d307c-5a9b-43e3-a2d5-4616cc48ffb1 tempest-ProjectReaderTests-1967638373 None] Flow 'volume_create_manager' (3c1d21c8-d608-4256-89b0-3114c2ada18a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:41:02 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-b27d307c-5a9b-43e3-a2d5-4616cc48ffb1 tempest-ProjectReaderTests-1967638373 None] Created volume successfully. Jul 31 12:41:02 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-8e39b5f4-030a-45b1-8517-70554add07ce tempest-ProjectReaderTests-1967638373 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:41:02 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-8e39b5f4-030a-45b1-8517-70554add07ce tempest-ProjectReaderTests-1967638373 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:41:02 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-8e39b5f4-030a-45b1-8517-70554add07ce tempest-ProjectReaderTests-1967638373 None] Creating offline snapshot 08670d88-7834-4c86-a2e6-26c6aa6e94ab of volume 5a24f751-4d28-4647-9cce-1f4f2d0ef313 {{(pid=89182) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 31 12:41:02 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[bec29984-1092-4beb-a9a0-7ad1280d48e5]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:41:02 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-8e39b5f4-030a-45b1-8517-70554add07ce tempest-ProjectReaderTests-1967638373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-5a24f751-4d28-4647-9cce-1f4f2d0ef313 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:41:02 devstack sudo[116487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-5a24f751-4d28-4647-9cce-1f4f2d0ef313 Jul 31 12:41:02 devstack sudo[116487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:41:03 devstack sudo[116487]: pam_unix(sudo:session): session closed for user root Jul 31 12:41:03 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-8e39b5f4-030a-45b1-8517-70554add07ce tempest-ProjectReaderTests-1967638373 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-5a24f751-4d28-4647-9cce-1f4f2d0ef313" returned: 0 in 0.351s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:41:03 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-8e39b5f4-030a-45b1-8517-70554add07ce tempest-ProjectReaderTests-1967638373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-5a24f751-4d28-4647-9cce-1f4f2d0ef313,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-5a24f751-4d28-4647-9cce-1f4f2d0ef313.08670d88-7834-4c86-a2e6-26c6aa6e94ab 1G {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:41:03 devstack sudo[116493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-5a24f751-4d28-4647-9cce-1f4f2d0ef313,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-5a24f751-4d28-4647-9cce-1f4f2d0ef313.08670d88-7834-4c86-a2e6-26c6aa6e94ab 1G Jul 31 12:41:03 devstack sudo[116493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:41:03 devstack sudo[116493]: pam_unix(sudo:session): session closed for user root Jul 31 12:41:03 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-8e39b5f4-030a-45b1-8517-70554add07ce tempest-ProjectReaderTests-1967638373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-5a24f751-4d28-4647-9cce-1f4f2d0ef313,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-5a24f751-4d28-4647-9cce-1f4f2d0ef313.08670d88-7834-4c86-a2e6-26c6aa6e94ab 1G" returned: 0 in 0.363s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:41:03 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-8e39b5f4-030a-45b1-8517-70554add07ce tempest-ProjectReaderTests-1967638373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5a24f751-4d28-4647-9cce-1f4f2d0ef313 -F qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-5a24f751-4d28-4647-9cce-1f4f2d0ef313.08670d88-7834-4c86-a2e6-26c6aa6e94ab {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:41:03 devstack sudo[116498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5a24f751-4d28-4647-9cce-1f4f2d0ef313 -F qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-5a24f751-4d28-4647-9cce-1f4f2d0ef313.08670d88-7834-4c86-a2e6-26c6aa6e94ab Jul 31 12:41:03 devstack sudo[116498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:41:03 devstack sudo[116498]: pam_unix(sudo:session): session closed for user root Jul 31 12:41:03 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-8e39b5f4-030a-45b1-8517-70554add07ce tempest-ProjectReaderTests-1967638373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5a24f751-4d28-4647-9cce-1f4f2d0ef313 -F qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-5a24f751-4d28-4647-9cce-1f4f2d0ef313.08670d88-7834-4c86-a2e6-26c6aa6e94ab" returned: 0 in 0.273s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:41:03 devstack cinder-volume[89182]: WARNING cinder.volume.drivers.remotefs [None req-8e39b5f4-030a-45b1-8517-70554add07ce tempest-ProjectReaderTests-1967638373 None] /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-5a24f751-4d28-4647-9cce-1f4f2d0ef313.08670d88-7834-4c86-a2e6-26c6aa6e94ab is being set with open permissions: ugo+rw Jul 31 12:41:03 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-8e39b5f4-030a-45b1-8517-70554add07ce tempest-ProjectReaderTests-1967638373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-5a24f751-4d28-4647-9cce-1f4f2d0ef313.08670d88-7834-4c86-a2e6-26c6aa6e94ab {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:41:03 devstack sudo[116504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-5a24f751-4d28-4647-9cce-1f4f2d0ef313.08670d88-7834-4c86-a2e6-26c6aa6e94ab Jul 31 12:41:03 devstack sudo[116504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:41:04 devstack sudo[116504]: pam_unix(sudo:session): session closed for user root Jul 31 12:41:04 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-8e39b5f4-030a-45b1-8517-70554add07ce tempest-ProjectReaderTests-1967638373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-5a24f751-4d28-4647-9cce-1f4f2d0ef313.08670d88-7834-4c86-a2e6-26c6aa6e94ab" returned: 0 in 0.235s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:41:04 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-8e39b5f4-030a-45b1-8517-70554add07ce tempest-ProjectReaderTests-1967638373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-5a24f751-4d28-4647-9cce-1f4f2d0ef313.info {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:41:04 devstack sudo[116507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-5a24f751-4d28-4647-9cce-1f4f2d0ef313.info Jul 31 12:41:04 devstack sudo[116507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:41:04 devstack sudo[116507]: pam_unix(sudo:session): session closed for user root Jul 31 12:41:04 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-8e39b5f4-030a-45b1-8517-70554add07ce tempest-ProjectReaderTests-1967638373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-5a24f751-4d28-4647-9cce-1f4f2d0ef313.info" returned: 0 in 0.240s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:41:04 devstack cinder-volume[89182]: WARNING cinder.volume.drivers.remotefs [None req-8e39b5f4-030a-45b1-8517-70554add07ce tempest-ProjectReaderTests-1967638373 None] /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-5a24f751-4d28-4647-9cce-1f4f2d0ef313.info is being set with open permissions: ugo+rw Jul 31 12:41:04 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-8e39b5f4-030a-45b1-8517-70554add07ce tempest-ProjectReaderTests-1967638373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-5a24f751-4d28-4647-9cce-1f4f2d0ef313.info {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:41:04 devstack sudo[116510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-5a24f751-4d28-4647-9cce-1f4f2d0ef313.info Jul 31 12:41:04 devstack sudo[116510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:41:04 devstack sudo[116510]: pam_unix(sudo:session): session closed for user root Jul 31 12:41:04 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-8e39b5f4-030a-45b1-8517-70554add07ce tempest-ProjectReaderTests-1967638373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-5a24f751-4d28-4647-9cce-1f4f2d0ef313.info" returned: 0 in 0.233s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:41:04 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-8e39b5f4-030a-45b1-8517-70554add07ce tempest-ProjectReaderTests-1967638373 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.768s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:41:04 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-8e39b5f4-030a-45b1-8517-70554add07ce tempest-ProjectReaderTests-1967638373 None] Create snapshot completed successfully Jul 31 12:41:05 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-9f55f800-7bff-4f48-a4a6-324cdac598ac tempest-ProjectReaderTests-1967638373 None] Acquiring lock "cinder-08670d88-7834-4c86-a2e6-26c6aa6e94ab-delete_snapshot" by "delete_snapshot" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:41:05 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-9f55f800-7bff-4f48-a4a6-324cdac598ac tempest-ProjectReaderTests-1967638373 None] Lock "cinder-08670d88-7834-4c86-a2e6-26c6aa6e94ab-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:41:05 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-9f55f800-7bff-4f48-a4a6-324cdac598ac tempest-ProjectReaderTests-1967638373 None] Acquiring lock "cinder-quobyte-5a24f751-4d28-4647-9cce-1f4f2d0ef313" by "delete_snapshot" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:41:05 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-9f55f800-7bff-4f48-a4a6-324cdac598ac tempest-ProjectReaderTests-1967638373 None] Lock "cinder-quobyte-5a24f751-4d28-4647-9cce-1f4f2d0ef313" acquired by "delete_snapshot" :: waited 0.016s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:41:05 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-9f55f800-7bff-4f48-a4a6-324cdac598ac tempest-ProjectReaderTests-1967638373 None] Acquiring lock "cinder-quobyte-08670d88-7834-4c86-a2e6-26c6aa6e94ab" by "_delete_snapshot" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:41:05 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-9f55f800-7bff-4f48-a4a6-324cdac598ac tempest-ProjectReaderTests-1967638373 None] Lock "cinder-quobyte-08670d88-7834-4c86-a2e6-26c6aa6e94ab" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:41:05 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-9f55f800-7bff-4f48-a4a6-324cdac598ac tempest-ProjectReaderTests-1967638373 None] Deleting offline snapshot 08670d88-7834-4c86-a2e6-26c6aa6e94ab of volume 5a24f751-4d28-4647-9cce-1f4f2d0ef313 {{(pid=89182) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 31 12:41:05 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-9f55f800-7bff-4f48-a4a6-324cdac598ac tempest-ProjectReaderTests-1967638373 None] snapshot_file for this snap is: volume-5a24f751-4d28-4647-9cce-1f4f2d0ef313.08670d88-7834-4c86-a2e6-26c6aa6e94ab {{(pid=89182) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 31 12:41:05 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[788b7337-7af8-4d38-af84-7bd679265835]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:41:05 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-9f55f800-7bff-4f48-a4a6-324cdac598ac tempest-ProjectReaderTests-1967638373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-5a24f751-4d28-4647-9cce-1f4f2d0ef313.08670d88-7834-4c86-a2e6-26c6aa6e94ab {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:41:05 devstack sudo[116513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-5a24f751-4d28-4647-9cce-1f4f2d0ef313.08670d88-7834-4c86-a2e6-26c6aa6e94ab Jul 31 12:41:05 devstack sudo[116513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:41:05 devstack sudo[116513]: pam_unix(sudo:session): session closed for user root Jul 31 12:41:05 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-9f55f800-7bff-4f48-a4a6-324cdac598ac tempest-ProjectReaderTests-1967638373 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-5a24f751-4d28-4647-9cce-1f4f2d0ef313.08670d88-7834-4c86-a2e6-26c6aa6e94ab" returned: 0 in 0.383s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:41:05 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-9f55f800-7bff-4f48-a4a6-324cdac598ac tempest-ProjectReaderTests-1967638373 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5a24f751-4d28-4647-9cce-1f4f2d0ef313(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89182) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 12:41:05 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ee10592-5b90-422f-a2f7-3ac6c98d37b9]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:41:05 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-9f55f800-7bff-4f48-a4a6-324cdac598ac tempest-ProjectReaderTests-1967638373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-5a24f751-4d28-4647-9cce-1f4f2d0ef313 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:41:05 devstack sudo[116518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-5a24f751-4d28-4647-9cce-1f4f2d0ef313 Jul 31 12:41:05 devstack sudo[116518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:41:05 devstack sudo[116518]: pam_unix(sudo:session): session closed for user root Jul 31 12:41:05 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-9f55f800-7bff-4f48-a4a6-324cdac598ac tempest-ProjectReaderTests-1967638373 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-5a24f751-4d28-4647-9cce-1f4f2d0ef313" returned: 0 in 0.380s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:41:05 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-9f55f800-7bff-4f48-a4a6-324cdac598ac tempest-ProjectReaderTests-1967638373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-5a24f751-4d28-4647-9cce-1f4f2d0ef313.08670d88-7834-4c86-a2e6-26c6aa6e94ab {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:41:05 devstack sudo[116525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-5a24f751-4d28-4647-9cce-1f4f2d0ef313.08670d88-7834-4c86-a2e6-26c6aa6e94ab Jul 31 12:41:05 devstack sudo[116525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:41:06 devstack sudo[116525]: pam_unix(sudo:session): session closed for user root Jul 31 12:41:06 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-9f55f800-7bff-4f48-a4a6-324cdac598ac tempest-ProjectReaderTests-1967638373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-5a24f751-4d28-4647-9cce-1f4f2d0ef313.08670d88-7834-4c86-a2e6-26c6aa6e94ab" returned: 0 in 0.350s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:41:06 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-9f55f800-7bff-4f48-a4a6-324cdac598ac tempest-ProjectReaderTests-1967638373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-5a24f751-4d28-4647-9cce-1f4f2d0ef313.08670d88-7834-4c86-a2e6-26c6aa6e94ab {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:41:06 devstack sudo[116531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-5a24f751-4d28-4647-9cce-1f4f2d0ef313.08670d88-7834-4c86-a2e6-26c6aa6e94ab Jul 31 12:41:06 devstack sudo[116531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:41:06 devstack sudo[116531]: pam_unix(sudo:session): session closed for user root Jul 31 12:41:06 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-9f55f800-7bff-4f48-a4a6-324cdac598ac tempest-ProjectReaderTests-1967638373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-5a24f751-4d28-4647-9cce-1f4f2d0ef313.08670d88-7834-4c86-a2e6-26c6aa6e94ab" returned: 0 in 0.257s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:41:06 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-9f55f800-7bff-4f48-a4a6-324cdac598ac tempest-ProjectReaderTests-1967638373 None] Lock "cinder-quobyte-08670d88-7834-4c86-a2e6-26c6aa6e94ab" released by "_delete_snapshot" :: held 1.464s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:41:06 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-9f55f800-7bff-4f48-a4a6-324cdac598ac tempest-ProjectReaderTests-1967638373 None] Lock "cinder-quobyte-5a24f751-4d28-4647-9cce-1f4f2d0ef313" released by "delete_snapshot" :: held 1.485s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:41:06 devstack cinder-volume[89182]: DEBUG cinder.quota [None req-9f55f800-7bff-4f48-a4a6-324cdac598ac tempest-ProjectReaderTests-1967638373 None] Created reservations ['89b5c88d-ea7b-4d51-be05-37e4cf203ee4', 'f740b4e8-5304-40e7-9045-98f87828c595', '358e4823-81a6-4377-a209-7eb20d85f354', '23212aa4-4d91-44c4-a4f0-b8762cee9637'] {{(pid=89182) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 12:41:06 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-9f55f800-7bff-4f48-a4a6-324cdac598ac tempest-ProjectReaderTests-1967638373 None] Delete snapshot completed successfully. Jul 31 12:41:06 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-9f55f800-7bff-4f48-a4a6-324cdac598ac tempest-ProjectReaderTests-1967638373 None] Lock "cinder-08670d88-7834-4c86-a2e6-26c6aa6e94ab-delete_snapshot" released by "delete_snapshot" :: held 1.625s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:41:07 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-9418eea3-c6f1-425a-93f5-98d3296bd034 tempest-ProjectReaderTests-1967638373 None] Acquiring lock "cinder-5a24f751-4d28-4647-9cce-1f4f2d0ef313-delete_volume" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:41:07 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-9418eea3-c6f1-425a-93f5-98d3296bd034 tempest-ProjectReaderTests-1967638373 None] Lock "cinder-5a24f751-4d28-4647-9cce-1f4f2d0ef313-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:41:07 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-9418eea3-c6f1-425a-93f5-98d3296bd034 tempest-ProjectReaderTests-1967638373 None] Acquiring lock "cinder-quobyte-5a24f751-4d28-4647-9cce-1f4f2d0ef313" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:41:07 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-9418eea3-c6f1-425a-93f5-98d3296bd034 tempest-ProjectReaderTests-1967638373 None] Lock "cinder-quobyte-5a24f751-4d28-4647-9cce-1f4f2d0ef313" acquired by "delete_volume" :: waited 0.018s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:41:07 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b4be0f0-38e1-4ffa-9f8c-7d422e81fa58]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:41:07 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-9418eea3-c6f1-425a-93f5-98d3296bd034 tempest-ProjectReaderTests-1967638373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-5a24f751-4d28-4647-9cce-1f4f2d0ef313 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:41:07 devstack sudo[116535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-5a24f751-4d28-4647-9cce-1f4f2d0ef313 Jul 31 12:41:07 devstack sudo[116535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:41:07 devstack sudo[116535]: pam_unix(sudo:session): session closed for user root Jul 31 12:41:07 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-9418eea3-c6f1-425a-93f5-98d3296bd034 tempest-ProjectReaderTests-1967638373 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-5a24f751-4d28-4647-9cce-1f4f2d0ef313" returned: 0 in 0.358s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:41:07 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-9418eea3-c6f1-425a-93f5-98d3296bd034 tempest-ProjectReaderTests-1967638373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-5a24f751-4d28-4647-9cce-1f4f2d0ef313 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:41:07 devstack sudo[116540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-5a24f751-4d28-4647-9cce-1f4f2d0ef313 Jul 31 12:41:07 devstack sudo[116540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:41:07 devstack sudo[116540]: pam_unix(sudo:session): session closed for user root Jul 31 12:41:07 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-9418eea3-c6f1-425a-93f5-98d3296bd034 tempest-ProjectReaderTests-1967638373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-5a24f751-4d28-4647-9cce-1f4f2d0ef313" returned: 0 in 0.260s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:41:07 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-9418eea3-c6f1-425a-93f5-98d3296bd034 tempest-ProjectReaderTests-1967638373 None] Lock "cinder-quobyte-5a24f751-4d28-4647-9cce-1f4f2d0ef313" released by "delete_volume" :: held 0.700s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:41:08 devstack cinder-volume[89182]: DEBUG cinder.quota [None req-9418eea3-c6f1-425a-93f5-98d3296bd034 tempest-ProjectReaderTests-1967638373 None] Created reservations ['54543584-e047-4c6d-80e1-b04e739159f0', '640d8e0f-f490-4efc-966a-fda82452135b', '8b0cb157-d80f-49d9-acc6-bac194224cf3', 'e333c94e-b1b8-45c3-b4f9-33fe54361741'] {{(pid=89182) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 12:41:08 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-9418eea3-c6f1-425a-93f5-98d3296bd034 tempest-ProjectReaderTests-1967638373 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:41:08 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-9418eea3-c6f1-425a-93f5-98d3296bd034 tempest-ProjectReaderTests-1967638373 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:41:08 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-9418eea3-c6f1-425a-93f5-98d3296bd034 tempest-ProjectReaderTests-1967638373 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:41:08 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-9418eea3-c6f1-425a-93f5-98d3296bd034 tempest-ProjectReaderTests-1967638373 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:41:08 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-9418eea3-c6f1-425a-93f5-98d3296bd034 tempest-ProjectReaderTests-1967638373 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:41:08 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-9418eea3-c6f1-425a-93f5-98d3296bd034 tempest-ProjectReaderTests-1967638373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:41:08 devstack sudo[116543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 Jul 31 12:41:08 devstack sudo[116543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:41:08 devstack sudo[116543]: pam_unix(sudo:session): session closed for user root Jul 31 12:41:08 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-9418eea3-c6f1-425a-93f5-98d3296bd034 tempest-ProjectReaderTests-1967638373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2" returned: 0 in 0.262s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:41:08 devstack cinder-volume[89182]: DEBUG cinder.manager [None req-9418eea3-c6f1-425a-93f5-98d3296bd034 tempest-ProjectReaderTests-1967638373 None] Notifying Schedulers of capabilities ... {{(pid=89182) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 12:41:08 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-9418eea3-c6f1-425a-93f5-98d3296bd034 tempest-ProjectReaderTests-1967638373 None] Deleted volume successfully. Jul 31 12:41:08 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-9418eea3-c6f1-425a-93f5-98d3296bd034 tempest-ProjectReaderTests-1967638373 None] Lock "cinder-5a24f751-4d28-4647-9cce-1f4f2d0ef313-delete_volume" released by "delete_volume" :: held 1.177s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:41:08 devstack cinder-volume[89182]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e6dc9b9-4415-467b-924e-f203001755e8 tempest-ProjectReaderTests-1967638373 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89182) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 12:41:08 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-1e6dc9b9-4415-467b-924e-f203001755e8 tempest-ProjectReaderTests-1967638373 None] Flow 'volume_create_manager' (d2248d4b-8d55-422c-85f7-68eb7dccb0b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:41:08 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-1e6dc9b9-4415-467b-924e-f203001755e8 tempest-ProjectReaderTests-1967638373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (596948fc-4f01-4d4d-9994-6b508ac84b98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:41:08 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-1e6dc9b9-4415-467b-924e-f203001755e8 tempest-ProjectReaderTests-1967638373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (596948fc-4f01-4d4d-9994-6b508ac84b98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:41:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-120154810',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8dc34bda-0940-4d43-a6f9-4abc4cabf39e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd5661a0bda34bab890473ed45a80ef5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:41:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:41:09Z,use_quota=True,user_id='d5216f552f4e478898bafd6f2643b0e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:41:08 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-1e6dc9b9-4415-467b-924e-f203001755e8 tempest-ProjectReaderTests-1967638373 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (214a06de-ea05-4df6-94b2-2e185c9fd122) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:41:08 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-1e6dc9b9-4415-467b-924e-f203001755e8 tempest-ProjectReaderTests-1967638373 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (214a06de-ea05-4df6-94b2-2e185c9fd122) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:41:08 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-1e6dc9b9-4415-467b-924e-f203001755e8 tempest-ProjectReaderTests-1967638373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db24f4c2-6179-4823-aa5a-310c343d76d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:41:08 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-1e6dc9b9-4415-467b-924e-f203001755e8 tempest-ProjectReaderTests-1967638373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db24f4c2-6179-4823-aa5a-310c343d76d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8dc34bda-0940-4d43-a6f9-4abc4cabf39e', 'volume_name': 'volume-8dc34bda-0940-4d43-a6f9-4abc4cabf39e', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:41:08 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-1e6dc9b9-4415-467b-924e-f203001755e8 tempest-ProjectReaderTests-1967638373 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da5b9f16-e3fa-4288-8679-549553cf4fca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:41:08 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-1e6dc9b9-4415-467b-924e-f203001755e8 tempest-ProjectReaderTests-1967638373 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da5b9f16-e3fa-4288-8679-549553cf4fca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:41:08 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-1e6dc9b9-4415-467b-924e-f203001755e8 tempest-ProjectReaderTests-1967638373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ebf8a827-031b-41bd-8139-35076cbee382) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:41:08 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-1e6dc9b9-4415-467b-924e-f203001755e8 tempest-ProjectReaderTests-1967638373 None] Volume 8dc34bda-0940-4d43-a6f9-4abc4cabf39e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8dc34bda-0940-4d43-a6f9-4abc4cabf39e', 'volume_size': 1} Jul 31 12:41:08 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-1e6dc9b9-4415-467b-924e-f203001755e8 tempest-ProjectReaderTests-1967638373 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:41:08 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-1e6dc9b9-4415-467b-924e-f203001755e8 tempest-ProjectReaderTests-1967638373 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:41:08 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-1e6dc9b9-4415-467b-924e-f203001755e8 tempest-ProjectReaderTests-1967638373 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:41:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-120154810',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8dc34bda-0940-4d43-a6f9-4abc4cabf39e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd5661a0bda34bab890473ed45a80ef5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:41:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:41:09Z,use_quota=True,user_id='d5216f552f4e478898bafd6f2643b0e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)}" {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 12:41:08 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-1e6dc9b9-4415-467b-924e-f203001755e8 tempest-ProjectReaderTests-1967638373 None] Creating volume 8dc34bda-0940-4d43-a6f9-4abc4cabf39e {{(pid=89182) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 12:41:08 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-1e6dc9b9-4415-467b-924e-f203001755e8 tempest-ProjectReaderTests-1967638373 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:41:08 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-1e6dc9b9-4415-467b-924e-f203001755e8 tempest-ProjectReaderTests-1967638373 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:41:08 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-1e6dc9b9-4415-467b-924e-f203001755e8 tempest-ProjectReaderTests-1967638373 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:41:08 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-1e6dc9b9-4415-467b-924e-f203001755e8 tempest-ProjectReaderTests-1967638373 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:41:08 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-1e6dc9b9-4415-467b-924e-f203001755e8 tempest-ProjectReaderTests-1967638373 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:41:08 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-1e6dc9b9-4415-467b-924e-f203001755e8 tempest-ProjectReaderTests-1967638373 None] Selected osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 as target Quobyte volume. {{(pid=89182) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 12:41:08 devstack cinder-volume[89182]: INFO cinder.volume.drivers.remotefs [None req-1e6dc9b9-4415-467b-924e-f203001755e8 tempest-ProjectReaderTests-1967638373 None] casted to osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 Jul 31 12:41:08 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-1e6dc9b9-4415-467b-924e-f203001755e8 tempest-ProjectReaderTests-1967638373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-8dc34bda-0940-4d43-a6f9-4abc4cabf39e 1073741824 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:41:08 devstack sudo[116546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-8dc34bda-0940-4d43-a6f9-4abc4cabf39e 1073741824 Jul 31 12:41:08 devstack sudo[116546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:41:09 devstack sudo[116546]: pam_unix(sudo:session): session closed for user root Jul 31 12:41:09 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-1e6dc9b9-4415-467b-924e-f203001755e8 tempest-ProjectReaderTests-1967638373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-8dc34bda-0940-4d43-a6f9-4abc4cabf39e 1073741824" returned: 0 in 0.421s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:41:09 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-1e6dc9b9-4415-467b-924e-f203001755e8 tempest-ProjectReaderTests-1967638373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-8dc34bda-0940-4d43-a6f9-4abc4cabf39e {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:41:09 devstack sudo[116551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-8dc34bda-0940-4d43-a6f9-4abc4cabf39e Jul 31 12:41:09 devstack sudo[116551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:41:09 devstack sudo[116551]: pam_unix(sudo:session): session closed for user root Jul 31 12:41:09 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-1e6dc9b9-4415-467b-924e-f203001755e8 tempest-ProjectReaderTests-1967638373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-8dc34bda-0940-4d43-a6f9-4abc4cabf39e" returned: 0 in 0.243s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:41:09 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-1e6dc9b9-4415-467b-924e-f203001755e8 tempest-ProjectReaderTests-1967638373 None] <== create_volume: return (706ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'} {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 12:41:09 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-1e6dc9b9-4415-467b-924e-f203001755e8 tempest-ProjectReaderTests-1967638373 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.708s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:41:09 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-1e6dc9b9-4415-467b-924e-f203001755e8 tempest-ProjectReaderTests-1967638373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ebf8a827-031b-41bd-8139-35076cbee382) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8dc34bda-0940-4d43-a6f9-4abc4cabf39e', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:41:09 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-1e6dc9b9-4415-467b-924e-f203001755e8 tempest-ProjectReaderTests-1967638373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f8a5295-c2b9-49c7-8190-0d8d88bae2a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:41:09 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-1e6dc9b9-4415-467b-924e-f203001755e8 tempest-ProjectReaderTests-1967638373 None] Volume volume-8dc34bda-0940-4d43-a6f9-4abc4cabf39e (8dc34bda-0940-4d43-a6f9-4abc4cabf39e): created successfully Jul 31 12:41:09 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-1e6dc9b9-4415-467b-924e-f203001755e8 tempest-ProjectReaderTests-1967638373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f8a5295-c2b9-49c7-8190-0d8d88bae2a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:41:09 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-1e6dc9b9-4415-467b-924e-f203001755e8 tempest-ProjectReaderTests-1967638373 None] Flow 'volume_create_manager' (d2248d4b-8d55-422c-85f7-68eb7dccb0b2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:41:09 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-1e6dc9b9-4415-467b-924e-f203001755e8 tempest-ProjectReaderTests-1967638373 None] Created volume successfully. Jul 31 12:41:09 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-246c93d1-0d22-486c-9d6e-2a33e0b2b542 tempest-ProjectReaderTests-1967638373 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:41:09 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-246c93d1-0d22-486c-9d6e-2a33e0b2b542 tempest-ProjectReaderTests-1967638373 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:41:09 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-246c93d1-0d22-486c-9d6e-2a33e0b2b542 tempest-ProjectReaderTests-1967638373 None] Creating offline snapshot da8bfc0b-867e-4773-9198-12ed784a201f of volume 8dc34bda-0940-4d43-a6f9-4abc4cabf39e {{(pid=89182) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 31 12:41:10 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[c10e8a35-c6fb-461b-bf59-ea5cd8b3cac1]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:41:10 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-246c93d1-0d22-486c-9d6e-2a33e0b2b542 tempest-ProjectReaderTests-1967638373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-8dc34bda-0940-4d43-a6f9-4abc4cabf39e {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:41:10 devstack sudo[116554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-8dc34bda-0940-4d43-a6f9-4abc4cabf39e Jul 31 12:41:10 devstack sudo[116554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:41:10 devstack sudo[116554]: pam_unix(sudo:session): session closed for user root Jul 31 12:41:10 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-246c93d1-0d22-486c-9d6e-2a33e0b2b542 tempest-ProjectReaderTests-1967638373 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-8dc34bda-0940-4d43-a6f9-4abc4cabf39e" returned: 0 in 0.348s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:41:10 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-246c93d1-0d22-486c-9d6e-2a33e0b2b542 tempest-ProjectReaderTests-1967638373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-8dc34bda-0940-4d43-a6f9-4abc4cabf39e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-8dc34bda-0940-4d43-a6f9-4abc4cabf39e.da8bfc0b-867e-4773-9198-12ed784a201f 1G {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:41:10 devstack sudo[116559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-8dc34bda-0940-4d43-a6f9-4abc4cabf39e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-8dc34bda-0940-4d43-a6f9-4abc4cabf39e.da8bfc0b-867e-4773-9198-12ed784a201f 1G Jul 31 12:41:10 devstack sudo[116559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:41:10 devstack sudo[116559]: pam_unix(sudo:session): session closed for user root Jul 31 12:41:10 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-246c93d1-0d22-486c-9d6e-2a33e0b2b542 tempest-ProjectReaderTests-1967638373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-8dc34bda-0940-4d43-a6f9-4abc4cabf39e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-8dc34bda-0940-4d43-a6f9-4abc4cabf39e.da8bfc0b-867e-4773-9198-12ed784a201f 1G" returned: 0 in 0.376s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:41:10 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-246c93d1-0d22-486c-9d6e-2a33e0b2b542 tempest-ProjectReaderTests-1967638373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8dc34bda-0940-4d43-a6f9-4abc4cabf39e -F qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-8dc34bda-0940-4d43-a6f9-4abc4cabf39e.da8bfc0b-867e-4773-9198-12ed784a201f {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:41:10 devstack sudo[116565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8dc34bda-0940-4d43-a6f9-4abc4cabf39e -F qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-8dc34bda-0940-4d43-a6f9-4abc4cabf39e.da8bfc0b-867e-4773-9198-12ed784a201f Jul 31 12:41:10 devstack sudo[116565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:41:11 devstack sudo[116565]: pam_unix(sudo:session): session closed for user root Jul 31 12:41:11 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-246c93d1-0d22-486c-9d6e-2a33e0b2b542 tempest-ProjectReaderTests-1967638373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8dc34bda-0940-4d43-a6f9-4abc4cabf39e -F qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-8dc34bda-0940-4d43-a6f9-4abc4cabf39e.da8bfc0b-867e-4773-9198-12ed784a201f" returned: 0 in 0.281s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:41:11 devstack cinder-volume[89182]: WARNING cinder.volume.drivers.remotefs [None req-246c93d1-0d22-486c-9d6e-2a33e0b2b542 tempest-ProjectReaderTests-1967638373 None] /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-8dc34bda-0940-4d43-a6f9-4abc4cabf39e.da8bfc0b-867e-4773-9198-12ed784a201f is being set with open permissions: ugo+rw Jul 31 12:41:11 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-246c93d1-0d22-486c-9d6e-2a33e0b2b542 tempest-ProjectReaderTests-1967638373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-8dc34bda-0940-4d43-a6f9-4abc4cabf39e.da8bfc0b-867e-4773-9198-12ed784a201f {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:41:11 devstack sudo[116571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-8dc34bda-0940-4d43-a6f9-4abc4cabf39e.da8bfc0b-867e-4773-9198-12ed784a201f Jul 31 12:41:11 devstack sudo[116571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:41:11 devstack sudo[116571]: pam_unix(sudo:session): session closed for user root Jul 31 12:41:11 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-246c93d1-0d22-486c-9d6e-2a33e0b2b542 tempest-ProjectReaderTests-1967638373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-8dc34bda-0940-4d43-a6f9-4abc4cabf39e.da8bfc0b-867e-4773-9198-12ed784a201f" returned: 0 in 0.241s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:41:11 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-246c93d1-0d22-486c-9d6e-2a33e0b2b542 tempest-ProjectReaderTests-1967638373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-8dc34bda-0940-4d43-a6f9-4abc4cabf39e.info {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:41:11 devstack sudo[116574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-8dc34bda-0940-4d43-a6f9-4abc4cabf39e.info Jul 31 12:41:11 devstack sudo[116574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:41:11 devstack sudo[116574]: pam_unix(sudo:session): session closed for user root Jul 31 12:41:11 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-246c93d1-0d22-486c-9d6e-2a33e0b2b542 tempest-ProjectReaderTests-1967638373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-8dc34bda-0940-4d43-a6f9-4abc4cabf39e.info" returned: 0 in 0.241s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:41:11 devstack cinder-volume[89182]: WARNING cinder.volume.drivers.remotefs [None req-246c93d1-0d22-486c-9d6e-2a33e0b2b542 tempest-ProjectReaderTests-1967638373 None] /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-8dc34bda-0940-4d43-a6f9-4abc4cabf39e.info is being set with open permissions: ugo+rw Jul 31 12:41:11 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-246c93d1-0d22-486c-9d6e-2a33e0b2b542 tempest-ProjectReaderTests-1967638373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-8dc34bda-0940-4d43-a6f9-4abc4cabf39e.info {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:41:11 devstack sudo[116577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-8dc34bda-0940-4d43-a6f9-4abc4cabf39e.info Jul 31 12:41:11 devstack sudo[116577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:41:11 devstack sudo[116577]: pam_unix(sudo:session): session closed for user root Jul 31 12:41:11 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-246c93d1-0d22-486c-9d6e-2a33e0b2b542 tempest-ProjectReaderTests-1967638373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-8dc34bda-0940-4d43-a6f9-4abc4cabf39e.info" returned: 0 in 0.240s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:41:11 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-246c93d1-0d22-486c-9d6e-2a33e0b2b542 tempest-ProjectReaderTests-1967638373 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.805s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:41:11 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-246c93d1-0d22-486c-9d6e-2a33e0b2b542 tempest-ProjectReaderTests-1967638373 None] Create snapshot completed successfully Jul 31 12:41:12 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-3033cd94-0946-4b14-8cc1-92fe64558873 tempest-ProjectReaderTests-1967638373 None] Acquiring lock "cinder-da8bfc0b-867e-4773-9198-12ed784a201f-delete_snapshot" by "delete_snapshot" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:41:12 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-3033cd94-0946-4b14-8cc1-92fe64558873 tempest-ProjectReaderTests-1967638373 None] Lock "cinder-da8bfc0b-867e-4773-9198-12ed784a201f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:41:12 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-3033cd94-0946-4b14-8cc1-92fe64558873 tempest-ProjectReaderTests-1967638373 None] Acquiring lock "cinder-quobyte-8dc34bda-0940-4d43-a6f9-4abc4cabf39e" by "delete_snapshot" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:41:12 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-3033cd94-0946-4b14-8cc1-92fe64558873 tempest-ProjectReaderTests-1967638373 None] Lock "cinder-quobyte-8dc34bda-0940-4d43-a6f9-4abc4cabf39e" acquired by "delete_snapshot" :: waited 0.013s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:41:12 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-3033cd94-0946-4b14-8cc1-92fe64558873 tempest-ProjectReaderTests-1967638373 None] Acquiring lock "cinder-quobyte-da8bfc0b-867e-4773-9198-12ed784a201f" by "_delete_snapshot" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:41:12 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-3033cd94-0946-4b14-8cc1-92fe64558873 tempest-ProjectReaderTests-1967638373 None] Lock "cinder-quobyte-da8bfc0b-867e-4773-9198-12ed784a201f" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:41:12 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-3033cd94-0946-4b14-8cc1-92fe64558873 tempest-ProjectReaderTests-1967638373 None] Deleting offline snapshot da8bfc0b-867e-4773-9198-12ed784a201f of volume 8dc34bda-0940-4d43-a6f9-4abc4cabf39e {{(pid=89182) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 31 12:41:12 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-3033cd94-0946-4b14-8cc1-92fe64558873 tempest-ProjectReaderTests-1967638373 None] snapshot_file for this snap is: volume-8dc34bda-0940-4d43-a6f9-4abc4cabf39e.da8bfc0b-867e-4773-9198-12ed784a201f {{(pid=89182) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 31 12:41:12 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[8125f88d-d16c-4d77-bf86-c22ef3bed131]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:41:12 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-3033cd94-0946-4b14-8cc1-92fe64558873 tempest-ProjectReaderTests-1967638373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-8dc34bda-0940-4d43-a6f9-4abc4cabf39e.da8bfc0b-867e-4773-9198-12ed784a201f {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:41:12 devstack sudo[116580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-8dc34bda-0940-4d43-a6f9-4abc4cabf39e.da8bfc0b-867e-4773-9198-12ed784a201f Jul 31 12:41:12 devstack sudo[116580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:41:12 devstack sudo[116580]: pam_unix(sudo:session): session closed for user root Jul 31 12:41:12 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-3033cd94-0946-4b14-8cc1-92fe64558873 tempest-ProjectReaderTests-1967638373 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-8dc34bda-0940-4d43-a6f9-4abc4cabf39e.da8bfc0b-867e-4773-9198-12ed784a201f" returned: 0 in 0.363s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:41:12 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-3033cd94-0946-4b14-8cc1-92fe64558873 tempest-ProjectReaderTests-1967638373 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8dc34bda-0940-4d43-a6f9-4abc4cabf39e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89182) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 12:41:12 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[27fb447a-80af-4912-a6a3-70242b687789]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:41:12 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-3033cd94-0946-4b14-8cc1-92fe64558873 tempest-ProjectReaderTests-1967638373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-8dc34bda-0940-4d43-a6f9-4abc4cabf39e {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:41:12 devstack sudo[116585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-8dc34bda-0940-4d43-a6f9-4abc4cabf39e Jul 31 12:41:12 devstack sudo[116585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:41:12 devstack sudo[116585]: pam_unix(sudo:session): session closed for user root Jul 31 12:41:12 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-3033cd94-0946-4b14-8cc1-92fe64558873 tempest-ProjectReaderTests-1967638373 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-8dc34bda-0940-4d43-a6f9-4abc4cabf39e" returned: 0 in 0.363s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:41:12 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-3033cd94-0946-4b14-8cc1-92fe64558873 tempest-ProjectReaderTests-1967638373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-8dc34bda-0940-4d43-a6f9-4abc4cabf39e.da8bfc0b-867e-4773-9198-12ed784a201f {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:41:12 devstack sudo[116590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-8dc34bda-0940-4d43-a6f9-4abc4cabf39e.da8bfc0b-867e-4773-9198-12ed784a201f Jul 31 12:41:12 devstack sudo[116590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:41:13 devstack sudo[116590]: pam_unix(sudo:session): session closed for user root Jul 31 12:41:13 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-3033cd94-0946-4b14-8cc1-92fe64558873 tempest-ProjectReaderTests-1967638373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-8dc34bda-0940-4d43-a6f9-4abc4cabf39e.da8bfc0b-867e-4773-9198-12ed784a201f" returned: 0 in 0.333s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:41:13 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-3033cd94-0946-4b14-8cc1-92fe64558873 tempest-ProjectReaderTests-1967638373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-8dc34bda-0940-4d43-a6f9-4abc4cabf39e.da8bfc0b-867e-4773-9198-12ed784a201f {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:41:13 devstack sudo[116595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-8dc34bda-0940-4d43-a6f9-4abc4cabf39e.da8bfc0b-867e-4773-9198-12ed784a201f Jul 31 12:41:13 devstack sudo[116595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:41:13 devstack sudo[116595]: pam_unix(sudo:session): session closed for user root Jul 31 12:41:13 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-3033cd94-0946-4b14-8cc1-92fe64558873 tempest-ProjectReaderTests-1967638373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-8dc34bda-0940-4d43-a6f9-4abc4cabf39e.da8bfc0b-867e-4773-9198-12ed784a201f" returned: 0 in 0.243s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:41:13 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-3033cd94-0946-4b14-8cc1-92fe64558873 tempest-ProjectReaderTests-1967638373 None] Lock "cinder-quobyte-da8bfc0b-867e-4773-9198-12ed784a201f" released by "_delete_snapshot" :: held 1.396s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:41:13 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-3033cd94-0946-4b14-8cc1-92fe64558873 tempest-ProjectReaderTests-1967638373 None] Lock "cinder-quobyte-8dc34bda-0940-4d43-a6f9-4abc4cabf39e" released by "delete_snapshot" :: held 1.418s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:41:13 devstack cinder-volume[89182]: DEBUG cinder.quota [None req-3033cd94-0946-4b14-8cc1-92fe64558873 tempest-ProjectReaderTests-1967638373 None] Created reservations ['15b60aeb-37a4-4895-8a62-7d14eec0aeb1', 'e1d19072-0b29-4317-bafd-1ff35131e81b', 'fe2a0f85-d23d-4d14-aa4a-6519d0bb6cf0', '559cf42c-f61a-4e16-98f3-50a8df086fd1'] {{(pid=89182) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 12:41:13 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-3033cd94-0946-4b14-8cc1-92fe64558873 tempest-ProjectReaderTests-1967638373 None] Delete snapshot completed successfully. Jul 31 12:41:13 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-3033cd94-0946-4b14-8cc1-92fe64558873 tempest-ProjectReaderTests-1967638373 None] Lock "cinder-da8bfc0b-867e-4773-9198-12ed784a201f-delete_snapshot" released by "delete_snapshot" :: held 1.542s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:41:14 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-d0eba5f1-e075-4bdc-8141-95c746aab186 tempest-ProjectReaderTests-1967638373 None] Acquiring lock "cinder-8dc34bda-0940-4d43-a6f9-4abc4cabf39e-delete_volume" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:41:14 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-d0eba5f1-e075-4bdc-8141-95c746aab186 tempest-ProjectReaderTests-1967638373 None] Lock "cinder-8dc34bda-0940-4d43-a6f9-4abc4cabf39e-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:41:14 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-d0eba5f1-e075-4bdc-8141-95c746aab186 tempest-ProjectReaderTests-1967638373 None] Acquiring lock "cinder-quobyte-8dc34bda-0940-4d43-a6f9-4abc4cabf39e" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:41:14 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-d0eba5f1-e075-4bdc-8141-95c746aab186 tempest-ProjectReaderTests-1967638373 None] Lock "cinder-quobyte-8dc34bda-0940-4d43-a6f9-4abc4cabf39e" acquired by "delete_volume" :: waited 0.017s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:41:14 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[32a4d71e-1743-4c1b-bcfb-6db6215be60e]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:41:14 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-d0eba5f1-e075-4bdc-8141-95c746aab186 tempest-ProjectReaderTests-1967638373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-8dc34bda-0940-4d43-a6f9-4abc4cabf39e {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:41:14 devstack sudo[116598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-8dc34bda-0940-4d43-a6f9-4abc4cabf39e Jul 31 12:41:14 devstack sudo[116598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:41:14 devstack sudo[116598]: pam_unix(sudo:session): session closed for user root Jul 31 12:41:14 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-d0eba5f1-e075-4bdc-8141-95c746aab186 tempest-ProjectReaderTests-1967638373 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-8dc34bda-0940-4d43-a6f9-4abc4cabf39e" returned: 0 in 0.347s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:41:14 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-d0eba5f1-e075-4bdc-8141-95c746aab186 tempest-ProjectReaderTests-1967638373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-8dc34bda-0940-4d43-a6f9-4abc4cabf39e {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:41:14 devstack sudo[116603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-8dc34bda-0940-4d43-a6f9-4abc4cabf39e Jul 31 12:41:14 devstack sudo[116603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:41:14 devstack sudo[116603]: pam_unix(sudo:session): session closed for user root Jul 31 12:41:14 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-d0eba5f1-e075-4bdc-8141-95c746aab186 tempest-ProjectReaderTests-1967638373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-8dc34bda-0940-4d43-a6f9-4abc4cabf39e" returned: 0 in 0.259s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:41:14 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-d0eba5f1-e075-4bdc-8141-95c746aab186 tempest-ProjectReaderTests-1967638373 None] Lock "cinder-quobyte-8dc34bda-0940-4d43-a6f9-4abc4cabf39e" released by "delete_volume" :: held 0.665s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:41:15 devstack cinder-volume[89182]: DEBUG cinder.quota [None req-d0eba5f1-e075-4bdc-8141-95c746aab186 tempest-ProjectReaderTests-1967638373 None] Created reservations ['4c8617c4-df1b-4dee-8465-f3215daf52e4', 'e7e3bb8b-57dd-4158-a518-c2e647d7b1cd', '9755bfc9-8e04-4e78-8f26-8d12b489de1d', '36cb8fed-3309-4d57-95b2-c4d1cae18509'] {{(pid=89182) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 12:41:15 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-d0eba5f1-e075-4bdc-8141-95c746aab186 tempest-ProjectReaderTests-1967638373 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:41:15 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-d0eba5f1-e075-4bdc-8141-95c746aab186 tempest-ProjectReaderTests-1967638373 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:41:15 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-d0eba5f1-e075-4bdc-8141-95c746aab186 tempest-ProjectReaderTests-1967638373 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:41:15 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-d0eba5f1-e075-4bdc-8141-95c746aab186 tempest-ProjectReaderTests-1967638373 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:41:15 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-d0eba5f1-e075-4bdc-8141-95c746aab186 tempest-ProjectReaderTests-1967638373 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:41:15 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-d0eba5f1-e075-4bdc-8141-95c746aab186 tempest-ProjectReaderTests-1967638373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:41:15 devstack sudo[116606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 Jul 31 12:41:15 devstack sudo[116606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:41:15 devstack sudo[116606]: pam_unix(sudo:session): session closed for user root Jul 31 12:41:15 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-d0eba5f1-e075-4bdc-8141-95c746aab186 tempest-ProjectReaderTests-1967638373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2" returned: 0 in 0.252s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:41:15 devstack cinder-volume[89182]: DEBUG cinder.manager [None req-d0eba5f1-e075-4bdc-8141-95c746aab186 tempest-ProjectReaderTests-1967638373 None] Notifying Schedulers of capabilities ... {{(pid=89182) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 12:41:15 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-d0eba5f1-e075-4bdc-8141-95c746aab186 tempest-ProjectReaderTests-1967638373 None] Deleted volume successfully. Jul 31 12:41:15 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-d0eba5f1-e075-4bdc-8141-95c746aab186 tempest-ProjectReaderTests-1967638373 None] Lock "cinder-8dc34bda-0940-4d43-a6f9-4abc4cabf39e-delete_volume" released by "delete_volume" :: held 1.111s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:41:15 devstack cinder-volume[89182]: DEBUG cinder.volume.flows.manager.create_volume [None req-f6d9bdfa-4404-4902-99e3-69ec60319ba5 tempest-ProjectReaderTests-1967638373 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89182) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 12:41:15 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-f6d9bdfa-4404-4902-99e3-69ec60319ba5 tempest-ProjectReaderTests-1967638373 None] Flow 'volume_create_manager' (c2fe1dc9-e399-49c8-ac71-7729085b4231) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:41:15 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-f6d9bdfa-4404-4902-99e3-69ec60319ba5 tempest-ProjectReaderTests-1967638373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7849c4de-a2d6-4abb-b699-5368ae9b46b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:41:15 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-f6d9bdfa-4404-4902-99e3-69ec60319ba5 tempest-ProjectReaderTests-1967638373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7849c4de-a2d6-4abb-b699-5368ae9b46b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:41:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1937325094',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4023bcdd-bc73-4b9f-abb0-93650dd11324,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd5661a0bda34bab890473ed45a80ef5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:41:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:41:16Z,use_quota=True,user_id='d5216f552f4e478898bafd6f2643b0e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:41:15 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-f6d9bdfa-4404-4902-99e3-69ec60319ba5 tempest-ProjectReaderTests-1967638373 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2294c0ff-abe9-4afd-b81e-616e7d2db6aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:41:15 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-f6d9bdfa-4404-4902-99e3-69ec60319ba5 tempest-ProjectReaderTests-1967638373 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2294c0ff-abe9-4afd-b81e-616e7d2db6aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:41:15 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-f6d9bdfa-4404-4902-99e3-69ec60319ba5 tempest-ProjectReaderTests-1967638373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6bc907b4-fcb4-4277-9637-a9712b5e48a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:41:15 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-f6d9bdfa-4404-4902-99e3-69ec60319ba5 tempest-ProjectReaderTests-1967638373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6bc907b4-fcb4-4277-9637-a9712b5e48a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4023bcdd-bc73-4b9f-abb0-93650dd11324', 'volume_name': 'volume-4023bcdd-bc73-4b9f-abb0-93650dd11324', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:41:15 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-f6d9bdfa-4404-4902-99e3-69ec60319ba5 tempest-ProjectReaderTests-1967638373 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80ffb2e3-6cb3-4bf7-90f5-cb155cb3c4c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:41:15 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-f6d9bdfa-4404-4902-99e3-69ec60319ba5 tempest-ProjectReaderTests-1967638373 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80ffb2e3-6cb3-4bf7-90f5-cb155cb3c4c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:41:15 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-f6d9bdfa-4404-4902-99e3-69ec60319ba5 tempest-ProjectReaderTests-1967638373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67cc3ec2-ca94-4267-b99f-0e5c556f7951) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:41:15 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-f6d9bdfa-4404-4902-99e3-69ec60319ba5 tempest-ProjectReaderTests-1967638373 None] Volume 4023bcdd-bc73-4b9f-abb0-93650dd11324: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4023bcdd-bc73-4b9f-abb0-93650dd11324', 'volume_size': 1} Jul 31 12:41:15 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-f6d9bdfa-4404-4902-99e3-69ec60319ba5 tempest-ProjectReaderTests-1967638373 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:41:15 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-f6d9bdfa-4404-4902-99e3-69ec60319ba5 tempest-ProjectReaderTests-1967638373 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:41:15 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-f6d9bdfa-4404-4902-99e3-69ec60319ba5 tempest-ProjectReaderTests-1967638373 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:41:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1937325094',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4023bcdd-bc73-4b9f-abb0-93650dd11324,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd5661a0bda34bab890473ed45a80ef5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:41:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:41:16Z,use_quota=True,user_id='d5216f552f4e478898bafd6f2643b0e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)}" {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 12:41:15 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-f6d9bdfa-4404-4902-99e3-69ec60319ba5 tempest-ProjectReaderTests-1967638373 None] Creating volume 4023bcdd-bc73-4b9f-abb0-93650dd11324 {{(pid=89182) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 12:41:15 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-f6d9bdfa-4404-4902-99e3-69ec60319ba5 tempest-ProjectReaderTests-1967638373 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:41:15 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-f6d9bdfa-4404-4902-99e3-69ec60319ba5 tempest-ProjectReaderTests-1967638373 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:41:15 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-f6d9bdfa-4404-4902-99e3-69ec60319ba5 tempest-ProjectReaderTests-1967638373 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:41:15 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-f6d9bdfa-4404-4902-99e3-69ec60319ba5 tempest-ProjectReaderTests-1967638373 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:41:15 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-f6d9bdfa-4404-4902-99e3-69ec60319ba5 tempest-ProjectReaderTests-1967638373 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:41:15 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-f6d9bdfa-4404-4902-99e3-69ec60319ba5 tempest-ProjectReaderTests-1967638373 None] Selected osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 as target Quobyte volume. {{(pid=89182) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 12:41:15 devstack cinder-volume[89182]: INFO cinder.volume.drivers.remotefs [None req-f6d9bdfa-4404-4902-99e3-69ec60319ba5 tempest-ProjectReaderTests-1967638373 None] casted to osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 Jul 31 12:41:15 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-f6d9bdfa-4404-4902-99e3-69ec60319ba5 tempest-ProjectReaderTests-1967638373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-4023bcdd-bc73-4b9f-abb0-93650dd11324 1073741824 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:41:15 devstack sudo[116609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-4023bcdd-bc73-4b9f-abb0-93650dd11324 1073741824 Jul 31 12:41:15 devstack sudo[116609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:41:16 devstack sudo[116609]: pam_unix(sudo:session): session closed for user root Jul 31 12:41:16 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-f6d9bdfa-4404-4902-99e3-69ec60319ba5 tempest-ProjectReaderTests-1967638373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-4023bcdd-bc73-4b9f-abb0-93650dd11324 1073741824" returned: 0 in 0.411s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:41:16 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-f6d9bdfa-4404-4902-99e3-69ec60319ba5 tempest-ProjectReaderTests-1967638373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-4023bcdd-bc73-4b9f-abb0-93650dd11324 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:41:16 devstack sudo[116615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-4023bcdd-bc73-4b9f-abb0-93650dd11324 Jul 31 12:41:16 devstack sudo[116615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:41:16 devstack sudo[116615]: pam_unix(sudo:session): session closed for user root Jul 31 12:41:16 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-f6d9bdfa-4404-4902-99e3-69ec60319ba5 tempest-ProjectReaderTests-1967638373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-4023bcdd-bc73-4b9f-abb0-93650dd11324" returned: 0 in 0.246s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:41:16 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-f6d9bdfa-4404-4902-99e3-69ec60319ba5 tempest-ProjectReaderTests-1967638373 None] <== create_volume: return (702ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'} {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 12:41:16 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-f6d9bdfa-4404-4902-99e3-69ec60319ba5 tempest-ProjectReaderTests-1967638373 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.704s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:41:16 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-f6d9bdfa-4404-4902-99e3-69ec60319ba5 tempest-ProjectReaderTests-1967638373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67cc3ec2-ca94-4267-b99f-0e5c556f7951) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4023bcdd-bc73-4b9f-abb0-93650dd11324', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:41:16 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-f6d9bdfa-4404-4902-99e3-69ec60319ba5 tempest-ProjectReaderTests-1967638373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68e5a98c-7cb2-42dc-838d-5d555e8820b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:41:16 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-f6d9bdfa-4404-4902-99e3-69ec60319ba5 tempest-ProjectReaderTests-1967638373 None] Volume volume-4023bcdd-bc73-4b9f-abb0-93650dd11324 (4023bcdd-bc73-4b9f-abb0-93650dd11324): created successfully Jul 31 12:41:16 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-f6d9bdfa-4404-4902-99e3-69ec60319ba5 tempest-ProjectReaderTests-1967638373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68e5a98c-7cb2-42dc-838d-5d555e8820b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:41:16 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-f6d9bdfa-4404-4902-99e3-69ec60319ba5 tempest-ProjectReaderTests-1967638373 None] Flow 'volume_create_manager' (c2fe1dc9-e399-49c8-ac71-7729085b4231) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:41:16 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-f6d9bdfa-4404-4902-99e3-69ec60319ba5 tempest-ProjectReaderTests-1967638373 None] Created volume successfully. Jul 31 12:41:17 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-5f439d17-684f-4abc-97c0-ac874a1bbcbc tempest-ProjectReaderTests-1967638373 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:41:17 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-5f439d17-684f-4abc-97c0-ac874a1bbcbc tempest-ProjectReaderTests-1967638373 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:41:17 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-5f439d17-684f-4abc-97c0-ac874a1bbcbc tempest-ProjectReaderTests-1967638373 None] Creating offline snapshot e40a4626-3e84-4597-ab27-e890d3b080fc of volume 4023bcdd-bc73-4b9f-abb0-93650dd11324 {{(pid=89182) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 31 12:41:17 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4680507-d6c1-4028-ae31-9cecbbdb20a1]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:41:17 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-5f439d17-684f-4abc-97c0-ac874a1bbcbc tempest-ProjectReaderTests-1967638373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-4023bcdd-bc73-4b9f-abb0-93650dd11324 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:41:17 devstack sudo[116618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-4023bcdd-bc73-4b9f-abb0-93650dd11324 Jul 31 12:41:17 devstack sudo[116618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:41:17 devstack sudo[116618]: pam_unix(sudo:session): session closed for user root Jul 31 12:41:17 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-5f439d17-684f-4abc-97c0-ac874a1bbcbc tempest-ProjectReaderTests-1967638373 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-4023bcdd-bc73-4b9f-abb0-93650dd11324" returned: 0 in 0.350s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:41:17 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-5f439d17-684f-4abc-97c0-ac874a1bbcbc tempest-ProjectReaderTests-1967638373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-4023bcdd-bc73-4b9f-abb0-93650dd11324,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-4023bcdd-bc73-4b9f-abb0-93650dd11324.e40a4626-3e84-4597-ab27-e890d3b080fc 1G {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:41:17 devstack sudo[116624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-4023bcdd-bc73-4b9f-abb0-93650dd11324,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-4023bcdd-bc73-4b9f-abb0-93650dd11324.e40a4626-3e84-4597-ab27-e890d3b080fc 1G Jul 31 12:41:17 devstack sudo[116624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:41:17 devstack sudo[116624]: pam_unix(sudo:session): session closed for user root Jul 31 12:41:17 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-5f439d17-684f-4abc-97c0-ac874a1bbcbc tempest-ProjectReaderTests-1967638373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-4023bcdd-bc73-4b9f-abb0-93650dd11324,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-4023bcdd-bc73-4b9f-abb0-93650dd11324.e40a4626-3e84-4597-ab27-e890d3b080fc 1G" returned: 0 in 0.380s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:41:17 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-5f439d17-684f-4abc-97c0-ac874a1bbcbc tempest-ProjectReaderTests-1967638373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4023bcdd-bc73-4b9f-abb0-93650dd11324 -F qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-4023bcdd-bc73-4b9f-abb0-93650dd11324.e40a4626-3e84-4597-ab27-e890d3b080fc {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:41:17 devstack sudo[116630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4023bcdd-bc73-4b9f-abb0-93650dd11324 -F qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-4023bcdd-bc73-4b9f-abb0-93650dd11324.e40a4626-3e84-4597-ab27-e890d3b080fc Jul 31 12:41:17 devstack sudo[116630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:41:18 devstack sudo[116630]: pam_unix(sudo:session): session closed for user root Jul 31 12:41:18 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-5f439d17-684f-4abc-97c0-ac874a1bbcbc tempest-ProjectReaderTests-1967638373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4023bcdd-bc73-4b9f-abb0-93650dd11324 -F qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-4023bcdd-bc73-4b9f-abb0-93650dd11324.e40a4626-3e84-4597-ab27-e890d3b080fc" returned: 0 in 0.322s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:41:18 devstack cinder-volume[89182]: WARNING cinder.volume.drivers.remotefs [None req-5f439d17-684f-4abc-97c0-ac874a1bbcbc tempest-ProjectReaderTests-1967638373 None] /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-4023bcdd-bc73-4b9f-abb0-93650dd11324.e40a4626-3e84-4597-ab27-e890d3b080fc is being set with open permissions: ugo+rw Jul 31 12:41:18 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-5f439d17-684f-4abc-97c0-ac874a1bbcbc tempest-ProjectReaderTests-1967638373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-4023bcdd-bc73-4b9f-abb0-93650dd11324.e40a4626-3e84-4597-ab27-e890d3b080fc {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:41:18 devstack sudo[116635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-4023bcdd-bc73-4b9f-abb0-93650dd11324.e40a4626-3e84-4597-ab27-e890d3b080fc Jul 31 12:41:18 devstack sudo[116635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:41:18 devstack sudo[116635]: pam_unix(sudo:session): session closed for user root Jul 31 12:41:18 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-5f439d17-684f-4abc-97c0-ac874a1bbcbc tempest-ProjectReaderTests-1967638373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-4023bcdd-bc73-4b9f-abb0-93650dd11324.e40a4626-3e84-4597-ab27-e890d3b080fc" returned: 0 in 0.251s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:41:18 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-5f439d17-684f-4abc-97c0-ac874a1bbcbc tempest-ProjectReaderTests-1967638373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-4023bcdd-bc73-4b9f-abb0-93650dd11324.info {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:41:18 devstack sudo[116638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-4023bcdd-bc73-4b9f-abb0-93650dd11324.info Jul 31 12:41:18 devstack sudo[116638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:41:18 devstack sudo[116638]: pam_unix(sudo:session): session closed for user root Jul 31 12:41:18 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-5f439d17-684f-4abc-97c0-ac874a1bbcbc tempest-ProjectReaderTests-1967638373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-4023bcdd-bc73-4b9f-abb0-93650dd11324.info" returned: 0 in 0.248s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:41:18 devstack cinder-volume[89182]: WARNING cinder.volume.drivers.remotefs [None req-5f439d17-684f-4abc-97c0-ac874a1bbcbc tempest-ProjectReaderTests-1967638373 None] /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-4023bcdd-bc73-4b9f-abb0-93650dd11324.info is being set with open permissions: ugo+rw Jul 31 12:41:18 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-5f439d17-684f-4abc-97c0-ac874a1bbcbc tempest-ProjectReaderTests-1967638373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-4023bcdd-bc73-4b9f-abb0-93650dd11324.info {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:41:18 devstack sudo[116641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-4023bcdd-bc73-4b9f-abb0-93650dd11324.info Jul 31 12:41:18 devstack sudo[116641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:41:18 devstack sudo[116641]: pam_unix(sudo:session): session closed for user root Jul 31 12:41:18 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-5f439d17-684f-4abc-97c0-ac874a1bbcbc tempest-ProjectReaderTests-1967638373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-4023bcdd-bc73-4b9f-abb0-93650dd11324.info" returned: 0 in 0.242s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:41:18 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-5f439d17-684f-4abc-97c0-ac874a1bbcbc tempest-ProjectReaderTests-1967638373 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.870s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:41:18 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-5f439d17-684f-4abc-97c0-ac874a1bbcbc tempest-ProjectReaderTests-1967638373 None] Create snapshot completed successfully Jul 31 12:41:19 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-3f305d2a-f02b-4df2-b639-dc626e3af596 tempest-ProjectReaderTests-1967638373 None] Acquiring lock "cinder-e40a4626-3e84-4597-ab27-e890d3b080fc-delete_snapshot" by "delete_snapshot" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:41:19 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-3f305d2a-f02b-4df2-b639-dc626e3af596 tempest-ProjectReaderTests-1967638373 None] Lock "cinder-e40a4626-3e84-4597-ab27-e890d3b080fc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:41:19 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-3f305d2a-f02b-4df2-b639-dc626e3af596 tempest-ProjectReaderTests-1967638373 None] Acquiring lock "cinder-quobyte-4023bcdd-bc73-4b9f-abb0-93650dd11324" by "delete_snapshot" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:41:19 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-3f305d2a-f02b-4df2-b639-dc626e3af596 tempest-ProjectReaderTests-1967638373 None] Lock "cinder-quobyte-4023bcdd-bc73-4b9f-abb0-93650dd11324" acquired by "delete_snapshot" :: waited 0.015s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:41:19 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-3f305d2a-f02b-4df2-b639-dc626e3af596 tempest-ProjectReaderTests-1967638373 None] Acquiring lock "cinder-quobyte-e40a4626-3e84-4597-ab27-e890d3b080fc" by "_delete_snapshot" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:41:19 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-3f305d2a-f02b-4df2-b639-dc626e3af596 tempest-ProjectReaderTests-1967638373 None] Lock "cinder-quobyte-e40a4626-3e84-4597-ab27-e890d3b080fc" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:41:19 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-3f305d2a-f02b-4df2-b639-dc626e3af596 tempest-ProjectReaderTests-1967638373 None] Deleting offline snapshot e40a4626-3e84-4597-ab27-e890d3b080fc of volume 4023bcdd-bc73-4b9f-abb0-93650dd11324 {{(pid=89182) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 31 12:41:19 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-3f305d2a-f02b-4df2-b639-dc626e3af596 tempest-ProjectReaderTests-1967638373 None] snapshot_file for this snap is: volume-4023bcdd-bc73-4b9f-abb0-93650dd11324.e40a4626-3e84-4597-ab27-e890d3b080fc {{(pid=89182) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 31 12:41:19 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ab61c7a-601c-4ea7-9f16-2915281486a0]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:41:19 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-3f305d2a-f02b-4df2-b639-dc626e3af596 tempest-ProjectReaderTests-1967638373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-4023bcdd-bc73-4b9f-abb0-93650dd11324.e40a4626-3e84-4597-ab27-e890d3b080fc {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:41:19 devstack sudo[116644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-4023bcdd-bc73-4b9f-abb0-93650dd11324.e40a4626-3e84-4597-ab27-e890d3b080fc Jul 31 12:41:19 devstack sudo[116644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:41:19 devstack sudo[116644]: pam_unix(sudo:session): session closed for user root Jul 31 12:41:19 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-3f305d2a-f02b-4df2-b639-dc626e3af596 tempest-ProjectReaderTests-1967638373 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-4023bcdd-bc73-4b9f-abb0-93650dd11324.e40a4626-3e84-4597-ab27-e890d3b080fc" returned: 0 in 0.349s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:41:19 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-3f305d2a-f02b-4df2-b639-dc626e3af596 tempest-ProjectReaderTests-1967638373 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4023bcdd-bc73-4b9f-abb0-93650dd11324(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89182) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 12:41:19 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[a06a565f-0bc4-4cb5-bd5d-7d2efed746b1]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:41:19 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-3f305d2a-f02b-4df2-b639-dc626e3af596 tempest-ProjectReaderTests-1967638373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-4023bcdd-bc73-4b9f-abb0-93650dd11324 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:41:19 devstack sudo[116649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-4023bcdd-bc73-4b9f-abb0-93650dd11324 Jul 31 12:41:19 devstack sudo[116649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:41:19 devstack sudo[116649]: pam_unix(sudo:session): session closed for user root Jul 31 12:41:19 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-3f305d2a-f02b-4df2-b639-dc626e3af596 tempest-ProjectReaderTests-1967638373 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-4023bcdd-bc73-4b9f-abb0-93650dd11324" returned: 0 in 0.352s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:41:19 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-3f305d2a-f02b-4df2-b639-dc626e3af596 tempest-ProjectReaderTests-1967638373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-4023bcdd-bc73-4b9f-abb0-93650dd11324.e40a4626-3e84-4597-ab27-e890d3b080fc {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:41:19 devstack sudo[116654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-4023bcdd-bc73-4b9f-abb0-93650dd11324.e40a4626-3e84-4597-ab27-e890d3b080fc Jul 31 12:41:20 devstack sudo[116654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:41:20 devstack sudo[116654]: pam_unix(sudo:session): session closed for user root Jul 31 12:41:20 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-3f305d2a-f02b-4df2-b639-dc626e3af596 tempest-ProjectReaderTests-1967638373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-4023bcdd-bc73-4b9f-abb0-93650dd11324.e40a4626-3e84-4597-ab27-e890d3b080fc" returned: 0 in 0.341s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:41:20 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-3f305d2a-f02b-4df2-b639-dc626e3af596 tempest-ProjectReaderTests-1967638373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-4023bcdd-bc73-4b9f-abb0-93650dd11324.e40a4626-3e84-4597-ab27-e890d3b080fc {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:41:20 devstack sudo[116659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-4023bcdd-bc73-4b9f-abb0-93650dd11324.e40a4626-3e84-4597-ab27-e890d3b080fc Jul 31 12:41:20 devstack sudo[116659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:41:20 devstack sudo[116659]: pam_unix(sudo:session): session closed for user root Jul 31 12:41:20 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-3f305d2a-f02b-4df2-b639-dc626e3af596 tempest-ProjectReaderTests-1967638373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-4023bcdd-bc73-4b9f-abb0-93650dd11324.e40a4626-3e84-4597-ab27-e890d3b080fc" returned: 0 in 0.248s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:41:20 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-3f305d2a-f02b-4df2-b639-dc626e3af596 tempest-ProjectReaderTests-1967638373 None] Lock "cinder-quobyte-e40a4626-3e84-4597-ab27-e890d3b080fc" released by "_delete_snapshot" :: held 1.379s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:41:20 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-3f305d2a-f02b-4df2-b639-dc626e3af596 tempest-ProjectReaderTests-1967638373 None] Lock "cinder-quobyte-4023bcdd-bc73-4b9f-abb0-93650dd11324" released by "delete_snapshot" :: held 1.401s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:41:20 devstack cinder-volume[89182]: DEBUG cinder.quota [None req-3f305d2a-f02b-4df2-b639-dc626e3af596 tempest-ProjectReaderTests-1967638373 None] Created reservations ['99b64ed2-0340-460e-906d-142cbef96708', '348001d4-f8a6-40fd-8614-20ab97ebd2d8', '772f8c35-1274-4eb7-a390-b3518000c32e', 'a95e601a-411e-411f-9f32-2372ba0a87d9'] {{(pid=89182) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 12:41:20 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-3f305d2a-f02b-4df2-b639-dc626e3af596 tempest-ProjectReaderTests-1967638373 None] Delete snapshot completed successfully. Jul 31 12:41:20 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-3f305d2a-f02b-4df2-b639-dc626e3af596 tempest-ProjectReaderTests-1967638373 None] Lock "cinder-e40a4626-3e84-4597-ab27-e890d3b080fc-delete_snapshot" released by "delete_snapshot" :: held 1.534s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:41:21 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-4efed158-4ed7-49d9-801e-979e29d4b0a1 tempest-ProjectReaderTests-1967638373 None] Acquiring lock "cinder-4023bcdd-bc73-4b9f-abb0-93650dd11324-delete_volume" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:41:21 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-4efed158-4ed7-49d9-801e-979e29d4b0a1 tempest-ProjectReaderTests-1967638373 None] Lock "cinder-4023bcdd-bc73-4b9f-abb0-93650dd11324-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:41:21 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-4efed158-4ed7-49d9-801e-979e29d4b0a1 tempest-ProjectReaderTests-1967638373 None] Acquiring lock "cinder-quobyte-4023bcdd-bc73-4b9f-abb0-93650dd11324" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:41:21 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-4efed158-4ed7-49d9-801e-979e29d4b0a1 tempest-ProjectReaderTests-1967638373 None] Lock "cinder-quobyte-4023bcdd-bc73-4b9f-abb0-93650dd11324" acquired by "delete_volume" :: waited 0.016s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:41:21 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cfd719b-a4bc-49ff-a6c2-45097778a34d]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:41:21 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-4efed158-4ed7-49d9-801e-979e29d4b0a1 tempest-ProjectReaderTests-1967638373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-4023bcdd-bc73-4b9f-abb0-93650dd11324 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:41:21 devstack sudo[116662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-4023bcdd-bc73-4b9f-abb0-93650dd11324 Jul 31 12:41:21 devstack sudo[116662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:41:21 devstack sudo[116662]: pam_unix(sudo:session): session closed for user root Jul 31 12:41:21 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-4efed158-4ed7-49d9-801e-979e29d4b0a1 tempest-ProjectReaderTests-1967638373 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-4023bcdd-bc73-4b9f-abb0-93650dd11324" returned: 0 in 0.356s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:41:21 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-4efed158-4ed7-49d9-801e-979e29d4b0a1 tempest-ProjectReaderTests-1967638373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-4023bcdd-bc73-4b9f-abb0-93650dd11324 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:41:21 devstack sudo[116667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-4023bcdd-bc73-4b9f-abb0-93650dd11324 Jul 31 12:41:21 devstack sudo[116667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:41:21 devstack cinder-volume[89182]: DEBUG oslo_service.periodic_task [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89182) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 31 12:41:21 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:41:21 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:41:21 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:41:21 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:41:21 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:41:21 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:41:22 devstack sudo[116669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 Jul 31 12:41:22 devstack sudo[116669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:41:22 devstack sudo[116667]: pam_unix(sudo:session): session closed for user root Jul 31 12:41:22 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-4efed158-4ed7-49d9-801e-979e29d4b0a1 tempest-ProjectReaderTests-1967638373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-4023bcdd-bc73-4b9f-abb0-93650dd11324" returned: 0 in 0.259s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:41:22 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-4efed158-4ed7-49d9-801e-979e29d4b0a1 tempest-ProjectReaderTests-1967638373 None] Lock "cinder-quobyte-4023bcdd-bc73-4b9f-abb0-93650dd11324" released by "delete_volume" :: held 0.672s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:41:22 devstack cinder-volume[89182]: DEBUG dbcounter [-] [89182] Writing DB stats cinder:INSERT=47,cinder:UPDATE=148,cinder:SELECT=113,cinder:DELETE=13 {{(pid=89182) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 12:41:22 devstack cinder-volume[89182]: DEBUG dbcounter [-] [89182] Writing DB stats cinder:SELECT=118,cinder:UPDATE=152,cinder:INSERT=36,cinder:DELETE=11 {{(pid=89182) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 12:41:22 devstack cinder-volume[89182]: DEBUG cinder.quota [None req-4efed158-4ed7-49d9-801e-979e29d4b0a1 tempest-ProjectReaderTests-1967638373 None] Created reservations ['88e6e6c9-93ec-42cb-a114-ef1de8d97e70', '6f9ff5fc-2b39-4bff-8355-976128ecaade', 'add2c9e4-06a4-4914-bef5-9b2bf2f778a3', 'fae61fea-b5e7-46cd-98cb-72953c306236'] {{(pid=89182) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 12:41:22 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-4efed158-4ed7-49d9-801e-979e29d4b0a1 tempest-ProjectReaderTests-1967638373 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:41:22 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-4efed158-4ed7-49d9-801e-979e29d4b0a1 tempest-ProjectReaderTests-1967638373 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:41:22 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-4efed158-4ed7-49d9-801e-979e29d4b0a1 tempest-ProjectReaderTests-1967638373 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:41:22 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-4efed158-4ed7-49d9-801e-979e29d4b0a1 tempest-ProjectReaderTests-1967638373 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:41:22 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-4efed158-4ed7-49d9-801e-979e29d4b0a1 tempest-ProjectReaderTests-1967638373 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:41:22 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-4efed158-4ed7-49d9-801e-979e29d4b0a1 tempest-ProjectReaderTests-1967638373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:41:22 devstack sudo[116672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 Jul 31 12:41:22 devstack sudo[116672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:41:22 devstack sudo[116669]: pam_unix(sudo:session): session closed for user root Jul 31 12:41:22 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2" returned: 0 in 0.278s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:41:22 devstack cinder-volume[89182]: DEBUG cinder.manager [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] Notifying Schedulers of capabilities ... {{(pid=89182) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 12:41:22 devstack cinder-volume[89182]: DEBUG oslo_service.periodic_task [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] Running periodic task VolumeManager._thread_info {{(pid=89182) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 31 12:41:22 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] thread count: 28 {{(pid=89182) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 31 12:41:22 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-9c45656f-86a4-42b0-8942-53a65409b33c None None] thread info: [<_MainThread(MainThread, started 136154603720832)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=89182) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 31 12:41:22 devstack sudo[116672]: pam_unix(sudo:session): session closed for user root Jul 31 12:41:22 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-4efed158-4ed7-49d9-801e-979e29d4b0a1 tempest-ProjectReaderTests-1967638373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2" returned: 0 in 0.276s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:41:22 devstack cinder-volume[89182]: DEBUG cinder.manager [None req-4efed158-4ed7-49d9-801e-979e29d4b0a1 tempest-ProjectReaderTests-1967638373 None] Notifying Schedulers of capabilities ... {{(pid=89182) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 12:41:22 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-4efed158-4ed7-49d9-801e-979e29d4b0a1 tempest-ProjectReaderTests-1967638373 None] Deleted volume successfully. Jul 31 12:41:22 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-4efed158-4ed7-49d9-801e-979e29d4b0a1 tempest-ProjectReaderTests-1967638373 None] Lock "cinder-4023bcdd-bc73-4b9f-abb0-93650dd11324-delete_volume" released by "delete_volume" :: held 1.158s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:41:22 devstack cinder-volume[89182]: DEBUG cinder.volume.flows.manager.create_volume [None req-48b56a5f-bdbb-4db9-bf7b-3db465059b4d tempest-ProjectReaderTests-1967638373 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89182) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 12:41:22 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-48b56a5f-bdbb-4db9-bf7b-3db465059b4d tempest-ProjectReaderTests-1967638373 None] Flow 'volume_create_manager' (460c6eeb-76b4-4767-bf8d-4fa0b09bd9c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:41:22 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-48b56a5f-bdbb-4db9-bf7b-3db465059b4d tempest-ProjectReaderTests-1967638373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59eade4c-ee0c-4294-ba7c-47a6eba86164) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:41:22 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-48b56a5f-bdbb-4db9-bf7b-3db465059b4d tempest-ProjectReaderTests-1967638373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59eade4c-ee0c-4294-ba7c-47a6eba86164) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:41:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-703978452',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=385f2d3f-4c8c-4cfc-a606-d3f3f63dcb65,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd5661a0bda34bab890473ed45a80ef5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:41:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:41:23Z,use_quota=True,user_id='d5216f552f4e478898bafd6f2643b0e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:41:23 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-48b56a5f-bdbb-4db9-bf7b-3db465059b4d tempest-ProjectReaderTests-1967638373 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6cc5bb1-ea81-405d-88cc-ccd76e02fe06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:41:23 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-48b56a5f-bdbb-4db9-bf7b-3db465059b4d tempest-ProjectReaderTests-1967638373 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6cc5bb1-ea81-405d-88cc-ccd76e02fe06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:41:23 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-48b56a5f-bdbb-4db9-bf7b-3db465059b4d tempest-ProjectReaderTests-1967638373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7fdcb730-61c2-4dcd-8372-7cf7e19fb655) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:41:23 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-48b56a5f-bdbb-4db9-bf7b-3db465059b4d tempest-ProjectReaderTests-1967638373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7fdcb730-61c2-4dcd-8372-7cf7e19fb655) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '385f2d3f-4c8c-4cfc-a606-d3f3f63dcb65', 'volume_name': 'volume-385f2d3f-4c8c-4cfc-a606-d3f3f63dcb65', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:41:23 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-48b56a5f-bdbb-4db9-bf7b-3db465059b4d tempest-ProjectReaderTests-1967638373 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (752b5930-3a73-4e87-bf15-e3fed38b6270) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:41:23 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-48b56a5f-bdbb-4db9-bf7b-3db465059b4d tempest-ProjectReaderTests-1967638373 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (752b5930-3a73-4e87-bf15-e3fed38b6270) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:41:23 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-48b56a5f-bdbb-4db9-bf7b-3db465059b4d tempest-ProjectReaderTests-1967638373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb2af460-32b0-42a5-bdda-fd57f3e199d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:41:23 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-48b56a5f-bdbb-4db9-bf7b-3db465059b4d tempest-ProjectReaderTests-1967638373 None] Volume 385f2d3f-4c8c-4cfc-a606-d3f3f63dcb65: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-385f2d3f-4c8c-4cfc-a606-d3f3f63dcb65', 'volume_size': 1} Jul 31 12:41:23 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-48b56a5f-bdbb-4db9-bf7b-3db465059b4d tempest-ProjectReaderTests-1967638373 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:41:23 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-48b56a5f-bdbb-4db9-bf7b-3db465059b4d tempest-ProjectReaderTests-1967638373 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:41:23 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-48b56a5f-bdbb-4db9-bf7b-3db465059b4d tempest-ProjectReaderTests-1967638373 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:41:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-703978452',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=385f2d3f-4c8c-4cfc-a606-d3f3f63dcb65,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd5661a0bda34bab890473ed45a80ef5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:41:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:41:23Z,use_quota=True,user_id='d5216f552f4e478898bafd6f2643b0e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)}" {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 12:41:23 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-48b56a5f-bdbb-4db9-bf7b-3db465059b4d tempest-ProjectReaderTests-1967638373 None] Creating volume 385f2d3f-4c8c-4cfc-a606-d3f3f63dcb65 {{(pid=89182) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 12:41:23 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-48b56a5f-bdbb-4db9-bf7b-3db465059b4d tempest-ProjectReaderTests-1967638373 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:41:23 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-48b56a5f-bdbb-4db9-bf7b-3db465059b4d tempest-ProjectReaderTests-1967638373 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:41:23 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-48b56a5f-bdbb-4db9-bf7b-3db465059b4d tempest-ProjectReaderTests-1967638373 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:41:23 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-48b56a5f-bdbb-4db9-bf7b-3db465059b4d tempest-ProjectReaderTests-1967638373 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:41:23 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-48b56a5f-bdbb-4db9-bf7b-3db465059b4d tempest-ProjectReaderTests-1967638373 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:41:23 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-48b56a5f-bdbb-4db9-bf7b-3db465059b4d tempest-ProjectReaderTests-1967638373 None] Selected osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 as target Quobyte volume. {{(pid=89182) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 12:41:23 devstack cinder-volume[89182]: INFO cinder.volume.drivers.remotefs [None req-48b56a5f-bdbb-4db9-bf7b-3db465059b4d tempest-ProjectReaderTests-1967638373 None] casted to osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 Jul 31 12:41:23 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-48b56a5f-bdbb-4db9-bf7b-3db465059b4d tempest-ProjectReaderTests-1967638373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-385f2d3f-4c8c-4cfc-a606-d3f3f63dcb65 1073741824 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:41:23 devstack sudo[116676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-385f2d3f-4c8c-4cfc-a606-d3f3f63dcb65 1073741824 Jul 31 12:41:23 devstack sudo[116676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:41:23 devstack sudo[116676]: pam_unix(sudo:session): session closed for user root Jul 31 12:41:23 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-48b56a5f-bdbb-4db9-bf7b-3db465059b4d tempest-ProjectReaderTests-1967638373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-385f2d3f-4c8c-4cfc-a606-d3f3f63dcb65 1073741824" returned: 0 in 0.414s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:41:23 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-48b56a5f-bdbb-4db9-bf7b-3db465059b4d tempest-ProjectReaderTests-1967638373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-385f2d3f-4c8c-4cfc-a606-d3f3f63dcb65 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:41:23 devstack sudo[116681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-385f2d3f-4c8c-4cfc-a606-d3f3f63dcb65 Jul 31 12:41:23 devstack sudo[116681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:41:23 devstack sudo[116681]: pam_unix(sudo:session): session closed for user root Jul 31 12:41:23 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-48b56a5f-bdbb-4db9-bf7b-3db465059b4d tempest-ProjectReaderTests-1967638373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-385f2d3f-4c8c-4cfc-a606-d3f3f63dcb65" returned: 0 in 0.250s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:41:23 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-48b56a5f-bdbb-4db9-bf7b-3db465059b4d tempest-ProjectReaderTests-1967638373 None] <== create_volume: return (705ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'} {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 12:41:23 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-48b56a5f-bdbb-4db9-bf7b-3db465059b4d tempest-ProjectReaderTests-1967638373 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.708s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:41:23 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-48b56a5f-bdbb-4db9-bf7b-3db465059b4d tempest-ProjectReaderTests-1967638373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb2af460-32b0-42a5-bdda-fd57f3e199d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-385f2d3f-4c8c-4cfc-a606-d3f3f63dcb65', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:41:23 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-48b56a5f-bdbb-4db9-bf7b-3db465059b4d tempest-ProjectReaderTests-1967638373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d964b44e-70c1-4ec7-b6da-8aabd26748a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:41:23 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-48b56a5f-bdbb-4db9-bf7b-3db465059b4d tempest-ProjectReaderTests-1967638373 None] Volume volume-385f2d3f-4c8c-4cfc-a606-d3f3f63dcb65 (385f2d3f-4c8c-4cfc-a606-d3f3f63dcb65): created successfully Jul 31 12:41:23 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-48b56a5f-bdbb-4db9-bf7b-3db465059b4d tempest-ProjectReaderTests-1967638373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d964b44e-70c1-4ec7-b6da-8aabd26748a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:41:23 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-48b56a5f-bdbb-4db9-bf7b-3db465059b4d tempest-ProjectReaderTests-1967638373 None] Flow 'volume_create_manager' (460c6eeb-76b4-4767-bf8d-4fa0b09bd9c7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:41:23 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-48b56a5f-bdbb-4db9-bf7b-3db465059b4d tempest-ProjectReaderTests-1967638373 None] Created volume successfully. Jul 31 12:41:24 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-08157118-3d77-4be0-846b-934290b56929 tempest-ProjectReaderTests-1967638373 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:41:24 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-08157118-3d77-4be0-846b-934290b56929 tempest-ProjectReaderTests-1967638373 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:41:24 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-08157118-3d77-4be0-846b-934290b56929 tempest-ProjectReaderTests-1967638373 None] Creating offline snapshot c251bc4c-3cce-47d8-98a5-ca8d6ee2908d of volume 385f2d3f-4c8c-4cfc-a606-d3f3f63dcb65 {{(pid=89182) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 31 12:41:24 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[c30cec21-0b1f-4191-a768-544879ddd18d]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:41:24 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-08157118-3d77-4be0-846b-934290b56929 tempest-ProjectReaderTests-1967638373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-385f2d3f-4c8c-4cfc-a606-d3f3f63dcb65 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:41:24 devstack sudo[116684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-385f2d3f-4c8c-4cfc-a606-d3f3f63dcb65 Jul 31 12:41:24 devstack sudo[116684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:41:24 devstack sudo[116684]: pam_unix(sudo:session): session closed for user root Jul 31 12:41:24 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-08157118-3d77-4be0-846b-934290b56929 tempest-ProjectReaderTests-1967638373 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-385f2d3f-4c8c-4cfc-a606-d3f3f63dcb65" returned: 0 in 0.365s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:41:24 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-08157118-3d77-4be0-846b-934290b56929 tempest-ProjectReaderTests-1967638373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-385f2d3f-4c8c-4cfc-a606-d3f3f63dcb65,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-385f2d3f-4c8c-4cfc-a606-d3f3f63dcb65.c251bc4c-3cce-47d8-98a5-ca8d6ee2908d 1G {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:41:24 devstack sudo[116689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-385f2d3f-4c8c-4cfc-a606-d3f3f63dcb65,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-385f2d3f-4c8c-4cfc-a606-d3f3f63dcb65.c251bc4c-3cce-47d8-98a5-ca8d6ee2908d 1G Jul 31 12:41:24 devstack sudo[116689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:41:24 devstack sudo[116689]: pam_unix(sudo:session): session closed for user root Jul 31 12:41:24 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-08157118-3d77-4be0-846b-934290b56929 tempest-ProjectReaderTests-1967638373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-385f2d3f-4c8c-4cfc-a606-d3f3f63dcb65,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-385f2d3f-4c8c-4cfc-a606-d3f3f63dcb65.c251bc4c-3cce-47d8-98a5-ca8d6ee2908d 1G" returned: 0 in 0.402s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:41:24 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-08157118-3d77-4be0-846b-934290b56929 tempest-ProjectReaderTests-1967638373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-385f2d3f-4c8c-4cfc-a606-d3f3f63dcb65 -F qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-385f2d3f-4c8c-4cfc-a606-d3f3f63dcb65.c251bc4c-3cce-47d8-98a5-ca8d6ee2908d {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:41:24 devstack sudo[116694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-385f2d3f-4c8c-4cfc-a606-d3f3f63dcb65 -F qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-385f2d3f-4c8c-4cfc-a606-d3f3f63dcb65.c251bc4c-3cce-47d8-98a5-ca8d6ee2908d Jul 31 12:41:24 devstack sudo[116694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:41:25 devstack sudo[116694]: pam_unix(sudo:session): session closed for user root Jul 31 12:41:25 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-08157118-3d77-4be0-846b-934290b56929 tempest-ProjectReaderTests-1967638373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-385f2d3f-4c8c-4cfc-a606-d3f3f63dcb65 -F qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-385f2d3f-4c8c-4cfc-a606-d3f3f63dcb65.c251bc4c-3cce-47d8-98a5-ca8d6ee2908d" returned: 0 in 0.292s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:41:25 devstack cinder-volume[89182]: WARNING cinder.volume.drivers.remotefs [None req-08157118-3d77-4be0-846b-934290b56929 tempest-ProjectReaderTests-1967638373 None] /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-385f2d3f-4c8c-4cfc-a606-d3f3f63dcb65.c251bc4c-3cce-47d8-98a5-ca8d6ee2908d is being set with open permissions: ugo+rw Jul 31 12:41:25 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-08157118-3d77-4be0-846b-934290b56929 tempest-ProjectReaderTests-1967638373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-385f2d3f-4c8c-4cfc-a606-d3f3f63dcb65.c251bc4c-3cce-47d8-98a5-ca8d6ee2908d {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:41:25 devstack sudo[116699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-385f2d3f-4c8c-4cfc-a606-d3f3f63dcb65.c251bc4c-3cce-47d8-98a5-ca8d6ee2908d Jul 31 12:41:25 devstack sudo[116699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:41:25 devstack sudo[116699]: pam_unix(sudo:session): session closed for user root Jul 31 12:41:25 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-08157118-3d77-4be0-846b-934290b56929 tempest-ProjectReaderTests-1967638373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-385f2d3f-4c8c-4cfc-a606-d3f3f63dcb65.c251bc4c-3cce-47d8-98a5-ca8d6ee2908d" returned: 0 in 0.243s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:41:25 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-08157118-3d77-4be0-846b-934290b56929 tempest-ProjectReaderTests-1967638373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-385f2d3f-4c8c-4cfc-a606-d3f3f63dcb65.info {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:41:25 devstack sudo[116702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-385f2d3f-4c8c-4cfc-a606-d3f3f63dcb65.info Jul 31 12:41:25 devstack sudo[116702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:41:25 devstack sudo[116702]: pam_unix(sudo:session): session closed for user root Jul 31 12:41:25 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-08157118-3d77-4be0-846b-934290b56929 tempest-ProjectReaderTests-1967638373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-385f2d3f-4c8c-4cfc-a606-d3f3f63dcb65.info" returned: 0 in 0.251s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:41:25 devstack cinder-volume[89182]: WARNING cinder.volume.drivers.remotefs [None req-08157118-3d77-4be0-846b-934290b56929 tempest-ProjectReaderTests-1967638373 None] /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-385f2d3f-4c8c-4cfc-a606-d3f3f63dcb65.info is being set with open permissions: ugo+rw Jul 31 12:41:25 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-08157118-3d77-4be0-846b-934290b56929 tempest-ProjectReaderTests-1967638373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-385f2d3f-4c8c-4cfc-a606-d3f3f63dcb65.info {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:41:25 devstack sudo[116705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-385f2d3f-4c8c-4cfc-a606-d3f3f63dcb65.info Jul 31 12:41:25 devstack sudo[116705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:41:25 devstack sudo[116705]: pam_unix(sudo:session): session closed for user root Jul 31 12:41:25 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-08157118-3d77-4be0-846b-934290b56929 tempest-ProjectReaderTests-1967638373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-385f2d3f-4c8c-4cfc-a606-d3f3f63dcb65.info" returned: 0 in 0.237s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:41:25 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-08157118-3d77-4be0-846b-934290b56929 tempest-ProjectReaderTests-1967638373 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.865s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:41:25 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-08157118-3d77-4be0-846b-934290b56929 tempest-ProjectReaderTests-1967638373 None] Create snapshot completed successfully Jul 31 12:41:26 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-78cfc502-4780-4839-9d44-0345490903db tempest-ProjectReaderTests-1967638373 None] Acquiring lock "cinder-c251bc4c-3cce-47d8-98a5-ca8d6ee2908d-delete_snapshot" by "delete_snapshot" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:41:26 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-78cfc502-4780-4839-9d44-0345490903db tempest-ProjectReaderTests-1967638373 None] Lock "cinder-c251bc4c-3cce-47d8-98a5-ca8d6ee2908d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:41:26 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-78cfc502-4780-4839-9d44-0345490903db tempest-ProjectReaderTests-1967638373 None] Acquiring lock "cinder-quobyte-385f2d3f-4c8c-4cfc-a606-d3f3f63dcb65" by "delete_snapshot" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:41:26 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-78cfc502-4780-4839-9d44-0345490903db tempest-ProjectReaderTests-1967638373 None] Lock "cinder-quobyte-385f2d3f-4c8c-4cfc-a606-d3f3f63dcb65" acquired by "delete_snapshot" :: waited 0.020s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:41:26 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-78cfc502-4780-4839-9d44-0345490903db tempest-ProjectReaderTests-1967638373 None] Acquiring lock "cinder-quobyte-c251bc4c-3cce-47d8-98a5-ca8d6ee2908d" by "_delete_snapshot" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:41:26 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-78cfc502-4780-4839-9d44-0345490903db tempest-ProjectReaderTests-1967638373 None] Lock "cinder-quobyte-c251bc4c-3cce-47d8-98a5-ca8d6ee2908d" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:41:26 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-78cfc502-4780-4839-9d44-0345490903db tempest-ProjectReaderTests-1967638373 None] Deleting offline snapshot c251bc4c-3cce-47d8-98a5-ca8d6ee2908d of volume 385f2d3f-4c8c-4cfc-a606-d3f3f63dcb65 {{(pid=89182) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 31 12:41:26 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-78cfc502-4780-4839-9d44-0345490903db tempest-ProjectReaderTests-1967638373 None] snapshot_file for this snap is: volume-385f2d3f-4c8c-4cfc-a606-d3f3f63dcb65.c251bc4c-3cce-47d8-98a5-ca8d6ee2908d {{(pid=89182) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 31 12:41:26 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[c45cc8e2-4982-4544-a785-e5e42abfcc7d]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:41:26 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-78cfc502-4780-4839-9d44-0345490903db tempest-ProjectReaderTests-1967638373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-385f2d3f-4c8c-4cfc-a606-d3f3f63dcb65.c251bc4c-3cce-47d8-98a5-ca8d6ee2908d {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:41:26 devstack sudo[116708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-385f2d3f-4c8c-4cfc-a606-d3f3f63dcb65.c251bc4c-3cce-47d8-98a5-ca8d6ee2908d Jul 31 12:41:26 devstack sudo[116708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:41:26 devstack sudo[116708]: pam_unix(sudo:session): session closed for user root Jul 31 12:41:26 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-78cfc502-4780-4839-9d44-0345490903db tempest-ProjectReaderTests-1967638373 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-385f2d3f-4c8c-4cfc-a606-d3f3f63dcb65.c251bc4c-3cce-47d8-98a5-ca8d6ee2908d" returned: 0 in 0.365s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:41:26 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-78cfc502-4780-4839-9d44-0345490903db tempest-ProjectReaderTests-1967638373 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-385f2d3f-4c8c-4cfc-a606-d3f3f63dcb65(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89182) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 12:41:26 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[074e39e5-29e3-4983-9584-fd8f83c91512]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:41:26 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-78cfc502-4780-4839-9d44-0345490903db tempest-ProjectReaderTests-1967638373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-385f2d3f-4c8c-4cfc-a606-d3f3f63dcb65 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:41:26 devstack sudo[116713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-385f2d3f-4c8c-4cfc-a606-d3f3f63dcb65 Jul 31 12:41:26 devstack sudo[116713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:41:27 devstack sudo[116713]: pam_unix(sudo:session): session closed for user root Jul 31 12:41:27 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-78cfc502-4780-4839-9d44-0345490903db tempest-ProjectReaderTests-1967638373 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-385f2d3f-4c8c-4cfc-a606-d3f3f63dcb65" returned: 0 in 0.353s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:41:27 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-78cfc502-4780-4839-9d44-0345490903db tempest-ProjectReaderTests-1967638373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-385f2d3f-4c8c-4cfc-a606-d3f3f63dcb65.c251bc4c-3cce-47d8-98a5-ca8d6ee2908d {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:41:27 devstack sudo[116718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-385f2d3f-4c8c-4cfc-a606-d3f3f63dcb65.c251bc4c-3cce-47d8-98a5-ca8d6ee2908d Jul 31 12:41:27 devstack sudo[116718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:41:27 devstack sudo[116718]: pam_unix(sudo:session): session closed for user root Jul 31 12:41:27 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-78cfc502-4780-4839-9d44-0345490903db tempest-ProjectReaderTests-1967638373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-385f2d3f-4c8c-4cfc-a606-d3f3f63dcb65.c251bc4c-3cce-47d8-98a5-ca8d6ee2908d" returned: 0 in 0.336s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:41:27 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-78cfc502-4780-4839-9d44-0345490903db tempest-ProjectReaderTests-1967638373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-385f2d3f-4c8c-4cfc-a606-d3f3f63dcb65.c251bc4c-3cce-47d8-98a5-ca8d6ee2908d {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:41:27 devstack sudo[116724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-385f2d3f-4c8c-4cfc-a606-d3f3f63dcb65.c251bc4c-3cce-47d8-98a5-ca8d6ee2908d Jul 31 12:41:27 devstack sudo[116724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:41:27 devstack sudo[116724]: pam_unix(sudo:session): session closed for user root Jul 31 12:41:27 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-78cfc502-4780-4839-9d44-0345490903db tempest-ProjectReaderTests-1967638373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-385f2d3f-4c8c-4cfc-a606-d3f3f63dcb65.c251bc4c-3cce-47d8-98a5-ca8d6ee2908d" returned: 0 in 0.248s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:41:27 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-78cfc502-4780-4839-9d44-0345490903db tempest-ProjectReaderTests-1967638373 None] Lock "cinder-quobyte-c251bc4c-3cce-47d8-98a5-ca8d6ee2908d" released by "_delete_snapshot" :: held 1.399s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:41:27 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-78cfc502-4780-4839-9d44-0345490903db tempest-ProjectReaderTests-1967638373 None] Lock "cinder-quobyte-385f2d3f-4c8c-4cfc-a606-d3f3f63dcb65" released by "delete_snapshot" :: held 1.422s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:41:27 devstack cinder-volume[89182]: DEBUG cinder.quota [None req-78cfc502-4780-4839-9d44-0345490903db tempest-ProjectReaderTests-1967638373 None] Created reservations ['d2dd4523-5707-4e8c-8de5-89feac6fee31', 'c9e1b5e9-6498-499e-985f-620de689549b', '7febd647-6971-4af6-b43b-c5122be0404a', '132c5e01-ce2d-422b-8f0e-e24bd94132de'] {{(pid=89182) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 12:41:27 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-78cfc502-4780-4839-9d44-0345490903db tempest-ProjectReaderTests-1967638373 None] Delete snapshot completed successfully. Jul 31 12:41:27 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-78cfc502-4780-4839-9d44-0345490903db tempest-ProjectReaderTests-1967638373 None] Lock "cinder-c251bc4c-3cce-47d8-98a5-ca8d6ee2908d-delete_snapshot" released by "delete_snapshot" :: held 1.557s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:41:28 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-52591a9e-5866-4c74-9060-3bedbc506fcf tempest-ProjectReaderTests-1967638373 None] Acquiring lock "cinder-385f2d3f-4c8c-4cfc-a606-d3f3f63dcb65-delete_volume" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:41:28 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-52591a9e-5866-4c74-9060-3bedbc506fcf tempest-ProjectReaderTests-1967638373 None] Lock "cinder-385f2d3f-4c8c-4cfc-a606-d3f3f63dcb65-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:41:28 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-52591a9e-5866-4c74-9060-3bedbc506fcf tempest-ProjectReaderTests-1967638373 None] Acquiring lock "cinder-quobyte-385f2d3f-4c8c-4cfc-a606-d3f3f63dcb65" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:41:28 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-52591a9e-5866-4c74-9060-3bedbc506fcf tempest-ProjectReaderTests-1967638373 None] Lock "cinder-quobyte-385f2d3f-4c8c-4cfc-a606-d3f3f63dcb65" acquired by "delete_volume" :: waited 0.014s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:41:28 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[259b5de5-062e-4863-8abd-f121a5eaa4c2]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:41:28 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-52591a9e-5866-4c74-9060-3bedbc506fcf tempest-ProjectReaderTests-1967638373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-385f2d3f-4c8c-4cfc-a606-d3f3f63dcb65 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:41:28 devstack sudo[116727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-385f2d3f-4c8c-4cfc-a606-d3f3f63dcb65 Jul 31 12:41:28 devstack sudo[116727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:41:28 devstack sudo[116727]: pam_unix(sudo:session): session closed for user root Jul 31 12:41:28 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-52591a9e-5866-4c74-9060-3bedbc506fcf tempest-ProjectReaderTests-1967638373 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-385f2d3f-4c8c-4cfc-a606-d3f3f63dcb65" returned: 0 in 0.345s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:41:28 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-52591a9e-5866-4c74-9060-3bedbc506fcf tempest-ProjectReaderTests-1967638373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-385f2d3f-4c8c-4cfc-a606-d3f3f63dcb65 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:41:28 devstack sudo[116732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-385f2d3f-4c8c-4cfc-a606-d3f3f63dcb65 Jul 31 12:41:28 devstack sudo[116732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:41:29 devstack sudo[116732]: pam_unix(sudo:session): session closed for user root Jul 31 12:41:29 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-52591a9e-5866-4c74-9060-3bedbc506fcf tempest-ProjectReaderTests-1967638373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-385f2d3f-4c8c-4cfc-a606-d3f3f63dcb65" returned: 0 in 0.256s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:41:29 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-52591a9e-5866-4c74-9060-3bedbc506fcf tempest-ProjectReaderTests-1967638373 None] Lock "cinder-quobyte-385f2d3f-4c8c-4cfc-a606-d3f3f63dcb65" released by "delete_volume" :: held 0.654s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:41:29 devstack cinder-volume[89182]: DEBUG cinder.quota [None req-52591a9e-5866-4c74-9060-3bedbc506fcf tempest-ProjectReaderTests-1967638373 None] Created reservations ['ffec9219-8089-4c8e-b934-4be779c99fcd', 'f2ce8c8e-76a9-409f-b149-c59570c758eb', '66573a9b-258d-4730-9261-efced36f04d9', '713ec263-04ad-4d52-b0c0-5cbea82092e2'] {{(pid=89182) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 12:41:29 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-52591a9e-5866-4c74-9060-3bedbc506fcf tempest-ProjectReaderTests-1967638373 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:41:29 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-52591a9e-5866-4c74-9060-3bedbc506fcf tempest-ProjectReaderTests-1967638373 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:41:29 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-52591a9e-5866-4c74-9060-3bedbc506fcf tempest-ProjectReaderTests-1967638373 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:41:29 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-52591a9e-5866-4c74-9060-3bedbc506fcf tempest-ProjectReaderTests-1967638373 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:41:29 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-52591a9e-5866-4c74-9060-3bedbc506fcf tempest-ProjectReaderTests-1967638373 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:41:29 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-52591a9e-5866-4c74-9060-3bedbc506fcf tempest-ProjectReaderTests-1967638373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:41:29 devstack sudo[116735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 Jul 31 12:41:29 devstack sudo[116735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:41:29 devstack sudo[116735]: pam_unix(sudo:session): session closed for user root Jul 31 12:41:29 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-52591a9e-5866-4c74-9060-3bedbc506fcf tempest-ProjectReaderTests-1967638373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2" returned: 0 in 0.252s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:41:29 devstack cinder-volume[89182]: DEBUG cinder.manager [None req-52591a9e-5866-4c74-9060-3bedbc506fcf tempest-ProjectReaderTests-1967638373 None] Notifying Schedulers of capabilities ... {{(pid=89182) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 12:41:29 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-52591a9e-5866-4c74-9060-3bedbc506fcf tempest-ProjectReaderTests-1967638373 None] Deleted volume successfully. Jul 31 12:41:29 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-52591a9e-5866-4c74-9060-3bedbc506fcf tempest-ProjectReaderTests-1967638373 None] Lock "cinder-385f2d3f-4c8c-4cfc-a606-d3f3f63dcb65-delete_volume" released by "delete_volume" :: held 1.098s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:41:29 devstack cinder-volume[89182]: DEBUG cinder.volume.flows.manager.create_volume [None req-2555fd39-50b9-400b-80c6-82bf6f967a14 tempest-ProjectReaderTests-1967638373 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89182) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 12:41:29 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-2555fd39-50b9-400b-80c6-82bf6f967a14 tempest-ProjectReaderTests-1967638373 None] Flow 'volume_create_manager' (557ffcd8-1e1c-4bff-96c0-bd06cb3beaca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:41:29 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-2555fd39-50b9-400b-80c6-82bf6f967a14 tempest-ProjectReaderTests-1967638373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d665b7ce-41e3-4c15-b16c-7508c66daea6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:41:30 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-2555fd39-50b9-400b-80c6-82bf6f967a14 tempest-ProjectReaderTests-1967638373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d665b7ce-41e3-4c15-b16c-7508c66daea6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:41:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-401235034',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0359d1e6-aafd-4ad6-9836-f6114fcb6847,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd5661a0bda34bab890473ed45a80ef5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:41:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:41:30Z,use_quota=True,user_id='d5216f552f4e478898bafd6f2643b0e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:41:30 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-2555fd39-50b9-400b-80c6-82bf6f967a14 tempest-ProjectReaderTests-1967638373 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d743229-a594-4e75-abfa-cbc3115fd5da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:41:30 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-2555fd39-50b9-400b-80c6-82bf6f967a14 tempest-ProjectReaderTests-1967638373 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d743229-a594-4e75-abfa-cbc3115fd5da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:41:30 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-2555fd39-50b9-400b-80c6-82bf6f967a14 tempest-ProjectReaderTests-1967638373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f617703c-fb88-4b4e-bf5c-dc4bf39600c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:41:30 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-2555fd39-50b9-400b-80c6-82bf6f967a14 tempest-ProjectReaderTests-1967638373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f617703c-fb88-4b4e-bf5c-dc4bf39600c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0359d1e6-aafd-4ad6-9836-f6114fcb6847', 'volume_name': 'volume-0359d1e6-aafd-4ad6-9836-f6114fcb6847', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:41:30 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-2555fd39-50b9-400b-80c6-82bf6f967a14 tempest-ProjectReaderTests-1967638373 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3634cbf2-b23c-42e4-b3a5-113f3ae7f942) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:41:30 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-2555fd39-50b9-400b-80c6-82bf6f967a14 tempest-ProjectReaderTests-1967638373 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3634cbf2-b23c-42e4-b3a5-113f3ae7f942) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:41:30 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-2555fd39-50b9-400b-80c6-82bf6f967a14 tempest-ProjectReaderTests-1967638373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (257fb3fb-b612-4833-b050-3af7acc23c9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:41:30 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-2555fd39-50b9-400b-80c6-82bf6f967a14 tempest-ProjectReaderTests-1967638373 None] Volume 0359d1e6-aafd-4ad6-9836-f6114fcb6847: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0359d1e6-aafd-4ad6-9836-f6114fcb6847', 'volume_size': 1} Jul 31 12:41:30 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-2555fd39-50b9-400b-80c6-82bf6f967a14 tempest-ProjectReaderTests-1967638373 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:41:30 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-2555fd39-50b9-400b-80c6-82bf6f967a14 tempest-ProjectReaderTests-1967638373 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:41:30 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-2555fd39-50b9-400b-80c6-82bf6f967a14 tempest-ProjectReaderTests-1967638373 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T10:41:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-401235034',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0359d1e6-aafd-4ad6-9836-f6114fcb6847,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd5661a0bda34bab890473ed45a80ef5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T10:41:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T10:41:30Z,use_quota=True,user_id='d5216f552f4e478898bafd6f2643b0e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb),volume_type_id=e0128bd7-a5a0-4a3a-a4cd-67ad86804dcb)}" {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 12:41:30 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-2555fd39-50b9-400b-80c6-82bf6f967a14 tempest-ProjectReaderTests-1967638373 None] Creating volume 0359d1e6-aafd-4ad6-9836-f6114fcb6847 {{(pid=89182) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 12:41:30 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-2555fd39-50b9-400b-80c6-82bf6f967a14 tempest-ProjectReaderTests-1967638373 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:41:30 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-2555fd39-50b9-400b-80c6-82bf6f967a14 tempest-ProjectReaderTests-1967638373 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:41:30 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-2555fd39-50b9-400b-80c6-82bf6f967a14 tempest-ProjectReaderTests-1967638373 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:41:30 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-2555fd39-50b9-400b-80c6-82bf6f967a14 tempest-ProjectReaderTests-1967638373 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:41:30 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-2555fd39-50b9-400b-80c6-82bf6f967a14 tempest-ProjectReaderTests-1967638373 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:41:30 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-2555fd39-50b9-400b-80c6-82bf6f967a14 tempest-ProjectReaderTests-1967638373 None] Selected osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 as target Quobyte volume. {{(pid=89182) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 31 12:41:30 devstack cinder-volume[89182]: INFO cinder.volume.drivers.remotefs [None req-2555fd39-50b9-400b-80c6-82bf6f967a14 tempest-ProjectReaderTests-1967638373 None] casted to osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88 Jul 31 12:41:30 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-2555fd39-50b9-400b-80c6-82bf6f967a14 tempest-ProjectReaderTests-1967638373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0359d1e6-aafd-4ad6-9836-f6114fcb6847 1073741824 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:41:30 devstack sudo[116738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0359d1e6-aafd-4ad6-9836-f6114fcb6847 1073741824 Jul 31 12:41:30 devstack sudo[116738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:41:30 devstack sudo[116738]: pam_unix(sudo:session): session closed for user root Jul 31 12:41:30 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-2555fd39-50b9-400b-80c6-82bf6f967a14 tempest-ProjectReaderTests-1967638373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0359d1e6-aafd-4ad6-9836-f6114fcb6847 1073741824" returned: 0 in 0.395s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:41:30 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-2555fd39-50b9-400b-80c6-82bf6f967a14 tempest-ProjectReaderTests-1967638373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0359d1e6-aafd-4ad6-9836-f6114fcb6847 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:41:30 devstack sudo[116744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0359d1e6-aafd-4ad6-9836-f6114fcb6847 Jul 31 12:41:30 devstack sudo[116744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:41:30 devstack sudo[116744]: pam_unix(sudo:session): session closed for user root Jul 31 12:41:30 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-2555fd39-50b9-400b-80c6-82bf6f967a14 tempest-ProjectReaderTests-1967638373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0359d1e6-aafd-4ad6-9836-f6114fcb6847" returned: 0 in 0.238s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:41:30 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-2555fd39-50b9-400b-80c6-82bf6f967a14 tempest-ProjectReaderTests-1967638373 None] <== create_volume: return (672ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'} {{(pid=89182) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 12:41:30 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-2555fd39-50b9-400b-80c6-82bf6f967a14 tempest-ProjectReaderTests-1967638373 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.675s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:41:30 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-2555fd39-50b9-400b-80c6-82bf6f967a14 tempest-ProjectReaderTests-1967638373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (257fb3fb-b612-4833-b050-3af7acc23c9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0359d1e6-aafd-4ad6-9836-f6114fcb6847', 'volume_size': 1}' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:41:30 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-2555fd39-50b9-400b-80c6-82bf6f967a14 tempest-ProjectReaderTests-1967638373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f30742cb-4138-4cdc-88f9-a1c39b8fcabb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 12:41:30 devstack cinder-volume[89182]: INFO cinder.volume.flows.manager.create_volume [None req-2555fd39-50b9-400b-80c6-82bf6f967a14 tempest-ProjectReaderTests-1967638373 None] Volume volume-0359d1e6-aafd-4ad6-9836-f6114fcb6847 (0359d1e6-aafd-4ad6-9836-f6114fcb6847): created successfully Jul 31 12:41:30 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-2555fd39-50b9-400b-80c6-82bf6f967a14 tempest-ProjectReaderTests-1967638373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f30742cb-4138-4cdc-88f9-a1c39b8fcabb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89182) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 12:41:30 devstack cinder-volume[89182]: DEBUG cinder.volume.manager [None req-2555fd39-50b9-400b-80c6-82bf6f967a14 tempest-ProjectReaderTests-1967638373 None] Flow 'volume_create_manager' (557ffcd8-1e1c-4bff-96c0-bd06cb3beaca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89182) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 12:41:30 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-2555fd39-50b9-400b-80c6-82bf6f967a14 tempest-ProjectReaderTests-1967638373 None] Created volume successfully. Jul 31 12:41:31 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-9b7d023a-a5c5-469e-bcc2-3e2fe3ef07d6 tempest-ProjectReaderTests-1967638373 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:41:31 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-9b7d023a-a5c5-469e-bcc2-3e2fe3ef07d6 tempest-ProjectReaderTests-1967638373 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:41:31 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-9b7d023a-a5c5-469e-bcc2-3e2fe3ef07d6 tempest-ProjectReaderTests-1967638373 None] Creating offline snapshot 4020a903-412e-472e-a941-756a80577099 of volume 0359d1e6-aafd-4ad6-9836-f6114fcb6847 {{(pid=89182) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 31 12:41:31 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[a632f30d-0f7f-4287-ba0a-7a7c399598b1]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:41:31 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-9b7d023a-a5c5-469e-bcc2-3e2fe3ef07d6 tempest-ProjectReaderTests-1967638373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0359d1e6-aafd-4ad6-9836-f6114fcb6847 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:41:31 devstack sudo[116747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0359d1e6-aafd-4ad6-9836-f6114fcb6847 Jul 31 12:41:31 devstack sudo[116747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:41:31 devstack sudo[116747]: pam_unix(sudo:session): session closed for user root Jul 31 12:41:31 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-9b7d023a-a5c5-469e-bcc2-3e2fe3ef07d6 tempest-ProjectReaderTests-1967638373 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0359d1e6-aafd-4ad6-9836-f6114fcb6847" returned: 0 in 0.358s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:41:31 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-9b7d023a-a5c5-469e-bcc2-3e2fe3ef07d6 tempest-ProjectReaderTests-1967638373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0359d1e6-aafd-4ad6-9836-f6114fcb6847,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0359d1e6-aafd-4ad6-9836-f6114fcb6847.4020a903-412e-472e-a941-756a80577099 1G {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:41:31 devstack sudo[116752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0359d1e6-aafd-4ad6-9836-f6114fcb6847,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0359d1e6-aafd-4ad6-9836-f6114fcb6847.4020a903-412e-472e-a941-756a80577099 1G Jul 31 12:41:31 devstack sudo[116752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:41:31 devstack sudo[116752]: pam_unix(sudo:session): session closed for user root Jul 31 12:41:31 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-9b7d023a-a5c5-469e-bcc2-3e2fe3ef07d6 tempest-ProjectReaderTests-1967638373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0359d1e6-aafd-4ad6-9836-f6114fcb6847,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0359d1e6-aafd-4ad6-9836-f6114fcb6847.4020a903-412e-472e-a941-756a80577099 1G" returned: 0 in 0.379s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:41:31 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-9b7d023a-a5c5-469e-bcc2-3e2fe3ef07d6 tempest-ProjectReaderTests-1967638373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0359d1e6-aafd-4ad6-9836-f6114fcb6847 -F qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0359d1e6-aafd-4ad6-9836-f6114fcb6847.4020a903-412e-472e-a941-756a80577099 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:41:31 devstack sudo[116757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0359d1e6-aafd-4ad6-9836-f6114fcb6847 -F qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0359d1e6-aafd-4ad6-9836-f6114fcb6847.4020a903-412e-472e-a941-756a80577099 Jul 31 12:41:31 devstack sudo[116757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:41:32 devstack sudo[116757]: pam_unix(sudo:session): session closed for user root Jul 31 12:41:32 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-9b7d023a-a5c5-469e-bcc2-3e2fe3ef07d6 tempest-ProjectReaderTests-1967638373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0359d1e6-aafd-4ad6-9836-f6114fcb6847 -F qcow2 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0359d1e6-aafd-4ad6-9836-f6114fcb6847.4020a903-412e-472e-a941-756a80577099" returned: 0 in 0.294s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:41:32 devstack cinder-volume[89182]: WARNING cinder.volume.drivers.remotefs [None req-9b7d023a-a5c5-469e-bcc2-3e2fe3ef07d6 tempest-ProjectReaderTests-1967638373 None] /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0359d1e6-aafd-4ad6-9836-f6114fcb6847.4020a903-412e-472e-a941-756a80577099 is being set with open permissions: ugo+rw Jul 31 12:41:32 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-9b7d023a-a5c5-469e-bcc2-3e2fe3ef07d6 tempest-ProjectReaderTests-1967638373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0359d1e6-aafd-4ad6-9836-f6114fcb6847.4020a903-412e-472e-a941-756a80577099 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:41:32 devstack sudo[116762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0359d1e6-aafd-4ad6-9836-f6114fcb6847.4020a903-412e-472e-a941-756a80577099 Jul 31 12:41:32 devstack sudo[116762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:41:32 devstack sudo[116762]: pam_unix(sudo:session): session closed for user root Jul 31 12:41:32 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-9b7d023a-a5c5-469e-bcc2-3e2fe3ef07d6 tempest-ProjectReaderTests-1967638373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0359d1e6-aafd-4ad6-9836-f6114fcb6847.4020a903-412e-472e-a941-756a80577099" returned: 0 in 0.245s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:41:32 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-9b7d023a-a5c5-469e-bcc2-3e2fe3ef07d6 tempest-ProjectReaderTests-1967638373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0359d1e6-aafd-4ad6-9836-f6114fcb6847.info {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:41:32 devstack sudo[116765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0359d1e6-aafd-4ad6-9836-f6114fcb6847.info Jul 31 12:41:32 devstack sudo[116765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:41:32 devstack sudo[116765]: pam_unix(sudo:session): session closed for user root Jul 31 12:41:32 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-9b7d023a-a5c5-469e-bcc2-3e2fe3ef07d6 tempest-ProjectReaderTests-1967638373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0359d1e6-aafd-4ad6-9836-f6114fcb6847.info" returned: 0 in 0.241s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:41:32 devstack cinder-volume[89182]: WARNING cinder.volume.drivers.remotefs [None req-9b7d023a-a5c5-469e-bcc2-3e2fe3ef07d6 tempest-ProjectReaderTests-1967638373 None] /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0359d1e6-aafd-4ad6-9836-f6114fcb6847.info is being set with open permissions: ugo+rw Jul 31 12:41:32 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-9b7d023a-a5c5-469e-bcc2-3e2fe3ef07d6 tempest-ProjectReaderTests-1967638373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0359d1e6-aafd-4ad6-9836-f6114fcb6847.info {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:41:32 devstack sudo[116768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0359d1e6-aafd-4ad6-9836-f6114fcb6847.info Jul 31 12:41:32 devstack sudo[116768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:41:33 devstack sudo[116768]: pam_unix(sudo:session): session closed for user root Jul 31 12:41:33 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-9b7d023a-a5c5-469e-bcc2-3e2fe3ef07d6 tempest-ProjectReaderTests-1967638373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0359d1e6-aafd-4ad6-9836-f6114fcb6847.info" returned: 0 in 0.252s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:41:33 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-9b7d023a-a5c5-469e-bcc2-3e2fe3ef07d6 tempest-ProjectReaderTests-1967638373 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.847s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:41:33 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-9b7d023a-a5c5-469e-bcc2-3e2fe3ef07d6 tempest-ProjectReaderTests-1967638373 None] Create snapshot completed successfully Jul 31 12:41:33 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-70965632-1e75-4b12-9c4f-65236a37f50b tempest-ProjectReaderTests-1967638373 None] Acquiring lock "cinder-4020a903-412e-472e-a941-756a80577099-delete_snapshot" by "delete_snapshot" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:41:33 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-70965632-1e75-4b12-9c4f-65236a37f50b tempest-ProjectReaderTests-1967638373 None] Lock "cinder-4020a903-412e-472e-a941-756a80577099-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:41:33 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-70965632-1e75-4b12-9c4f-65236a37f50b tempest-ProjectReaderTests-1967638373 None] Acquiring lock "cinder-quobyte-0359d1e6-aafd-4ad6-9836-f6114fcb6847" by "delete_snapshot" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:41:33 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-70965632-1e75-4b12-9c4f-65236a37f50b tempest-ProjectReaderTests-1967638373 None] Lock "cinder-quobyte-0359d1e6-aafd-4ad6-9836-f6114fcb6847" acquired by "delete_snapshot" :: waited 0.017s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:41:33 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-70965632-1e75-4b12-9c4f-65236a37f50b tempest-ProjectReaderTests-1967638373 None] Acquiring lock "cinder-quobyte-4020a903-412e-472e-a941-756a80577099" by "_delete_snapshot" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:41:33 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-70965632-1e75-4b12-9c4f-65236a37f50b tempest-ProjectReaderTests-1967638373 None] Lock "cinder-quobyte-4020a903-412e-472e-a941-756a80577099" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:41:33 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-70965632-1e75-4b12-9c4f-65236a37f50b tempest-ProjectReaderTests-1967638373 None] Deleting offline snapshot 4020a903-412e-472e-a941-756a80577099 of volume 0359d1e6-aafd-4ad6-9836-f6114fcb6847 {{(pid=89182) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 31 12:41:33 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-70965632-1e75-4b12-9c4f-65236a37f50b tempest-ProjectReaderTests-1967638373 None] snapshot_file for this snap is: volume-0359d1e6-aafd-4ad6-9836-f6114fcb6847.4020a903-412e-472e-a941-756a80577099 {{(pid=89182) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 31 12:41:33 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[25d5fe71-f38b-40ea-8646-59f08769e856]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:41:33 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-70965632-1e75-4b12-9c4f-65236a37f50b tempest-ProjectReaderTests-1967638373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0359d1e6-aafd-4ad6-9836-f6114fcb6847.4020a903-412e-472e-a941-756a80577099 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:41:33 devstack sudo[116771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0359d1e6-aafd-4ad6-9836-f6114fcb6847.4020a903-412e-472e-a941-756a80577099 Jul 31 12:41:33 devstack sudo[116771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:41:33 devstack sudo[116771]: pam_unix(sudo:session): session closed for user root Jul 31 12:41:33 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-70965632-1e75-4b12-9c4f-65236a37f50b tempest-ProjectReaderTests-1967638373 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0359d1e6-aafd-4ad6-9836-f6114fcb6847.4020a903-412e-472e-a941-756a80577099" returned: 0 in 0.349s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:41:33 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.remotefs [None req-70965632-1e75-4b12-9c4f-65236a37f50b tempest-ProjectReaderTests-1967638373 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0359d1e6-aafd-4ad6-9836-f6114fcb6847(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89182) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 12:41:33 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[67850c61-1f0e-47a8-a26a-b7be45c117f1]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:41:33 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-70965632-1e75-4b12-9c4f-65236a37f50b tempest-ProjectReaderTests-1967638373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0359d1e6-aafd-4ad6-9836-f6114fcb6847 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:41:33 devstack sudo[116776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0359d1e6-aafd-4ad6-9836-f6114fcb6847 Jul 31 12:41:33 devstack sudo[116776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:41:34 devstack sudo[116776]: pam_unix(sudo:session): session closed for user root Jul 31 12:41:34 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-70965632-1e75-4b12-9c4f-65236a37f50b tempest-ProjectReaderTests-1967638373 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0359d1e6-aafd-4ad6-9836-f6114fcb6847" returned: 0 in 0.351s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:41:34 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-70965632-1e75-4b12-9c4f-65236a37f50b tempest-ProjectReaderTests-1967638373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0359d1e6-aafd-4ad6-9836-f6114fcb6847.4020a903-412e-472e-a941-756a80577099 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:41:34 devstack sudo[116781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0359d1e6-aafd-4ad6-9836-f6114fcb6847.4020a903-412e-472e-a941-756a80577099 Jul 31 12:41:34 devstack sudo[116781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:41:34 devstack sudo[116781]: pam_unix(sudo:session): session closed for user root Jul 31 12:41:34 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-70965632-1e75-4b12-9c4f-65236a37f50b tempest-ProjectReaderTests-1967638373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0359d1e6-aafd-4ad6-9836-f6114fcb6847.4020a903-412e-472e-a941-756a80577099" returned: 0 in 0.339s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:41:34 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-70965632-1e75-4b12-9c4f-65236a37f50b tempest-ProjectReaderTests-1967638373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0359d1e6-aafd-4ad6-9836-f6114fcb6847.4020a903-412e-472e-a941-756a80577099 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:41:34 devstack sudo[116786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0359d1e6-aafd-4ad6-9836-f6114fcb6847.4020a903-412e-472e-a941-756a80577099 Jul 31 12:41:34 devstack sudo[116786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:41:34 devstack sudo[116786]: pam_unix(sudo:session): session closed for user root Jul 31 12:41:34 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-70965632-1e75-4b12-9c4f-65236a37f50b tempest-ProjectReaderTests-1967638373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0359d1e6-aafd-4ad6-9836-f6114fcb6847.4020a903-412e-472e-a941-756a80577099" returned: 0 in 0.241s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:41:34 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-70965632-1e75-4b12-9c4f-65236a37f50b tempest-ProjectReaderTests-1967638373 None] Lock "cinder-quobyte-4020a903-412e-472e-a941-756a80577099" released by "_delete_snapshot" :: held 1.363s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:41:34 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-70965632-1e75-4b12-9c4f-65236a37f50b tempest-ProjectReaderTests-1967638373 None] Lock "cinder-quobyte-0359d1e6-aafd-4ad6-9836-f6114fcb6847" released by "delete_snapshot" :: held 1.384s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:41:34 devstack cinder-volume[89182]: DEBUG cinder.quota [None req-70965632-1e75-4b12-9c4f-65236a37f50b tempest-ProjectReaderTests-1967638373 None] Created reservations ['da26e791-c6ae-4fe5-9eda-d15908d67c7a', 'd60bc676-800e-4fcf-9c1c-4aac407bf4fc', '5d61350e-082e-4c0e-9f26-708ea052ee3c', '60e24b72-02aa-4845-995f-4dbec58e475c'] {{(pid=89182) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 12:41:34 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-70965632-1e75-4b12-9c4f-65236a37f50b tempest-ProjectReaderTests-1967638373 None] Delete snapshot completed successfully. Jul 31 12:41:34 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-70965632-1e75-4b12-9c4f-65236a37f50b tempest-ProjectReaderTests-1967638373 None] Lock "cinder-4020a903-412e-472e-a941-756a80577099-delete_snapshot" released by "delete_snapshot" :: held 1.509s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:41:35 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-903d4b0a-8358-457b-9b31-d8c06521b410 tempest-ProjectReaderTests-1967638373 None] Acquiring lock "cinder-0359d1e6-aafd-4ad6-9836-f6114fcb6847-delete_volume" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:41:35 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-903d4b0a-8358-457b-9b31-d8c06521b410 tempest-ProjectReaderTests-1967638373 None] Lock "cinder-0359d1e6-aafd-4ad6-9836-f6114fcb6847-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:41:35 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-903d4b0a-8358-457b-9b31-d8c06521b410 tempest-ProjectReaderTests-1967638373 None] Acquiring lock "cinder-quobyte-0359d1e6-aafd-4ad6-9836-f6114fcb6847" by "delete_volume" {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 12:41:35 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-903d4b0a-8358-457b-9b31-d8c06521b410 tempest-ProjectReaderTests-1967638373 None] Lock "cinder-quobyte-0359d1e6-aafd-4ad6-9836-f6114fcb6847" acquired by "delete_volume" :: waited 0.014s {{(pid=89182) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 12:41:35 devstack cinder-volume[89182]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7b8f24f-e52b-4c2a-89b5-980b2c271c23]: (4, 'qcow2') {{(pid=90705) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 12:41:35 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-903d4b0a-8358-457b-9b31-d8c06521b410 tempest-ProjectReaderTests-1967638373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0359d1e6-aafd-4ad6-9836-f6114fcb6847 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:41:35 devstack sudo[116789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0359d1e6-aafd-4ad6-9836-f6114fcb6847 Jul 31 12:41:35 devstack sudo[116789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:41:35 devstack sudo[116789]: pam_unix(sudo:session): session closed for user root Jul 31 12:41:35 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-903d4b0a-8358-457b-9b31-d8c06521b410 tempest-ProjectReaderTests-1967638373 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0359d1e6-aafd-4ad6-9836-f6114fcb6847" returned: 0 in 0.341s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:41:35 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-903d4b0a-8358-457b-9b31-d8c06521b410 tempest-ProjectReaderTests-1967638373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0359d1e6-aafd-4ad6-9836-f6114fcb6847 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:41:35 devstack sudo[116794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0359d1e6-aafd-4ad6-9836-f6114fcb6847 Jul 31 12:41:35 devstack sudo[116794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:41:36 devstack sudo[116794]: pam_unix(sudo:session): session closed for user root Jul 31 12:41:36 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-903d4b0a-8358-457b-9b31-d8c06521b410 tempest-ProjectReaderTests-1967638373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2/volume-0359d1e6-aafd-4ad6-9836-f6114fcb6847" returned: 0 in 0.238s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:41:36 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-903d4b0a-8358-457b-9b31-d8c06521b410 tempest-ProjectReaderTests-1967638373 None] Lock "cinder-quobyte-0359d1e6-aafd-4ad6-9836-f6114fcb6847" released by "delete_volume" :: held 0.633s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:41:36 devstack cinder-volume[89182]: DEBUG cinder.quota [None req-903d4b0a-8358-457b-9b31-d8c06521b410 tempest-ProjectReaderTests-1967638373 None] Created reservations ['9f7828a8-f104-472a-b4c2-05c0a2450934', 'e36def9b-65bd-4a2a-84c9-f904c5117f53', '746c03fc-8761-4462-9c70-7a2bd6a2ae9d', '86b2702a-bee3-414a-b68a-d5d2ad4077a6'] {{(pid=89182) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 12:41:36 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-903d4b0a-8358-457b-9b31-d8c06521b410 tempest-ProjectReaderTests-1967638373 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 12:41:36 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-903d4b0a-8358-457b-9b31-d8c06521b410 tempest-ProjectReaderTests-1967638373 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 12:41:36 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-903d4b0a-8358-457b-9b31-d8c06521b410 tempest-ProjectReaderTests-1967638373 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88': None} {{(pid=89182) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 31 12:41:36 devstack cinder-volume[89182]: DEBUG cinder.volume.drivers.quobyte [None req-903d4b0a-8358-457b-9b31-d8c06521b410 tempest-ProjectReaderTests-1967638373 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4aeb3790-ac17-4687-8b64-fd115ef61e88'] {{(pid=89182) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 31 12:41:36 devstack cinder-volume[89182]: DEBUG oslo_concurrency.lockutils [None req-903d4b0a-8358-457b-9b31-d8c06521b410 tempest-ProjectReaderTests-1967638373 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89182) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 12:41:36 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-903d4b0a-8358-457b-9b31-d8c06521b410 tempest-ProjectReaderTests-1967638373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 12:41:36 devstack sudo[116797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2 Jul 31 12:41:36 devstack sudo[116797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 12:41:36 devstack sudo[116797]: pam_unix(sudo:session): session closed for user root Jul 31 12:41:36 devstack cinder-volume[89182]: DEBUG oslo_concurrency.processutils [None req-903d4b0a-8358-457b-9b31-d8c06521b410 tempest-ProjectReaderTests-1967638373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a03181eee12bad9fd460b502fa71aae2" returned: 0 in 0.250s {{(pid=89182) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 12:41:36 devstack cinder-volume[89182]: DEBUG cinder.manager [None req-903d4b0a-8358-457b-9b31-d8c06521b410 tempest-ProjectReaderTests-1967638373 None] Notifying Schedulers of capabilities ... {{(pid=89182) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 12:41:36 devstack cinder-volume[89182]: INFO cinder.volume.manager [None req-903d4b0a-8358-457b-9b31-d8c06521b410 tempest-ProjectReaderTests-1967638373 None] Deleted volume successfully. Jul 31 12:41:36 devstack cinder-volume[89182]: DEBUG cinder.coordination [None req-903d4b0a-8358-457b-9b31-d8c06521b410 tempest-ProjectReaderTests-1967638373 None] Lock "cinder-0359d1e6-aafd-4ad6-9836-f6114fcb6847-delete_volume" released by "delete_volume" :: held 1.074s {{(pid=89182) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 12:41:46 devstack cinder-volume[89182]: DEBUG dbcounter [-] [89182] Writing DB stats cinder:SELECT=29,cinder:INSERT=18,cinder:UPDATE=41,cinder:DELETE=3 {{(pid=89182) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 12:41:46 devstack cinder-volume[89182]: DEBUG dbcounter [-] [89182] Writing DB stats cinder:UPDATE=47,cinder:SELECT=34,cinder:DELETE=4,cinder:INSERT=6 {{(pid=89182) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}